Apparatus, vehicle, and method for monitoring abnormal situations using a vehicle

A system using vehicles with external sensors, controlled by a parking management system, effectively monitors and reports abnormal situations in parking lots, enhancing security by utilizing infrastructure sensors and vehicle status information.

JP7582242B2Active Publication Date: 2024-11-13TOYOTA JIDOSHA KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022065255
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-04-11
Publication Date
2024-11-13
Estimated Expiration
2042-04-11

AI Technical Summary

Technical Problem

There is a need to effectively monitor unusual situations such as fires, incidents, or accidents within or in the surrounding area of a parking lot to improve security.

Method used

A device and method that utilize vehicles equipped with external monitoring sensors activated by a command transmitter, which are identified and controlled by a parking management system to detect and monitor abnormal situations using infrastructure sensors and vehicle status information.

Benefits of technology

Enhances the monitoring of abnormal situations within a parking lot area, improving security by leveraging surrounding vehicles with external sensors to detect and report occurrences accurately.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007582242000001
    Figure 0007582242000001
  • Figure 0007582242000002
    Figure 0007582242000002
  • Figure 0007582242000003
    Figure 0007582242000003
Patent Text Reader

Abstract

To improve security in the region by effectively monitoring abnormal situations such as fires, incidents or accidents, that may occur in a parking lot or in a region around the parking lot.SOLUTION: A device 30 for monitoring an abnormal situation which has occurred in a region inside or around a parking lot, by utilizing a vehicle in the region comprises: an information acquisition unit 32 for acquiring state information representing a state inside the region; an abnormality detection unit 34 for detecting the abnormal situation and identifying an occurrence place of the detected abnormal situation based on the state information; and a command transmission unit 36 that transmits a command for activating a vehicle exterior monitoring sensor provided in the vehicle 110 parked around the occurrence place identified by the abnormality detection unit 34 and causing a vehicle exterior monitoring sensor to detect the occurrence place to the parked vehicle 110.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an apparatus, a vehicle, and a method for monitoring abnormal situations using a vehicle. [Background technology]

[0002] 2. Description of the Related Art A security device for a vehicle is known (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-149088 A Summary of the Invention [Problem to be solved by the invention]

[0004] Abnormal events such as fires, incidents or accidents may occur within the area in or around a parking lot. There is a need to effectively monitor such abnormal events to improve security within the area. [Means for solving the problem]

[0005] A first aspect of the present disclosure is an apparatus that monitors abnormal situations that occur inside or in a surrounding area of ​​a parking lot using a vehicle in the area, and includes an information acquisition unit that acquires status information that represents the condition within the area, an abnormality detection unit that detects an abnormal situation based on the status information and identifies the location where the detected abnormal situation occurred, and a command transmission unit that activates an exterior monitoring sensor installed in a vehicle parked in the vicinity of the location of the abnormal situation identified by the abnormality detection unit and transmits a command to the parked vehicle to cause the exterior monitoring sensor to detect the location of the abnormality.

[0006] A second aspect of the present disclosure is the device described in the first aspect, wherein the information acquisition unit acquires image data captured by an infrastructure sensor installed in the parking lot as status information, and the abnormality detection unit detects an abnormal situation and identifies the location of the occurrence based on the image data.

[0007] A third aspect of the present disclosure is the device described in the first or second aspect, further comprising a vehicle identification unit that identifies, from among the vehicles within the area, a parked vehicle whose exterior monitoring sensor should be activated based on device status information or position information of the vehicle within the area, and the command sending unit sends a command to the parked vehicle identified by the vehicle identification unit.

[0008] A fourth aspect of the present disclosure is the device described in the third aspect, wherein the vehicle identification unit identifies a parking position of a vehicle within the area based on the status information or the position information, and identifies, from among the vehicles within the area, a parked vehicle having an exterior monitoring sensor that has the occurrence location within its detection range based on the identified parking position.

[0009] A fifth aspect of the present disclosure is the device described in the fourth aspect, wherein the vehicle identification unit further identifies an orientation of the vehicle in the area based on the status information or the position information, and identifies the parked vehicle based on the identified orientation.

[0010] A sixth aspect of the present disclosure is a device described in any one of the first to fifth aspects, wherein the information acquisition unit further acquires, as status information, detection data detected by the exterior monitoring sensor in accordance with the command sent by the command sending unit.

[0011] A seventh aspect of the present disclosure is a vehicle equipped with an exterior monitoring sensor, which activates the exterior monitoring sensor in accordance with a command transmitted by a command transmitting unit of a device described in any one of the first to sixth aspects, and causes the exterior monitoring sensor to detect the location of the occurrence.

[0012] An eighth aspect of the present disclosure is a method for monitoring an abnormality that occurs within a parking lot or a surrounding area using a vehicle in the area, in which a processor acquires status information representing the condition within the area, detects an abnormality based on the status information, identifies a location where the detected abnormality occurred, and transmits a command to the parked vehicle to activate an exterior monitoring sensor installed in a vehicle parked in the vicinity of the identified location of the abnormality and cause the exterior monitoring sensor to detect the location of the abnormality. Effect of the Invention

[0013] According to the present disclosure, abnormal situations occurring within an area can be monitored using external monitoring sensors mounted on surrounding vehicles, and thus, abnormal situations occurring within the area can be monitored effectively, thereby improving security within the area. [Brief description of the drawings]

[0014] [Figure 1] 1 illustrates a parking management system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram of the parking management system shown in FIG. [Diagram 3] FIG. 1 is a block diagram of a vehicle according to an embodiment. [Figure 4] 1 is a flow chart illustrating an example of a method for monitoring for an abnormal situation. [Diagram 5] Here is an example of an abnormal situation occurring inside a parking lot. [Figure 6] FIG. 11 is a block diagram of a parking management system according to another embodiment. [Figure 7] 10 is a flow chart illustrating another example of a method for monitoring an abnormal situation. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, an embodiment of the present disclosure will be described in detail with reference to the drawings. In various embodiments described below, similar elements are given the same reference numerals, and duplicated explanations will be omitted. First, a parking management system 10 according to one embodiment will be described with reference to Figs. 1 and 2. The parking management system 10 is a system for managing vehicles 110 parked in an area A inside or around a parking lot 100.

[0016] The parking management system 10 includes multiple infrastructure sensors 12, a communication device 14, and a parking management server 16. Each of the infrastructure sensors 12 has a camera or a laser scanner, etc., and is installed in the parking lot 100 so as to capture an image of area A. The multiple infrastructure sensors 12 may be installed in multiple locations in the parking lot 100 so as to capture an image of any location within area A (e.g., any parking space defined within the parking lot 100). The infrastructure sensor 12 supplies image data ID of the captured image of area A to the parking management server 16.

[0017] The communicator 14 is capable of data communication with external devices including the vehicle 110 in the area A. Specifically, the communicator 14 wirelessly transmits and receives data to and from the external devices using a mobile communication network system such as 4G or 5G. Note that multiple communicators 14 may be provided in the parking lot 100 so as to be able to communicate with the vehicle 110 parked anywhere in the area A. Furthermore, the communicator 14 may communicate with the external devices using any communication protocol.

[0018] The parking management server 16 controls the operations of the infrastructure sensors 12 and the communication device 14. Specifically, the parking management server 16 is a computer having a processor 18, a memory 20, and an I / O interface 22, as shown in Fig. 2. The processor 18 has a CPU, a GPU, or the like, and is communicatively connected to the memory 20 and the I / O interface 22 via a bus 24. The processor 18 performs calculations to realize an abnormal situation monitoring function, which will be described later.

[0019] The memory 20 has a RAM or a ROM, etc., and temporarily or permanently stores various data used in the arithmetic processing executed by the processor 18 and various data generated during the arithmetic processing. The I / O interface 22 has, for example, an Ethernet (registered trademark) port, a USB port, or an HDMI (registered trademark) terminal, and in addition to the above-mentioned infrastructure sensor 12 and communication device 14, peripheral devices such as a display (LCD, organic EL display, etc.), an input device (keyboard, mouse, etc.), and a speaker are connected to the I / O interface 22 so as to be able to communicate with each other via wire or wirelessly.

[0020] A plurality of vehicles 110 may be parked within area A (e.g., inside parking lot 100). The configuration of vehicle 110 according to one embodiment will be described below with reference to Fig. 3. Vehicle 110 is, for example, a four-wheeled automobile, and includes a vehicle body 112, an in-vehicle communication device 114, an exterior monitoring sensor 116, an electronic control unit (ECU) 118, and the like.

[0021] In addition to an on-board communication device 114, an exterior monitoring sensor 116, and an ECU 118, the vehicle body 112 is equipped with various on-board components such as a drive mechanism (an engine or an electric motor, etc.), a steering mechanism (a power steering device, etc.), a braking mechanism (an electric brake device, etc.), and various sensors (a speed sensor, a steering angle sensor, etc.).

[0022] The in-vehicle communication device 114 can communicate with external devices including the communication device 14 of the parking management system 10. The in-vehicle communication device 114 has, for example, a GPS receiver 114A, an inter-vehicle communication device 114B, and a data communication module (DCM) 140C. The GPS receiver 114A receives GPS signals from GPS satellites. The inter-vehicle communication device 114B can transmit and receive data with an in-vehicle communication device of another vehicle. The DCM 114C can transmit and receive data with the above-mentioned communication device 14, a management server of the automobile company that manufactured the vehicle 110, or a base station of a communication carrier, etc., using a mobile communication network system such as 4G or 5G.

[0023] The exterior monitoring sensor 116 detects the surrounding environment of the vehicle 110. For example, the exterior monitoring sensor 116 has at least one of a camera that detects the surrounding environment of the vehicle 110 by capturing an image of the surrounding environment, and a radar (LiDAR, laser scanner, etc.) that irradiates electromagnetic waves (e.g., laser light) around the vehicle 110 and detects the surrounding environment by receiving reflected waves from the surrounding environment.

[0024] The ECU 118 controls the operation of the vehicle 110. Specifically, the ECU 118 is a computer having a processor 120, a memory 122, and an I / O interface 124. The processor 120 has a CPU, a GPU, or the like, and is communicatively connected to the memory 122 and the I / O interface 124 via a bus 126.

[0025] The memory 122 has a RAM, a ROM, or the like, and temporarily or permanently stores various data used in the arithmetic processing executed by the processor 120 and various data generated during the arithmetic processing. The I / O interface 124 has, for example, a controller area network (CAN) port, an Ethernet (registered trademark) port, a USB port, an optical fiber connector, or an HDMI (registered trademark) terminal, and communicates data with in-vehicle components such as the in-vehicle communication device 114 and the outside-vehicle monitoring sensor 116 in a wired or wireless manner.

[0026] In this embodiment, the owner D of each vehicle 110 registers himself / herself as a user of the parking lot 100 in advance in order to use the parking lot 100. For example, the owner D operates a human-machine interface (HMI) of the vehicle 110 to access the parking management server 16 through the in-vehicle communication device 114 of the vehicle 110, downloads an application α for registering the user of the parking lot 100 from the parking management server 16, and installs the application α in the ECU 118 of the vehicle 110.

[0027] Then, owner D operates the HMI of vehicle 110 to launch app α, and enters owner D's personal information Iv (name, address, telephone number, etc.) and specific information Is that identifies vehicle 110 through the user registration screen displayed on the display of the HMI, and uploads it to the parking management server 16 via the in-vehicle communication device 114.

[0028] The identification information Is includes, for example, information such as the vehicle registration number Is1 of the vehicle 110, the chassis number Is2, the automobile company Is3 that manufactured the vehicle 110, and the model Is4 of the vehicle 110. Among the identification information Is, the vehicle registration number Is1 is printed on license plates attached to the front and rear of the vehicle 110 so as to be visible from outside the vehicle 110.

[0029] The processor 18 of the parking management server 16 obtains the personal information Iv and the identification information Is transmitted from the on-board communication device 114 of the vehicle 110 through the communication device 14, and also obtains the communication address AD (e.g., IP address) assigned to the on-board communication device 114. The processor 18 then creates a database DB in which the obtained personal information Iv, identification information Is, and address AR are stored in association with one another, and stores the database DB in advance in the memory 20. In this way, before the parking lot 100 is used, the identification information Is and addresses AR of multiple vehicles 110 are stored in the database DB.

[0030] Here, an abnormal situation AS may occur within the area A. Such an abnormal situation AS may be, for example, a fire AS1, an incident AS2 such as theft of a vehicle 110, or an accident AS3 between vehicles 110. In this embodiment, the parking management server 16 detects the occurrence of such an abnormal situation AS and executes a function of monitoring the abnormal situation AS using the vehicles 110 within the area A.

[0031] A method for monitoring the abnormal situation AS will be described below with reference to Fig. 4. The flow shown in Fig. 4 starts when the processor 18 of the parking management server 16 receives an operation start command (e.g., a power ON command) from an operator, a higher-level controller, or a computer program PG.

[0032] In step S1, the processor 18 starts an operation of acquiring status information Ia representing a status within the area A. As an example, the processor 18 acquires, as the status information Ia, image data ID captured by the infrastructure sensors 12. More specifically, each infrastructure sensor 12 continuously (e.g., periodically) captures images within the area A (e.g., the inside of the parking lot 100).

[0033] The processor 18 continuously (e.g., periodically) acquires image data ID captured by each infrastructure sensor 12 from the infrastructure sensor 12 through the I / O interface 22. In this manner, the processor 18 starts an operation of collecting the image data ID captured by the multiple infrastructure sensors 12 as status information Ia.

[0034] As another example, processor 18 acquires, as status information Ia, message data MD that reports the status within area A. The message data MD includes, for example, text data or image data of an article posted on a social network service (SNS) or a website (such as the homepage of the management company of parking lot 100, a personal blog, or a news site).

[0035] For example, when a user of parking lot 100 witnesses an abnormal situation AS occurring in area A, the user operates a portable device (e.g., a smartphone or a tablet terminal device) that he / she owns to post message data MD reporting the occurrence of the abnormal situation AS to an SNS or website. In this way, the message data MD reports the condition within area A by means of text data or image data.

[0036] On the other hand, the I / O interface 22 of the parking management server 16 is communicatively connected to a communication network NW (such as a LAN or the Internet), and the processor 18 can access an SNS or a website through the communication network NW. The processor 18 accesses the SNS or the website through the communication network NW, and searches for and collects message data MD that reports the status within the area A.

[0037] Thus, in step S1, the processor 18 starts an operation of acquiring the status information Ia (for example, image data ID and message data MD). Therefore, in the present embodiment, the processor 18 functions as an information acquiring unit 32 (FIG. 2) that acquires the status information Ia.

[0038] Here, in this embodiment, the processor 18 identifies the vehicle 110 that has entered the area A (e.g., inside the parking lot 100) and identifies the parking position PP of the vehicle 110 based on the acquired status information Ia. Specifically, the infrastructure sensor 12 continuously captures images of each vehicle 110 that has entered the area A. After starting step S1, the processor 18 collects image data ID of the vehicle 110 captured by the infrastructure sensor 12 as status information Ia.

[0039] For example, assume that the vehicle 110E shown in FIG. 5 enters the parking lot 100. In this case, the processor 18 performs image analysis on the image data ID of the vehicle 110E captured by the infrastructure sensor 12 to obtain the specific information Is 110E Among them, the vehicle registration number Is1 that was captured in the image data ID 110E Read:

[0040] The processor 18 reads the vehicle registration number Is1. 110E The processor 18 identifies the vehicle 110E stored in the database DB by comparing the vehicle registration number Is1 of the vehicle 110 stored in the database DB with the vehicle registration number Is2 of the vehicle 110E stored in the database DB.110E and vehicle model Is4 110E Identify the car company Is3 110E and vehicle model Is4 110E The vehicle 110E may be identified in the database DB based on the above.

[0041] Furthermore, the processor 18 identifies which parking position PP (parking space B4 in the example of FIG. 5) in the area A the vehicle 110E is parked in, based on the image data ID of the vehicle 110E captured by the infrastructure sensor 12 after the vehicle 110E has entered the area A. In this way, the processor 18 can identify which vehicle 110 stored in the database DB each vehicle 110 that has entered the area A is, and identify the parking position PP of the vehicle 110. This allows the processor 18 to obtain the address AD of each vehicle 110 in the area A from the database DB.

[0042] The processor 18 may identify the parking position PP of the vehicle 110 in the area A based on the position information Ip of the vehicle 110. Specifically, the processor 120 of the vehicle 110 estimates the vehicle position of the vehicle 110 based on the GPS signal received from a GPS satellite via the GPS receiver 114A and the map data MP stored in advance in the memory 122.

[0043] After entering area A (e.g., inside the parking lot 100), the processor 120 transmits the estimated vehicle position as position information Ip to the parking management system 10 via the in-vehicle communication device 114 (e.g., DCM 114C). The processor 18 of the parking management server 16 identifies the parking position PP of the vehicle 110 based on the position information Ip received by the communication device 14 from the in-vehicle communication device 114.

[0044] The processor 120 of the vehicle 110 may transmit behavior information Ib (e.g., the speed and acceleration of the vehicle 10, and the steering angle) of the vehicle 110 after entering the parking lot 100 together with the position information Ip (i.e., the vehicle's position). Then, the processor 18 of the parking management server 16 may identify the parking position PP of the vehicle 110 based on the position information Ip and the behavior information Ib. In this case, the processor 18 can more accurately identify the parking position PP of the vehicle 110 within the area A.

[0045] Furthermore, when the processor 18 of the parking management server 16 receives the position information Ip (and the behavior information Ib) from the in-vehicle communication device 114, the processor 18 may acquire the identification information Is of the vehicle 110 (e.g., the vehicle registration number Is1) or the address AD of the in-vehicle communication device 114. The processor 18 may then compare the acquired identification information Is or address AD with the identification information Is or addresses AD of multiple vehicles 110 stored in the database DB, thereby identifying which vehicle 110 stored in the database DB is the vehicle 110 that transmitted the position information Ip.

[0046] In this case, the processor 18 can identify the vehicle 110 that has entered the area A and identify the parking position PP of the vehicle 110 without using the status information Ia (i.e., the image data ID of the vehicle 110 captured by the infrastructure sensor 12). In this manner, the processor 18 can identify the parking position PP of each vehicle 110 that has entered the area A and obtain the address AD of the vehicle 110.

[0047] In step S2, the processor 18 detects whether or not an abnormal situation AS has occurred based on the state information Ia. Hereinafter, as an example of the abnormal situation AS, a case where a fire AS1 has occurred inside the parking lot 100 as shown in Fig. 5 will be described. In the example shown in Fig. 5, a plurality of parking spaces Bn (n = 1, 2, 3, 4, ... 11, 12, 13, 14, ...) are defined inside the parking lot 100, and a fire AS1 has occurred in the parking space B3.

[0048] Such a fire AS1 will be captured in the image data ID captured by the infrastructure sensor 12. Alternatively, a user of the parking lot 100 may operate a portable device to post message data MD reporting the occurrence of the fire AS1 to an SNS or website. Thus, the processor 18 can detect whether or not a fire AS1 has occurred by analyzing the image data ID and message data MD collected after the start of step S1.

[0049] In addition, the processor 18 may detect whether or not an abnormal event AS has occurred using a machine learning model LM (or an artificial intelligence: AI algorithm) that indicates a correlation between the status information Ia (i.e., the image data ID and the message data MD) and whether or not an abnormal event AS (in this example, a fire AS1) has occurred.

[0050] This machine learning model LM can be created, for example, by repeatedly providing the state information Ia and judgment data indicating the occurrence or non-occurrence of the abnormal situation AS to the machine learning device as a learning data set (for example, supervised learning). The processor 18 may be configured to execute the functions of the machine learning device and generate the machine learning model LM. The generated machine learning model LM may be stored in the memory 20 in advance.

[0051] The processor 18 inputs the state information Ia collected after the start of step S1 to the machine learning model LM. The machine learning model LM outputs determination result data indicating whether or not an abnormal situation AS (fire AS1) has occurred from the input state information Ia. The processor 18 can detect whether or not an abnormal situation AS has occurred from the determination result data output by the machine learning model LM.

[0052] Thus, in this embodiment, the processor 18 functions as an abnormality detection unit 34 (FIG. 2) that detects an abnormality AS (specifically, a fire AS1) that has occurred in the area A (for example, inside the parking lot 100) based on the status information AS (specifically, the image data ID and the message data MD). When the processor 18 detects the occurrence of an abnormality AS, it determines YES and proceeds to step S3, whereas when it determines NO, it proceeds to step S9.

[0053] In step S3, the processor 18 functions as the abnormality detection unit 34 and detects the status information Ia As an example, when the occurrence of a fire AS1 is detected based on the image data ID in step S2, the processor 18 identifies the occurrence location OL of the fire AS1 inside the parking lot 100 based on the position of the infrastructure sensor 12 that captured the image data ID in which the fire AS1 is captured and the position of the image of the fire AS1 in the image data ID.

[0054] Alternatively, the processor 18 may identify the parking space B3 where the fire AS1 is occurring from the image data ID in which the fire AS1 is captured, and identify the location OL where the fire AS1 is occurring as the parking space B3. In this case, a sign (e.g., a parking space number) identifying the parking space B3 may be provided on a building (e.g., a wall or a roadway) inside the parking lot 100. Then, the processor 18 may identify the location OL where the fire AS1 is occurring as the parking space B3 from the sign of the parking space B3 captured in the image data ID.

[0055] As another example, when the occurrence of a fire AS1 is detected based on the message data MD in step S2, the processor 18 identifies the occurrence location OL from the location information If of the fire AS1 included in the message data MD. For example, the message data MD may include, as the location information If of the fire AS1, the coordinates of a map application such as Google Maps (registered trademark), or keywords that identify the parking lot 100 and the parking space B3.

[0056] The processor 18 can identify the location OL of the occurrence of the fire AS1 from the location information If included in the message data MD. Thus, in this step S3, the processor 18 functions as the abnormality detection unit 34 and identifies the location OL of the occurrence of the abnormal situation AS based on the status information Ia (i.e., the image data ID or the message data MD).

[0057] In step S4, the processor 18 generates an alarm signal AL1 to notify the occurrence of the abnormal situation AS. For example, the processor 18 generates an alarm signal AL1 indicating that a fire AS1 has occurred as the abnormal situation AS and the occurrence location OL identified in step S3, and displays the signal on a display connected to the I / O interface 22 of the parking management server 16, or outputs the signal as sound through a speaker connected to the I / O interface 22.

[0058] Alternatively, the processor 18 may transmit the generated warning signal AL1 to an external device (e.g., a server of a management company of the parking lot 100) through the communication device 14 or the communication network NW. In this way, an operator of the parking management server 16 (or the external device) can immediately recognize the occurrence of the abnormal situation AS and the location OL of the occurrence.

[0059] In step S5, the processor 18 transmits a detection command C1 to the vehicle 110 parked in the vicinity of the occurrence location OL identified in step S3. This detection command C1 is a command to activate the vehicle exterior monitoring sensor 116 of the vehicle 110 parked in the vicinity of the occurrence location OL, and to cause the vehicle exterior monitoring sensor 116 to detect the occurrence location OL.

[0060] In step S5, the processor 18 acquires the addresses AD of the vehicles 110 parked in the vicinity of the occurrence location OL identified in step S3 from the database DB. As an example, the processor 18 may acquire the addresses AD of all the vehicles 110 parked in the area A (e.g., inside the parking lot 100) as the vehicles 110 parked in the vicinity of the occurrence location OL (parking space B3 in the example of FIG. 5).

[0061] As another example, the processor 18 may acquire addresses AD of all vehicles 110 parked on a floor (e.g., the second floor of the parking lot 100) of the parking lot 100 where the occurrence location OL is located as vehicles 110 parked in the vicinity of the occurrence location OL. As yet another example, the processor 18 may identify vehicles 110A, 110B, 110C, 110D, and 110E ( FIG. 5 ) parked in the vicinity of the occurrence location OL from among the vehicles 110 in the area A based on the status information Ia or the position information Ip, as described below, and acquire addresses AD of the identified vehicles 110A, 110B, 110C, 110D, and 110E.

[0062] The processor 18 refers to the acquired address AD and transmits a detection command C1 to the in-vehicle communication device 114 of the vehicle 110 having the address AD. In this manner, in the present embodiment, the processor 18 functions as a command transmitting unit 36 ​​(FIG. 2) that transmits the detection command C1 to the vehicle 110 parked in the vicinity of the occurrence location OL identified in step S3.

[0063] On the other hand, when the processor 120 of the vehicle 110 receives the detection command C1 through the in-vehicle communication device 114, it activates the vehicle exterior monitoring sensor 116 in accordance with the detection command C1. The vehicle exterior monitoring sensor 116 continuously (e.g., periodically) detects the surrounding environment of the vehicle 110. As a result, at least one of the vehicles 110 that have activated the vehicle exterior monitoring sensor 116 (e.g., vehicles 110A, 110B, 110C, 110D, and 110E shown in FIG. 5) can detect the occurrence location OL by the vehicle exterior monitoring sensor 116. Then, the processor 120 sequentially transmits the detection data DD (e.g., image data captured by a camera or radar) detected by the vehicle exterior monitoring sensor 116 to the parking management system 10 through the in-vehicle communication device 114.

[0064] The detection command C1 may include information on the communication address AD' (e.g., IP address) of the communication device 14 of the parking management system 10. In this case, the processor 120 can transmit the detection data DD from the in-vehicle communication device 114 to the communication device 14 by referring to the address AD'.

[0065] The processor 18 of the parking management server 16 sequentially acquires the detection data DD as the status information Ia through the communication device 14. In this way, the processor 18 further acquires the detection data DD as the operation of acquiring the status information Ia started in the above-mentioned step S1, and can continuously monitor the occurrence location OL based on the detection data DD.

[0066] In step S6, the processor 18 of the parking management server 16 determines whether the abnormal situation AS has been resolved based on the status information Ia. For example, the processor 18 analyzes the image data ID captured by the infrastructure sensor 12 after determining YES in step S2 and the detection data DD collected from the vehicle 110 as the status information Ia after step S5, and determines whether the fire AS1 detected in step S2 has been extinguished.

[0067] Alternatively, the processor 18 may determine whether the fire AS1 has been extinguished by analyzing the message data MD collected after determining YES in step S2. At this time, the processor 18 may detect whether the fire AS1 has been extinguished by inputting the state information Ia (image data ID, detection data DD, or message data MD) to the machine learning model LM.

[0068] In this way, the processor 18 determines whether the abnormal situation AS has been resolved (in this example, the fire AS1 has been extinguished) based on the state information Ia. If the processor 18 determines that the abnormal situation AS has been resolved (i.e., YES), the processor 18 ends the flow shown in Fig. 4, whereas if the processor 18 determines that the abnormal situation AS has not been resolved (i.e., NO), the processor 18 proceeds to step S7.

[0069] In step S7, the processor 18 generates an alarm signal AL2 to notify that the abnormal situation AS continues. For example, the processor 18 generates the alarm signal AL2 and outputs it through a display or a speaker of the parking management server 16. Alternatively, the processor 18 may transmit the generated alarm signal AL2 to an external device (for example, a server of a management company of the parking lot 100) through the communication device 14 or the communication network NW.

[0070] In step S8, the processor 18 judges whether or not an operation end command (e.g., a shutdown command) has been received from an operator, a higher-level controller, or the computer program PG. If the processor 18 judges that an operation end command has been received, the result is YES, and the flow shown in FIG. 4 is terminated, whereas if the processor 18 judges that the result is NO, the process returns to step S6.

[0071] In this way, processor 18 repeatedly executes the loop of steps S6 to S8 until it determines YES in step S6 or S8, and continuously monitors for the abnormal situation AS (fire AS1) based on status information Ia (image data ID, detection data DD, message data MD).

[0072] On the other hand, if the result of step S2 is NO, in step S9, processor 18 determines whether or not an operation end command has been received, similar to step S8 described above. If the result of step S2 is YES, processor 18 ends the flow shown in FIG. 4, whereas if the result of step S2 is NO, processor 18 returns to step S2.

[0073] As described above, in this embodiment, the processor 18 functions as the information acquisition unit 32, the abnormality detection unit 34, and the command transmission unit 36 ​​to detect an abnormal situation AS and monitor the abnormal situation AS by causing the exterior monitoring sensor 116 of the vehicle 110 to detect the location OL where the abnormal situation AS has occurred in accordance with the detection command C1. Therefore, the information acquisition unit 32, the abnormality detection unit 34, and the command transmission unit 36 ​​constitute a device 30 (FIG. 2) that monitors an abnormal situation AS that has occurred within an area A by using the vehicle 110 within the area A.

[0074] In this device 30, the information acquisition unit 32 acquires status information Ia representing the status within area A (step S1), and the abnormality detection unit 34 detects an abnormal situation AS based on the status information Ia (step S2) and identifies the location OL where the detected abnormal situation AS occurred (step S3).

[0075] Then, the command sending unit 36 ​​sends a detection command C1 to the parked vehicle 110 to activate the exterior monitoring sensor 116 installed in the parked vehicle 110 near the occurrence location OL identified by the abnormality detection unit 34 and cause the exterior monitoring sensor 116 to detect the occurrence location OL (step S5).

[0076] According to this configuration, an abnormal situation AS (for example, a fire AS1) that occurs within the area A can be monitored using the exterior monitoring sensor 116 mounted on the surrounding vehicle 110. Therefore, since the abnormal situation AS that occurs can be effectively monitored, security within the area A can be improved.

[0077] In the device 30, the information acquisition unit 32 acquires, as the status information Ia, image data ID captured by the infrastructure sensor 12 installed in the parking lot 100, and the abnormality detection unit 34 detects an abnormal situation AS based on the image data ID and identifies the occurrence location OL of the abnormal situation AS. With this configuration, the abnormal situation AS and the occurrence location OL can be detected with higher accuracy.

[0078] In the device 30, the information acquisition unit 32 further acquires, as status information Ia, detection data DD detected by the vehicle exterior monitoring sensor 116 in accordance with the detection command C1 transmitted by the command transmission unit 36. With this configuration, the processor 18 can continuously monitor the abnormal situation AS using the detection data DD.

[0079] Furthermore, in this embodiment, the vehicle 110 parked near the occurrence location OL of the abnormal situation AS activates the vehicle exterior monitoring sensor 116 in accordance with the detection command C1 transmitted by the command transmitting unit 36 ​​of the device 30, and causes the vehicle exterior monitoring sensor 116 to detect the occurrence location OL. With such a vehicle 110, the abnormal situation AS can be monitored more effectively by the vehicle exterior monitoring sensor 116.

[0080] Next, other functions of the parking management system 10 will be described with reference to Fig. 6 and Fig. 7. In this embodiment, the processor 18 of the parking management server 16 executes the flow of the abnormal situation monitoring method shown in Fig. 7. In the flow shown in Fig. 7, the same processes as those in the flow of Fig. 5 are given the same step numbers, and duplicated explanations will be omitted.

[0081] 7, the processor 18 executes step S10 after step S4. In step S10, the processor 18 identifies the vehicles 110A, 110B, 110C, 110D, and 110E whose exterior monitoring sensors 116 should be activated from among the vehicles 110 in the area A, based on the state information Ia (specifically, the image data ID of the vehicle 110) or the position information Ip of the vehicles 110 in the area A.

[0082] As described above, the processor 18 can identify the parking position PP of each vehicle 110 that has entered the area A (e.g., inside the parking lot 100) based on the image data ID of the vehicle 110 captured by the infrastructure sensor 12 or the position information Ip of the vehicle 110. Based on the identified parking position PP of each vehicle 110, the processor 18 identifies, from among the vehicles 110 in the area A, the vehicles 110A, 110B, 110C, 110D, and 110E that have exterior monitoring sensors 116 that include within their detection range DR the location OL of the abnormal situation AS (fire AS1) that has occurred.

[0083] Here, the exterior monitoring sensor 116 of each vehicle 110 has a predetermined detection range DR. For example, when a single vehicle 110 is provided with a plurality of exterior monitoring sensors 116, the detection range DR of the plurality of exterior monitoring sensors 116 may be a range (e.g., a range of a distance δ [m] from the center of the vehicle 110) all around the vehicle 110 (i.e., the front, rear, right, and left of the vehicle 110).

[0084] As an example, information on the detection range DR of each vehicle 110 (for example, the above-mentioned distance δ) is stored in advance in the database DB in association with the personal information Iv, the specific information Is, and the address AR. The processor 18 can acquire the detection range DR of each vehicle 110 from the database DB.

[0085] Alternatively, the processor 18 may refer to the vehicle 110's specific information Is (e.g., the automobile company Is3 and the vehicle model Is4) and access the website of the automobile company Is3 of the vehicle 110 via the communication network NW to obtain information on the detection range DR of the vehicle 110.

[0086] The processor 18 can estimate the detection range DR of each vehicle 110 in the area A based on the identified parking position PP of the vehicle 110 and information on the detection range DR of the vehicle 110 acquired from the database DB or a website. For example, in the example shown in Fig. 5, it is assumed that the location OL of the fire AS1 falls within the detection range DR of vehicles 110A, 110B, 110C, 110D, and 110E parked nearby.

[0087] In this case, based on the estimation result of the detection range DR, the processor 18 will identify vehicles 110A, 110B, 110C, 110D, and 110E from among the vehicles 110 in area A as vehicles 110 that have exterior monitoring sensors 116 that place the occurrence location OL within the detection range DR.

[0088] The processor 18 may further specify the direction φ of the vehicle 110 in the area A (specifically, the forward direction of the vehicle 110) based on the state information Ia or the position information Ip. For example, when one vehicle 110 is provided with an exterior monitoring sensor 116 capable of monitoring only the area ahead of the vehicle 110, the detection range DR may be the range ahead of the vehicle 110 (a range of a distance δ [m] ahead of the vehicle 110).

[0089] In order to estimate the detection range DR of such a vehicle 110 within the area A, it is necessary to acquire the orientation φ of the vehicle 110 parked within the area A. As an example, the processor 18 identifies the orientation φ of the vehicle 110 within the area A by analyzing the image data ID of the vehicle 110 captured by the infrastructure sensor 12 as the state information Ia.

[0090] As another example, the processor 18 may identify the orientation φ of the vehicle 110 within the area A based on the position information Ip (and behavior information Ib) of the vehicle 110. Then, the processor 18 estimates the detection range DR of the vehicle 110 within the area A based on the identified parking position PP and orientation φ of the vehicle 110 and information (distance δ) of the detection range DR of the vehicle 110. The processor 18 may identify the vehicles 110A, 110B, 110C, 110D, and 110E from the detection range DR estimated based on the parking position PP and orientation φ in this manner.

[0091] Alternatively, the processor 18 may identify the vehicle 110 parked in the parking position PP within a distance Δ (e.g., 5 m) from the occurrence location OL as the vehicle 110 for which the exterior monitoring sensor 116 should be activated. This distance Δ may be determined in advance by an operator of the parking management server 16, taking into account the detection range DR of the vehicle 110.

[0092] 5, it is assumed that vehicles 110A, 110B, 110C, 110D, and 110E are parked within a distance Δ from the occurrence location OL. In this case, based on the occurrence location OL identified in the above-mentioned step S3 and the predetermined distance Δ, the processor 18 identifies the vehicles 110A, 110B, 110C, 110D, and 110E from among the vehicles 110 in the area A as the vehicles 110 having the exterior monitoring sensor 116 that includes the occurrence location OL within the detection range DR.

[0093] As described above, the processor 18 identifies the parking position PP of the vehicle 110 in the area A based on the status information Ia (specifically, the image data ID) or the position information Ip, and identifies the vehicles 110A, 110B, 110C, 110D, and 110E whose exterior monitoring sensor 116 should be activated from among the vehicles 110 in the area A based on the identified parking position PP. Therefore, in this embodiment, the processor 18 functions as a vehicle identification unit 38 (FIG. 6) that identifies the vehicles 110A, 110B, 110C, 110D, and 110E whose exterior monitoring sensor 116 should be activated.

[0094] After step S10, the processor 18 executes step S5 and functions as the command transmitting unit 36 ​​to transmit a detection command C1 to the vehicles 110A, 110B, 110C, 110D, and 110E identified in step S10. The processors 120 of the vehicles 110A, 110B, 110C, 110D, and 110E activate their respective exterior monitoring sensors 116 to detect the occurrence location OL.

[0095] As described above, in this embodiment, the processor 18 of the parking management server 16 functions as the information acquisition unit 32, the abnormality detection unit 34, the command transmission unit 36, and the vehicle identification unit 38 to monitor the abnormal situation AS using the vehicles 110A, 110B, 110C, 110D, and 110E in the area A. Therefore, the information acquisition unit 32, the abnormality detection unit 34, the command transmission unit 36, and the vehicle identification unit 38 constitute a device 40 (FIG. 6) that monitors the abnormal situation AS using the vehicles 110 in the area A.

[0096] In this device 40, the vehicle identification unit 38 identifies vehicles 110A, 110B, 110C, 110D, and 110E that should have their exterior monitoring sensor 116 activated from among the vehicles 110 in area A based on status information Ia (specifically, image data ID of the vehicle 110) or position information Ip of the vehicle 110 in area A (step S10).

[0097] Then, the command transmitting unit 36 ​​transmits the detection command C1 to the vehicles 110A, 110B, 110C, 110D, and 110E identified by the vehicle identifying unit 38 (step S5). With this configuration, the vehicles 110A, 110B, 110C, 110D, and 110E parked in the vicinity of the occurrence location OL can be effectively selected, and the vehicle exterior monitoring sensors 116 of the vehicles 110A, 110B, 110C, 110D, and 110E can be activated. Therefore, the occurrence location OL can be more effectively detected by the vehicle exterior monitoring sensors 116 of the vehicles 110A, 110B, 110C, 110D, and 110E.

[0098] In addition, in the device 40, the vehicle identification unit 38 identifies the parking position PP of the vehicle 110 within the area A based on the status information Ia (image data ID of the vehicle 110) or the position information Ip, and based on the identified parking position PP, identifies vehicles 110A, 110B, 110C, 110D, and 110E from among the vehicles 110 within the area A that have an exterior monitoring sensor 116 that includes the occurrence location OL within its detection range DR.

[0099] Furthermore, the vehicle identification unit 38 further identifies the orientation φ of the vehicle 110 in the area A based on the status information Ia (image data ID of the vehicle 110) or the position information Ip, and identifies the vehicles 110A, 110B, 110C, 110D, and 110E based on the identified parking position PP and orientation φ. With this configuration, the vehicles 110A, 110B, 110C, 110D, and 110E that can reliably detect the occurrence location OL can be effectively selected from the vehicles 110 in the area A.

[0100] The processor 18 of the parking management server 16 may execute the flow shown in Fig. 4 or 7 according to a computer program PG pre-stored in the memory 20. The functions of the device 30 or 40 (i.e., the information acquisition unit 32, the abnormality detection unit 34, the command transmission unit 36, and the vehicle identification unit 38) executed by the processor 18 may be functional modules realized by the computer program PG.

[0101] Note that, although the flows in Figures 4 and 7 have been illustrated as examples of methods for monitoring the abnormal situation AS, various modifications can be made to the flows in Figures 4 and 7. For example, in the above-described embodiment, a case has been described in which the processor 18 acquires the detection data DD from the vehicle 110 (or the vehicles 110A, 110B, 110C, 110D, and 110E) as the status information Ia after step S5 in Figure 4 (or Figure 7).

[0102] However, this is not limiting, and in the flow shown in Fig. 4 (or Fig. 7), the processor 18 may not execute the operation of acquiring the detection data DD from the vehicle 110 (or the vehicles 110A, 110B, 110C, 110D, and 110E) as the status information Ia after step S5. In this case, the processor 120 of the vehicle 110 (or the vehicles 110A, 110B, 110C, 110D, and 110E) may operate the in-vehicle communication device 114 to transmit the detection data DD detected by the exterior monitoring sensor 116 to an external device other than the parking management server 16.

[0103] For example, the processor 120 may operate the vehicle-to-vehicle communication device 114B to transmit the detection data DD to another vehicle, or may operate the DCM 114C to transmit the detection data DD to an external device such as a management server of the automobile company or a base station. This makes it possible to notify the outside of the parking lot 100 of the occurrence of an abnormal situation AS (fire AS1). Also, steps S6 to S8 may be omitted from the flow shown in Fig. 4 or Fig. 7. Also, in the flow shown in Fig. 4 or Fig. 7, step S4 may be executed when it is determined YES in step S2, and then step S3 may be executed.

[0104] Furthermore, after step S5, when the detection data DD is detected by the exterior monitoring sensor 116 for a predetermined period of time, the processor 120 of the vehicle 110 (or vehicles 110A, 110B, 110C, 110D and 110E) may automatically control the drive mechanism, steering mechanism and braking mechanism to automatically drive the vehicle 110 (or vehicles 110A, 110B, 110C, 110D and 110E) to a safe parking position PP' away from the location OL where the abnormality AS (fire AS1) occurred.

[0105] In this case, the processor 18 of the parking management server 16 may determine an evacuation route for the vehicle 110 (or vehicles 110A, 110B, 110C, 110D, and 110E) based on the image data ID captured by the infrastructure sensor 12, and transmit an automatic driving command to the vehicle 110 (or vehicles 110A, 110B, 110C, 110D, and 110E) to cause the vehicle 110 (or vehicles 110A, 110B, 110C, 110D, and 110E) to perform automatic driving. As described above, various modifications can be made to the flow shown in FIG. 4 or FIG. 7.

[0106] In the example shown in Fig. 5, the abnormal situation AS is described as occurring when a fire AS1 occurs inside the parking lot 100 (specifically, parking space B3). However, even if an incident AS2 or an accident AS3 occurs as the abnormal situation AS, or if the abnormal situation AS occurs in the vicinity of the parking lot 100, the processor 18 of the parking management server 16 can monitor the abnormal situation AS that has occurred by executing the flow shown in Fig. 4 or Fig. 7, using the vehicle 110 parked in the vicinity of the location OL where the abnormal situation AS has occurred.

[0107] In this case, in the above-mentioned step S5, the processor 18 may transmit a detection command C1 to the vehicles 110 parked in the vicinity of the parking lot 100. Although the present disclosure has been described above through the embodiments, the above-mentioned embodiments do not limit the invention according to the claims. [Explanation of symbols]

[0108] 10 Parking Management System 12 Infrastructure Sensors 14 Communication Devices 16 Parking Management Server 18,120 processors 30,40 equipment 32 Information Acquisition Department 34 Anomaly detection unit 36 Command transmission unit 38 Vehicle Identification Department 100 Parking 110, 110A, 110B, 110C, 110E Vehicles 114 Vehicle communication device 116 Vehicle exterior monitoring sensor

Claims

1. A device for monitoring abnormal situations occurring within or around a parking lot using vehicles within the area, an information acquisition unit that acquires status information representing a status within the area; an abnormality detection unit that detects the abnormal situation based on the state information and identifies a location where the detected abnormal situation has occurred; a command transmission unit that transmits a command to the parked vehicle to activate an exterior monitoring sensor provided in the vehicle parked in the vicinity of the occurrence location identified by the abnormality detection unit and cause the exterior monitoring sensor to detect the occurrence location; a vehicle identification unit that identifies the parked vehicle that should have the vehicle exterior monitoring sensor activated from among the vehicles within the area based on the state information or position information of the vehicle within the area, The vehicle identification unit is Identifying a parking position of the vehicle within the area based on the status information or the position information; Based on the identified parking position and information on the detection range of the vehicle exterior monitoring sensor provided on the vehicle within the area, an estimation is made of the detection range of the vehicle within the area; The device identifies, from among the vehicles within the area, the parked vehicle having the exterior monitoring sensor whose estimated detection range includes the location of the occurrence.

2. The information acquisition unit acquires, as the status information, image data captured by an infrastructure sensor installed in the parking lot, The device according to claim 1 , wherein the abnormality detection unit detects the abnormal situation and identifies the location of the occurrence based on the image data.

3. The abnormality detection unit The status information acquired by the information acquisition unit is input into a machine learning model that indicates a correlation between the status information and the occurrence or non-occurrence of the abnormal situation; The device according to claim 1 , wherein the device detects whether or not the abnormal situation has occurred based on determination result data indicating whether or not the abnormal situation has occurred, the determination result data being output by the machine learning model in response to the input.

4. The vehicle identification unit is Obtaining the information on the detection range from a database that previously stores the information on the detection range in association with specific information of the vehicle, or The apparatus of claim 1 , wherein the detection range information is obtained by accessing a website of an automobile company of the vehicle through a communications network.

5. The vehicle identification unit is Further determining an orientation of the vehicle within the region based on the state information or the position information; The apparatus of claim 1 , further comprising: estimating the detection range of a vehicle within the region further based on the determined orientation.

6. The information acquisition unit further acquires, as the status information, detection data detected by the vehicle exterior monitoring sensor in accordance with the command transmitted by the command transmission unit; The device according to claim 1 , wherein the abnormality detection unit determines whether the abnormal situation has been resolved based on the state information acquired by the information acquisition unit after the detection of the abnormal situation.

7. The device described in Claim 6, further comprising a warning signal generating unit that generates a warning signal to notify that the abnormal situation continues when the abnormality detection unit determines that the abnormal situation has not been resolved.

8. A vehicle equipped with an exterior monitoring sensor, 2. A vehicle comprising: an exterior monitoring sensor that is activated in accordance with the command transmitted by the command transmission unit of the device according to claim 1, and that detects the location of the occurrence with the exterior monitoring sensor.

9. A method for monitoring an abnormal situation occurring within an area inside or around a parking lot, using a vehicle within the area, comprising: The processor: acquiring status information representing a status within the region; Detecting the abnormal situation based on the state information and identifying a location of the detected abnormal situation; transmitting a command to the parked vehicle to activate an exterior monitoring sensor provided in the vehicle parked in the vicinity of the identified occurrence location and to cause the exterior monitoring sensor to detect the occurrence location; Identifying the parked vehicle for which the vehicle exterior monitoring sensor should be activated from among the vehicles within the area based on the state information or position information of the vehicles within the area; To identify the parked vehicle, Identifying a parking position of the vehicle within the area based on the status information or the position information; Based on the identified parking position and information on the detection range of the vehicle exterior monitoring sensor provided on the vehicle within the area, an estimation is made of the detection range of the vehicle within the area; The method further comprises identifying, from among the vehicles within the area, the parked vehicles having the exterior monitoring sensors whose estimated detection range includes the location of the occurrence.

Citation Information

Patent Citations

  • Vehicle warning device and system

    JP2004094696A

  • Coverage device, mobile body, controller, and mobile body dispersion control program

    JP2019016306A

  • Vehicle-crime prevention device

    JP2020149088A

  • Information processing device and information processing method

    JP2021140399A