Surveillance system

The monitoring system addresses the issue of detecting and notifying passengers about left-behind luggage by using cameras to associate passengers with their luggage and integrating with ticket gate and transportation IC systems, ensuring timely notification.

JP7588566B2Active Publication Date: 2024-11-22KOKUSAI DENKI ELECTRIC INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021136492
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-08-24
Publication Date
2024-11-22
Estimated Expiration
2041-08-24

AI Technical Summary

Technical Problem

Conventional railway systems fail to promptly detect and notify passengers about left-behind luggage, leading to delayed discovery and potential confusion between suspicious and non-suspicious items, and passengers may not realize their luggage is missing until it's too late.

Method used

A monitoring system that uses cameras to recognize passengers and their luggage, associates them, and notifies passengers via their mobile devices if luggage is left behind, integrating with ticket gate and transportation IC systems to verify and identify passengers who have left their luggage.

Benefits of technology

The system effectively and promptly recognizes left-behind luggage, allowing passengers to be notified quickly and efficiently, reducing the risk of delayed discovery and confusion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007588566000001
    Figure 0007588566000001
  • Figure 0007588566000002
    Figure 0007588566000002
  • Figure 0007588566000003
    Figure 0007588566000003
Patent Text Reader

Abstract

To provide a monitor system capable of associating and recognizing a passenger having left a baggage behind and the baggage and notifying the passenger having left the baggage at an early stage.SOLUTION: The monitor system comprises a vehicle system 10 which detects a passenger's baggage left behind; and a notification system 50 which is connected and coordinated with a traffic IC system 20, a ticket gate system 30, and an operation system 40 via a network 70, collates the passenger having left the baggage behind with passengers having passed through a ticket gate to identify a person having passed through the ticket gate, acquires operation information of a vehicle, and gives notification about the baggage left behind, to a mobile terminal 60 of the identified passenger.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a monitoring system for monitoring baggage left behind in a vehicle or the like, and more particularly to a monitoring system capable of notifying passengers of baggage left behind at an early stage. [Background technology]

[0002] [Prior Art] Terrorist attacks targeting public transportation systems have occurred in many countries, and railway operators are strengthening their anti-terrorism measures. Specific measures taken on board include police officers on patrol, conductors checking for suspicious items, and passengers making emergency calls. In addition, as the working population declines and one-man operation and autonomous driving are promoted, it is necessary to quickly detect and deal with suspicious objects inside the vehicle with minimal human effort.

[0003] A conventional vehicle-mounted camera system consists of a display that displays images in the driver's cab, a control device that controls the display based on signals from the vehicle, in-vehicle cameras installed on the sides of each vehicle, passenger compartment cameras inside each vehicle, and a relay device that creates an IP network.

[0004] When the train stops at the station platform and the doors are opened, the image from the on-board camera is displayed on the display to assist the driver in checking whether passengers are getting on and off. In addition, if an abnormality occurs inside the passenger compartment, passengers can press the emergency call button in the compartment and the image from the passenger compartment camera will be displayed on the display. Furthermore, the cabin cameras mentioned above do not detect objects inside the cabin, so abandoned luggage is only noticed when a passenger calls the emergency number, a police officer or cleaner checks it, or the luggage is returned to the garage.

[0005] [Related Technology] As a related prior art, there is Japanese Patent No. 6526953 "Object Identification Method" (Patent Document 1). Patent Document 1 discloses that a moving object is detected by a surveillance camera, and the type and attributes of the moving object can be identified, thereby supporting crime prevention and crime investigation. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent No. 6526953 Summary of the Invention [Problem to be solved by the invention]

[0007] However, in the conventional railway operation system described above, abandoned baggage is checked visually, so if a police officer or conductor patrols the train while it is in motion, the baggage may be missed, and if there are no patrols while the train is in motion, passengers have to wait until they notice the baggage before reporting it, which can result in a delay in discovering suspicious objects.

[0008] It is also possible that even if luggage is left behind in the cabin, passengers may not be able to distinguish between suspicious items and lost property, and may be unable to make the decision to report it. Furthermore, when a passenger forgets something and leaves it behind, there is the problem that the passenger may not realize that they have left something behind until later, or that the whereabouts of the lost item may become unknown.

[0009] Incidentally, Patent Document 1 does not disclose a configuration for associating and recognizing a passenger who has left baggage behind with the baggage, and for notifying the passenger who left the baggage behind at an early stage.

[0010] The present invention has been made in consideration of the above-mentioned situation, and aims to provide a monitoring system that can recognize and associate a passenger who has left luggage behind with the luggage, and can notify the passenger who left the luggage behind at an early stage. [Means for solving the problem]

[0011] In order to solve the problems of the above-mentioned conventional example, the present invention is a surveillance system that performs surveillance using a camera mounted on a vehicle, Located in the vehicle,The vehicle is equipped with a control device that recognizes passengers who board the vehicle from image data captured by a camera and recognizes the baggage carried by the passengers in association with the image data, and determines that the baggage has been left behind if a passenger who gets off the vehicle is not carrying the associated baggage based on the image data. A processing device and a storage device are connected to the network, the processing device receives vehicle information and image data of passengers who have left their luggage behind and the luggage from the vehicle's control device and stores them in the storage device, a ticket gate system that manages passage through the ticket gate is connected to the network, the ticket gate system stores image data of passengers who pass through the ticket gate taken by a ticket gate camera that takes pictures of the passage through the ticket gate, receives the image data of the passengers who have left their luggage behind from the processing device and compares it with the image data of passengers who have passed through the ticket gate, the processing device requests the ticket gate system to narrow down the passengers who have left their luggage behind based on information on the boarding time, boarding station and boarding route, makes a comparison inquiry, and associates the image data of the passengers who have left their luggage behind with the image data of the passengers who have passed through the ticket gate. It is characterized by:

[0012] The present invention is characterized in that the monitoring system further comprises a display device that is provided in the vehicle and that, when the control device determines that luggage has been abandoned, displays the fact that luggage has been abandoned.

[0016] The present invention is characterized in that, in the above-mentioned monitoring system, an operation system that manages vehicle operations is connected to a network, and a processing device transmits information regarding abandoned luggage to a terminal device at a relevant station or a terminal of a relevant station staff member.

[0017] In the above monitoring system, a transportation IC system that manages transportation IC cards is connected to a network, the ticket gate system cooperates with the transportation IC system, and registers image data of passengers who pass through the ticket gate in association with identification information of their transportation IC cards, and outputs to the transportation IC system the identification information of the transportation IC card of the image data of the passenger who passed through the ticket gate corresponding to the image data of the passenger who left his / her luggage inquired by the processing device, the transportation IC system stores contact information of the mobile device of the user of the transportation IC card, and outputs to the processing device the contact information of the mobile device of the passenger who passed through the ticket gate according to the identification information of the transportation IC card from the ticket gate system, Processing Equipment But, From the IC system Mobile contacts Please send information about abandoned luggage to notification The present invention is characterized by the above. Effect of the Invention

[0018] According to the present invention, Located in the vehicle, The vehicle is provided with a control device that recognizes passengers who board the vehicle from image data captured by a camera mounted on the vehicle, and recognizes the baggage carried by the passenger in association with the image data, and determines that the baggage has been left behind if the passenger who gets off the vehicle is not carrying the associated baggage based on the image data. A processing device and a storage device are connected to the network, the processing device receives vehicle information and image data of passengers who have left their luggage behind and the luggage from the vehicle's control device and stores them in the storage device, a ticket gate system that manages passage through the ticket gate is connected to the network, the ticket gate system stores image data of passengers who pass through the ticket gate taken by a ticket gate camera that takes pictures of the passage through the ticket gate, receives the image data of the passengers who have left their luggage behind from the processing device and compares it with the image data of passengers who have passed through the ticket gate, the processing device requests the ticket gate system to narrow down the passengers who have left their luggage behind based on information on the boarding time, boarding station and boarding route, makes a comparison inquiry, and associates the image data of the passengers who have left their luggage behind with the image data of the passengers who have passed through the ticket gate. As it is a surveillance system, it has the effect of being able to detect early on if passengers leave their luggage behind.

[0019] According to the present invention, a transportation IC system that manages transportation IC cards is connected to a network, the ticket gate system cooperates with the transportation IC system, and registers image data of passengers who pass through the ticket gate in association with identification information of their transportation IC cards, and outputs to the transportation IC system the identification information of the transportation IC card of the image data of the passenger who passed through the ticket gate corresponding to the image data of the passenger who left his / her luggage inquired by the processing device, the transportation IC system stores contact information of the mobile device of the user of the transportation IC card, and outputs to the processing device the contact information of the mobile device of the passenger who passed through the ticket gate according to the identification information of the transportation IC card from the ticket gate system, Processing Equipment But, From the IC system Mobile contacts Please send information about abandoned luggage to notificationSince the monitoring system is based on the above, passengers can quickly become aware that their luggage has been left behind. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a schematic diagram of the configuration of the present system. [Diagram 2] FIG. 1 is a schematic configuration diagram of a vehicle system. [Diagram 3] FIG. 1 is a schematic configuration diagram of a notification system. [Figure 4] FIG. 1 is a schematic diagram showing an image of a ticket gate. [Diagram 5] FIG. 1 is a schematic diagram showing an image of in-car photography. [Figure 6] FIG. 13 is a schematic diagram showing an example of a notification message for passengers. [Figure 7] FIG. 2 is a flow diagram showing the operation flow of the present system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described with reference to the drawings. [Outline of the embodiment] A surveillance system (this system) according to an embodiment of the present invention is equipped with a vehicle system in which a surveillance camera mounted on a vehicle photographs passengers and the luggage they are carrying, a control device identifies and associates the passengers with their luggage, and when a passenger disembarks and the associated luggage is left behind, the system displays the fact that the luggage has been left behind on a display device viewed by the conductor, allowing the conductor, looking at the display device, to alert disembarking passengers that their luggage has been left behind at an early stage.

[0022] This system also works in conjunction with the operation system, ticket gate system, and transportation IC system to match the passenger who left their luggage behind with the passenger who passed through the ticket gate, identify the person who passed through the ticket gate, and further acquires vehicle operation information.It is also equipped with an alarm system that notifies the identified passenger that their luggage has been left behind on their mobile device.By being notified of the fact that their luggage has been left behind on their mobile device, the passenger is able to become aware of this at an early stage.

[0023] [This system: Figure 1] This system will be described with reference to Fig. 1. Fig. 1 is a schematic diagram of the configuration of this system. As shown in Figure 1, this system comprises a vehicle system 10 that monitors each vehicle for abandoned baggage, an operation system 20 that manages vehicle operations, a ticket gate system 30 that manages ticket gate passage, a transportation IC system 40 that manages transportation IC cards, an alarm system 50 that manages abandoned baggage and alerts passengers who have left it behind, and passengers' mobile terminals 60, all connected via a network 70. Although not shown in Fig. 1, terminal devices installed in the offices of each station, mobile terminals owned by each station staff member, etc. are also connected to the network 70. In addition, since the vehicle system 10 and the mobile terminal 60 are mobile, they are connected wirelessly.

[0024] [Outline of each system] An overview of each of the systems that make up this system will now be given. The vehicle system 10 is a characteristic configuration of the present system, in which the control device recognizes passengers and luggage photographed by a surveillance camera installed inside the vehicle, and notifies passengers by displaying the fact that luggage has been left behind on a display device in the conductor's room. The vehicle system 10 will be described in detail below.

[0025] The operation system 20 manages the operation of vehicles, and by being included in this system, it is possible to grasp the operating status of the vehicle in which the baggage was left behind. The ticket gate system 30 manages information about passing through a ticket gate (ticket gate information), and when a transportation IC card is used, the ticket gate system 30 works in conjunction with the transportation IC system 40 to associate the user information with the ticket gate information.

[0026] The transportation IC system 40 is a system that manages transportation IC cards, holds information on users of transportation IC cards, and in particular stores contact information for users' mobile terminals and the like. The notification system 50 is a characteristic component of the present system, and when a passenger leaves baggage behind, it notifies the passenger that the baggage has been left behind.

[0027] The passenger's mobile terminal 60 is a passenger's smartphone or the like, which notifies the passenger if their baggage is left behind. A network 70 connects the various systems and is assumed to be the Internet.

[0028] Next, the vehicle system 10 and the notification system 50 which are characteristic of this system will be described in more detail. [Vehicle System 10: Figure 2] The vehicle system 10 will be described with reference to Fig. 2. Fig. 2 is a schematic diagram of the vehicle system. As shown in FIG. 2, the vehicle system 10 includes a surveillance camera 11 provided inside the vehicle, a control device 12, and a display device 13.

[0029] The surveillance cameras 11 capture images of passengers getting on and off the train, and also capture images of passengers' luggage. Therefore, the surveillance cameras 11 include a camera installed near the door and multiple cameras that capture images inside the train. The control device 12 analyzes image data captured by the surveillance camera 11, recognizes passengers and also recognizes baggage carried by the passengers, and associates the passengers with the baggage.

[0030] Passengers are recognized through pattern recognition, including facial recognition and clothing, while luggage is recognized through pattern recognition of objects. Recognized passengers and luggage are given a passenger ID and luggage ID, respectively, as well as a vehicle ID (ID of the vehicle in operation), vehicle number (number of the vehicle the passenger is riding in), and information on the location where the luggage was left (position). The control device 12 is connected to a network 70 by wireless communication and transmits and receives data to and from other systems.

[0031] The display device 13 displays image data and the like processed by the control device 12, and is installed in a location where the conductor can see it. Furthermore, when an abandoned baggage occurs, the display device 13 displays an alert on the display screen, and displays a "Bag has been collected" button and a "Bag has not been collected" button on the screen. If the passenger retrieves their baggage as announced by the conductor, the conductor presses the "baggage retrieved" button, and if the passenger does not retrieve their baggage, the conductor presses the "baggage not retrieved" button. The process after the button operation will be described later.

[0032] [Notification system 50: Figure 3] The notification system 50 will be described with reference to Fig. 3. Fig. 3 is a schematic diagram of the notification system. The notification system 50 has a notification server 50a, which includes a control unit 51, a storage unit 52, and an interface unit 53. Here, the control unit 51 corresponds to a processing device in the claims, and the storage unit 52 corresponds to a storage device in the claims. Note that the roles of the processing device and the storage device may be performed by the vehicle system 10 or the ticket gate system 30.

[0033] The control unit 51 of the notification server 50a reads a processing program from the memory unit 52 and operates, and when luggage is left behind in a vehicle, it receives image data of the luggage and passenger to be left behind, passenger ID, luggage ID, vehicle ID and vehicle number from the vehicle system 10 and stores them in the memory unit 52.

[0034] Then, the control unit 51 of the notification server 50a acquires vehicle operation information from the operation system 20, and makes inquiries to the ticket gate system 30 and the transportation IC system 40 about the passenger who left his / her baggage behind. Furthermore, the control unit 51 of the notification server 50a acquires contact information of the passenger who left his / her baggage behind from the transportation IC system 40, and notifies the contact information that the baggage has been left behind. In addition, the control unit 51 displays information about the abandoned baggage on the terminal devices in the offices of related stations on the line and on the mobile terminals of station staff.

[0035] [Processing of this system] The processing of this system will now be explained in accordance with the flow of passengers. [Enter the ticket gate] When a passenger arrives at a station and passes through an automatic ticket gate, the passenger is photographed by a ticket gate camera installed at the entrance side of the ticket gate, and the image is analyzed by the ticket gate system 30 to recognize the passenger by face recognition, etc. A passenger ID is temporarily assigned to the recognized image data. The ticket gate system 30 cooperates with the transportation IC system 40 to link the ID of the transportation IC card of a passenger who has passed through the ticket gate with the image data of the passenger. Here, the ticket gate system 30 registers the transportation IC card ID and the image data of the passenger in association with each other.

[0036] [Ride] Next, when a passenger gets on a specific vehicle, the surveillance camera 11 of the vehicle system 10 photographs the passenger and his / her baggage, and the control device 12 recognizes the passenger and his / her baggage and temporarily assigns a passenger ID and baggage ID to associate them. Here, since the assigned passenger ID is different from the passenger ID assigned by the ticket gate system 30, the vehicle system 10 may transmit the passenger ID and passenger image data to the ticket gate system 30, compare it with registered passenger image data, and assign an ID for the transportation IC card.

[0037] [Get off] When a passenger gets off the vehicle and the associated baggage remains in the vehicle, the display device 13 seen by the conductor displays the fact that the passenger has left their baggage behind, and the conductor announces the baggage left behind to the passenger over the microphone, urging them to take their baggage with them.

[0038] Nevertheless, if the passenger still leaves the baggage behind (if the vehicle departs without getting off and retrieving the baggage), the vehicle system 10 notifies the notification system 50 that baggage has been left behind. This notification includes image data and passenger ID of the passenger who left the baggage behind, image data and baggage ID of the baggage, the passenger's boarding time and disembarking time, and the vehicle ID and vehicle number.

[0039] When the notification server 50a of the notification system 50 receives information about abandoned luggage from the vehicle system 10, it queries the ticket gate system 30 using the image data of the passenger who left their luggage received from the vehicle system 10, obtains the contact information of the passenger, and notifies the contact information that the luggage has been left behind.

[0040] In the above, only when baggage is left behind, does the notification server 50a inquire about passengers to the ticket gate system 30, and in the inquiry, it requests narrowing down of passengers based on information of the passenger's boarding time, boarding station, and boarding line, which has the advantage of making the search more efficient compared to matching against a huge amount of passenger image data. If the vehicle system 10 has already acquired the ID of the passenger's transportation IC card, the ID is transmitted to the ticket gate system 30 to acquire the corresponding contact information, and a notification is sent to the contact information.

[0041] The notification server 50a also notifies the terminal device in the office of the relevant station that the baggage has been abandoned, and also notifies the mobile terminal of the relevant station staff. The relevant stations are the station where the abandoned baggage occurred and the stations where the train is scheduled to stop, and the relevant station staff are the station staff who work at those stations.

[0042] [Exit the ticket gate] When the passenger in question exits the ticket gate, the ticket gate system 30 may display the fact that baggage has been left behind on a display unit at the ticket gate, or may display the information on a large-screen monitor. A ticket gate camera may be installed to photograph passengers leaving the ticket gate, and if the image data of the passenger who left their luggage matches the image data of the passenger who entered the ticket gate and the image data of the passenger who left the ticket gate, and the passengers who entered and left the ticket gate are the same person (same transportation IC card ID) in the ticket gate system 30, a notification may be sent to the contact person. Notification can be done without error.

[0043] [Another example] As another example, instead of photographing passengers with the ticket gate camera when they enter the ticket gate, the ticket gate camera photographs passengers when they leave the ticket gate, and when an inquiry is made by the notification server 40a, the ticket gate system 30 verifies the passenger and returns the contact information of the relevant passenger to the notification server 40a. The notification server 40a then notifies the passenger through the contact information that received the notification about the abandoned baggage.

[0044] In this other example, it is sufficient to install a ticket gate camera on the exit side of the ticket gate, and the ticket gate system 30 only needs to verify the passenger when an inquiry is received from the notification server 40a, which reduces the load on the ticket gate system 30. Furthermore, since there is no need to install a ticket gate camera on the entrance side of the ticket gate, the configuration can be simplified and system costs can be reduced.

[0045] [Ticket gate image: Figure 4] An image of a ticket gate in this system will be described with reference to Fig. 4. Fig. 4 is a schematic diagram showing an image of a ticket gate. As shown in Figure 4, when the facial image of a passenger entering the ticket gate is detected and the transportation IC card is touched, the passenger ID of the detected facial image is linked to the ID of the transportation IC card and registered in the ticket gate system 30.

[0046] [Image of inside the car: Figure 5] An image of the inside of a vehicle captured by the monitoring camera 11 of the vehicle system 10 in this system will be described with reference to Fig. 5. Fig. 5 is a schematic diagram showing an image captured inside the vehicle. As shown in FIG. 5, the control device 12 recognizes a parcel by encircling it in a square in image data captured by the surveillance camera 11 of the vehicle system 10, and stores the image data and the parcel ID of the parcel.

[0047] [Image of notification to passengers: Figure 6] The message notifying passengers that their luggage has been left behind will be described with reference to Fig. 6. Fig. 6 is a schematic diagram showing an example of the message notifying passengers. As shown in Fig. 6(a), a notice of the lost item is sent to the passenger's mobile terminal (smartphone, etc.) 60, and further, as shown in Fig. 6(b), detailed information is displayed. The detailed information includes the station where the luggage was left, the station where the lost item is being kept, etc.

[0048] [Operation flow: Figure 7] Next, the operation flow of this system will be described with reference to Fig. 7. Fig. 7 is a flow diagram showing the operation flow of this system. In this system, as shown in FIG. 7, the ticket gate system 30 photographs passengers passing through the ticket gate with a ticket gate camera and extracts facial images (S1). Then, the passenger is recognized by the facial image extracted by the processing device in the ticket gate system 30, linked to the ID of the transportation IC card, and registered in the database (DB) in the ticket gate system 30 (S2).

[0049] Next, when the passenger boards the train, the passenger and his / her baggage are photographed by the surveillance camera 11 of the train system 10 to detect the passenger's face image and the baggage image. Then, the train system 10 acquires the ID of the transportation IC card corresponding to the passenger's face image from the DB of the ticket gate system 30 (S3). The vehicle system 10 associates the ID of the transportation IC card with the passenger ID and the baggage ID and stores them in the processing device 12 (S4).

[0050] Since the above processing is distributed to each vehicle, it is efficient to perform it in the notification system 50. In other words, the vehicle system 10 transmits information about the abandoned luggage to the notification system 50, and the notification server 50a of the notification system 50 transmits image data of the passenger who left the luggage behind to the ticket gate system 30, the ticket gate system 30 searches for the passenger based on the image data of the passenger, obtains the ID of the corresponding transportation IC card and returns it to the notification server 50a, and the notification server 50a manages and stores the transportation IC card ID, passenger ID, passenger image data, luggage ID, and luggage image data in association with each other.

[0051] Next, the surveillance camera 11 of the vehicle system 10 photographs the passengers and their baggage when they get off the vehicle and detects whether any baggage has been left behind (S5). Specifically, luggage is recognized by the in-car camera of the surveillance camera 11, and when the passenger gets off, an image of the passenger getting off and the luggage is taken by the surveillance camera 11 near the door. If the passenger does not have their luggage with them when getting off and the luggage is left behind on the in-car camera, it is detected as the luggage being left behind.

[0052] When it is detected that baggage has been left behind, the processor 12 of the vehicle system 10 displays an alarm indicating that baggage has been left behind on the display device 13 which can be seen by the conductor (S6). This allows the conductor to make an announcement over an external speaker to passengers who have left their luggage behind, urging them to retrieve their luggage.

[0053] If the passenger does not collect their luggage despite the conductor's announcement (No), the conductor selects the "Not collected" button on the display screen of the display device 13, and if the luggage is collected (Yes), the conductor selects the "Collected" button on the display screen of the display device 13. The determination process is performed by pressing either button on the display screen (S7).

[0054] If the baggage is collected, the process returns to step S1. If the baggage is not collected, the relevant station is notified of the baggage being left behind (S8). Specifically, the relevant stations are the station where the baggage was left behind and the subsequent stations where the train will stop. Furthermore, the train system 10 also notifies the notification system 50. The notification contents include information such as the passenger ID and passenger image data, baggage ID and baggage image data, the vehicle ID and vehicle number in which the baggage was left behind, and the location where the baggage was left.

[0055] The notification server 50a then notifies the passenger who left the baggage behind of the information about the abandoned baggage to the contact information of the passenger obtained from the ID of the transportation IC card of the passenger who left the baggage behind (S9). The information on abandoned luggage includes the station where it occurred, the station where the luggage is being kept, the storage period at the station, the storage period at the lost and found center, and contact information.

[0056] [Application to autonomous driving] This system can be applied to vehicles such as trains, subways, monorails, and buses that are operated by a single driver, as well as to self-driving vehicles. In addition, in the case of automatic driving, an announcement to passengers who get off the vehicle about their luggage being left behind is automatically output by voice, and the processing device 12 determines whether the luggage has been collected or not based on the image captured by the surveillance camera 11.

[0057] [Effects of the embodiment] According to this system, passengers and any baggage they are carrying are photographed by a surveillance camera 11 mounted on the vehicle, and a control device 12 identifies and associates the passengers with their baggage. When a passenger gets off the vehicle, if the associated baggage is left behind, the vehicle system 10 displays the fact that the baggage has been left behind on a display device 13 viewed by the conductor. This has the effect of enabling the conductor, who is looking at the display device 13, to inform a passenger who has disembarked that baggage has been left behind at an early stage.

[0058] Furthermore, the present system is equipped with a vehicle system 10, and is connected and linked to a transportation IC system 20, a ticket gate system 30, and an operation system 40 via a network 70, and is equipped with an alarm system 50 which matches the passenger who left his / her luggage with the passenger who passed through the ticket gate, identifies the person who passed through the ticket gate, and further obtains vehicle operation information and notifies the identified passenger's mobile device 60 that his / her luggage has been left behind. As the passenger's mobile device 60 is notified of the luggage being left behind, the passenger is able to recognize that his / her luggage has been left behind at an early stage. [Industrial Applicability]

[0059] INDUSTRIAL APPLICABILITY The present invention is suitable for a monitoring system that can recognize a passenger who has left baggage behind in association with the baggage and can notify the passenger who left the baggage behind at an early stage. [Explanation of symbols]

[0060] 10...vehicle system, 11...surveillance camera, 12...control device, 13...display device, 20...transport IC system, 30...ticket gate system, 40...operation system, 50...notification system, 50a...notification server, 51...control unit, 52...storage unit, 53...interface unit, 60...passenger's mobile terminal, 70...network

Claims

1. A surveillance system that performs surveillance using a camera mounted on a vehicle, a camera provided in the vehicle, which recognizes passengers who board the vehicle from image data captured by the camera and recognizes baggage carried by the passengers in association with the image data; a control device that determines that baggage has been left behind when a passenger getting off is not carrying baggage associated with the image data; A processing device and a storage device are connected to the network, The processing device receives vehicle information and image data of the passenger who left his / her baggage and the baggage from the control device of the vehicle, and stores the information in the storage device; A ticket gate system that manages the passage of passengers through the ticket gate is connected to the network; The ticket gate system stores image data of passengers passing through the ticket gate captured by a ticket gate camera that captures the passengers passing through the ticket gate, receives image data of the passengers who have abandoned their luggage from the processing device, and compares the image data of the passengers passing through the ticket gate with the image data of the passengers passing through the ticket gate, The processing device requests the ticket gate system to narrow down the passengers who have left their luggage behind based on information about the boarding time, boarding station, and boarding route, makes the matching inquiry, and associates image data of the passengers who have left their luggage behind with image data of passengers who have passed through the ticket gate.This monitoring system is characterized by the above.

2. 2. The monitoring system according to claim 1, further comprising a display device that is provided in a vehicle and that displays, when the control device determines that luggage has been abandoned, that luggage has been abandoned.

3. A vehicle operation system that manages vehicle operation is connected to the network; 3. The monitoring system according to claim 1, wherein the processing device transmits information regarding abandoned baggage to a terminal device of a related station or to a terminal of a related station staff member.

4. A transportation IC system that manages transportation IC cards is connected to the network; The ticket gate system cooperates with the transportation IC system, registers image data of the passenger who passed through the ticket gate in association with identification information of the transportation IC card, and outputs to the transportation IC system, the identification information of the transportation IC card of the image data of the passenger who passed through the ticket gate corresponding to the image data of the passenger who left his / her baggage inquired from the processing device. the transportation IC system stores contact information of the mobile terminal of the user of the transportation IC card, and outputs contact information of the mobile terminal of the passenger who passes through the ticket gate to the processing device based on the identification information of the transportation IC card from the ticket gate system; 4. The monitoring system according to claim 1, wherein the processing device notifies information regarding abandoned luggage to a contact of the portable terminal from the transportation IC system.

Citation Information

Patent Citations

  • Detecting device for articles left in vehicle

    CN213322875U

  • Residue detection system

    JP2020004252A

  • Moving object controlling device and moving object indoor monitoring and controlling device

    JP2021039473A

  • Object recognition methods

    JP6526953B2