Passenger information collection system, passenger information collection method and program
The passenger information collection system addresses the challenge of determining mask-wearing status in passengers by using cameras to confirm and transmit this information, ensuring safer taxi dispatches.
Patent Information
- Application Number
- JP2023508391
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-26
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-03-26
AI Technical Summary
Existing systems fail to determine whether passengers in passenger vehicles like taxis are wearing masks before dispatch, making it difficult for drivers to enforce mask policies and potentially spreading infections.
A passenger information collection system that uses cameras to acquire images of passengers, confirms mask-wearing status, and transmits this information to the vehicle dispatch system, enabling informed dispatch decisions.
Enables pre-dispatch verification of mask-wearing status, allowing companies to enforce mask policies and ensure safer transportation.
Smart Images

Figure 0007593477000001 
Figure 0007593477000002 
Figure 0007593477000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a passenger information collection system, a passenger information collection method, and program Regarding. [Background technology]
[0002] Patent Document 1 discloses an invention that, in a system for managing the dispatch of vehicles such as taxis, improves the convenience of a user when requesting a dispatch by selecting a vehicle to be assigned to the user based on the user's attribute information (see claim 7, etc.). Note that the attribute information in this document is managed in a user information table in a dispatch management server.
[0003] Patent Document 2 discloses a bus stop that can detect the number of passengers at the bus stop and whether assistance is required by performing image recognition on images captured by a camera. The bus stop control device described in the document notifies a bus 40 approaching the bus stop in advance of the number of passengers and whether assistance is required (see paragraph 0027).
[0004] Patent document 3 discloses a vehicle dispatch system that can dispatch an unmanned mobile vehicle to a designated dispatch location in a timely manner, the vehicle dispatch system including an outdoor surveillance camera and a camera management system that can capture images of users moving around outdoors. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2020-170572 A [Patent Document 2] International Publication No. 2020 / 145312 [Patent Document 3] JP 2019-101464 A Summary of the Invention [Problem to be solved by the invention]
[0006] The following analysis is provided by the inventor. It has been pointed out that some infectious diseases do not develop immediately after infection, but develop after a certain incubation period, and that contact with such infected people may spread the infection. For this reason, wearing a mask is widely recommended in public places, not only for infected people.
[0007] On the other hand, passenger vehicles such as taxis may encounter passengers who are not wearing masks at their destination. For this reason, some taxi companies have begun to include provisions in their transportation terms and conditions that state that they may refuse to pick up passengers if the reason for not wearing a mask is not a valid reason such as illness. However, it is difficult to determine whether or not there is a valid reason such as illness, which places a burden on the driver.
[0008] The present invention provides a passenger information collection system, a passenger information collection method, and a method for providing information on whether a person who has made a vehicle dispatch request is wearing a mask before dispatching the vehicle. program The purpose is to provide. [Means for solving the problem]
[0009] According to a first aspect, a method for providing a vehicle-reserving service according to the present invention includes: receiving means for receiving information of a user who has made a reservation from a vehicle-reserving system that can acquire images from a camera installed around a road and that allocates passenger vehicles; and, based on the information of the user, The above The system includes an image acquisition means for acquiring an image of a person who has made a taxi dispatch request from a camera, a confirmation means for confirming whether or not the person is wearing a mask based on the image of the person, and a transmission means for transmitting information on whether or not the person who has made the taxi dispatch request is wearing a mask to a terminal of a company to which the taxi dispatch request is made. the receiving means receives a request for photographing from the user before the image acquiring means acquires an image, and the image acquiring means acquires an image including the person who has made the dispatch request when the image acquiring means receives the request for photographing. A passenger information collection system is provided.
[0010] According to a second aspect, a passenger information collection system capable of acquiring images from cameras installed around roads receives information of users who have made reservations from a vehicle dispatch system that dispatches passenger vehicles; When a request for photography is received from the user, A passenger information collection method is provided, which acquires an image of a person who has requested a taxi from the camera based on the user information, checks whether the person is wearing a mask based on the image of the person, and transmits information on whether the person who has requested a taxi is wearing a mask to a terminal of a company to which the taxi is requested. This method is linked to a specific machine called a passenger information collection system that can acquire images from cameras installed around roads.
[0011] According to a third aspect, there is provided a computer program (hereinafter, "program") for realizing the functions of the passenger information collection system described above. The computer program is input to the computer device from an input device or from the outside via a communication interface, stored in a storage device, and drives the processor according to a predetermined step or process. The program can display the processing result including an intermediate state at each stage via a display device as necessary, or can communicate with the outside via the communication interface. For example, the computer device for this purpose typically includes a processor, a storage device, an input device, a communication interface, and a display device as necessary, which are connectable to each other via a bus. The program can be recorded on a computer-readable (non-transitive) storage medium. That is, the present invention can also be embodied as a computer program product. Effect of the Invention
[0012] According to the present invention, it is possible to provide information in advance as to whether or not a person who has made a vehicle dispatch request is wearing a mask. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a diagram showing a configuration of an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a configuration of a passenger information collection system according to a first embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram for explaining the operation of the passenger information collection system according to the first embodiment of the present invention. [Figure 4] FIG. 4 is a block diagram showing a configuration of a passenger information collection system according to a second embodiment of the present invention. [Diagram 5] FIG. 11 is a diagram for explaining the operation of the passenger information collection system according to the second embodiment of the present invention. [Figure 6] FIG. 1 is a diagram showing the configuration of a computer capable of functioning as the passenger information collection system of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] First, an overview of one embodiment of the present invention will be described with reference to the drawings. Note that the reference numerals in the drawings are added to each element for convenience as an example to aid in understanding, and are not intended to limit the present invention to the illustrated embodiment. Also, the connection lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional. The unidirectional arrows are intended to show the flow of the main signal (data) and do not exclude bidirectionality. Also, although there are ports or interfaces at the connection points of the input and output of each block in the drawings, they are not shown. The program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as necessary. Also, the computer device is configured to be able to communicate with devices (including computers) inside or outside the device via the communication interface, regardless of whether it is wired or wireless.
[0015] In one embodiment, the present invention can be realized by a passenger information collection system 10 connected to cameras 30 installed around a road, as shown in Fig. 1. More specifically, the passenger information collection system 10 includes a receiving means 11, an image acquiring means 12, a confirming means 13, and a transmitting means 14.
[0016] The receiving means 11 receives information about a user who has made a reservation from a vehicle dispatch system 40 that dispatches passenger vehicles.
[0017] The image acquisition means 12 acquires, based on the user information, an image from the camera 30 showing the person who has made the taxi dispatch request.
[0018] The image acquisition means 12 may acquire images of passengers from the camera 30 based on the information of the passengers in the passenger vehicles in the following manner. (1) The face, gait, etc. of the user registered in advance are compared with the image of the person captured by the camera 30. (2) Information including location information is received as user information, and based on the location information, the camera 30 is panned, tilted, and zoomed, or an arbitrary camera is selected from the multiple cameras 30. For this location information, for example, location information obtained by a GPS (Global Positioning System) or serving cell information obtained from a base station of a wireless communication network can be used. (3) An explicit request to take a photograph is received from a passenger vehicle user using a terminal carried by the user, and the user is photographed using a camera 30 capable of photographing.
[0019] The confirmation means 13 confirms whether or not the person is wearing a mask based on the image of the person in the image.
[0020] Transmission means 14 teeth, Information on whether the person who has requested a taxi to be dispatched is wearing a mask is transmitted to the terminal 20 of the company to which the taxi dispatch request is made. The terminal 20 may be a terminal included in the dispatch system 40.
[0021] According to the above configuration, it is possible to provide information in advance as to whether or not the person who made the dispatch request is wearing a mask. With this information, the company to which the dispatch request is made can take the following measures. If it is determined that the person making the ride request is not wearing a mask, a staff member will contact the person who made the ride request and ask them to put on a mask before getting in the car. Taxis that are equipped with masks to lend to passengers will be assigned to the dispatched vehicles. -Assign drivers who can appropriately handle the needs of the taxis to be dispatched in accordance with the transportation terms and conditions.
[0022] [First embodiment] Next, a first embodiment of the present invention will be described in detail with reference to the drawings. Fig. 2 is a block diagram showing the configuration of a passenger information collection system 100 according to the first embodiment of the present invention. Referring to Fig. 2, the configuration of the passenger information collection system 100 connected to a terminal 200, a camera 300, and a vehicle dispatch system 400 is shown.
[0023] The vehicle dispatch system 400 is a system that accepts reservations for passenger vehicles that specify the date and time, pick-up location, etc. from passenger vehicle users, and issues vehicle dispatch instructions to the on-board terminals of the passenger vehicles. The vehicle dispatch system 400 of this embodiment also has a function of transmitting information about the users who have made the reservations to the passenger information collection system 100.
[0024] The terminal 200 is a terminal to which the results of the information collected and determined by the passenger information collection system 100 are output. The terminal 200 may be a terminal that issues vehicle dispatch instructions to passenger vehicles of the vehicle dispatch system 400.
[0025] The camera 300 is installed on the roadside or the like and is capable of photographing a user who has made a reservation for a passenger vehicle. The installation location of the camera 300 may be, but is not limited to, a major facility or an intersection that is often designated as a pick-up location. The camera 300 may be a surveillance or security camera installed on a sidewalk or in a store.
[0026] The passenger information collection system 100 includes a receiving unit 101, an image acquiring unit 102, a confirming unit 103, a transmitting unit 104, and a classifier 105. Such a passenger information collection system 100 can be realized by a server arranged on a cloud platform or a MEC (Multi-access Edge Computing) server installed near a service provision area.
[0027] The receiving unit 101 receives information about the user who made the reservation from the vehicle dispatch system 400. The "user information" is information that can identify the user in the image captured by the camera 300, and can be, for example, the user's ID, face image information, etc.
[0028] The image acquisition unit 102 acquires an image of the user from the camera 300 based on the user information. For example, when face image information is used as the "user information", the image acquisition unit 102 cuts out the face area of the person in the image captured by the camera 300 and performs face authentication by matching it with the face image of the corresponding user registered in advance. When the corresponding person can be detected by the face authentication, the image acquisition unit 102 acquires the image as an image of the user. It is also assumed that the camera 300 has a function of cutting out the face area of the person in the image, performing face authentication, and tagging the image. In this case, the image acquisition unit 102 can also identify the user of the passenger vehicle by matching these tags with the user's ID.
[0029] The confirmation unit 103 uses the classifier 105 to confirm whether or not a person appearing in an image of the user is wearing a mask, and outputs the result to the transmission unit 104. The classifier 105 can be configured, for example, by a classification function that, when an image is input, outputs a value indicating whether or not the person is wearing a mask. Moreover, such a classifier 105 can be created by machine learning using training data prepared in advance.
[0030] A transmission unit 104 transmits to the terminal 200 the result of whether or not the person appearing in the image of the user confirmed by the confirmation unit 103 is wearing a mask.
[0031] Next, the operation of this embodiment will be described in detail with reference to the drawings. Fig. 3 is a flow chart showing the operation of the passenger information collection system 100 of the first embodiment of the present invention. Referring to Fig. 3, first, the passenger information collection system 100 detects the person who has reserved the vehicle dispatch from the image obtained by the camera 300 (step S001).
[0032] Next, the passenger information collection system 100 acquires an image in which the detected person is captured (step S002).
[0033] Next, the passenger information collection system 100 checks whether or not the person in the image showing the person is wearing a mask (step S003).
[0034] Finally, the passenger information collection system 100 transmits to the terminal 200 information indicating whether or not the person is wearing a mask (mask wearing / not wearing information) together with the user information (step S004).
[0035] According to this embodiment, which operates as described above, it is possible to provide information in advance to a company that dispatches passenger vehicles, etc., as to whether or not a person who has made a vehicle dispatch request is wearing a mask.
[0036] [Second embodiment] In the above-described first embodiment, it has been described that whether or not a person who has booked a ride is wearing a mask is determined from an image of the person and the information is provided to the agency, but the information that can be provided by the passenger information collection system 100 is not limited to this. Next, a second embodiment will be described in which the passenger information collection system 100a uses a multi-class classifier to collect information (first attribute) for selecting a driver suitable for the user and information (second attribute) for selecting a vehicle suitable for the user.
[0037] FIG. 4 is a passenger information collection system according to a second embodiment of the present invention. 100a 2 in that the confirmation unit 103 is replaced with an attribute detection unit 106, and the classifier 105 is replaced with two multi-class classifiers 105a and 105b. The other configurations and operations are almost the same as those of the first embodiment, so the following description will focus on the differences.
[0038] The attribute detection unit 106 detects the first and second attributes of a person appearing in an image of the user using the classifiers 105a and 105b. Therefore, the attribute detection unit 106 functions as a first and second attribute detection means. The first attribute is an attribute for assigning a driver suitable for the user. Examples of the first attribute include the type of communication language (Japanese, English, Chinese, etc.) that can be estimated from the person's appearance, and the purpose of travel (business, sightseeing, etc.). For these first attributes, appropriate teacher data can be prepared in advance, and a multi-class classifier 105a that can detect (classify) the first attributes can be prepared.
[0039] The second attribute is an attribute for allocating a vehicle suitable for a user. An example of the second attribute is the presence or absence of a handicap, which can be estimated from a person's appearance. For these second attributes, appropriate teacher data can be prepared in advance, and a multi-class classifier 105b capable of detecting (classifying) the second attributes can be prepared. Note that the contents of the first attribute and the second attribute may partially overlap. For example, the type of communication language (Japanese, English, Chinese, etc.), the purpose of travel (business, sightseeing, etc.), etc. may be detected as the second attribute.
[0040] The transmitting unit 104 a of this embodiment transmits the first attribute and the second attribute detected by the attribute detecting unit 106 to the terminal 200 .
[0041] Next, the operation of this embodiment will be described in detail with reference to the drawings. Fig. 5 is a flow chart showing the operation of the passenger information collection system 100a of the second embodiment of the present invention. The operation of steps S001 to S002 in Fig. 5 is the same as that of the first embodiment, so the description will be omitted.
[0042] The passenger information collection system 100a that has acquired an image in which the detected person appears detects a first attribute of the person in the image in which the person appears (step S103).
[0043] Next, the passenger information collection system 100a detects a second attribute of the person in the image in which the person is captured (step S104). Note that the above steps S103 and S104 may be executed in parallel, or may be executed in a reverse order.
[0044] Finally, the passenger information collection system 100a transmits the first and second attribute information together with the user information to the terminal 200 (step S105).
[0045] According to the present embodiment, which operates as described above, it is possible to provide a company that dispatches passenger vehicles with information for selecting a vehicle and a driver to be dispatched. Specifically, a taxi company or the like can select a driver suitable for a user using the notified first attribute. For example, if the type of communication language estimated from the user's appearance is English or Chinese, it is possible to increase the user's satisfaction by selecting a driver who can converse in these languages. In addition, depending on the travel purpose (business, tourism, etc.) estimated from the user's appearance, a driver who is familiar with nearby shared offices and workplaces or a driver who is qualified as a tourist guide can be assigned.
[0046] Similarly, for the second attribute, it is possible to increase the satisfaction of the user by selecting an appropriate vehicle according to the handicap estimated from the user's appearance. For example, if the user is in a wheelchair, a vehicle with a lift can be assigned. In addition, if the communication language and the purpose of the trip are detected as the second attribute, it is possible to assign a vehicle equipped with an interpretation terminal and a foreign language voice guidance function.
[0047] Also in this embodiment, as in the first embodiment, a confirmation unit 103 for confirming whether or not the user is wearing a mask may be provided. This makes it possible to provide in advance information on whether or not the person who has made the vehicle dispatch request is wearing a mask, in addition to information for allocating a vehicle and driver suitable for the user.
[0048] Although each embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiments, and further modifications, substitutions, and adjustments can be made without departing from the basic technical idea of the present invention. For example, the device configurations, element configurations, and data expression forms shown in the drawings are examples to help understand the present invention, and the present invention is not limited to the configurations shown in these drawings.
[0049] For example, in the above-mentioned second embodiment, the first attribute and the second attribute are described as being detected, but it is also possible to change the configuration to detect only one of the first attribute or the second attribute.
[0050] The procedures shown in the above-described embodiments can be realized by a program that causes a computer (9000 in FIG. 6) functioning as the passenger information collection system 100, 100a to realize the functions of the passenger information collection system 100, 100a. Such a computer is exemplified by a configuration including a CPU (Central Processing Unit) 9010, a communication interface 9020, a memory 9030, and an auxiliary storage device 9040 in FIG. 6. That is, an image acquisition program and a class classification program may be executed by the CPU 9010 in FIG. 6.
[0051] In other words, each part (processing means, function) of the above-mentioned passenger information collection systems 100, 100a can be realized by a computer program that causes a processor installed in these devices to execute each of the above-mentioned processes using its hardware.
[0052] Finally, preferred embodiments of the present invention will be summarized. [First form] (See passenger information collection system from the first perspective above) [Second Form] The passenger information collection system further includes: a first attribute detection means for detecting a first attribute for assigning a suitable driver to a person based on an image of the person in the image; The transmission means may be configured to transmit information about the first attribute to a terminal of a company to which a dispatch request for the taxi is made. [Third Form] The first attribute is a communication language estimated from the person's appearance, The transmission means may be configured to transmit information about the communication language estimated as the first attribute to a terminal of a company to which a taxi dispatch request is made. [Fourth Form] The first attribute is a travel purpose estimated from the person's clothing or belongings, The transmission means may be configured to transmit information about the travel purpose estimated as the first attribute to a terminal of a company to which a taxi dispatch request is made. [Fifth Form] The passenger information collection system further includes: a second attribute detection means for detecting a second attribute for allocating a vehicle suitable for a person based on an image of the person in the image; The transmission means may be configured to transmit information about the second attribute to a terminal of a company to which a dispatch request for the taxi is made. [Sixth Form] The second attribute is the content of a handicap estimated from the person's appearance, The transmission means may be configured to transmit information regarding the handicap estimated as the second attribute to a terminal of a company to which a request for dispatching a taxi is made. [7th form] The second attribute is a language of communication or a travel purpose estimated from the person's clothing or belongings, The transmission means may be configured to transmit information about the communication language estimated as the second attribute or information about the travel purpose to a terminal of a company to which a taxi dispatch request is made. [8th form] (See the second point above on how to collect passenger information) [9th form] (See the program for the third perspective above) The eighth and ninth embodiments can be expanded into the second to seventh embodiments in the same manner as the first embodiment.
[0053] The disclosures of the above patent documents are incorporated herein by reference and may be used as the basis or part of the present invention as necessary. Within the framework of the entire disclosure of the present invention (including the scope of claims), modifications and adjustments of the embodiments and examples are possible based on the basic technical ideas. Furthermore, within the framework of the disclosure of the present invention, various combinations or selections (including partial deletions) of various disclosed elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, the present invention naturally includes various modifications and corrections that a person skilled in the art would be able to make in accordance with the entire disclosure including the scope of claims and the technical ideas. In particular, with regard to the numerical ranges described in this document, any numerical value or small range included in the range should be construed as being specifically described even if not otherwise specified. Furthermore, the disclosures of the above cited documents may be used in part or in whole in combination with the disclosures of this document as part of the disclosure of the present invention in accordance with the spirit of the present invention as necessary, and are deemed to be included in the disclosures of this application. [Explanation of symbols]
[0054] 10, 100, 100a Passenger Information Collection System 11 Receiving means 12 Image Acquisition Method 13 Verification methods 14 Transmission Method 20,200 terminals 30, 300 cameras 40,400 dispatch system 101 Receiving unit 102 Image acquisition unit 103 Verification Department 104, 104a Transmitter 105 Classifier 105a, 105b Multi-class classifier 106 Attribute detection unit 9000 Computers 9010 CPU 9020 Communication Interface 9030 Memory 9040 Auxiliary storage device
Claims
1. Images can be acquired from cameras installed around the road. A receiving means for receiving information of a user who has made a reservation from a vehicle dispatching system that dispatches passenger vehicles; an image acquisition means for acquiring an image of a person who has made a taxi dispatch request from the camera based on the user information; A verification means for verifying whether or not a person is wearing a mask based on an image of the person in the image; A transmission means for transmitting information as to whether or not a person who has made a taxi dispatch request is wearing a mask to a terminal of a company to which the taxi dispatch request is made, the receiving means receives an image capturing request from the user before the image capturing means captures an image; A passenger information collection system, wherein the image acquisition means acquires an image of the person who made the vehicle dispatch request when the image acquisition means receives the image capture request.
2. moreover, a first attribute detection means for detecting a first attribute for assigning a suitable driver to a person based on an image of the person in the image; The transmission means transmits information regarding the first attribute to a terminal of a company to which the dispatch request for the taxi is made. The passenger information collection system according to claim 1.
3. the first attribute is a communication language estimated from the person's appearance; The transmission means transmits information regarding the communication language estimated as the first attribute to a terminal of a company to which the taxi dispatch request is made. The passenger information collection system according to claim 2.
4. The first attribute is a travel purpose estimated from clothing or belongings of the person, The transmission means transmits information regarding the travel purpose estimated as the first attribute to a terminal of a company to which the taxi dispatch request is made. The passenger information collection system according to claim 2.
5. moreover, a second attribute detection means for detecting a second attribute for allocating a vehicle suitable for a person based on an image of the person in the image; The transmission means transmits information regarding the second attribute to a terminal of a company to which the dispatch request for the taxi is made.
5. A passenger information collection system according to claim 1.
6. The receiving means further receives user information including location information of the user, 2. The passenger information collection system according to claim 1, wherein the image acquisition means acquires the images by panning, tilting and zooming the camera in the vicinity of a position specified by the position information, based on the position information.
7. The second attribute is a language of communication or a travel purpose estimated from the person's clothing or belongings, The transmission means transmits the information on the communication language or the information on the travel purpose estimated as the second attribute to a terminal of a company to which the taxi dispatch request is made. The passenger information collection system according to claim 5.
8. A passenger information collection system that can obtain images from cameras installed around the road Receive information about the user who made the reservation from a vehicle dispatch system that dispatches passenger vehicles, When a photographing request is received from the user, an image of the person who has made the taxi dispatch request is obtained from the camera based on the information of the user, determining whether the person is wearing a mask based on an image of the person in the image; Transmitting information as to whether or not the person who has made the taxi dispatch request is wearing a mask to a terminal of a company to which the taxi dispatch request is made; How passenger information is collected.
9. A computer that can acquire images from cameras installed around the road A process of receiving information of a user who has made a reservation from a vehicle dispatch system that dispatches passenger vehicles; receiving a photographing request from the user; When a photographing request is received from the user, a process of acquiring an image of the person who has made the taxi dispatch request from the camera based on information of the user; determining whether or not the person is wearing a mask based on an image of the person in the image; A process of transmitting information as to whether or not a person who has made a taxi dispatch request is wearing a mask to a terminal of a company to which the taxi dispatch request is made; A program that executes the following.
Citation Information
Patent Citations
Facial shelter wearing detection method and device, electronic equipment and storage medium
CN111598021A
Taxi dispatching system
JP2005250614A
Vehicle dispatch management device
JP2006276961A
Operation input device, sales data processor and program
JP2017219909A
Order pairing system and method
JP2018511121A
