Assistance guide display control apparatus, assistance guide display control method, and assistance guide display control program
The assistance guidance display control device addresses the lack of tailored assistance at ticket gates by providing personalized guidance through image acquisition, identification, and display control, enhancing accessibility for disabled passengers.
Patent Information
- Application Number
- JP2024026706
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-26
- Publication Date
- 2025-09-05
AI Technical Summary
Existing systems fail to provide tailored assistance guidance near ticket gates for individuals requiring assistance, such as those with disabilities, after they pass through.
An assistance guidance display control device that includes image acquisition, person identification, determination, and display control means to provide personalized assistance guidance near ticket gates based on user identification.
Enables the display of appropriate assistance guidance for users requiring help near ticket gates, reducing the burden on station staff and improving accessibility for disabled passengers.
Smart Images

Figure 2025129806000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to an assistance guidance display control device, an assistance guidance display control method, and an assistance guidance display control program. [Background technology]
[0002] A mobility assistance server is known that, in accordance with a request for assistance notified from a communication terminal for a disabled person, notifies a communication terminal for a facility at a station that has received the request for assistance from the communication terminal for the disabled person of the request for assistance, the name of the disabled person to be assisted, the date and time of the disabled person's travel, the departure station, the destination station, and the location at the station where the disabled person will be assisted (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-038623 Summary of the Invention [Problem to be solved by the invention]
[0004] However, Patent Document 1 does not mention at all that when a user requiring assistance passes through a ticket gate, guidance information related to assistance tailored to the user is displayed near the ticket gate, and there is room for improvement in this regard.
[0005] In view of the above-mentioned problems, the object of the present disclosure is to provide an assistance guidance display control device, an assistance guidance display control method, and an assistance guidance display control program that can display guidance information related to assistance appropriate for a user requiring assistance near a ticket gate when the user passes through the ticket gate. [Means for solving the problem]
[0006] The assistance guidance display control device according to the first aspect of the present disclosure comprises an image acquisition means for acquiring an image of a person passing through a ticket gate, a person identification means for identifying the person based on the acquired image, a determination means for determining whether the person is a person requiring assistance, and a display control means for controlling a display device to display guidance information related to assistance corresponding to the identified person if the person is determined to be a person requiring assistance.
[0007] In a second aspect of the present disclosure, a method for controlling the display of assistance guidance involves a computer acquiring an image of a person passing through a ticket gate, identifying the person based on the acquired image, determining whether the person is a person requiring assistance, and, if determined to be a person requiring assistance, controlling a display device to display guidance information related to assistance appropriate for the identified person.
[0008] The assistance guidance display control program according to the third aspect of the present disclosure is an assistance guidance display control program that causes a computer to execute the following processes: acquiring an image of a person passing through a ticket gate; identifying the person based on the acquired image; determining whether the person is a person requiring assistance; and, if the person is determined to be a person requiring assistance, controlling a display device to display guidance information related to assistance corresponding to the identified person. [Effects of the Invention]
[0009] The present disclosure provides an assistance guidance display control device, an assistance guidance display control method, and an assistance guidance display control program that can display guidance information related to assistance appropriate for a user requiring assistance near a ticket gate when the user passes through the ticket gate. [Brief explanation of the drawings]
[0010] [Figure 1] FIG. 2 is a schematic diagram of the assistance guidance display control device 30. [Figure 2] 10 is a flowchart illustrating an example of the operation of the assistance guidance display control device 30. [Figure 3] 1 is a block diagram showing the configuration of an assistance guidance display control system 1. FIG. [Figure 4] FIG. 2 is a system configuration diagram of the assistance guidance display control device 30. [Figure 5] (a) is an example of an authentication result image 31b1 indicating an authentication failure, and (b) is an example of an authentication result image 31b2 indicating an authentication success. [Figure 6] 10 is a flowchart of an example of operation of the assistance guidance display control device 30 (after passing through the ticket gate). [Figure 7] 10 is a flowchart of an example of operation of the predetermined system 20 (an example of operation for notifying the mobile terminal 70 after passing through a ticket gate). [Figure 8] (a) An example of a screen showing the search results of a route search performed by the person U1 requiring assistance using a specific app installed on his / her mobile device 70, and (b) an example of a notification (guidance information related to assistance appropriate to the person requiring assistance) displayed on the display 71 of the mobile device 70. [Figure 9] 10 is a flowchart of an example of operation of the predetermined system 20 (an example of operation for notifying the station staff terminal 90). DETAILED DESCRIPTION OF THE INVENTION
[0011] (Embodiment 1) First, an example of the configuration of the care-giver guidance display control device 30 that constitutes the care-giver guidance display control system 1 of the first embodiment will be described with reference to FIG.
[0012] FIG. 1 is a schematic diagram of the assistance guidance display control device 30. As shown in FIG.
[0013] As shown in Figure 1, the assistance guidance display control device 30 includes an image acquisition means 32a that acquires an image including a person passing through a ticket gate, a person identification means 32b that identifies the person based on the acquired image, a determination means 32g that determines whether the person is a person requiring assistance, and a display control means 32f that, if the person is determined to be a person requiring assistance, controls the display device to display guidance information related to assistance corresponding to the identified person.
[0014] Next, an example of the operation of the assistance guidance display control device 30 having the above configuration will be described.
[0015] FIG. 2 is a flowchart showing an example of the operation of the assistance guidance display control device 30.
[0016] First, the image acquisition means 32a acquires an image including a person passing through a ticket gate (step S1). Next, the person identification means 32b identifies the person based on the acquired image (step S2). Next, the determination means 32g determines whether the person is a person requiring assistance (step S3). Next, if the person is determined to be a person requiring assistance, the display control means 32f controls the display device to display guidance information related to assistance corresponding to the identified person.
[0017] As described above, according to embodiment 1, when a user requiring assistance passes through a ticket gate, guidance information related to assistance appropriate for the user (for example, guidance information I1, I2 shown in Figure 3) can be displayed near the ticket gate (for example, on a display device installed near the ticket gate or on the floor in front of the user).
[0018] (Embodiment 2) The assistance guidance display control system 1 will be described in detail below as a second embodiment of the present invention. Hereinafter, an image acquisition unit is used as the image acquisition means 32a. Hereinafter, this will be referred to as the image acquisition unit 32a. Furthermore, a person identification unit is used as the person identification means 32b. Hereinafter, this will be referred to as the person identification unit 32b. Furthermore, a determination unit is used as the determination means 32g. Hereinafter, this will be referred to as the determination unit 32g. Furthermore, a display control unit is used as the display control means 32f. Hereinafter, this will be referred to as the display control unit 32f.
[0019] Hereinafter, a description will be given of an assistance guide display control system 1 according to a second embodiment of the present disclosure.
[0020] FIG. 3 is a block diagram showing the configuration of the assistance guidance display control system 1. As shown in FIG.
[0021] First, an outline of the assistance guide display control system 1 will be described.
[0022] When one or more users (for example, users U1 to U3) pass through a gateless ticket barrier 80, the assistance guidance display control system 1 performs facial authentication of the users and determines whether or not the users request assistance (hereinafter referred to as "assistance recipients"), and if the facial authentication is successful and the users are deemed to be assistance recipients, it displays guidance information related to assistance appropriate for the users on a display 51 provided near the ticket barrier 80. The display 51 may display multiple pieces of guidance information appropriate for multiple users.
[0023] Guidance information related to assistance is generated based on destination information for the person requiring assistance. The arrow I1 displayed on the display 51 in FIG. 3 is an example of guidance information related to assistance generated based on destination information for the person requiring assistance U1. The arrow I1 is information guiding the person to (the direction of) a meeting place with the station staff member who will provide assistance. The meeting place may be a meeting place at the boarding station or a meeting place at the disembarking station. Guidance information related to assistance may also be displayed on the floor along which the person requiring assistance moves. Symbol I2 in FIG. 3 is an example of guidance information related to assistance for the person requiring assistance U1, displayed on the floor in front of the person requiring assistance U1. Without being limited to this, the guidance information may also include the user's name, appearance, and waiting (meeting) place.
[0024] The guidance information related to assistance is displayed together with the avatar image AG (see FIG. 3). That is, the guidance information related to assistance is displayed in association with the avatar image. For example, the guidance information related to assistance is displayed superimposed on the avatar image AG (see FIG. 3). The guidance information related to assistance may also be displayed near the avatar image AG (not shown).
[0025] The facial recognition and the display of guidance information related to assistance are performed before the person to be assisted passes through the ticket gate 80, for example, when the person to be assisted (e.g., person to be assisted U1) moving (e.g., walking) toward the ticket gate 80 reaches a position a predetermined distance (e.g., several meters) from the ticket gate 80. Therefore, the person to be assisted whose facial recognition has been successful can check the guidance information related to assistance appropriate for that person while moving toward the ticket gate 80. At that time, the guidance information related to assistance is displayed together with the avatar image AG, so that even if multiple pieces of guidance information appropriate for each of the other users are displayed on the display 51 of the display device 50, the person to be assisted can easily identify the guidance information related to assistance appropriate for that person by using the avatar image AG of that person as a landmark.
[0026] After the person requiring assistance passes through the ticket gate 80, the assistance guide display control system 1 notifies the person requiring assistance who has passed through the ticket gate 80 of the assistance-related guidance information displayed on the display 51 of the display device 50 or information with the same content. Therefore, even after passing through the ticket gate 80, the person requiring assistance can check the assistance-related guidance information appropriate for that person by displaying it on the display 71 of the mobile terminal 70 carried by that person. In addition, the assistance guide display control system 1 notifies the station staff terminal 90 that the person requiring assistance has arrived. Therefore, the station staff can know that the person requiring assistance has arrived by checking the notification on the display of the station staff terminal 90.
[0027] Next, the assistance guide display control system 1 will be described in detail.
[0028] As shown in Figure 3, the assistance guidance display control system 1 includes an authentication device 10, a predetermined system 20, an assistance guidance display control device 30, a camera 40, a display device 50, a projection device 60, a mobile terminal 70, and a station staff terminal 90, which are capable of communicating with each other via a network NW (e.g., the Internet).
[0029] When the authentication device 10 receives an authentication request transmitted from the caregiver guidance display control device 30, it detects a facial area in the image included in the authentication request and extracts facial feature information based on the facial area. Then, the authentication device 10 compares the extracted facial feature information with the facial information database, and if the facial feature information matches (i.e., the user is identified), it returns authentication success and the user ID of the identified user to the caregiver guidance display control device 30 that sent the authentication request. On the other hand, if the facial feature information does not match (i.e., the user is not identified), it returns authentication failure to the caregiver guidance display control device 30 that sent the authentication request.
[0030] The predetermined system 20 is realized by, for example, a physical server or a virtual server. The predetermined system 20 includes a user information database 21 (see FIG. 3). The user information database 21 stores destination information, an assistance desire flag, an avatar image, and an email address in association with a user ID. The destination information is destination information of a user having a user ID corresponding to the destination information. The assistance desire flag is information indicating whether the user having the user ID desires assistance. The assistance desire flag is an example of assistance recipient information of the present disclosure. The avatar image is an image unique to each user. The email address is the email address of the user having the user ID corresponding to the email address. The destination information, assistance desire flag, avatar image, and email address are stored (set) in advance in the user information database 21 by the user (person receiving assistance) operating an information processing terminal such as a mobile terminal.
[0031] The predetermined system 20 is, for example, a station system installed within a station, but may also be installed outside the station. When the predetermined system 20 receives a destination acquisition request transmitted from the assistance guidance display control device 30, it refers to the user information database 21, reads out the destination information and assistance desire flag associated with the user ID included in the destination acquisition request from the user information database 21, and returns the read destination information and assistance desire flag to the assistance guidance display control device 30 that sent the destination acquisition request.
[0032] In addition, when the specified system 20 receives a guidance information generation request sent from the assistance guidance display control device 30, it refers to a specified database (not shown) and generates guidance information (guidance information related to assistance) that provides guidance to a meeting place with station staff who will provide assistance, which is located on the way to the destination (destination information) included in the guidance information generation request, and returns the generated guidance information to the assistance guidance display control device 30 that sent the guidance information generation request.
[0033] Furthermore, when the specified system 20 receives a request to determine who needs assistance sent from the assistance guidance display control device 30, it refers to the user information database 21, reads out the assistance desire flag (information indicating whether the user of the user ID desires assistance or not) associated with the user ID included in the assistance requirement determination request, and returns the read assistance desire flag to the assistance guidance display control device 30 that sent the assistance requirement determination request.
[0034] FIG. 4 is a system configuration diagram of the assistance guidance display control device 30.
[0035] As shown in FIG. 4, the assistance guidance display control device 30 includes a storage unit 31, a control unit 32, a memory 33, and a communication unit .
[0036] The storage unit 31 is a non-volatile storage unit such as a hard disk drive, a ROM, etc. The storage unit 31 stores a program 31a and an authentication result image 31b.
[0037] The program 31a is a program executed by the control unit 32 (processor). In Fig. 5(a), reference numeral 31b1 is an example of an authentication result image that is displayed when the authentication result is authentication failure. In Fig. 5(b), reference numeral 31b2 is an example of an authentication result image that is displayed when the authentication result is authentication success.
[0038] The control unit 32 includes a processor (not shown). The processor is, for example, a CPU (Central Processing Unit). There may be one processor or multiple processors. The processor executes a program 31a loaded from the storage unit 31 into a memory 33 (for example, a RAM) to function as an image acquisition unit 32a, a person identification unit 32b, an authentication result acquisition unit 32c, a destination information acquisition unit 32d, a guidance information generation unit 32e, a display control unit 32f, and a determination unit 32g. Some or all of these may be realized by hardware.
[0039] The image acquisition unit 32a acquires an image (hereinafter also referred to as a captured image) including a user (person to be authenticated) in front of the ticket gate 80, captured by the camera 40. Specifically, the communication unit 34 receives the captured image transmitted from the camera 40, and the image acquisition unit 32a acquires the captured image received by the communication unit 34.
[0040] The person identification unit 32b identifies a user by face authentication, iris authentication, skeletal authentication, or biometric authentication. For example, in the case of face authentication, the person identification unit 32b transmits an authentication request to the authentication device 10 via the communication unit 34. The authentication request includes the captured image acquired by the image acquisition unit 32a.
[0041] The authentication result acquisition unit 32c acquires the result of face authentication executed by the authentication device 10. Specifically, the communication unit 34 receives the authentication result transmitted from the authentication device 10, and the authentication result acquisition unit 32c acquires the authentication result received by the communication unit 34.
[0042] The determination unit 32g determines whether the person identified by the person identification unit 32b is a person requiring assistance. For example, the determination unit 32g transmits an assistance recipient determination request to the predetermined system 20, and acquires an assistance desire flag returned by the predetermined system 20 in response to the request. The assistance recipient determination request includes the user ID of the user (person requiring assistance) requesting the request. The determination unit 32g determines whether the person identified by the person identification unit 32b is a person requiring assistance based on the assistance desire flag.
[0043] The determination unit 32g may determine whether the person identified by the person identification unit 32b is a person requiring assistance, based on the image acquired by the image acquisition unit 32a. For example, if the image acquired by the image acquisition unit 32a shows the person identified by the person identification unit 32b in a wheelchair or using a cane, the determination unit 32g may determine that the person identified by the person identification unit 32b is a person requiring assistance.
[0044] The destination information acquisition unit 32d transmits a destination information acquisition request to the predetermined system 20, and acquires the destination information and assistance request flag returned by the predetermined system 20 in response. The destination information acquisition request includes the user ID of the user requesting the request (for example, the person receiving assistance). Note that the destination information acquisition unit 32d may acquire the destination information from anywhere, as long as it acquires destination information set in a predetermined app (for example, a route guidance app) installed on the user's mobile terminal 70 or the like.
[0045] The guide information generating unit 32e transmits a guide information generation request to the predetermined system 20. The guide information generation request includes the destination information acquired by the destination information acquiring unit 32d.
[0046] When a notification of successful authentication is received, the display control unit 32f controls the display device 50 so that an authentication result image 31b2 (see FIG. 5(b)) indicating successful authentication is displayed on the display 51 of the display device 50. Furthermore, when a notification of successful authentication is received, the display control unit 32f controls the projection device 60 so that an authentication result image 31b2 (see FIG. 5(b)) indicating successful authentication is displayed on the road surface in front of the person to be assisted U1. On the other hand, when a notification of unsuccessful authentication is received, the display control unit 32f controls the display device 50 so that an authentication result image 31b1 (see FIG. 5(a)) indicating unsuccessful authentication is displayed on the display 51 of the display device 50. Furthermore, when a notification of unsuccessful authentication is received, the display control unit 32f controls the projection device 60 so that an authentication result image 31b1 (see FIG. 5(b)) indicating unsuccessful authentication is displayed on the road surface in front of the person to be assisted U1.
[0047] Furthermore, when the display control unit 32f receives guidance information related to assistance appropriate for the person to be assisted, it controls the display device 50 so that the received guidance information is displayed on the display 51 of the display device 50. Furthermore, when the display control unit 32f receives guidance information related to assistance appropriate for the person to be assisted, it controls the projection device 60 so that the received guidance information is displayed on the road surface in front of the person to be assisted U1.
[0048] The communication unit 34 is a communication device for communicating with the authentication device 10, the predetermined system 20, the camera 40, the display device 50, the projection device 60, the mobile terminal 70, and the like via the network NW.
[0049] The camera 40 captures an image including a user (person to be authenticated) moving in the area in front of the ticket gate 80 toward the ticket gate 80. The camera 40 is installed, for example, near the passageway through which the user moves so that it can capture an image of the user's face, i.e., the face of the user moving toward the ticket gate 80, from the front or nearly the front (i.e., so that it can capture an image at an angle suitable for face authentication). The camera 40 is, for example, a digital camera that is remotely controlled by the caregiver guidance display control device 30, and continuously captures images of the area in front of the ticket gate 80 and transmits the captured images (and the camera's identification information (such as a location ID)) to the caregiver guidance display control device 30 via the network NW.
[0050] The display device 50 includes a display 51 such as a liquid crystal display on which various information is displayed. The display 51 is disposed above the passageway through the ticket gate 80, across the passageway through which the user moves.
[0051] As shown in Fig. 3, the projection device 60 is provided near the passageway along which the user moves. The projection device 60 is, for example, but not limited to, a liquid crystal projector. The projection device 60 receives a projection instruction from the caregiver guidance display control device 30 via the network NW, and projects the guidance information included in the projection instruction into a projection area (a projection area set on the floor in front of the user) included in the projection instruction.
[0052] The mobile terminal 70 is a mobile terminal, such as a smartphone, carried by a user (for example, a person receiving care). The mobile terminal 70 includes a display 71 on which various information is displayed.
[0053] The station staff terminal 90 is a mobile terminal, such as a smartphone, carried by the station staff providing assistance. The station staff terminal 90 includes a display (not shown) on which various information is displayed.
[0054] Next, an example of operation of the assistance guidance display control system 1 configured as above (before passing through the ticket gate) will be described.
[0055] FIG. 6 is a flowchart of an example of the operation of the assistance guidance display control device 30 (after passing through the ticket gate).
[0056] An example of the operation when the person to be assisted U1 passes through the ticket gate 80 will be described below, as shown in Fig. 3. Hereinafter, it is assumed that the destination information, assistance request flag, avatar image, and email address of the person to be assisted U1 are stored (registered) in advance in the predetermined system 20 (user information database 21). It is also assumed that the boarding station and disembarking station of the person to be assisted U1 are set in advance in a predetermined app (for example, a route guidance app) installed on the mobile terminal 70 of the person to be assisted U1. Fig. 8(a) is an example of a screen showing the results of a route search performed by the person to be assisted U1 using a predetermined app installed on his / her mobile terminal 70.
[0057] First, it is determined whether or not the conditions for passing through the ticket gate are met (step S10). This determination is made, for example, when the person U1 to be assisted reaches a position a predetermined distance (for example, several meters) from the ticket gate 80. For example, if the person U1 to be assisted has a ticket to the destination or has a charge balance of more than a predetermined amount, it is determined that the conditions for passing through the ticket gate are met.
[0058] Next, authentication processing (face authentication processing) is executed (step S11). Specifically, first, the image acquisition unit 32a acquires an image (captured image) including the person to be assisted (person to be authenticated) in front of the ticket gate 80, captured by the camera 40. Next, the person identification unit 32b transmits an authentication request to the authentication device 10 via the communication unit 34. The authentication request includes the captured image acquired by the image acquisition unit 32a. Next, the authentication result acquisition unit 32c acquires the authentication result of the face authentication executed by the authentication device 10. If the authentication result is successful, the authentication result includes the user ID. In this manner, the authentication processing (face authentication processing) is executed.
[0059] Next, the authentication result received from the authentication device 10 is displayed on the display 51 of the display device 50 (step S12). This is realized by the display control unit 32f.
[0060] FIG. 5(a) is an example of an authentication result image 31b1 indicating an authentication failure, and FIG. 5(b) is an example of an authentication result image 31b2 indicating an authentication success.
[0061] When the display control unit 32f receives a message indicating successful authentication, the display control unit 32f controls the display device 50 so that an authentication result image 31b2 (see FIG. 5(b)) indicating successful authentication is displayed on the display 51 of the display device 50. At this time, the charge balance, etc. may be displayed on the display 51 of the display device 50. On the other hand, when the display control unit 32f receives a message indicating unsuccessful authentication, the display control unit 32f controls the display device 50 so that an authentication result image 31b1 (see FIG. 5(a)) indicating unsuccessful authentication is displayed on the display 51 of the display device 50.
[0062] Next, if the authentication result indicates successful face authentication (step S13: YES), the determination unit 32g determines whether the person identified by the person identification unit 32b, i.e., the user whose face authentication was successful in step S13, is a person requiring assistance (step S14). This is achieved by the determination unit 32g. For example, the determination unit 32g transmits a request for assistance recipient determination to the predetermined system 20, and acquires an assistance desire flag returned by the predetermined system 20 in response. The assistance recipient determination request includes the user ID of the user (person requiring assistance) requesting this. The determination unit 32g determines whether the person identified by the person identification unit 32b is a person requiring assistance based on this assistance desire flag.
[0063] Next, if the determination result is that the user is a person requiring assistance (step S14: YES), destination information is acquired (step S15). This is achieved by the destination information acquisition unit 32d. The destination information acquisition unit 32d transmits a destination information acquisition request to the predetermined system 20, and acquires the destination information returned by the predetermined system 20 in response. The destination information acquisition request includes the user ID of the user (person requiring assistance) requesting it.
[0064] Next, guidance information related to assistance is generated (step S16). Specifically, the guidance information generation unit 32e transmits a request for generating guidance information to the predetermined system 20, and acquires guidance information related to assistance corresponding to the assistance recipient returned by the predetermined system 20 in response. The guidance information generation request includes the destination information acquired by the destination information acquisition unit 32d. Note that the guidance information related to assistance may be generated by the assistance guidance display control device 30 (guidance information generation unit 32e) itself.
[0065] Next, guidance information related to assistance is displayed on the display 51 of the display device 50 (step S16). This is achieved by the display control unit 32f. When guidance information related to assistance tailored to the person to be assisted is received, the display control unit 32f controls the display device 50 so that the received guidance information (see, for example, guidance information I1 in FIG. 3) is displayed on the display 51 of the display device 50. When guidance information related to assistance tailored to the person to be assisted is received, the display control unit 32f controls the projection device 60 so that the received guidance information (see, for example, guidance information I2 in FIG. 3) is displayed on the road surface ahead of the person to be assisted U1. Note that guidance information related to assistance tailored to the person to be assisted may be displayed on both the display 51 of the display device 50 and the road surface ahead of the person to be assisted U1, or may be displayed on only one of them.
[0066] Next, an example of the operation of the assistance guidance display control system 1 configured as above (after passing through the ticket gate) will be described.
[0067] FIG. 7 is a flowchart of an example of operation of the predetermined system 20 (an example of operation for notifying the mobile terminal 70 after passing through a ticket gate).
[0068] When the transmission timing arrives after the person requiring assistance has passed through the ticket gate 80 (step S20: YES), the predetermined system 20 transmits a notification to the mobile device 70 carried by the person requiring assistance who has passed through the ticket gate 80 (step S21). Specifically, the predetermined system 20 references the user information database 21 and transmits the notification to the email address corresponding to the user ID of the person requiring assistance who has passed through the ticket gate 80. FIG. 8(b) is an example of a notification (guidance information related to assistance for the person requiring assistance) sent to the mobile device 70 and displayed on its display 71. The notification sent to the mobile device 70 carried by the person requiring assistance may be the screen shown in FIG. 8(b) itself, or address information (e.g., a URL) for accessing the screen. In addition, in the case of FIG. 8(b), each sentence in the figure may be a push notification. By sending each notification (guidance display) via push notification and displaying it in real time on the display 71 of the mobile device 70, the person requiring assistance can check the guidance display without opening a dedicated page. The notifications that may be displayed on the display 71 of the mobile terminal 70 include, for example, notifications informing the user of the station staff's status, such as "Station staff will be arriving shortly," as well as notifications providing elevator information and directions and time to reach the destination, such as "There is an elevator at the A3 exit, and it will take 3 minutes to reach your destination, City Hall."
[0069] FIG. 9 is a flowchart of an example of operation of the predetermined system 20 (an example of operation for notifying the station staff terminal 90).
[0070] When the transmission timing arrives (step S30: YES), the predetermined system 20 notifies the station staff terminal 90 that the person requiring assistance has arrived (step S31). The transmission timing occurs when the determination result in step S14 is that the person requiring assistance is a person requiring assistance (step S14: YES) or when the person requiring assistance passes through the ticket gate 80. Therefore, the station staff can know that the person requiring assistance has arrived by checking the notification on the display of the station staff terminal 90. The station staff terminal 90 may be installed at the boarding station or at the disembarking station.
[0071] As described above, according to embodiment 2, when a user requiring assistance passes through a ticket gate 80, guidance information related to assistance appropriate for the user (for example, guidance information I1, I2 shown in Figure 3) can be displayed near the ticket gate, for example, on a display device 50 (display 51) installed near the ticket gate or on the floor in front of the user requiring assistance.
[0072] Furthermore, according to the second embodiment, by providing guidance related to assistance according to the person requiring assistance (guidance linked to transfer guidance), it becomes possible for passersby to transfer and arrive at their destination without getting lost even in places they have never seen before.
[0073] Furthermore, according to the second embodiment, guidance displays related to assistance according to the person requiring assistance are displayed on a display device 50 (display 51) installed near the ticket gate, making it easier for nearby users to call out to the person, allowing the users to resolve the issue among themselves and reducing the burden of providing guidance on the part of station staff.
[0074] Furthermore, according to the second embodiment, after passing through the ticket gate, it is possible to send a notification (notification of guidance information) to the mobile terminal carried by the person to be assisted, so that the person to be assisted can check the guidance information again after passing through the ticket gate.
[0075] Furthermore, according to the second embodiment, cooperation with the assistance support SL for station staff enables smoother cooperation between station staff, without users having to wait due to misunderstandings about the time when using the service for those requesting assistance. It also enables labor-saving in the guidance work of station staff. It also enables promotion of barrier-free access to public transportation (improving convenience for handicapped passengers). The assistance support SL is an app that smoothly shares information about a passenger's clothing and boarding position between station staff between boarding and alighting stations when a passenger requiring assistance boards the service. This app reduces the station staff's labor and reduces communication errors. Therefore, by combining it with the assistance support display control system 1 (face recognition assistance support display), smooth assistance support can be realized from the perspectives of both the passenger and the station staff.
[0076] As described above, according to the second embodiment, it is possible to reduce the labor required for station staff to provide guidance and improve convenience for those requiring assistance.
[0077] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.
[0078] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate without departing from the spirit of the present disclosure. For example, in the above-described second embodiment, an example in which the display device 50 is installed in a gateless ticket gate 80 has been described, but the present disclosure is not limited to this, and the display device 50 may also be installed in a ticket gate with a gate (not shown). Furthermore, the ticket gate 80 may be configured to allow multiple users to pass through at the same time, or to allow multiple users to line up in a line and pass through sequentially.
[0079] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.
[0080] (Appendix 1) image acquisition means for acquiring an image of a person passing through a ticket gate; a person identification means for identifying a person based on the acquired image; a determination means for determining whether the person is a person requiring assistance; and a display control means for controlling the display device to display guidance information related to assistance according to the identified person when the identified person is determined to be an assistance recipient.
[0081] (Appendix 2) The assistance guidance display control device according to claim 1, wherein the determination means determines whether the person is a person requiring assistance based on assistance recipient information of the identified person that is stored in advance.
[0082] (Appendix 3) further comprising a destination information means for acquiring pre-stored destination information of the identified person; The display control means controls the display device to display guidance information related to assistance corresponding to the identified person based on the acquired destination information.
[0083] (Appendix 4) 2. The assistance guidance display control device according to claim 1, wherein the determination means determines whether or not the person is a person requiring assistance based on the acquired image.
[0084] (Appendix 5) The assistance guidance display control device according to claim 1, wherein the display control means controls the display device to display guidance information related to assistance corresponding to the identified person in association with an avatar image specific to the identified person.
[0085] (Appendix 6) The assistance guidance display control device described in Appendix 1, wherein the display control means controls a projection device to display guidance information related to assistance corresponding to the identified person on the road surface in front of the identified person.
[0086] (Appendix 7) 2. The assistance guidance display control device according to claim 1, wherein the guidance information related to assistance is information providing guidance on a meeting place with the station staff member who will provide assistance.
[0087] (Appendix 8) 8. The assistance guidance display control device according to claim 7, wherein the assistance-related guidance information includes an arrow indicating the direction of the meeting place.
[0088] (Appendix 9) The display control means is an assistance guidance display control device described in Appendix 1 that controls a mobile terminal carried by the identified person so as to display guidance information related to assistance appropriate for the person at a predetermined timing after the identified person passes through the ticket gate.
[0089] (Appendix 10) An assistance guidance display control device as described in Appendix 1, which controls a station staff terminal to display that the identified person has arrived if the identified person is determined to be a person requiring assistance.
[0090] (Appendix 11) The computer Capture an image of a person passing through the ticket gate, Identifying a person based on the captured image; Determine whether the person is a care recipient; An assistance guidance display control method for controlling a display device so that, when a person is determined to be an assistance recipient, guidance information related to assistance corresponding to the identified person is displayed.
[0091] (Appendix 12) A process of acquiring an image of a person passing through a ticket gate; Identifying a person based on the acquired image; A process of determining whether the person is a person requiring assistance; and when the person is determined to be an assistance recipient, controlling the display device to display guidance information related to assistance appropriate for the identified person. [Explanation of symbols]
[0092] 1. Assistance guidance display control system 10 Authentication Device 20 Prescribed System 21 User Information Database 30 Assistance guidance display control device 31 Storage section 31a Program 31b Authentication result image 31b1, 31b2 authentication result images 32 Control section 32a Image acquisition unit (image acquisition means) 32b Person identification section (person identification means) 32c Authentication result acquisition unit 32d Destination information acquisition section 32e Guidance information generation unit 32f Display control unit (display control means) 33 Memory 34 Communications Department 40 Camera 50 Display device 51 Display 60 Projection equipment 70 Mobile Devices 71 Display 80 ticket gates AG butter images I1, I2 guide information U1~U3 users NW Network
Claims
1. image acquisition means for acquiring an image of a person passing through a ticket gate; a person identification means for identifying a person based on the acquired image; a determination means for determining whether the person is a person requiring assistance; and a display control means for controlling the display device to display guidance information related to assistance according to the identified person when the identified person is determined to be an assistance recipient.
2. The assistance guidance display control device according to claim 1 , wherein the determining means determines whether the person is an assistance recipient based on previously stored assistance recipient information of the identified person.
3. further comprising a destination information means for acquiring pre-stored destination information of the identified person; The assistance guidance display control device according to claim 1, wherein the display control means controls the display device to display guidance information related to assistance corresponding to the identified person based on the acquired destination information.
4. The assistance guidance display control device according to claim 1 , wherein the determining means determines whether or not the person is a person requiring assistance based on the acquired image.
5. The assistance guidance display control device according to claim 1, wherein the display control means controls the display device to display guidance information related to assistance corresponding to the identified person in association with an avatar image specific to the identified person.
6. 2. The assistance guidance display control device according to claim 1, wherein the display control means controls a projection device to display guidance information related to assistance corresponding to the identified person on the road surface in front of the identified person.
7. The assistance guidance display control device according to claim 1, wherein the display control means controls a portable terminal carried by the identified person so as to display guidance information related to assistance appropriate for the identified person at a predetermined timing after the identified person passes through the ticket gate.
8. The assistance guidance display control device according to claim 1, wherein, when the person is determined to be an assistance recipient, the device controls a station attendant terminal to display a message indicating that the identified person has arrived.
9. The computer Capture an image of a person passing through the ticket gate, Identifying a person based on the captured image; Determine whether the person is a care recipient; An assistance guidance display control method for controlling a display device so that, when a person is determined to be an assistance recipient, guidance information related to assistance corresponding to the identified person is displayed.
10. A process of acquiring an image of a person passing through a ticket gate; Identifying a person based on the acquired image; A process of determining whether the person is a person requiring assistance; and when the person is determined to be an assistance recipient, controlling the display device to display guidance information related to assistance appropriate for the identified person.
Citation Information
Patent Citations
Movement support server, handicapped person side communication terminal, facility side communication terminal, and movement support system
JP2016038623A