Touchpoint Device

Abstract

To facilitate mobile, interactive and / or contact-free operations in a process flow that can be used in a variety of facilities, such as an airport.SOLUTION: A touchpoint apparatus is configured to: detect a mobile device within an area defined by a virtual geographic boundary; receive identification information from the mobile device; acquire biometric information from an image captured by a camera in the vicinity of the apparatus; and based on a match between the identification information and the biometric information, perform at least one of: transmitting to the mobile device first information related to the area and displaying second information related to the area on a display of the apparatus so as to enable an application and one or more functions corresponding to the application on the basis of a workflow available for a person; and establishing an interface for performing a touchless interaction with a person associated with the mobile device.SELECTED DRAWING: Figure 2A

Description

[Technical Field]

[0001] The present disclosure relates to a touchpoint device, a touchpoint system, a touchpoint method, and a storage medium. More specifically, the present disclosure relates to a touchpoint device, a touchpoint system, a touchpoint method, and a storage medium for facilitating mobile, interactive, and / or contactless operation in a process flow that can be used in various facilities, such as airports. However, the present disclosure is not limited to process flows in airports. For example, one or more aspects of the present disclosure may be applied to other facilities or environments. [Background technology]

[0002] In large facilities such as public transportation, tourist attractions, amusement parks, etc., a user may be required to go through various procedures to enter or use the facility. For example, at an airport, a passenger intending to board an aircraft may be required to go through a process flow involving various procedures, such as check-in procedures, baggage drop-off procedures, security screening procedures, immigration procedures, or lounge access procedures, before boarding the aircraft. To facilitate the various steps in the process flow, touchpoints may be provided at different locations to obtain and process information from the user.

[0003] The world is currently experiencing the COVID-19 coronavirus pandemic, resulting in widespread social distancing measures. These measures and concerns about viral transmission have created an urgent and widespread need to limit contact with other people while still engaging in activities that require close proximity to others. Therefore, users visiting public facilities and engaging in essential process flows must perform the necessary steps with minimal contact with publicly accessible devices. Summary of the Invention

[0004] According to one or more aspects of the present disclosure, a touchpoint device, a touchpoint method, a touchpoint system, and a storage medium are provided to facilitate a process flow for a user, such as a passenger or visitor, to pass through a facility in a contactless and safe manner.

[0005] According to one aspect of the present disclosure, an apparatus is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to detect a mobile device entering an area defined by a virtual geographic boundary, receive authentication information from the mobile device upon entry into the area, and transmit information regarding the area to the mobile device based on verification of the authentication information.

[0006] The information about the area sent to the mobile device may be warning or guidance information.

[0007] The area information sent to the mobile device corresponds to the stage of a process within the airport in which the device is located.

[0008] The information about the area transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0009] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0010] The authentication information is biometric information of the user of the mobile device.

[0011] According to another aspect of the present disclosure, a mobile device is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to determine that the mobile device is entering an area defined by a virtual geographic boundary; enable an application in the mobile device to perform an interaction with an external device based on a determination that the mobile device is entering the area defined by the virtual geographic boundary; transmit authentication information to the external device; and receive information regarding the area from the external device based on verification of the authentication information.

[0012] The information about the area sent to the mobile device may be warning or guidance information.

[0013] The area information sent to the mobile device corresponds to the stage of a process within the airport in which the device is located.

[0014] The information about the area transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0015] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0016] According to another aspect of the present disclosure, an apparatus is provided that includes a camera; a display; a memory that stores one or more instructions; and a processor configured to execute the one or more instructions to detect a mobile device within an area defined by a virtual geographic boundary, receive identification information from the mobile device, obtain biometric information from an image captured by a camera in the vicinity of the apparatus, and, based on a match between the identification information and the biometric information, transmit information about the area to the mobile device, display the information about the area on a display, or establish an interface for touchless interaction with a person associated with the mobile device.

[0017] A touchless interaction is an interaction between a person and a device in which the interaction is performed without the person touching the device.

[0018] The interface is based on gesture control.

[0019] The interface is based on voice control.

[0020] The interface is head-control based.

[0021] The information about the area sent to the mobile device may be warning or guidance information.

[0022] The area information sent to the mobile device corresponds to the stage of a process within the airport in which the device is located.

[0023] The information about the area transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0024] The device may further comprise a chatbot configured to provide information about the area to the user.

[0025] The apparatus may further comprise a printer configured to print information about the area.

[0026] According to another aspect of the present disclosure, an apparatus is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to detect a mobile device entering an area defined by a virtual geographic boundary, receive authentication information from the mobile device, obtain biometric information from an image captured in the vicinity of the apparatus, and transmit information regarding the area to the mobile device based on matching the identification information with the biometric information.

[0027] The information about the area sent to the mobile device may be warning or guidance information.

[0028] The area information sent to the mobile device corresponds to the level in which the device is located among multiple levels within the airport.

[0029] The information about the area transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0030] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0031] According to another aspect of the present disclosure, a mobile device is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to determine that the mobile device is entering an area defined by a virtual geographic boundary, transmit identification information to an external device, and receive information regarding the area from the external device based on matching the identification information with biometric information.

[0032] The information about the area sent to the mobile device may be warning or guidance information.

[0033] The area information sent to the mobile device corresponds to the level in which the device is located among multiple levels within the airport.

[0034] The information about the area transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0035] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0036] According to another aspect of the present disclosure, an apparatus is provided comprising: a memory that stores one or more instructions; and a processor configured to execute the one or more instructions to detect a mobile device entering a first area of ​​a plurality of areas, each area designated for a different stage in airport passenger flow; receive identification information from the mobile device; acquire biometric information of a user of the mobile device from an image captured in the vicinity of the apparatus; transmit a touchpoint user interface for the first area to the mobile device based on a match between the identification information and the biometric information; receive user input information entered by the user via the touchpoint user interface; and perform airport operations for the first area based on the user input information.

[0037] The information about the first area that is sent to the mobile device is an alert or guidance information.

[0038] The information about the first area sent to the mobile device corresponds to the level in which the device is located, among multiple levels within the airport.

[0039] The information about the first area transmitted to the mobile device corresponds to an airline selected from the plurality of airlines based on the identification information received from the mobile device.

[0040] The information is a shared application that replicates an application used by a shared terminal in a first area of ​​the airport. [Brief explanation of the drawings]

[0041] [Figure 1A] FIG. 1 illustrates a process flow for passengers passing through an airport. [Figure 1B] FIG. 1 illustrates related technology used by airports to facilitate passenger process flow. [Figure 2A]FIG. 1 is a schematic diagram illustrating the configuration of a touchpoint system for facilitating a passenger's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment. [Figure 2B] FIG. 1 is a schematic diagram illustrating the configuration of a touchpoint system for facilitating a passenger's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment. [Figure 2C] FIG. 1 is a schematic diagram illustrating the configuration of a touchpoint system for facilitating a passenger's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment. [Figure 3] FIG. 1 illustrates geofencing, according to an exemplary embodiment. [Figure 4] FIG. 1 illustrates sensor fusion in accordance with an exemplary embodiment. [Figure 5] FIG. 1 illustrates proximity detection according to an exemplary embodiment. [Figure 6A] FIG. 1 illustrates a process for establishing a mobile interaction according to an exemplary embodiment. [Figure 6B] FIG. 1 illustrates a process for establishing a mobile interaction according to an exemplary embodiment. [Figure 6C] FIG. 1 illustrates a process for establishing a mobile interaction according to an exemplary embodiment. [Figure 7] FIG. 10 illustrates an interface for baggage drop-off in accordance with an exemplary embodiment. [Figure 8A] FIG. 1 illustrates an intelligent touch point (ITP) terminal 20 according to an exemplary embodiment. [Figure 8B] FIG. 1 illustrates an intelligent touch point (ITP) terminal 20 according to an exemplary embodiment. [Figure 9] FIG. 1 is a block diagram of a management server 10 according to an exemplary embodiment. [Figure 10] 8 is a block diagram of features of a mobile device 80 according to an example embodiment. [Figure 11] FIG. 2 is a block diagram of features of an ITP terminal 20, according to an exemplary embodiment. [Figure 12] FIG. 1 is a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. [Figure 13] FIG. 1 is a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. [Figure 14] FIG. 10 is a sequence diagram of operations in a touchpoint system according to another exemplary embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0042] Exemplary embodiments are described in more detail below with reference to the accompanying drawings. The following detailed description is provided to help readers gain a comprehensive understanding of the methods, devices, and / or systems described herein. However, the exemplary embodiments provided in this disclosure should not be considered as limiting the scope of the disclosure. Accordingly, various changes, modifications, and equivalents of the systems, devices, and / or methods described herein will be suggested to those skilled in the art.

[0043] The terms used herein are intended to describe embodiments only and are in no way limiting. Unless expressly used otherwise, singular terms include plural terms. As used herein, terms such as "including" are intended to specify features, numbers, steps, operations, elements, portions, or combinations thereof, and should not be interpreted as excluding the presence or possibility of one or more other features, numbers, steps, operations, elements, portions, or combinations thereof.

[0044] One or more exemplary embodiments of the present disclosure will be described below with reference to the drawings, in which identical or corresponding components are designated by the same reference numerals throughout the drawings, and descriptions thereof may be omitted or simplified.

[0045] FIG. 1A illustrates a passenger's process flow through an airport, and FIG. 1B illustrates related technologies used by airports to facilitate passengers' process flow through an airport. Currently, airports use common-use terminal equipment (CUTE), common-use self-service (CUSS), and common-use passenger processing systems (CUPPS). Common-use technologies generally include physical shared devices (i.e., check-in kiosks and computer terminals or workstations located at check-in counters, baggage drop areas, and / or boarding areas) intended to increase passenger throughput. In FIG. 1B, A1 indicates a queue at a CUSS kiosk. A2 indicates a passenger arriving at the airport. A3 indicates a passenger waiting in line to drop off their baggage. A4 indicates a passenger waiting in line at a check-in counter. A5 indicates a common-use self-service (CUSS) kiosk. A6 indicates a common-use terminal equipment (CUTE) within a check-in counter. Reference symbol A7 denotes a shared terminal device (CUTE) at the baggage counter.

[0046] The CUTE system allows multiple airlines to use and share the same existing airport infrastructure to control passenger and flight processing information to their respective airline applications. For example, a shared CUTE workstation may run an airline's host system, allowing airline personnel to interact directly with the host via a touch screen and / or keyboard interface to process passenger information.

[0047] CUSS systems are a solution currently being deployed in airports with the goal of facilitating and speeding up CUTE processes that require human interaction. For example, touchpoints such as self-service kiosks may activate an airline's host system, allowing passengers to interact directly with the host via a touchscreen and / or keyboard interface to input and process information.

[0048] As shown in FIG. 1B, passengers arriving at an airport may check in and process information to board an aircraft using a CUTE terminal operated by airline personnel at check-in and / or baggage counters (items A6 and A7) or self-service CUSS kiosks (item A5).

[0049] Recently, airlines and airports have not only been committed to improving passenger experience, but also concerned with protecting passenger health and safety. Specifically, combating COVID-19 and / or other diseases, which are easily spread, especially in public places, due to a lack of social / physical distancing, is crucial. However, shared technologies do not offer touchless / frictionless approaches to address such issues. For example, as shown in Figures 1A and 1B, CUTE and CUSS touchpoints are available for public use by the general traveling public. These shared devices require multiple physical interactions between many different passengers, potentially increasing passenger health concerns. To this end, a touchless and seamless solution for process flow in airports or other similar facilities is needed to combat the spread of COVID-19 and other contagious diseases.

[0050] Furthermore, the above-mentioned shared technologies have additional drawbacks, such as requiring airport real estate with a large environmental footprint, high infrastructure, energy and hardware costs, dependency on a limited number of common-use providers, and lengthy and expensive certification processes for managing different applications based on different providers. Therefore, there is a need for an improved system with enhanced process flows that allows airport space and actual conditions to be used more efficiently, ensuring efficient and cost-effective throughput while providing a more intuitive, clean and safe solution for passengers.

[0051] Furthermore, while virtualization solutions running on cloud networks may reduce the need for local data centers, the shared technologies mentioned above still require physical self-service touchpoints, thus the problems mentioned above remain.

[0052] FIG. 2A is a schematic diagram illustrating the configuration of a touchpoint system for facilitating a passenger U's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment.

[0053] 2A , the touchpoint system 1 according to the exemplary embodiment includes a management server 10, multiple intelligent touchpoint (ITP) terminals 20 provided in different areas in the process flow of a passenger U passing through an airport A, and a mobile device 80. For example, the multiple ITP terminals 20 may be provided in a check-in area P1, a baggage drop-off area P2, a security inspection area P3, an immigration and customs area P4, a signage area P5, and a boarding area P6. Here, the information processing system 1 may recognize and manage the process flow and status of a passenger U who is scheduled to board an aircraft within a facility such as airport A.

[0054] According to an exemplary embodiment, the management server 10 may be installed in airport A. According to another exemplary embodiment, the management server 10 may be installed in a remote location and connected to devices and infrastructure in the airport via a network NW. According to an exemplary embodiment, the management server 10 may be implemented based on cloud technology.

[0055] According to an exemplary embodiment, a check-in area P1 may be located in a lobby area P1 within airport A. Furthermore, an automated baggage drop machine 30 may be installed in a baggage counter area P2, a security inspection device 40 may be installed in a security inspection area P3, an automated gate device 50 may be installed in an immigration area P4, a signage terminal 60 may be installed in an aisle P5 within airport A, and a boarding gate device 70 may be installed in a boarding gate area P6. The aisle P5 is a passageway connecting the immigration area P4 and the boarding gate area P6. Passenger U can board an aircraft through the boarding gate P6. The mobile device 80 may be a portable electronic device carried by passenger U. For example, the mobile device 80 may be a smartphone, a laptop, a watch, or any other electronic device that passenger U may carry.

[0056] According to an exemplary embodiment, multiple surveillance cameras 90 may be installed at various locations within airport A. For example, surveillance cameras 90 are installed in a check-in lobby area P1, a baggage counter area P2, a security inspection area P3, an immigration area P4, a passageway area P5, and a boarding gate area P6.

[0057] According to an exemplary embodiment, the management server 10, the ITP terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, the boarding gate device 70, and the surveillance camera 90 are connected to a network NW. Furthermore, upon arrival at the airport, the mobile device 80 may be connected to the management server 10 and the ITP terminal 20 via the network NW. The network NW may be configured as a local area network (LAN), a wide area network (WAN), or a mobile communication network, including an in-house communication network of airport A. The mobile device 80 can be connected to the network NW wirelessly.

[0058] After arriving at airport A, a passenger U intending to board an aircraft passes through check-in lobby area P1, baggage area P2, security inspection area P3, immigration area P4, and passageway P5, and then passes through boarding gate area P6 to board the aircraft. According to an exemplary embodiment, passenger U may pass through only some of the check-in lobby area P1, baggage area P2, security inspection area P3, immigration area P4, and passageway P5. For example, passenger U may have completed the check-in process at home or may not have any baggage, and therefore passenger U may need to pass through check-in lobby area P1 or baggage area P2. According to an exemplary embodiment, passenger U may be a person intending to board a domestic flight, in which case passenger U may skip immigration area P4.

[0059] According to an exemplary embodiment of the present disclosure, the touchpoint system 1 provides an improved method of interaction between passenger U and airport process flows using passenger U's mobile device 80 and ITP terminals 20 located in different areas P1-P6 of the airport. For example, the improved touchpoint system 1 enables completely contactless and paperless interaction between passenger U and the airport infrastructure by facilitating a passenger-centric system for standardizing process flows at the airport using the mobile device 80 and the ITP terminal 20. For example, according to an exemplary embodiment of the present disclosure, the mobile device 80 may be used as an interaction device to replicate the user interface, process flow, and / or workflow of existing airport touchpoints, such as CUSS, CUTE, and CUPPS. Furthermore, according to an exemplary embodiment of the present disclosure, a novel method is provided for detecting a specific user's location using the mobile device 80 and the ITP terminal 20 to facilitate interaction between passenger U and the ITP terminal 20 and / or the management server 10.

[0060] FIG. 2B is a schematic diagram illustrating a particular exemplary configuration of a touchpoint system for facilitating a process flow for passenger U in the check-in and baggage drop areas of an airport.

[0061] According to FIG. 2B, an area corresponding to Airport A is covered by Geofence 2 according to an exemplary embodiment. As shown in FIG. 3, a geofence represents a virtual boundary around a geographic area that can be monitored by a geofencer service. The geofence is used to identify when a user's mobile device 80 (i.e., passenger U) enters or exits the virtual environment covered by the geofence. When passenger U's mobile device 80 crosses the virtual boundary of the geofence, an event / alert may be triggered. According to an exemplary embodiment, the geofence may identify the mobile device 80 based on the device location detected by Detector D. Detector D may include sensors of different technologies, such as, but not limited to, GPS, RFID, WIFI, LTE, 5G, BLE, or beacons, allowing software to trigger interactions when the mobile device 80 enters or exits a predetermined area covered by the geofence. According to an exemplary embodiment, after detecting the mobile device 80, the system may execute policies, profiles, restrictions, alerts, etc., corresponding to the particular predetermined area in which the mobile device 80 was detected.

[0062] Additionally, to improve detection accuracy, sensor fusion may be applied, as shown in Figure 4. Sensor fusion collects data from multiple detectors and / or sensors and combines them to improve detection accuracy. Additionally, context awareness may be used to enable applications to intelligently respond to variable conditions within the sensing device.

[0063] Referring to FIG. 2B , when a mobile device 80 carried by passenger U enters geofenced area 2, an interaction may be initiated by the geofence system. According to an exemplary embodiment, the geofence may be monitored by management server 10. According to another exemplary embodiment, the geofence may be monitored by a dedicated geofence server or geofence system different from management server 10, which initiates an interaction between mobile device 80 and one or more components of the airport infrastructure. For example, one or more components of the infrastructure may be ITP terminals 20 located in different areas of the airport (i.e., P1-P6). According to another embodiment, one or more components of the infrastructure may be dedicated geofence devices or geofence systems for detecting devices entering the geofence and initiating an interaction with the devices.

[0064] According to an exemplary embodiment, the interaction may be initiated by launching an application pre-installed on the mobile device 80. In this case, when the mobile device 80 enters the geofenced area 2, the application installed on the mobile device 80 is launched. According to one embodiment, the application may be associated with a facility such as an airport or airline. According to an exemplary embodiment, the application may be a shared application such as CUSS, CUTE, or CUPPS, which has the same process, workflow, and user interface as those used in airport kiosks. According to another exemplary embodiment, the application may be associated with a particular area within the facility, such as a check-in area or a baggage drop area.

[0065] According to another exemplary embodiment, if an application related to the facility is not pre-installed on the device, initiating the interaction may include prompting the user to install the application on the mobile device 80 when the mobile device 80 enters the geofence area 2.

[0066] According to an exemplary embodiment, as shown in FIG. 2B, multiple sub-areas (i.e., 2-1, 2-2, ...) within airport A may be associated with one of the process flow areas, such as check-in P1, baggage P2, etc. When mobile device 80 enters one of the sub-areas, ITP terminal 20 may detect the passenger using an application installed on mobile device 80 by proximity detection technology, as shown in FIG. 5. According to an exemplary embodiment, proximity technology may include geofencing technology or other technology for detecting the location of mobile device 80. According to an exemplary embodiment, determining the location of passenger U may also be performed using surveillance camera 90.

[0067] 6A illustrates a process for establishing a mobile interaction according to an exemplary embodiment. For example, if the ITP terminal 20 detects a mobile device 80 entering subarea 2-1 through proximity detection technology, the ITP terminal 20 and the mobile device 80 may be associated with each other through an association process. For example, the ITP terminal 20 may obtain identification information about the mobile device 80 and perform a handshake protocol. According to an exemplary embodiment, the ITP terminal 20 may perform the handshake protocol directly with the mobile device 80. According to another exemplary embodiment, the ITP terminal 20 may perform the handshake protocol through an orchestration layer embedded in a server, such as the management server 10.

[0068] According to an exemplary embodiment, a token may be exchanged between the mobile device 80 and the ITP terminal 20 based on a handshake protocol. According to an exemplary embodiment, the sensitive information may be distributed and stored only on the mobile device 80. In this manner, once the passenger enters the sensitive information, a token, i.e., a security token, may be created that is shared across various interactions between the passenger and the airport's infrastructure, such as the ITP terminal 20 and the management server 10.

[0069] According to an exemplary embodiment, as shown in Figure 5, the ITP terminal 20 may initiate a facial recognition process to verify the passenger associated with the mobile device 80. According to an exemplary embodiment, the facial recognition process occurs after the mobile device 80 is associated with the ITP terminal 20. According to other exemplary embodiments, the facial recognition process may occur before or simultaneously with the association process for associating the mobile device 80 with the ITP terminal 20. According to other exemplary embodiments, the facial recognition process may include a liveness check or other security feature.

[0070] According to an exemplary embodiment, the facial recognition process may include capturing an image of a person in the vicinity of the ITP terminal 20 and matching the captured image with a pre-stored image associated with the mobile device 80 or the passenger of the mobile device 80. According to another exemplary embodiment, the matching operation may match the captured image with a pre-stored image associated with device information or a token received from the mobile device 80. Thus, the passenger is identified based on matching the captured image with the pre-stored image.

[0071] According to an exemplary embodiment, once the passenger is verified, an interface or application may be shared with the mobile device 80 to facilitate interaction between the mobile device 80 and the ITP terminal 20. According to an exemplary embodiment, the application may be a shared application such as CUSS, CUTE, or CUPPS, which has the same processes, workflow, and user interface as those used at airport kiosks. According to an exemplary embodiment, the user interface may provide alerts and guidance information to the passenger for process flows within the airport.

[0072] 6B and 6C illustrate a process for establishing a mobile interaction according to another exemplary embodiment. For example, in FIG. 6B, the interaction between the mobile device 80 and the ITP terminal 20 may be coordinated by a process orchestration layer in the management server 10. According to another exemplary embodiment, the interaction between the mobile device 80 and the ITP terminal 20 may be facilitated by each other by directly accessing necessary information, such as airline data, via a cloud infrastructure, as shown in FIG. 6C.

[0073] Referring to FIG. 2B , according to an exemplary embodiment, when the mobile device 80 enters the sub-area 2-1, the ITP 20-1 may associate with the mobile device 80, identify the passenger U, and send an interface or application to facilitate interaction between the mobile device 80 and the ITP terminal 20-1. According to an exemplary embodiment, an alert may be pushed to the mobile device 80 inquiring whether the passenger U would like to complete the check-in process. According to another exemplary embodiment, an alert may be pushed to the mobile device 80 inquiring whether the passenger U would like to change information about a previous check-in. In this case, the user may interact with the interface and application provided on the mobile device 80 to complete the check-in process. According to an exemplary embodiment, the passenger information is stored or updated in the system. Additionally, a message may be pushed to the mobile device 80 indicating the user's next destination area.

[0074] According to another exemplary embodiment, when the mobile device 80 enters the subarea 2-1, the ITP 20-1 may associate with the mobile device 80, identify the passenger U, and display information about the passenger U on the display of the ITP terminal 20-1. Furthermore, according to an exemplary embodiment, the ITP terminal 20-1 may transmit an interface or application to facilitate interaction between the mobile device 80 and the ITP terminal 20-1. According to an exemplary embodiment, the displayed information may inquire whether the passenger U wishes to change information about a previous check-in. In this case, the passenger U may interact with the ITP terminal 20-1 through an interface or application provided on the mobile device 80 to provide responses to interactively displayed information on the display of the ITP terminal 20-1. For example, selections within an interface on the mobile device 80 may control selections displayed on the display of the ITP terminal 20-1. According to another exemplary embodiment, the passenger U may interact with the ITP terminal 20-1 using gestures or voice control. For example, the ITP 20-1 may include a motion sensor, a microphone, and / or a camera to detect gestures or voice inputs by the passenger U.

[0075] Referring to FIG. 2B , according to an exemplary embodiment, when the mobile device 80 enters the subarea 2-2, the ITP 20-2 may associate with the mobile device 80, identify the passenger U, and send an interface or application to facilitate interaction between the mobile device 80 and the ITP terminal 20-2. According to an exemplary embodiment, an alert may be pushed to the mobile device 80 inquiring whether the passenger U wants to proceed with the baggage drop-off process. According to another exemplary embodiment, an alert may be pushed to the mobile device 80 inquiring whether the passenger U wants to change information about the previously performed baggage drop-off process. During the baggage drop-off process, if the passenger U selects to drop off their baggage, the ITP 20-2 may push guidance information to guide the passenger U to the baggage drop-off counter 30 to drop off their baggage. Here, the passenger U can interact with the baggage drop-off ITP terminal 20-2 via an interface on the mobile device 80, or the passenger U can interact with the baggage drop-off ITP terminal 20-2 directly. When passenger U interacts directly with baggage drop ITP terminal 20-2, a motion sensor is implemented to detect gestures such as hang gestures, thumbs up and down, and head movements to identify whether passenger U selects "yes" or "no."

[0076] FIG. 7 illustrates an interface for baggage drop-off, according to an exemplary embodiment. In view 7-1, a diagram of the BagDrop App is shown. In view 7-2, passenger U selects the number of bags to check. In view 7-3, passenger U proceeds with payment information. Now, if additional fees are required (e.g., because the baggage is overweight), a message is pushed to the mobile application, and passenger U may pay via the application using various electronic payment methods (i.e., credit card or other forms of electronic payment). In view 7-4, passenger U receives a baggage tag printed by ITP 20-2. In view 7-5, passenger U attaches the baggage tag and checks the baggage at the drop-off counter.

[0077] According to an exemplary embodiment, regardless of the option used, the graphical presentation / interface may be the same on the mobile device 80 and the ITP terminal 20. According to another exemplary embodiment, the graphical presentation / interface may be different on the mobile device 80 and the ITP terminal 20.

[0078] According to an exemplary embodiment, if passenger U needs any assistance, an application running on mobile device 80 of ITP terminal 20 may provide information to call a chatbot for easy assistance or airport staff to provide assistance. The proximity information detected by ITP terminal 20 allows airport staff to easily identify the requester and provide the necessary assistance.

[0079] 2C, a passenger may check in at home (or as appropriate for arrival at the airport) using an airport or airline-related mobile application installed on mobile device 80. Here, the passenger may check in directly using a mobile phone application that interacts with the application using the same process, workflow, and user interface as used by the airport's public kiosks. The passenger may also be able to identify the number of bags they are checking using a mobile phone application that interacts with the application using the same process, workflow, and user interface as used by the airport's public kiosks.

[0080] 2C, because the passenger has already checked in, ITP 20-1 may push guidance information to the passenger to guide them to the next step in the workflow. Also, because the passenger already has baggage information, ITP 20-1 may push guidance information to guide the passenger to baggage drop counter 30.

[0081] 2B and 2C illustrate interactions between mobile device 80 and ITP terminals 20-1 and 20-2 in the check-in and baggage areas, respectively, the present disclosure is not limited thereto. In accordance with a novel aspect of the present disclosure, the exemplary embodiment includes an interactive mobile device 80 capable of communicating with other ITP terminals 20 in other areas P3-P5 of the airport, which would enable remote interactions between mobile device 80 and ITP terminals 20 to simplify the complete process.

[0082] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented at a security checkpoint. For example, an ITP terminal 20 at security checkpoint area P3 may detect passenger U, who has a mobile application installed on a mobile device 80, via proximity technology. Furthermore, the passenger's face may be verified by facial matching technology at the ITP terminal 20. If passenger U is not authenticated, the ITP terminal 20 will not allow the security checkpoint door to open. At this time, a passenger-specific message is pushed to the mobile application on the mobile device 80, indicating the problem detected at the security checkpoint and the next step that needs to be taken. On the other hand, if passenger U is authenticated, the ITP terminal 20 will open the door and allow passenger U to enter the security zone. Furthermore, passenger information may be updated in the system record, and a message may be pushed to the mobile application on the mobile device 80 indicating where passenger U should go next. The message may also include information about the distance to the next step, the closing time of the ITP terminal 20, and specific sales opportunities at airport stores.

[0083] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented in a lounge area. For example, an ITP terminal 20 in the lounge area may detect a passenger U having a mobile application installed on a mobile device 80 via proximity technology. According to an exemplary embodiment, the passenger's face may be verified at the ITP terminal 20 via facial matching technology. If passenger U is not authorized to enter the lounge, a message explaining the issue may be pushed to the mobile application on the mobile device 80. Specific lounge messages regarding lounge information or promotions may also be pushed to passenger U. Furthermore, if payment is required, a message may be pushed to the mobile application on the mobile device 80, and passenger U may make payment within the application using various payment methods (i.e., credit card or other electronic device).

[0084] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented at immigration areas. According to an exemplary embodiment, the touchpoint system may notify immigration authorities prior to the passenger's arrival, allowing for more detailed identity verification even before the passenger reaches the touchpoint. If specific questions need to be answered for departure, this may also be done via a mobile application and shared with immigration authorities even before the passenger reaches the departure gate.

[0085] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented in a boarding area. According to an exemplary embodiment, boarding pass information may be stored in a mobile application on a mobile device 80 and shared with an airline departure control system (DCS).

[0086] Additionally, according to an exemplary embodiment, flight information, gate numbers, delays and queue wait times may also be pushed to installed applications on the mobile device 80 to alert passengers. According to another exemplary embodiment, the interactive mobile device 80 may also be capable of communicating with existing legacy touchpoint terminals 20 at the airport.

[0087] According to another exemplary embodiment, passengers may use a mobile application to select a service to collect their baggage from home, minimizing interaction and waiting time at the airport. Here, after collecting the baggage, the system updates the information and shares the baggage ticket within the mobile application. Furthermore, if payment is required, a message is pushed to the mobile application, and passengers can make payment within the application using various electronic payment methods.

[0088] 8A and 8B illustrate an ITP terminal 20 according to an exemplary embodiment. According to an exemplary embodiment, the ITP terminal 20 may include a display 1001, an audio input / output interface 1002, a camera 1003, memory, and a processor. According to some exemplary embodiments, the ITP 20 may include a printer 1004 and a scanner 1005. The audio I / O interface 1002 may be implemented as a chatbot to assist passengers.

[0089] According to an exemplary embodiment, ITP terminal 20 may be configured to perform proximity detection, recognize gestures made by a user to interact with the user, facilitate and implement voice control, facilitate interaction with mobile device 80, and facilitate interaction with existing airport facilities and infrastructure. According to an exemplary embodiment, ITP terminal 20 facilitates interaction with mobile device 80 by pushing applications to mobile device 80 (touchpoint form factors and workflows for passenger mobile device 80) and remotely receiving instructions from mobile device 80 to control the operation of ITP terminal 20.

[0090] According to an exemplary embodiment, a user may be able to use head control to control an interface provided via ITP terminal 20. For example, a user may be able to control selections on a selection screen displayed on the display of the ITP terminal based on the user's head movements. For example, in response to a selection query, the user may move (or shake) their head left and right or up and down to indicate yes or no. The types of movements are not limited thereto, and other types of head movements may be used to make selections.

[0091] According to an exemplary embodiment, the ITP terminal 20 may notify or announce that the ITP terminal 20 can be remotely controlled and / or monitored via an external device, such as a mobile device 80. According to an exemplary embodiment, the ITP terminal 20 may notify or announce to an external electronic device, such as a mobile device 80, that the ITP terminal 20 can be remotely controlled and / or monitored via an external device, such as a mobile device 80. According to an exemplary embodiment, the ITP terminal 20 not only interfaces and interacts with the mobile device 80 (or other external device), but also enables the ITP terminal 20 to display workflow-based applications (i.e., shared applications) available to passengers and one or more functions corresponding to the applications on the display of the ITP terminal 20. According to an exemplary embodiment, the interface display on the mobile device 80 may be mirrored on the display of the ITP terminal 20. However, the present disclosure is not limited thereto.

[0092] According to an exemplary embodiment, ITP terminal 20 may be a stationary device located at various locations throughout a facility. However, the present disclosure is not limited thereto, and according to another exemplary embodiment, ITP terminal 20 may be a mobile, non-stationary device. According to an exemplary embodiment, ITP terminal 20 may have a small form factor and may be used for various purposes. For example, ITP terminal 20 may have a small form factor that is a shared terminal or kiosk currently used in airports.

[0093] According to another exemplary embodiment, the ITP terminal 20 may be a handheld device located on a counter. According to an exemplary embodiment, airline or facility personnel may hold or move (using wheels) a non-stationary ITP device and use it for monitoring purposes and to facilitate process flow. For example, according to an exemplary embodiment, personnel may roll or carry a non-stationary ITP device to approach and interact with passengers. According to an exemplary embodiment, in this case, the ITP may assume both a touchpoint display and an employee monitoring tool, allowing the employee to remotely interact with passengers while also performing the authorized functions of the employee monitoring tool, such as administrative exceptions and flow admission. According to an exemplary embodiment, connectivity between non-stationary ITP terminals, other ITP terminals, and passenger mobile devices 80 may be achieved in the same manner as described above through geofencing and proximity, proximity detection, and / or facial recognition.

[0094] 9 shows a block diagram of the management server 10 according to an exemplary embodiment. For example, the management server 10 may include a CPU 102, a RAM 104, a storage device 106, and a communication unit 108. The CPU 102, the RAM 104, the storage device 106, and the communication unit 108 are connected to a bus line 110.

[0095] The CPU 102 operates by executing programs stored in the storage device 106 and may function as a control unit that controls the overall operation of the management server 10. According to an exemplary embodiment, the CPU 102 may function as an orchestration layer that coordinates interactions between front-end components of the touchpoint system, such as the mobile devices 80 and the ITP terminals 20, and back-end airport infrastructure, such as gate equipment and fixed checkpoints. Furthermore, the CPU 102 may execute application programs stored in the storage device 106 to perform various processes as the management server 10. The RAM 104 provides memory fields necessary for the operation of the CPU 102.

[0096] More specifically, the CPU 102 functions as an information management unit that stores user information about passenger U received from the mobile device 80 and / or the ITP terminal 20 in the storage device 106 and manages the stored user information. The CPU 102 as the information management unit registers the user information received from the mobile device 80 and / or the ITP terminal 20 in the user information DB 106a stored in the storage device 106 and manages the registered user information. Every time the CPU 102 receives user information from the mobile device 80 and / or the ITP terminal 20, it registers the received user information in the user information DB 106a. The user information about passenger U includes identification information, facial information, baggage information, and boarding information about passenger U, which are associated with each other. The facial information corresponds to a captured facial image or a facial image on a passport acquired by the mobile device 80 and / or the ITP terminal 20. The registered facial images, which are captured facial images and passport facial images registered in the user information DB 106a, are used to compare facial images used to verify the identity of passenger U at the automatic baggage check-in machine 30, security inspection device 40, automatic gate device 50, and boarding gate device 70.

[0097] 10 shows a block diagram of features of a mobile device 80, according to an example embodiment. For example, the mobile device 80 may include a central processing unit (CPU) 802, a random access memory (RAM) 804, a storage device 806, a communication unit 808, a display 812, an input / output (I / O) interface 814, and a camera 816, which may be connected to a bus line 810.

[0098] According to an exemplary embodiment, the CPU 802 operates by executing programs stored in the storage device 806 and functions as a control unit that controls the operation of the mobile device 80. Furthermore, the CPU 802 may execute application programs stored in the storage device 806 to perform various processes as the mobile device 80. The RAM 804 provides memory fields necessary for the operation of the CPU 802.

[0099] According to an example embodiment, communication unit 808 may include a transceiver configured to transmit and receive data from one or more devices external to mobile device 80. According to an example embodiment, communication unit 808 may perform wireless communication. According to an example embodiment, display 812 may display information. According to an example embodiment, display 812 may include a touch screen for receiving touch input. According to an example embodiment, input / output (I / O) interface 814 may include a microphone and speaker for receiving audio input and outputting audio output. According to an example embodiment, camera 816 may capture one or more images.

[0100] According to an exemplary embodiment, the mobile device 80 may function as an improved common use terminal equipment (CTE) in your pocket. For example, according to an exemplary embodiment, the mobile device 80 may launch common use applications to initiate and process workflows similar to those of related art CUTE terminals at airports. In this manner, a user may be able to navigate a workflow at an airport or other facility without having to touch a kiosk or other terminal located at the airport or other facility to use and / or interact with applications running on the kiosk or other terminal. According to an exemplary embodiment, the improved "common use terminal equipment (CTE) in your pocket" device may include a device that can be carried in a user's pocket. However, the present disclosure is not limited in this respect, and according to other exemplary embodiments, the improved "common use terminal equipment (CTE) in your pocket" device may include other electronic portable devices such as a laptop, a tablet, an electronic watch, an electronic wearable device, etc.

[0101] 11 shows a block diagram of features of ITP terminal 20, according to an exemplary embodiment. For example, ITP terminal 20 includes a central processing unit (CPU) 202, a random access memory (RAM) 204, a storage device 206, a communication unit 208, a display 212, and an input / output (I / O) interface 214. In addition, ITP terminal 20 may include a camera 216, a printer 218, and a scanner 220. CPU 202, RAM 204, storage device 206, communication unit 208, display 212, input / output (I / O) interface 214, camera 214, printer 216, and scanner 218 are connected to bus line 210.

[0102] According to an exemplary embodiment, CPU 202 operates by executing programs stored in storage device 206 and functions as a control unit that controls the operation of ITP terminal 20. Furthermore, CPU 202 may execute application programs stored in storage device 206 to perform various processes as ITP terminal 20. RAM 204 provides memory fields necessary for the operation of CPU 202.

[0103] The storage device 206 is configured with storage media such as nonvolatile memory and a hard disk drive, and functions as a storage unit. The storage device 206 stores programs executed by the CPU 202, data referenced by the CPU 202 when the programs are executed, and the like.

[0104] According to an exemplary embodiment, the communication unit 208 may be connected to the network NW and may transmit and receive data via the network NW. The communication unit 216 communicates with the management server 10, the mobile device 80, etc. under the control of the CPU 202.

[0105] According to an exemplary embodiment, the communication unit 208 may include a transceiver configured to transmit and receive data from one or more devices external to the mobile device 80. According to an exemplary embodiment, the communication unit 208 may perform wireless communication. According to an exemplary embodiment, the display 212 may display information. According to an exemplary embodiment, the input / output (I / O) interface 214 may include a microphone and a speaker for receiving audio input and outputting audio output. According to an exemplary embodiment, the camera 216 may capture one or more images to perform facial recognition of passengers. According to an exemplary embodiment, the printer 218 may print boarding passes or baggage tags. According to an exemplary embodiment, the scanner 220 may scan documents such as passports. According to an exemplary embodiment, the CPU 202 may be configured to implement an intelligent chatbot to assist passengers.

[0106] 12 shows a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. The sequence diagram shows interactions between a mobile device 80, an ITP terminal 20, and a management device 10 according to an exemplary embodiment.

[0107] According to an exemplary embodiment, in operation S1, the ITP terminal 20 detects, based on proximity detection, a mobile device 80 entering an area covered by the ITP terminal 20. The area may be any one of areas P1 to P6 shown in FIG. 1. According to an exemplary embodiment, the ITP terminal 20 may detect the mobile device 80 using geofencing or other forms of proximity detection. According to an exemplary embodiment, the ITP terminal 20 may obtain identification information from the mobile device 80 during proximity detection. The identification information may be a device ID.

[0108] In an operation S2, the ITP terminal 20 may transmit a device ID to the management server 10. Based on the received device ID, in an operation S3, the management server 10 may initiate a handshake protocol with the mobile device 80. According to another exemplary embodiment, based on the received device ID, the ITP terminal 20 may initiate a handshake protocol with the mobile device 80 as shown in FIG. 6A. In an operation S4, the mobile device 80 exchanges security tokens with the management server 10 according to an exemplary embodiment. According to another exemplary embodiment, the mobile device 80 may exchange security tokens with the ITP terminal 20 as shown in FIG. 6A.

[0109] In operation S5, the administrative server may retrieve information about the security token according to an example embodiment. For example, the administrative server may retrieve airline data for the passenger associated with the received security token. According to an example embodiment, the airline data may be retrieved from a database of a legacy infrastructure that stores passenger and airline data.

[0110] In operation S6, the management server 10 may send a request to the ITP terminal 20 to acquire biometric information of the user of the mobile device 80. In operation S7, the ITP terminal 20 may acquire the biometric information of the user of the mobile device 80. According to another exemplary embodiment, the ITP terminal 20 may acquire the biometric information of the user without receiving a request from the management server 10. According to an exemplary embodiment, the biometric information may be a facial image of the user captured by a camera of the ITP terminal 20.

[0111] In operation S8, the ITP terminal 20 may transmit the captured facial image to the management device 10 for biometric matching. The management server 20 may perform facial recognition to match the facial image received from the ITP terminal 20 by comparing the captured facial image with a pre-registered image associated with the obtained security token. The pre-registered image may be stored in a database as part of the airline data.

[0112] In operation S9, the management server 10 may push a touchpoint user interface (UI) to the mobile device 80 and the ITP terminal 20. According to an exemplary embodiment, the same touchpoint UI may be sent to both the mobile device 80 and the ITP terminal 20.

[0113] In operation S10, the mobile device 80 interacts directly with the management server 10 or remotely controls a user interface provided on the ITP terminal 20. For example, a user may operate the mobile device 80 to input information about a process flow in the area where the ITP terminal 20 is located. According to an exemplary embodiment, the information input by the user on the mobile device 80 is sent directly to the management server 10. According to an exemplary embodiment, the information input by the user on the mobile device 80 may control selections on a touchpoint UI provided on the ITP terminal 20, which may be forwarded to the management server 10. According to another exemplary embodiment, the user may use gestures to control selections on a touchpoint UI provided on the ITP terminal instead of on the mobile device 80.

[0114] In operation S11, the management server 10 may obtain and process the information entered by the user and update the airline infrastructure database.

[0115] According to an exemplary embodiment, multiple mobile devices can simultaneously interact with the management server 20 based on biometric matching after proximity detection and biometric information capture by the ITP terminal 20. According to an exemplary embodiment, multiple mobile devices may simultaneously interact directly with the management server 20 after a touchpoint user interface is pushed to the mobile device 80. According to another exemplary embodiment, the touchpoint UI may be sent only to the mobile device 80.

[0116] According to another exemplary embodiment, the mobile device 80 may not only be configured to be used to remotely control the ITP terminal 20, but the mobile device 80 may also be implemented as a standalone touchpoint device that completely eliminates dependency on a physical terminal. For example, a passenger would in effect have a touchpoint in their pocket as an intelligent passenger processing mobile device that the passenger can use whenever needed without having to rely on a physical shared terminal.

[0117] 13 shows a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. The sequence diagram shows the interaction between a mobile device 80 and a management device 10 according to an exemplary embodiment.

[0118] According to an exemplary embodiment, a mobile application may be installed on the mobile device 80 to facilitate a platform that allows passengers to execute workflows on the mobile device 80 based on the passenger's flight information, as shown in Figure 13. According to an exemplary embodiment, the platform may be an intelligent passenger process platform that serves as a marketplace where airlines can host and publish specific airline applications (i.e., Airline APP Lite) that can be launched via the mobile device 80. Furthermore, according to an exemplary embodiment, pending tasks that are not completed on the platform may be delegated to the airport ITP terminal 20, which completes the tasks at the airport.

[0119] According to an exemplary embodiment, in operation S11, a mobile application running on the mobile device 80 identifies a passenger. For example, the mobile application may identify flight information for the passenger. In operation S12, the mobile application may launch a user interface screen related to one of the workflows for boarding an airplane. For example, the mobile application may launch a UI screen related to a check-in workflow. According to another exemplary embodiment, the mobile application may launch a UI screen related to a baggage drop workflow.

[0120] In operation S13, the mobile application may communicate with the legacy system's infrastructure to access and retrieve data. For example, the mobile application may communicate with the legacy system's database to access and retrieve data needed to complete a workflow. According to an exemplary embodiment, access to the legacy system or other operations of the mobile application may be permitted only after authentication of the user of the mobile device 80.

[0121] In operation S14, the information entered by the user of the mobile device 80 is processed and reported to the management server 10. The management server 10 may include an orchestration layer for managing and updating passenger information received from a mobile application running on the mobile device 80, as shown in operation S15.

[0122] According to another exemplary embodiment, information entered by a user of mobile device 80 is processed and reported directly to a legacy system. For example, an airline database may be updated with information entered by a user of mobile device 80.

[0123] In operation S16, based on the state of the workflow, the orchestration layer of the management server 10 may push a UI screen to the ITP terminal 20. For example, a pending task that has not been completed on the platform may be delegated to the ITP terminal 20 at the airport, which completes the task at the airport. In operation S17, a user operation corresponding to the UI screen is received by the orchestration layer of the management server 10. In operation S18, the orchestration layer updates and sends the passenger data to the legacy system infrastructure.

[0124] 14 is a sequence diagram of operations in a touchpoint system according to another exemplary embodiment. For example, FIG. 14 illustrates another exemplary embodiment in which a mobile device 80 launches an existing airline application. For example, in operation S11-1, the mobile application identifies an airline, and in operation S12-1, the mobile application launches the airline application. After the airline application is launched, the operations performed by the mobile device 80 may be similar to those illustrated in FIG. 13.

[0125] The present disclosure is not limited to the above-described exemplary embodiments and may be modified as necessary without departing from the spirit of the present disclosure. For example, although the exemplary embodiments show an ITP terminal, a mobile device, and a management server used in an airport to facilitate various workflow procedures required for a user to enter or use the airport, the present disclosure is not limited thereto. For example, according to another exemplary embodiment, the ITP terminal, a mobile device, and / or a management server may be used in any facility, such as public transportation, a tourist attraction, an amusement park, a museum, a supermarket, or the like, that utilizes touchpoint devices to assist users with services offered at the facility.

[0126] The scope of one or more exemplary embodiments also includes a processing method in which a program for operating the configuration of the exemplary embodiment to implement the functions of the above-described exemplary embodiment is stored in a storage medium, and the program stored in the storage medium is read as code and executed in a computer. In other words, a computer-readable storage medium is also included in the scope of each exemplary embodiment. Furthermore, not only the storage medium on which the above-described program is stored, but also the program itself is included in each exemplary embodiment. Furthermore, one or more components included in the above-described exemplary embodiment may be circuits such as application-specific integrated circuits (ASICs) or field-programmable gate arrays (FPGAs) configured to implement the functions of each component.

[0127] Examples of storage media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, compact disks (CD-ROMs), magnetic tapes, non-volatile memory cards, ROMs, etc. Furthermore, the scope of each of the exemplary embodiments is not limited to examples in which processing is performed by an individual program stored on a storage medium, but also includes examples in which processing is performed by operating on an operating system (OS) in cooperation with the functions of other software or add-in boards.

[0128] Services implemented by the functionality of one or more of the exemplary embodiments described above may be provided to users in the form of Software as a Service (SaaS).

[0129] It should be noted that the above-described exemplary embodiments are merely examples of embodiments for implementing the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these exemplary embodiments. In other words, the present disclosure can be implemented in various forms without departing from its technical idea or main features.

[0130] Some or all of the exemplary embodiments disclosed above can be described as follows, but are not limited to:

[0131] (Appendix 1) a memory storing one or more instructions; Executing said one or more instructions, Detecting a mobile device entering an area defined by the virtual geographic boundary; receiving authentication information from the mobile device upon entry into the area; transmitting information about the area to the mobile device based on verification of the authentication information; and a processor configured to: The apparatus, wherein the information indicates that the apparatus can be remotely controlled or monitored via the mobile device.

[0132] (Appendix 2) 10. The apparatus of claim 1, wherein the information about the area sent to the mobile device is alert or guidance information.

[0133] (Appendix 3) 10. The apparatus of claim 1, wherein the information about the area sent to the mobile device corresponds to a stage of a process within an airport at which the apparatus is located.

[0134] (Appendix 4) 10. The apparatus of claim 1, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0135] (Appendix 5) 10. The apparatus of claim 1, wherein the information is a shared application that replicates an application used by a shared terminal at an airport.

[0136] (Appendix 6) 10. The apparatus of claim 1, wherein the authentication information is biometric information of a user of the mobile device.

[0137] (Appendix 7) A mobile device, a memory storing one or more instructions; Executing said one or more instructions, determining that the mobile device is entering an area defined by a virtual geographic boundary; enabling an application within the mobile device to perform an interaction with an external device based on the determination that the mobile device has entered the area defined by the virtual geographic boundary; transmitting authentication information to the external device; receiving the information about the area from the external device based on verification of the authentication information; and a processor configured as A mobile device comprising:

[0138] (Appendix 8) 8. The mobile device of claim 7, wherein the information about the area sent to the mobile device is alert or guidance information.

[0139] (Appendix 9) 8. The mobile device of claim 7, wherein the information about the area sent to the mobile device corresponds to a stage of a process within an airport at which the device is located.

[0140] (Appendix 10) 8. The mobile device of claim 7, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0141] (Appendix 11) 8. The mobile device of claim 7, wherein the information is a shared application that replicates an application used by a shared terminal at an airport.

[0142] (Appendix 12) 8. The mobile device of claim 7, wherein the mobile device is configured to function as an improved shared terminal device in a pocket.

[0143] (Appendix 13) 8. The mobile device of claim 7, wherein the processor is further configured to execute a shared application.

[0144] (Appendix 14) 1. An apparatus comprising: A camera and The display and a memory storing one or more instructions; Execute one or more instructions, Detecting the mobile device within an area defined by the virtual geographic boundary; receiving identification information from the mobile device; acquiring biometric information from an image captured by the camera in the vicinity of the device; Based on the comparison between the identification information and the biometric information, transmitting first information about the area to the mobile device; displaying second information about the area on the display of the device to enable an application and one or more functions corresponding to the application based on a workflow available to the passenger; or establishing an interface for conducting touchless interactions with a person associated with the mobile device; Do at least one of the following: and a processor configured as An apparatus comprising:

[0145] (Appendix 15) 15. The device of claim 14, wherein the touchless interaction is the interaction between the person and the device that performs the interaction without the person touching the device.

[0146] (Appendix 16) 15. The device of claim 14, wherein the interface is based on gesture control.

[0147] (Appendix 17) 15. The device of claim 14, wherein the interface is based on voice control.

[0148] (Appendix 18) 15. The device of claim 14, wherein the interface is head-control based.

[0149] (Appendix 19) 15. The apparatus of claim 14, wherein the first information about the area sent to the mobile device is alert or guidance information.

[0150] (Appendix 20) 15. The apparatus of claim 14, wherein the interface is based on a user remotely controlling the apparatus using a mobile device.

[0151] (Appendix 21) 15. The apparatus of claim 14, wherein the first information about the area sent to the mobile device corresponds to a stage of a process within an airport at which the apparatus is located.

[0152] (Appendix 22) 15. The apparatus of claim 14, wherein the first information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0153] (Appendix 23) a chatbot configured to provide the first information about the area to the user; 15. The apparatus of claim 14, further comprising:

[0154] (Appendix 24) a printer configured to print the first information about the area. 15. The apparatus of claim 14, further comprising:

[0155] (Appendix 25) The device, a handheld device, or Small form factor device for airport shared terminals 15. The device of claim 14, wherein

[0156] (Appendix 26) 15. The apparatus of claim 14, wherein the apparatus is a non-stationary, movable device configured to facilitate interaction with the passenger, monitor process flow, or monitor other equipment, intelligent touchpoint terminals, or mobile devices.

[0157] (Appendix 27) 15. The apparatus of claim 14, wherein the first information and the second information are the same.

[0158] (Appendix 28) 1. An apparatus comprising: a memory storing one or more instructions; Executing said one or more instructions, Detecting a mobile device entering an area defined by the virtual geographic boundary; receiving identification information from the mobile device; acquiring biometric information from an image captured near the device; transmitting information about the area to the mobile device based on a match between the identification information and the biometric information; and a processor configured as An apparatus comprising:

[0159] (Appendix 29) 29. The apparatus of claim 28, wherein the information about the area sent to the mobile device is alert or guidance information.

[0160] (Appendix 30) 29. The apparatus of claim 28, wherein the information about the area sent to the mobile device corresponds to one of a plurality of levels within an airport in which the apparatus is located.

[0161] (Appendix 31) 29. The apparatus of claim 28, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0162] (Appendix 32) 29. The apparatus of claim 28, wherein the information is a shared application that replicates an application used by a shared terminal at the airport.

[0163] (Appendix 33) A mobile device, a memory storing one or more instructions; Executing said one or more instructions, determining that the mobile device is entering an area defined by a virtual geographic boundary; transmitting the identification information to an external device; and receiving information about the area from the external device based on a match between the identification information and biometric information; and a processor configured as A mobile device comprising:

[0164] (Appendix 34) 34. The mobile device of claim 33, wherein the information about the area sent to the mobile device is alert or guidance information.

[0165] (Appendix 35) 34. The mobile device of claim 33, wherein the information about the area sent to the mobile device corresponds to a stage in an airport where the device is located.

[0166] (Appendix 36) 34. The mobile device of claim 33, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0167] (Appendix 37) 34. The mobile device of claim 33, wherein the information is a shared application that replicates an application used by a shared terminal at the airport.

[0168] (Appendix 38) 1. An apparatus comprising: a memory storing one or more instructions; Executing said one or more instructions, Detecting a mobile device entering a first area of ​​a plurality of areas, each area designated for a different stage in the passenger flow of the airport; receiving identification information from the mobile device; acquiring biometric information of a user of the mobile device from an image captured in the vicinity of the device; sending a touch point user interface relating to the first area to the mobile device based on a match between the identification information and the biometric information; receiving user input information input by the user via the touchpoint user interface; Based on the user input information, an airport operation for the first area is performed. and a processor configured as An apparatus comprising:

[0169] (Appendix 39) 39. The apparatus of claim 38, wherein the information about the first area sent to the mobile device is alert or guidance information.

[0170] (Appendix 40) 39. The apparatus of claim 38, wherein the information about the first area sent to the mobile device corresponds to a stage in an airport in which the apparatus is located.

[0171] (Appendix 41) 39. The apparatus of claim 38, wherein the information about the first area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0172] (Appendix 42) 39. The apparatus of claim 38, wherein the information is a shared application that replicates an application used by a shared terminal in the first area of ​​the airport.

[0173] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 054584, filed July 21, 2020, the entire disclosure of which is incorporated herein by reference.

Claims

1. 1. An apparatus comprising: A camera and The display and a memory storing one or more instructions; Execute one or more instructions, Detecting the mobile device within an area defined by the virtual geographic boundary; receiving identification information from the mobile device; acquiring biometric information from an image captured by the camera; based on a comparison between information stored in advance in association with the identification information and the biometric information, transmitting first information about the area to the mobile device; displaying on the display of the device workflow-based applications available to a person associated with the mobile device and one or more features corresponding to the applications; or establishing an interface for engaging in touchless interaction with said person; Do at least one of the following: and a processor configured as Equipped with The apparatus, wherein the processor mirrors an interface display of the mobile device on the display of the apparatus.

2. The device of claim 1 , wherein the touchless interaction is an interaction between the person and the device that occurs without the person touching the device.

3. The device of claim 1 , wherein the interface is based on at least one of gesture control, voice control, and head control.

4. The apparatus of claim 1 , wherein the first information about the area transmitted to the mobile device is alert or guidance information.

5. The apparatus of claim 1 , wherein the interface is based on the person remotely controlling the apparatus using the mobile device.

6. The apparatus of claim 1 , wherein the first information about the area transmitted to the mobile device corresponds to a stage of a process within an airport at which the apparatus is located.

7. 2. The apparatus of claim 1, wherein the first information about the area transmitted to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

8. a chatbot configured to provide the first information about the area to the person; The apparatus of claim 1 further comprising:

9. 10. The apparatus of claim 1, wherein the apparatus is a non-stationary, mobile device configured to facilitate interaction with the person, monitor a process flow, or monitor other equipment, intelligent touchpoint terminals, or mobile devices.

10. 1. An apparatus comprising: The display and a memory storing one or more instructions; Executing the one or more instructions, Detecting a mobile device entering an area defined by the virtual geographic boundary; receiving identification information from the mobile device; acquiring biometric information from an image captured near the device; transmitting information about the area to the mobile device based on a comparison between the biometric information and information previously stored in association with the identification information; and a processor configured as Equipped with The apparatus, wherein the processor mirrors an interface display of the mobile device on the display of the apparatus.

Images