Touchpoint apparatus, touchpoint system, touchpoint method, and storage medium

Abstract

To facilitate mobile, interactive and / or contact-free operations in a process flow that can be used in a variety of facilities, such as an airport.SOLUTION: A touchpoint apparatus is configured to: detect a mobile device within an area defined by a virtual geographic boundary; receive identification information from the mobile device; acquire biometric information from an image captured by a camera in the vicinity of the apparatus; and based on a match between the identification information and the biometric information, perform at least one of: transmitting to the mobile device first information related to the area and displaying second information related to the area on a display of the apparatus so as to enable an application and one or more functions corresponding to the application on the basis of a workflow available for a person; and establishing an interface for performing a touchless interaction with a person associated with the mobile device.SELECTED DRAWING: Figure 2A

Description

[Technical field]

[0001] The present disclosure relates to a touchpoint device, a touchpoint system, a touchpoint method, and a storage medium. More specifically, the present disclosure relates to a touchpoint device, a touchpoint system, a touchpoint method, and a storage medium for facilitating mobile, interactive, and / or contactless operation in a process flow that can be used in various facilities, such as an airport. However, the present disclosure is not limited to the process flow in an airport. For example, one or more aspects of the present disclosure may be applied to other facilities or environments. [Background technology]

[0002] In large facilities such as public transportation, tourist attractions, amusement parks, etc., a user may be required to go through various procedures to enter or use the facility. For example, in an airport, a passenger who is about to board an aircraft may need to go through a process flow involving various procedures, such as check-in procedures, baggage drop procedures, security screening procedures, immigration procedures, or lounge access procedures, before boarding the aircraft. To facilitate the various procedures in the process flow, touch points may be provided at different locations to obtain and process information from the user.

[0003] Currently, the world is experiencing the COVID-19 coronavirus pandemic, leading to widespread social distancing measures. These measures and concerns about viral transmission have created an urgent and widespread need to limit contact with other people while still engaging in activities that require close proximity to others. Thus, users visiting public facilities and proceeding with necessary process flows must have minimal contact with publicly accessible equipment to perform the necessary procedures. Summary of the Invention

[0004] In accordance with one or more aspects of the present disclosure, a touchpoint device, a touchpoint method, a touchpoint system, and a storage medium are provided to facilitate a process flow for a user, such as a passenger or visitor, to pass through a facility in a contactless and safe manner.

[0005] According to one aspect of the present disclosure, an apparatus is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to detect a mobile device entering an area defined by a virtual geographic boundary, receive authentication information from the mobile device upon entry into the area, and transmit information regarding the area to the mobile device based on verification of the authentication information.

[0006] The information about the area that is sent to the mobile device may be warning or guidance information.

[0007] The area information transmitted to the mobile device corresponds to the stage of a process within the airport in which the device is located.

[0008] The area-related information transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0009] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0010] The authentication information is biometric information of the user of the mobile device.

[0011] According to another aspect of the present disclosure, a mobile device is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to determine that the mobile device is entering an area defined by a virtual geographic boundary, enable an application in the mobile device to perform an interaction with an external device based on a determination that the mobile device is entering an area defined by the virtual geographic boundary, transmit authentication information to the external device, and receive information regarding the area from the external device based on validation of the authentication information.

[0012] The information about the area that is sent to the mobile device may be warning or guidance information.

[0013] The area information transmitted to the mobile device corresponds to the stage of a process within the airport in which the device is located.

[0014] The area-related information transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0015] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0016] According to another aspect of the present disclosure, an apparatus is provided that includes a camera, a display, a memory that stores one or more instructions, and a processor configured to execute the one or more instructions to detect a mobile device within an area defined by a virtual geographic boundary, receive identification information from the mobile device, obtain biometric information from an image captured by a camera in the vicinity of the apparatus, and based on a matching of the identification information with the biometric information, at least one of: transmit information regarding the area to the mobile device, display information regarding the area on a display, or establish an interface for touchless interaction with a person associated with the mobile device.

[0017] A touchless interaction is an interaction between a person and a device in which the interaction occurs without the person touching the device.

[0018] The interface is based on gesture control.

[0019] The interface is based on voice control.

[0020] The interface is based on head control.

[0021] The information about the area that is sent to the mobile device may be warning or guidance information.

[0022] The area information transmitted to the mobile device corresponds to the stage of a process within the airport in which the device is located.

[0023] The area-related information transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0024] The apparatus may further comprise a chatbot configured to provide information about the area to the user.

[0025] The apparatus may further comprise a printer configured to print information about the area.

[0026] According to another aspect of the present disclosure, an apparatus is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to detect a mobile device entering an area defined by a virtual geographic boundary, receive authentication information from the mobile device, obtain biometric information from an image captured in a vicinity of the apparatus, and transmit information regarding the area to the mobile device based on matching the identification information with the biometric information.

[0027] The information about the area that is sent to the mobile device may be warning or guidance information.

[0028] The area information transmitted to the mobile device corresponds to the level in the airport in which the device is located.

[0029] The area-related information transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0030] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0031] According to another aspect of the present disclosure, a mobile device is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to determine that the mobile device is entering an area defined by a virtual geographic boundary, transmit identification information to an external device, and receive information regarding the area from the external device based on matching the identification information with the biometric information.

[0032] The information about the area that is sent to the mobile device may be warning or guidance information.

[0033] The area information transmitted to the mobile device corresponds to the level in the airport in which the device is located.

[0034] The area-related information transmitted to the mobile device corresponds to an airline selected from among a plurality of airlines based on the identification information received from the mobile device.

[0035] The information is a shared application that replicates the application used by the shared terminals at the airport.

[0036] According to another aspect of the present disclosure, an apparatus is provided comprising: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to detect a mobile device entering a first area of ​​a plurality of areas, each designated for a different stage in passenger flow at an airport, receive identification information from the mobile device, obtain biometric information of a user of the mobile device from an image captured in the vicinity of the apparatus, transmit a touchpoint user interface for the first area to the mobile device based on a matching of the identification information with the biometric information, receive user input information entered by a user via the touchpoint user interface, and perform airport operations for the first area based on the user input information.

[0037] The information about the first area that is sent to the mobile device is an alert or guidance information.

[0038] The information about the first area transmitted to the mobile device corresponds to one of a number of levels within the airport in which the device is located.

[0039] The information about the first area transmitted to the mobile device corresponds to an airline selected from the plurality of airlines based on the identification information received from the mobile device.

[0040] The information is a shared application that replicates an application used by a shared terminal in a first area of ​​the airport. [Brief description of the drawings]

[0041] [Figure 1A] FIG. 1 illustrates a process flow for passengers passing through an airport. [Figure 1B] FIG. 1 illustrates related technology used by airports to facilitate passenger process flow. [Figure 2A]FIG. 1 is a schematic diagram illustrating an arrangement of a touchpoint system for facilitating a passenger's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment. [Figure 2B] FIG. 1 is a schematic diagram illustrating an arrangement of a touchpoint system for facilitating a passenger's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment. [Figure 2C] FIG. 1 is a schematic diagram illustrating an arrangement of a touchpoint system for facilitating a passenger's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment. [Diagram 3] FIG. 1 illustrates geofencing, according to an example embodiment. [Figure 4] FIG. 1 illustrates sensor fusion in accordance with an exemplary embodiment. [Diagram 5] FIG. 1 illustrates proximity detection according to an exemplary embodiment. [Figure 6A] FIG. 1 illustrates a process for establishing a mobile interaction according to an exemplary embodiment. [Figure 6B] FIG. 1 illustrates a process for establishing a mobile interaction according to an exemplary embodiment. [Figure 6C] FIG. 1 illustrates a process for establishing a mobile interaction according to an exemplary embodiment. [Figure 7] FIG. 13 illustrates an interface for baggage drop off according to an exemplary embodiment. [Figure 8A] FIG. 1 illustrates an Intelligent Touch Point (ITP) terminal 20 according to an exemplary embodiment. [Figure 8B] FIG. 1 illustrates an Intelligent Touch Point (ITP) terminal 20 according to an exemplary embodiment. [Figure 9] FIG. 1 is a block diagram of a management server 10 according to an exemplary embodiment. [Figure 10] 2 is a block diagram of features of a mobile device 80 according to an example embodiment. [Figure 11] FIG. 2 is a block diagram of features of an ITP terminal 20, according to an exemplary embodiment. [Figure 12] FIG. 4 is a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. [Figure 13] FIG. 4 is a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. [Figure 14] FIG. 11 is a sequence diagram of operations in a touchpoint system according to another exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0042] Exemplary embodiments are described in more detail below with reference to the accompanying drawings. The following detailed description is provided to help readers gain a comprehensive understanding of the method, device and / or system described herein. However, the exemplary embodiments provided in this disclosure should not be considered as limiting the scope of the disclosure. Thus, various changes, modifications and equivalents of the system, device and / or method described herein will be suggested to those skilled in the art.

[0043] The terms used in this specification are intended to describe the embodiments only and are not limiting in any way. Unless otherwise clearly used, the singular terms include the plural terms. In this specification, terms such as "including" are intended to specify a feature, number, step, operation, element, part, or combination thereof, and should not be interpreted as excluding the presence or possibility of one or more other features, numbers, steps, operations, elements, parts, or combinations thereof.

[0044] One or more exemplary embodiments of the present disclosure will be described below with reference to the drawings. Throughout the drawings, identical or corresponding components are designated by the same reference numerals, and descriptions thereof may be omitted or simplified.

[0045] FIG. 1A illustrates a passenger process flow through an airport, and FIG. 1B illustrates related technologies used by airports to facilitate passenger process flow through an airport. Currently, airports use common use technologies such as Common Use Terminal Equipment (CUTE), Common Use Self-Service (CUSS), and Common Use Passenger Processing Systems (CUPPS). Common use technologies generally include physical shared devices (i.e., check-in kiosks and computer terminals or workstations at check-in counters, baggage drop areas, and / or boarding areas) aimed at increasing passenger throughput. In FIG. 1B, A1 illustrates a queue at a CUSS kiosk. A2 illustrates a passenger arriving at the airport. A3 illustrates a passenger queuing up to drop off baggage. A4 illustrates a passenger queuing up at a check-in counter. A5 illustrates a common use self-service (CUSS) kiosk. A6 illustrates a common use terminal equipment (CUTE) in a check-in counter. Reference symbol A7 denotes a shared terminal device (CUTE) at the baggage counter.

[0046] The CUTE system allows multiple airlines to use and share the same existing airport infrastructure to control passenger and flight processing information to their respective airline applications. For example, a shared CUTE workstation may run an airline host system, allowing airline personnel to interact directly with the host via a touch screen and / or keyboard interface to process passenger information.

[0047] CUSS systems are a solution currently being deployed in airports with the goal of easing and speeding up CUTE processes that require human interaction. For example, touchpoints such as self-service kiosks may activate the airline's host system, allowing passengers to interact directly with the host via a touch screen and / or keyboard interface to input and process information.

[0048] As shown in FIG. 1B, passengers arriving at the airport may check in and process information to board the aircraft using a CUTE terminal operated by airline personnel at the check-in and / or baggage counters (codes A6 and A7) or a self-service CUSS kiosk (code A5).

[0049] Recently, airlines and airports are not only committed to improving passenger experience, but are also interested in protecting passenger health and safety. Specifically, it is important to combat COVID-19 and / or other diseases that are easily spread especially in public places due to lack of social / physical distancing. However, shared technologies do not provide touchless / frictionless approaches to address such issues. For example, as shown in Figures 1A and 1B, CUTE and CUSS touchpoints are available for public use by the general traveling public. These shared devices require multiple physical interactions between many different passengers, which may increase passenger health concerns. To this end, a touchless and uninterrupted solution for process flow in airports or other similar facilities is needed to combat the spread of COVID-19 and other contagious diseases.

[0050] Furthermore, the above mentioned shared technologies have additional drawbacks such as requiring airport real estate with a large environmental footprint, high infrastructure, energy and hardware costs, dependency on a limited number of common use providers, redundant and expensive certification processes for managing different applications based on different providers, etc. Therefore, there is a need for an improved system with enhanced process flows that allows airport space and actual conditions to be used more efficiently, providing a more intuitive, clean and safe solution for passengers while ensuring efficient and cost-effective throughput.

[0051] Furthermore, while virtualization solutions running on cloud networks may reduce the need for local data centers, the shared technologies mentioned above still require physical self-service touchpoints, thus persisting the problems mentioned above.

[0052] FIG. 2A is a schematic diagram illustrating an arrangement of a touchpoint system for facilitating a passenger U's process flow through an airport from the check-in stage to the boarding stage, according to an exemplary embodiment.

[0053] 2A, the touch point system 1 according to the exemplary embodiment includes a management server 10, multiple intelligent touch point (ITP) terminals 20 provided in different areas in the process flow of a passenger U passing through an airport A, and a mobile device 80. For example, the multiple ITP terminals 20 may be provided in a check-in area P1, a baggage drop-off area P2, a security inspection area P3, a passport control and customs area P4, a signage area P5, and a boarding area P6. Here, the information processing system 1 may recognize and manage the process flow and status of a passenger U who is scheduled to board an aircraft within a facility such as airport A.

[0054] According to an exemplary embodiment, the management server 10 may be installed in the airport A. According to another exemplary embodiment, the management server 10 may be installed in a remote location and connected to devices and infrastructure in the airport via a network NW. According to an exemplary embodiment, the management server 10 may be implemented based on cloud technology.

[0055] According to an exemplary embodiment, the check-in area P1 may be disposed in a lobby area P1 in the airport A. Furthermore, the automated baggage drop machine 30 may be installed in the baggage counter area P2, the security inspection device 40 may be installed in the security inspection area P3, the automated gate device 50 may be installed in the immigration area P4, the signage terminal 60 may be installed in an aisle P5 in the airport A, and the boarding gate device 70 may be installed in the boarding gate area P6. The aisle P5 is an aisle connecting between the immigration area P4 and the boarding gate area P6. The passenger U can board the aircraft through the boarding gate P6. The mobile device 80 may be a portable electronic device carried by the passenger U. For example, the mobile device 80 may be a smartphone, a laptop, a watch, or other electronic device that the passenger U may carry.

[0056] According to an exemplary embodiment, multiple surveillance cameras 90 may be installed at various locations within airport A. The surveillance cameras 90 are installed, for example, in a check-in lobby area P1, a baggage counter area P2, a security inspection area P3, a passport control area P4, a passageway area P5, and a boarding gate area P6.

[0057] According to an exemplary embodiment, the management server 10, the ITP terminal 20, the automated baggage drop machine 30, the security inspection device 40, the automated gate device 50, the signage terminal 60, the boarding gate device 70, and the surveillance camera 90 are connected to a network NW. Furthermore, upon arrival at the airport, the mobile device 80 may be connected to the management server 10 and the ITP terminal 20 via the network NW. The network NW may be configured as a local area network (LAN), a wide area network (WAN), or a mobile communication network, including an in-house communication network of airport A. The mobile device 80 can be connected to the network NW by a wireless method.

[0058] After arriving at the airport A, a passenger U who is to board an aircraft passes through the check-in lobby area P1, the baggage area P2, the security inspection area P3, the immigration area P4, and the passageway P5, and then passes through the boarding gate area P6 to board the aircraft. According to an exemplary embodiment, the passenger U may pass through only some of the check-in lobby area P1, the baggage area P2, the security inspection area P3, the immigration area P4, and the passageway P5. For example, the passenger U may have completed the check-in process at home or may not have baggage, and therefore the passenger U may have to pass through the check-in lobby area P1 or the baggage area P2. Also, according to an exemplary embodiment, the passenger U may be a person who is to board a domestic flight, and in that case, the passenger U may omit the immigration area P4.

[0059] According to an exemplary embodiment of the present disclosure, the touchpoint system 1 provides an improved method of interaction between the passenger U and the airport process flow using the passenger U's mobile device 80 and the ITP terminals 20 located in different areas P1-P6 of the airport. For example, the improved touchpoint system 1 enables a completely contactless and paperless interaction between the passenger U and the airport infrastructure by facilitating a passenger-centric system for standardizing the process flow at the airport using the mobile device 80 and the ITP terminal 20. For example, according to an exemplary embodiment of the present disclosure, the mobile device 80 may be used as an interaction device to replicate the user interface, process flow and / or workflow of existing airport touchpoints such as CUSS, CUTE and CUPPS. Furthermore, according to an exemplary embodiment of the present disclosure, a novel method is provided for detecting the location of a particular user using the mobile device 80 and the ITP terminal 20 to facilitate the interaction between the passenger U and the ITP terminal 20 and / or the management server 10.

[0060] FIG. 2B is a schematic diagram illustrating a particular exemplary configuration of a touchpoint system for facilitating a process flow for passenger U at an airport check-in and baggage drop area.

[0061] According to FIG. 2B, the area corresponding to airport A is covered by a geofence 2 according to an exemplary embodiment. As shown in FIG. 3, a geofence represents a virtual boundary around a geographical area that can be monitored by a geofencer service. The geofence is used to identify when a user's mobile device 80 (i.e., passenger U) enters or leaves the virtual environment covered by the geofence. When passenger U's mobile device 80 crosses the virtual boundary of the geofence, an event / alert may be triggered. According to an exemplary embodiment, the geofence may identify the mobile device 80 based on the device location detected by a detector D. The detector D may include sensors of different technologies such as, but not limited to, GPS, RFID, WIFI, LTE, 5G, BLE or beacons, allowing the software to trigger an interaction if the mobile device 80 enters or leaves a predefined area covered by the geofence. According to an exemplary embodiment, after detecting the mobile device 80, the system may execute policies, profiles, restrictions and alerts, etc. corresponding to the particular predefined area in which the mobile device 80 was detected.

[0062] Also, to improve the accuracy of detection, sensor fusion may be applied as shown in Figure 4. Sensor fusion collects data from multiple detectors and / or sensors and combines them to improve the accuracy of detection. Additionally, context awareness may be used to enable applications to intelligently respond to variable conditions within the sensing device.

[0063] With reference to FIG. 2B, if a mobile device 80 carried by a passenger U enters the geofence area 2, an interaction may be initiated by the geofence system. According to an exemplary embodiment, the geofence may be monitored by the management server 10. According to another exemplary embodiment, the geofence may be monitored by a dedicated geofence server or geofence system different from the management server 10, which initiates an interaction between the mobile device 80 and one or more components of the airport infrastructure. For example, the one or more components of the infrastructure may be ITP terminals 20 located in different areas of the airport (i.e., P1-P6). According to another embodiment, the one or more components of the infrastructure may be dedicated geofence devices or geofence systems for detecting devices entering the geofence and initiating an interaction with the devices.

[0064] According to an exemplary embodiment, the interaction may be initiated by launching an application pre-installed on the mobile device 80. In this case, when the mobile device 80 enters the geofenced area 2, the application installed on the mobile device 80 is launched. According to one embodiment, the application may be associated with a facility such as an airport or an airline. According to an exemplary embodiment, the application may be a shared application such as CUSS, CUTE or CUPPS, which has the same processes, workflow and user interface as those used in airport kiosks. According to another exemplary embodiment, the application may be associated with a specific area within the facility such as a check-in area or a baggage drop area.

[0065] According to another example embodiment, if an application related to the facility is not pre-installed on the device, initiating the interaction may include prompting the user to install the application on the mobile device 80 when the mobile device 80 enters the geofenced area 2.

[0066] According to an exemplary embodiment, as shown in FIG. 2B, multiple sub-areas (i.e., 2-1, 2-2...) in airport A may be associated with one of the process flow areas, such as check-in P1, baggage P2, etc. When the mobile device 80 enters one of the sub-areas, the ITP terminal 20 may detect the passenger using an application installed on the mobile device 80 by a proximity detection technique, as shown in FIG. 5. According to an exemplary embodiment, the proximity technique may include a geofence technique or other technique for detecting the location of the mobile device 80. According to an exemplary embodiment, the determination of the location of the passenger U may also be performed using a surveillance camera 90.

[0067] FIG. 6A illustrates a process of establishing a mobile interaction according to an exemplary embodiment. For example, when the ITP terminal 20 detects a mobile device 80 entering a sub-area 2-1 by a proximity detection technique, the ITP terminal 20 and the mobile device 80 may be associated with each other through an association process. For example, the ITP terminal 20 may obtain identification information about the mobile device 80 and perform a handshake protocol. According to an exemplary embodiment, the ITP terminal 20 may perform the handshake protocol directly with the mobile device 80. According to another exemplary embodiment, the ITP terminal 20 may perform the handshake protocol through an orchestration layer embedded in a server such as the management server 10.

[0068] According to an exemplary embodiment, a token may be exchanged between the mobile device 80 and the ITP terminal 20 based on a handshake protocol. According to an exemplary embodiment, the sensitive information may be distributed and stored only on the mobile device 80. In this way, when the passenger inputs the sensitive information, a token, i.e., a security token, may be created that is shared in various interactions between the passenger and the airport's infrastructure, such as the ITP terminal 20 and the management server 10.

[0069] According to an exemplary embodiment, as shown in FIG. 5, the ITP terminal 20 may initiate a facial recognition process to verify a passenger associated with the mobile device 80. According to an exemplary embodiment, the facial recognition process occurs after the mobile device 80 is associated with the ITP terminal 20. According to other exemplary embodiments, the facial recognition process may occur prior to or simultaneously with the association process for associating the mobile device 80 with the ITP terminal 20. According to other exemplary embodiments, the facial recognition process may include a liveness check or other security features.

[0070] According to an exemplary embodiment, the facial recognition process may include capturing an image of a person in the vicinity of the ITP terminal 20 and matching the captured image with a pre-stored image associated with the mobile device 80 or the passenger of the mobile device 80. According to another exemplary embodiment, the matching operation may match the captured image with a pre-stored image associated with device information or a token received from the mobile device 80. Thus, the passenger is identified based on matching the captured image with the pre-stored image.

[0071] According to an exemplary embodiment, once the passenger is verified, an interface or application may be shared with the mobile device 80 to facilitate interaction between the mobile device 80 and the ITP terminal 20. According to an exemplary embodiment, the application may be a shared application such as CUSS, CUTE or CUPPS, which has the same processes, workflows and user interfaces as those used at the airport kiosks. According to an exemplary embodiment, the user interface may provide alerts and guidance information to the passenger for process flows within the airport.

[0072] 6B and 6C show a process of establishing a mobile interaction according to another exemplary embodiment. For example, in FIG. 6B, the interaction between the mobile device 80 and the ITP terminal 20 may be coordinated by a process orchestration layer in the management server 10. According to another exemplary embodiment, the interaction between the mobile device 80 and the ITP terminal 20 may be mutually facilitated by directly accessing necessary information, such as airline data, via a cloud infrastructure, as shown in FIG. 6C.

[0073] Referring to FIG. 2B, according to an exemplary embodiment, when the mobile device 80 enters the sub-area 2-1, the ITP 20-1 may associate with the mobile device 80, identify the passenger U, and send an interface or application to facilitate the interaction between the mobile device 80 and the ITP terminal 20-1. According to an exemplary embodiment, an alert may be pushed to the mobile device 80, asking whether the passenger U wants to perform the check-in process. According to another exemplary embodiment, an alert may be pushed to the mobile device 80, asking whether the passenger U wants to change information about the previously performed check-in. In this case, the user may interact with the interface and application provided on the mobile device 80 to complete the check-in process. According to an exemplary embodiment, the passenger information is stored or updated in the system. Furthermore, a message may be pushed to the mobile device 80, indicating to the user the next area of ​​destination.

[0074] According to another exemplary embodiment, when the mobile device 80 enters the sub-area 2-1, the ITP 20-1 may associate with the mobile device 80, identify the passenger U, and display information about the passenger U on the display of the ITP terminal 20-1. Furthermore, according to an exemplary embodiment, the ITP terminal 20-1 may transmit an interface or application for facilitating an interaction between the mobile device 80 and the ITP terminal 20-1. According to an exemplary embodiment, the display information may inquire whether the passenger U wants to change information about the previously performed check-in. In this case, the passenger U may interact with the ITP terminal 20-1 via an interface or application provided on the mobile device 80 to provide a response to the interactive display information on the display of the ITP terminal 20-1. For example, a selection in an interface on the mobile device 80 may control a selection displayed on the display of the ITP terminal 20-1. According to another exemplary embodiment, the passenger U may interact with the ITP terminal 20 using gestures or voice control. For example, the ITP 20-1 may include a motion sensor, a microphone and / or a camera for detecting gestures or voice input by the passenger U.

[0075] Referring to FIG. 2B, according to an exemplary embodiment, when the mobile device 80 enters the sub-area 2-2, the ITP 20-2 may associate with the mobile device 80, verify the passenger U, and send an interface or application to facilitate interaction between the mobile device 80 and the ITP terminal 20-2. According to an exemplary embodiment, an alert may be pushed to the mobile device 80 to inquire whether the passenger U wants to carry out the baggage drop process. According to another exemplary embodiment, an alert may be pushed to the mobile device 80 to inquire whether the passenger U wants to change information regarding the previously carried out baggage drop. During the baggage drop process, when the passenger U selects to drop off the baggage, the ITP 20-2 may push guidance information to guide the passenger U to the baggage counter 30 to drop off the baggage. Here, the passenger U may interact with the baggage drop ITP terminal 20-2 via an interface on the mobile device 80, or the passenger U may interact with the baggage drop ITP terminal 20-2 directly. When passenger U interacts directly with baggage drop ITP terminal 20-2, motion sensors are implemented to detect gestures such as hang gestures, thumbs up and down, and head movements to identify whether passenger U selects "yes" or "no."

[0076] FIG. 7 illustrates an interface for baggage drop, according to an exemplary embodiment. In view 7-1, a diagram of the BagDrop App is shown. In view 7-2, passenger U selects the number of bags to check. In view 7-3, passenger U proceeds with payment information. Now, if additional fees are required (e.g., i.e., because the baggage is overweight), a message is pushed to the mobile application and passenger U may make payment via the application using various electronic payment methods (i.e., credit card or other forms of electronic payment). In view 7-4, passenger U receives the baggage tag printed by ITP 20-2. In view 7-5, passenger U attaches the baggage tag and checks the baggage at the drop counter.

[0077] According to an exemplary embodiment, regardless of the option used, the graphical presentation / interface may be the same on the mobile device 80 and the ITP terminal 20. According to another exemplary embodiment, the graphical presentation / interface may be different on the mobile device 80 and the ITP terminal 20.

[0078] According to an exemplary embodiment, if passenger U needs any assistance, an application running on the mobile device 80 of the ITP terminal 20 may provide information to call a chatbot for easy assistance or an airport staff member to provide assistance. The proximity information detected by the ITP terminal 20 allows the airport staff member to easily identify the requester and provide the necessary assistance.

[0079] In Figure 2C, a passenger may check in at home (or as appropriate for arrival at the airport) using an airport or airline related mobile application installed on a mobile device 80. Here, the passenger may check in directly using a mobile phone application that interacts with the application using the same processes, workflow and user interface as those used by the airport's public kiosk. The passenger may also be able to identify the number of bags to be checked in using a mobile phone application that interacts with the application using the same processes, workflow and user interface as those used by the airport's public kiosk.

[0080] According to the exemplary embodiment of Figure 2C, since the passenger has already checked in, ITP 20-1 may push guidance information to the passenger to guide the passenger to the next step in the workflow, and since the passenger already has baggage information, ITP 20-1 may push guidance information to guide the passenger to baggage drop counter 30.

[0081] 2B and 2C show interactions between the mobile device 80 and the ITP terminals 20-1 and 20-2 in the check-in and baggage areas, respectively, but the disclosure is not limited thereto. In accordance with a novel aspect of the disclosure, the exemplary embodiment includes an interactive mobile device 80 capable of communicating with other ITP terminals 20 in other areas P3-P5 of the airport, which would enable remote interactions between the mobile device 80 and the ITP terminals 20 to simplify the complete process.

[0082] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented at a security checkpoint. For example, the ITP terminal 20 at the security checkpoint area P3 may detect a passenger U having a mobile application installed on a mobile device 80 via proximity technology. Furthermore, the passenger's face may be verified by face matching technology at the ITP terminal 20. If the passenger U is not authenticated, the ITP terminal 20 will not allow the door of the security checkpoint to be opened. At this time, a message for the passenger is pushed to the mobile application on the mobile device 80, indicating the problem detected at the security checkpoint and the next step that needs to be taken. On the other hand, if the passenger U is authenticated, the ITP terminal 20 will open the door and allow the passenger U to enter the security zone. Furthermore, the passenger information is updated in the system record, and a message may be pushed to the mobile application on the mobile device 80 indicating where the passenger U should go next. The message may further include information about the distance to the next step, the closing time of the ITP terminal 20, and a specific sales opportunity at the airport store.

[0083] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented in a lounge area. For example, the ITP terminal 20 in the lounge area may detect a passenger U having a mobile application installed on a mobile device 80 via proximity technology. According to an exemplary embodiment, the passenger's face may be verified by face matching technology at the ITP terminal 20. If the passenger U is not authorized to enter the lounge, a message is pushed to the mobile application on the mobile device 80 explaining the problem. Also, specific lounge messages regarding lounge information and promotions may be pushed to the passenger U. Furthermore, if payment is required, a message is pushed to the mobile application on the mobile device 80 and the passenger U may make payment within the application using various payment methods (i.e., credit card or other electronic device).

[0084] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented at immigration areas. According to an exemplary embodiment, the touchpoint system may notify immigration authorities before the passenger's arrival, so that a more detailed identity check can be performed even before the passenger reaches the touchpoint. If specific questions need to be answered for immigration, this may also be done in a mobile application and shared with immigration authorities even before the passenger reaches the departure gate.

[0085] According to an exemplary embodiment, the touchpoint system of the present disclosure may be implemented at the boarding area. According to an exemplary embodiment, boarding pass information may be stored in a mobile application on the mobile device 80 and shared with the airline departure control system (DCS).

[0086] Furthermore, according to an exemplary embodiment, flight information, gate numbers, delays and queue wait times may also be pushed to installed applications on the mobile device 80 to alert passengers. According to another exemplary embodiment, the interactive mobile device 80 may also be capable of communicating with existing legacy touchpoint terminals 20 at the airport.

[0087] According to another exemplary embodiment, passengers may use the mobile application to select the service of collecting baggage from home, minimizing interaction and waiting time at the airport, where after collecting the baggage, the system will update the information and share the baggage ticket within the mobile application, and if payment is required, a message will be pushed to the mobile application, and passengers can make payment within the application using various electronic payment methods.

[0088] 8A and 8B are diagrams illustrating an ITP terminal 20 according to an exemplary embodiment. According to an exemplary embodiment, the ITP terminal 20 may include a display 1001, an audio input / output interface 1002, a camera 1003, a memory, and a processor. According to some exemplary embodiments, the ITP 20 may include a printer 1004 and a scanner 1005. The audio I / O interface 1002 may be implemented as a chatbot to assist passengers.

[0089] According to an exemplary embodiment, the ITP terminal 20 may be configured to perform proximity detection, recognize gestures made by a user to interact with the user, facilitate and perform voice control, facilitate interaction with the mobile device 80, and facilitate interaction with existing airport facilities and infrastructure. According to an exemplary embodiment, the ITP terminal 20 facilitates interaction with the mobile device 80 by pushing applications to the mobile device 80 (touchpoint form factors and workflows for the passenger's mobile device 80) and remotely receiving instructions from the mobile device 80 to control the operation of the ITP terminal 20.

[0090] According to an exemplary embodiment, a user may be able to use head control to control an interface provided via the ITP terminal 20. For example, a user may be able to control selections on a selection screen displayed on the display of the ITP terminal based on the user's head movements. For example, in response to a selection query, the user may move (or shake) their head left and right or up and down to indicate yes or no. The types of movements are not limited in this respect, and other types of head movements may be used to make a selection.

[0091] According to an exemplary embodiment, the ITP terminal 20 may notify or announce that the ITP terminal 20 can be remotely controlled and / or monitored via an external device, such as a mobile device 80. According to an exemplary embodiment, the ITP terminal 20 may notify or announce to an external electronic device, such as a mobile device 80, that the ITP terminal 20 can be remotely controlled and / or monitored via an external device, such as a mobile device 80. According to an exemplary embodiment, the ITP terminal 20 not only interfaces and interacts with the mobile device 80 (or other external device), but the ITP terminal 20 also enables a display of workflow-based applications (i.e., shared applications) available to the passenger and one or more functions corresponding to the applications on the display of the ITP terminal 20. According to an exemplary embodiment, the interface display on the mobile device 80 may be mirrored on the display of the ITP terminal 20. However, the present disclosure is not limited thereto.

[0092] According to an exemplary embodiment, the ITP terminal 20 may be a stationary device located at various locations in a facility. However, the disclosure is not limited thereto, and according to another exemplary embodiment, the ITP terminal 20 may be a mobile, non-stationary device. According to an exemplary embodiment, the ITP terminal 20 may have a small form factor and may be used for various purposes. For example, the ITP terminal 20 may have a small form factor that is a shared terminal or kiosk currently used in airports.

[0093] According to another exemplary embodiment, the ITP terminal 20 may be a handheld device located on a counter. According to an exemplary embodiment, airline or facility personnel may hold or move (using wheels) a non-stationary ITP device and use it for monitoring purposes and to facilitate process flows. For example, according to an exemplary embodiment, personnel may roll or carry a non-stationary ITP device to approach and interact with passengers. According to an exemplary embodiment, in this case, the ITP may assume both a touch point display and a personnel monitoring tool, which allows the personnel to interact remotely with passengers while also performing the authorized functions of the personnel monitoring tool, such as administrative exceptions, flow acceptance, etc. According to an exemplary embodiment, the connection between the non-stationary ITP terminal, other ITP terminals and the passenger's mobile device 80 may be performed in the same manner as described through geofencing and proximity, proximity detection and / or face recognition.

[0094] 9 shows a block diagram of the management server 10 according to an exemplary embodiment. For example, the management server 10 may include a CPU 102, a RAM 104, a storage device 106, and a communication unit 108. The CPU 102, the RAM 104, the storage device 106, and the communication unit 108 are connected to a bus line 110.

[0095] The CPU 102 may operate by executing programs stored in the storage device 106 and function as a control unit that controls the operation of the entire management server 10. According to an exemplary embodiment, the CPU 102 may function as an orchestration layer that coordinates the interaction between front-end components of the touchpoint system, such as the mobile device 80 and the ITP terminal 20, and back-end airport infrastructure, such as gate equipment and fixed checkpoints. Furthermore, the CPU 102 may execute application programs stored in the storage device 106 to perform various processes as the management server 10. The RAM 104 provides memory fields necessary for the operation of the CPU 102.

[0096] More specifically, the CPU 102 functions as an information management unit that stores user information about the passenger U received from the mobile device 80 and / or the ITP terminal 20 in the storage device 106 and manages the stored user information. The CPU 102 as the information management unit registers the user information received from the mobile device 80 and / or the ITP terminal 20 in the user information DB 106a stored in the storage device 106 and manages the registered user information. The CPU 102 registers the received user information in the user information DB 106a every time it receives user information from the mobile device 80 and / or the ITP terminal 20. The user information of the passenger U includes identification information, face information, baggage information, and boarding information about the passenger U, which are associated with each other. The face information corresponds to a captured face image or a passport face image acquired by the mobile device 80 and / or the ITP terminal 20. The registered facial images, which are captured facial images or passport facial images registered in the user information DB 106a, are used for comparison with facial images used to verify the identity of passenger U at the automated baggage check-in machines 30, security inspection devices 40, automated gate devices 50 and boarding gate devices 70.

[0097] 10 illustrates a block diagram of features of a mobile device 80 according to an example embodiment. For example, the mobile device 80 may include a central processing unit (CPU) 802, a random access memory (RAM) 804, a storage device 806, a communication unit 808, a display 812, an input / output (I / O) interface 814, and a camera 816, which may be connected to a bus line 810.

[0098] According to an exemplary embodiment, the CPU 802 operates by executing programs stored in the storage device 806, and functions as a control unit that controls the operation of the mobile device 80. Furthermore, the CPU 802 may execute application programs stored in the storage device 806 to perform various processes as the mobile device 80. The RAM 804 provides memory fields necessary for the operation of the CPU 802.

[0099] According to an exemplary embodiment, the communication unit 808 may include a transceiver configured to transmit and receive data from one or more devices external to the mobile device 80. According to an exemplary embodiment, the communication unit 808 may perform wireless communication. According to an exemplary embodiment, the display 812 may display information. According to an exemplary embodiment, the display 812 may include a touch screen for receiving touch input. According to an exemplary embodiment, the input / output (I / O) interface 814 may include a microphone and a speaker for receiving audio input and outputting audio output. According to an exemplary embodiment, the camera 816 may capture one or more images.

[0100] According to an exemplary embodiment, the mobile device 80 may function as an improved Common Use Terminal Equipment in your pocket. For example, according to an exemplary embodiment, the mobile device 80 may launch common applications to initiate and process workflows similar to the related art CUTE terminals in airports. In this manner, a user may be able to navigate a workflow in an airport or other facility without having to touch a kiosk or other terminal located at the airport or other facility to use and / or interact with applications running on the kiosk or other terminal. According to an exemplary embodiment, the improved "Common Use Terminal Equipment in your pocket" device may include a device that can be carried in a user's pocket. However, the present disclosure is not limited thereto, and according to other exemplary embodiments, the improved "Common Use Terminal Equipment in your pocket" device may include other electronic portable devices such as laptops, tablets, electronic watches, electronic wearable devices, and the like.

[0101] 11 illustrates a block diagram of features of an ITP terminal 20, according to an exemplary embodiment. For example, the ITP terminal 20 includes a central processing unit (CPU) 202, a random access memory (RAM) 204, a storage device 206, a communication unit 208, a display 212, and an input / output (I / O) interface 214. In addition, the ITP terminal 20 may include a camera 216, a printer 218, and a scanner 220. The CPU 202, the RAM 204, the storage device 206, the communication unit 208, the display 212, the input / output (I / O) interface 214, the camera 214, the printer 216, and the scanner 218 are connected to a bus line 210.

[0102] According to an exemplary embodiment, the CPU 202 operates by executing programs stored in the storage device 206, and functions as a control unit that controls the operation of the ITP terminal 20. Furthermore, the CPU 202 may execute application programs stored in the storage device 206 to perform various processes as the ITP terminal 20. The RAM 204 provides memory fields necessary for the operation of the CPU 202.

[0103] The storage device 206 is configured with a storage medium such as a non-volatile memory or a hard disk drive, and functions as a storage unit. The storage device 206 stores programs executed by the CPU 202, data referenced by the CPU 202 when the programs are executed, and the like.

[0104] According to an exemplary embodiment, the communication unit 208 may be connected to the network NW and transmit and receive data via the network NW. The communication unit 216 communicates with the management server 10, the mobile device 80, etc. under the control of the CPU 202.

[0105] According to an exemplary embodiment, the communication unit 208 may include a transceiver configured to transmit and receive data from one or more devices external to the mobile device 80. According to an exemplary embodiment, the communication unit 208 may perform wireless communication. According to an exemplary embodiment, the display 212 may display information. According to an exemplary embodiment, the input / output (I / O) interface 214 may include a microphone and a speaker for receiving audio input and outputting audio output. According to an exemplary embodiment, the camera 216 may capture one or more images to perform facial recognition of the passenger. According to an exemplary embodiment, the printer 218 may print a boarding pass or a baggage tag. According to an exemplary embodiment, the scanner 220 may scan documents such as a passport. According to an exemplary embodiment, the CPU 202 may be configured to implement an intelligent chatbot to assist the passenger.

[0106] 12 shows a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. The sequence diagram shows interactions between a mobile device 80, an ITP terminal 20, and a management device 10 according to an exemplary embodiment.

[0107] According to an exemplary embodiment, in operation S1, the ITP terminal 20 detects a mobile device 80 entering an area covered by the ITP terminal 20 based on proximity detection. The area may be any one of areas P1-P6 shown in FIG. 1. According to an exemplary embodiment, the ITP terminal 20 may detect the mobile device 80 using geofencing or other forms of proximity detection. According to an exemplary embodiment, the ITP terminal 20 may obtain identification information from the mobile device 80 during the proximity detection. The identification information may be a device ID.

[0108] In an operation S2, the ITP terminal 20 may transmit a device ID to the management server 10. Based on the received device ID, in an operation S3, the management server 10 may initiate a handshake protocol with the mobile device 80. According to another exemplary embodiment, based on the received device ID, the ITP terminal 20 may initiate a handshake protocol with the mobile device 80 as shown in FIG. 6A. In an operation S4, the mobile device 80 exchanges a security token with the management server 10 according to an exemplary embodiment. According to another exemplary embodiment, the mobile device 80 may exchange a security token with the ITP terminal 20 as shown in FIG. 6A.

[0109] In operation S5, the management server may retrieve information regarding the security token according to an example embodiment. For example, the management server may retrieve airline data for the passenger associated with the received security token. According to an example embodiment, the airline data may be retrieved from a database of a legacy infrastructure that stores passenger and airline data.

[0110] In an operation S6, the management server 10 may send a request to the ITP terminal 20 to acquire biometric information of the user of the mobile device 80. In an operation S7, the ITP terminal 20 may acquire biometric information of the user of the mobile device 80. According to another exemplary embodiment, the ITP terminal 20 may acquire the biometric information of the user without receiving a request from the management server 10. According to an exemplary embodiment, the biometric information may be a face image of the user captured by a camera of the ITP terminal 20.

[0111] In operation S8, the ITP terminal 20 may transmit the captured facial image to the management device 10 for biometric matching. The management server 20 may perform facial recognition to match the facial image received from the ITP terminal 20 by comparing the captured facial image with a pre-registered image associated with the acquired security token. The pre-registered image may be stored in a database as part of the airline data.

[0112] In operation S9, the management server 10 may push a touchpoint user interface (UI) to the mobile device 80 and the ITP terminal 20. According to an exemplary embodiment, the same touchpoint UI may be sent to both the mobile device 80 and the ITP terminal 20.

[0113] In operation S10, the mobile device 80 directly interacts with the management server 10 or remotely controls a user interface provided on the ITP terminal 20. For example, a user may operate the mobile device 80 to input information about a process flow in the area where the ITP terminal 20 is located. According to an exemplary embodiment, the information input by the user on the mobile device 80 is directly transmitted to the management server 10. According to an exemplary embodiment, the information input by the user on the mobile device 80 may control a selection on a touchpoint UI provided on the ITP terminal 20, which may be forwarded to the management server 10. According to another exemplary embodiment, the user may use gestures to control a selection on a touchpoint UI provided on the ITP terminal instead of the mobile device 80.

[0114] In operation S11, the management server 10 may obtain and process the information entered by the user and update the airline infrastructure database.

[0115] According to an exemplary embodiment, multiple mobile devices can simultaneously interact with the management server 20 based on biometric matching after proximity detection and biometric information capture by the ITP terminal 20. According to an exemplary embodiment, multiple mobile devices may directly interact with the management server 20 simultaneously after a touchpoint user interface is pushed to the mobile device 80. According to another exemplary embodiment, the touchpoint UI may be sent only to the mobile device 80.

[0116] According to another exemplary embodiment, the mobile device 80 may not only be configured to be used to remotely control the ITP terminal 20, but the mobile device 80 may also be implemented as a standalone touchpoint device that completely eliminates dependency on a physical terminal. For example, a passenger will in effect have a touchpoint in their pocket as an intelligent passenger processing mobile device that the passenger can use whenever they need without having to rely on a physical shared terminal.

[0117] 13 shows a sequence diagram of operations in a touchpoint system according to an exemplary embodiment. The sequence diagram shows the interaction between a mobile device 80 and a management device 10 according to an exemplary embodiment.

[0118] According to an exemplary embodiment, a mobile application may be installed on the mobile device 80 to facilitate a platform that allows passengers to execute workflows on the mobile device 80 based on the passenger's flight information, as shown in Figure 13. According to an exemplary embodiment, the platform may be an intelligent passenger process platform that serves as a marketplace where airlines can host and publish specific airline applications (i.e., Airline APP Lite) that can be launched via the mobile device 80. Further, according to an exemplary embodiment, pending tasks that are not completed on the platform may be delegated to the airport ITP terminal 20 that completes the tasks at the airport.

[0119] According to an exemplary embodiment, in operation S11, a mobile application running on the mobile device 80 identifies a passenger. For example, the mobile application may identify flight information for the passenger. In operation S12, the mobile application may launch a user interface screen related to one of the workflows for boarding an airplane. For example, the mobile application may launch a UI screen related to a check-in workflow. According to another exemplary embodiment, the mobile application may launch a UI screen related to a baggage drop workflow.

[0120] In operation S13, the mobile application may communicate with the legacy system's infrastructure to access and retrieve data. For example, the mobile application may communicate with the legacy system's database to access and retrieve data required to complete a workflow. According to an exemplary embodiment, access to the legacy system or other operations of the mobile application may be permitted only after authentication of a user of the mobile device 80.

[0121] In operation S14, the information entered by the user of the mobile device 80 is processed and reported to the management server 10. The management server 10 may include an orchestration layer for managing and updating passenger information received from a mobile application running on the mobile device 80, as shown in operation S15.

[0122] According to another exemplary embodiment, information entered by a user of the mobile device 80 is processed and reported directly to a legacy system. For example, an airline database may be updated with information entered by a user of the mobile device 80.

[0123] In operation S16, based on the state of the workflow, the orchestration layer of the management server 10 may push a UI screen to the ITP terminal 20. For example, pending tasks that are not completed on the platform may be delegated to the ITP terminal 20 at the airport to complete the tasks at the airport. In operation S17, a user operation corresponding to the UI screen is received by the orchestration layer of the management server 10. In operation S18, the orchestration layer updates and sends the passenger data to the legacy system infrastructure.

[0124] 14 is a sequence diagram of operations in a touchpoint system according to another exemplary embodiment. For example, FIG. 14 illustrates another exemplary embodiment in which a mobile device 80 launches an existing airline application. For example, in operation S11-1, the mobile application identifies an airline, and in operation S12-1, the mobile application launches the airline application. After the airline application is launched, the operations performed by the mobile device 80 may be similar to those illustrated in FIG. 13.

[0125] The present disclosure is not limited to the above-described exemplary embodiment, and may be modified as necessary without departing from the spirit of the present disclosure. For example, although the exemplary embodiment shows an ITP terminal, a mobile device, and a management server used in an airport to facilitate various workflow procedures required for a user to enter or use the airport, the present disclosure is not limited thereto. For example, according to another exemplary embodiment, the ITP terminal, the mobile device, and / or the management server may be used in any facility, such as a public transportation facility, a tourist attraction, an amusement park, a museum, a supermarket, etc., that utilizes touch point devices to assist users with services provided at the facility.

[0126] The scope of one or more exemplary embodiments also includes a processing method for storing a program for operating the configuration of the exemplary embodiment to implement the functions of the above-mentioned exemplary embodiment in a storage medium, reading the program stored in the storage medium as code, and executing it in a computer. That is, a computer-readable storage medium is also included in the scope of each exemplary embodiment. Furthermore, not only the storage medium on which the above-mentioned program is stored, but also the program itself is included in each exemplary embodiment. Furthermore, one or more components included in the above-mentioned exemplary embodiment may be circuits such as application specific integrated circuits (ASICs) and field programmable gate arrays (FPGAs) configured to implement the functions of each component.

[0127] Examples of storage media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, compact disks (CD)-ROMs, magnetic tapes, non-volatile memory cards, ROMs, etc. Furthermore, the scope of each of the exemplary embodiments is not limited to examples in which processing is performed by individual programs stored in storage media, but includes examples in which processing is performed by operating on an operating system (OS) and cooperating with the functions of other software or add-in boards.

[0128] Services implemented by the functionality of one or more of the exemplary embodiments described above may be provided to users in the form of Software as a Service (SaaS).

[0129] It should be noted that the above exemplary embodiments are merely examples of embodiments for implementing the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these exemplary embodiments. In other words, the present disclosure can be implemented in various forms without departing from its technical idea or main features.

[0130] A part or all of the exemplary embodiments disclosed above can be described as follows, but are not limited to these.

[0131] (Appendix 1) a memory storing one or more instructions; Executing said one or more instructions Detecting a mobile device entering an area defined by the virtual geographic boundary; receiving authentication information from the mobile device upon entry into the area; Transmitting information about the area to the mobile device based on verification of the authentication information. and a processor configured to: An apparatus, wherein the information indicates that the apparatus can be remotely controlled or monitored via the mobile device.

[0132] (Appendix 2) 2. The apparatus of claim 1, wherein the information about the area sent to the mobile device is alert or guidance information.

[0133] (Appendix 3) 2. The apparatus of claim 1, wherein the information about the area sent to the mobile device corresponds to one of a number of stages of a process within an airport at which the apparatus is located.

[0134] (Appendix 4) 2. The apparatus of claim 1, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0135] (Appendix 5) 2. The apparatus of claim 1, wherein the information is a shared application that replicates an application used by a shared terminal at an airport.

[0136] (Appendix 6) 2. The apparatus of claim 1, wherein the authentication information is biometric information of a user of the mobile device.

[0137] (Appendix 7) 1. A mobile device comprising: a memory storing one or more instructions; Executing said one or more instructions determining that the mobile device is entering an area defined by a virtual geographic boundary; based on the determination that the mobile device is within the area defined by the virtual geographic boundary, enabling an application within the mobile device to perform an interaction with an external device; Sending authentication information to the external device; receiving the information about the area from the external device based on verification of the authentication information; A processor configured as A mobile device comprising:

[0138] (Appendix 8) 8. The mobile device of claim 7, wherein the information about the area sent to the mobile device is alert or guidance information.

[0139] (Appendix 9) 8. The mobile device of claim 7, wherein the information about the area sent to the mobile device corresponds to one of a number of stages of a process within an airport at which the apparatus is located.

[0140] (Appendix 10) 8. The mobile device of claim 7, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0141] (Appendix 11) 8. The mobile device of claim 7, wherein the information is a shared application that replicates an application used by a shared terminal at an airport.

[0142] (Appendix 12) 8. The mobile device of claim 7, wherein the mobile device is configured to function as an improved shared terminal device in a pocket.

[0143] (Appendix 13) 8. The mobile device of claim 7, wherein the processor is further configured to execute a shared application.

[0144] (Appendix 14) 1. An apparatus comprising: A camera and A display and a memory storing one or more instructions; Execute one or more instructions, Detecting mobile devices within an area defined by the virtual geographic boundary; receiving identification information from the mobile device; acquiring biometric information from an image captured by the camera in the vicinity of the device; Based on the comparison between the identification information and the biometric information, Transmitting first information about the area to the mobile device; displaying second information about the area on the display of the device to enable an application and one or more functions corresponding to the application based on a workflow available to the passenger; or Establishing an interface for conducting a touchless interaction with a person associated with the mobile device. Do at least one of the following: A processor configured as An apparatus comprising:

[0145] (Appendix 15) 15. The apparatus of claim 14, wherein the touchless interaction is the interaction between the person and the device that performs the interaction without the person touching the device.

[0146] (Appendix 16) 15. The apparatus of claim 14, wherein the interface is based on gesture control.

[0147] (Appendix 17) 15. The apparatus of claim 14, wherein the interface is based on voice control.

[0148] (Appendix 18) 15. The apparatus of claim 14, wherein the interface is head-control based.

[0149] (Appendix 19) 15. The apparatus of claim 14, wherein the first information about the area sent to the mobile device is alert or guidance information.

[0150] (Appendix 20) 15. The apparatus of claim 14, wherein the interface is based on a user's remote control of the apparatus using a mobile device.

[0151] (Appendix 21) 15. The apparatus of claim 14, wherein the first information about the area sent to the mobile device corresponds to one of a plurality of stages of a process within an airport at which the apparatus is located.

[0152] (Appendix 22) 15. The apparatus of claim 14, wherein the first information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0153] (Appendix 23) a chatbot configured to provide the first information about the area to the user; 15. The apparatus of claim 14, further comprising:

[0154] (Appendix 24) a printer configured to print the first information about the area. 15. The apparatus of claim 14, further comprising:

[0155] (Appendix 25) The apparatus, Handheld devices, or Small form factor devices for airport shared terminals 15. The apparatus of claim 14, wherein

[0156] (Appendix 26) 15. The apparatus of claim 14, wherein the apparatus is a non-stationary, movable device configured to facilitate interaction with the passenger, monitor process flow, or monitor other equipment, intelligent touchpoint terminals, or mobile devices.

[0157] (Appendix 27) 15. The apparatus of claim 14, wherein the first information and the second information are the same.

[0158] (Appendix 28) An apparatus comprising: a memory storing one or more instructions; Executing said one or more instructions Detecting a mobile device entering an area defined by the virtual geographic boundary; receiving identification information from the mobile device; Acquiring biometric information from an image captured near the device; Transmitting information about the area to the mobile device based on a match between the identification information and the biometric information. A processor configured as An apparatus comprising:

[0159] (Appendix 29) 29. The apparatus of claim 28, wherein the information about the area sent to the mobile device is alert or guidance information.

[0160] (Appendix 30) 29. The apparatus of claim 28, wherein the information about the area sent to the mobile device corresponds to one of a number of levels within an airport in which the apparatus is located.

[0161] (Appendix 31) 29. The apparatus of claim 28, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0162] (Appendix 32) 29. The apparatus of claim 28, wherein the information is a shared application that replicates an application used by a shared terminal at the airport.

[0163] (Appendix 33) 1. A mobile device comprising: a memory storing one or more instructions; Executing said one or more instructions determining that the mobile device is entering an area defined by a virtual geographic boundary; Transmitting the identification information to an external device; and receiving information about the area from the external device based on a comparison between the identification information and the biometric information; A processor configured as A mobile device comprising:

[0164] (Appendix 34) 34. The mobile device of claim 33, wherein the information about the area sent to the mobile device is alert or guidance information.

[0165] (Appendix 35) 34. The mobile device of claim 33, wherein the information about the area sent to the mobile device corresponds to one of a number of levels within an airport in which the apparatus is located.

[0166] (Appendix 36) 34. The mobile device of claim 33, wherein the information about the area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0167] (Appendix 37) 34. The mobile device of claim 33, wherein the information is a shared application that replicates an application used by a shared terminal at the airport.

[0168] (Appendix 38) An apparatus comprising: a memory storing one or more instructions; Executing said one or more instructions Detecting a mobile device entering a first area of ​​a plurality of areas, each area designated for a different stage in a passenger flow at the airport; receiving identification information from the mobile device; acquiring biometric information of a user of the mobile device from an image captured in the vicinity of the device; sending a touch point user interface for the first area to the mobile device based on matching the identification information with the biometric information; receiving user input information input by the user via the touchpoint user interface; Based on the user input information, an airport operation for the first area is performed. A processor configured as An apparatus comprising:

[0169] (Appendix 39) 40. The apparatus of claim 38, wherein the information about the first area sent to the mobile device is alert or guidance information.

[0170] (Appendix 40) 40. The apparatus of claim 38, wherein the information about the first area sent to the mobile device corresponds to a stage in an airport in which the apparatus is located.

[0171] (Appendix 41) 39. The apparatus of claim 38, wherein the information about the first area sent to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

[0172] (Appendix 42) 40. The apparatus of claim 38, wherein the information is a shared application that replicates an application used by a shared terminal in the first area of ​​the airport.

[0173] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 054584, filed July 21, 2020, the disclosure of which is incorporated herein by reference in its entirety.

Claims

1. An apparatus comprising: A camera and A display and a memory storing one or more instructions; Executing one or more instructions Detecting mobile devices within an area defined by the virtual geographic boundary; receiving identification information from the mobile device; acquiring biometric information from an image captured by the camera in the vicinity of the device; Based on the comparison between the identification information and the biometric information, Transmitting first information about the area to the mobile device; displaying second information about the area on the display of the device to enable applications and one or more functions corresponding to the applications based on a workflow available to the person; or Establishing an interface for conducting a touchless interaction with a person associated with the mobile device. Do at least one of the following: A processor configured as An apparatus comprising:

2. The device of claim 1 , wherein the touchless interaction is an interaction between the person and the device that performs the interaction without the person touching the device.

3. The device of claim 1 , wherein the interface is based on at least one of gesture control, voice control, and head control.

4. The apparatus of claim 1 , wherein the first information about the area transmitted to the mobile device is alert or guidance information.

5. The apparatus of claim 1 , wherein the interface is based on remote control of the apparatus by the person using the mobile device.

6. The apparatus of claim 1 , wherein the first information about the area transmitted to the mobile device corresponds to a stage of a process within an airport at which the apparatus is located.

7. 2. The apparatus of claim 1, wherein the first information about the area transmitted to the mobile device corresponds to an airline selected from a plurality of airlines based on the identification information received from the mobile device.

8. a chatbot configured to provide the first information about the area to the person; The apparatus of claim 1 further comprising:

9. The apparatus of claim 1 , wherein the apparatus is a non-stationary mobile device configured to facilitate interaction with the person, monitor a process flow, or monitor other equipment, intelligent touchpoint terminals, or mobile devices.

10. An apparatus comprising: a memory storing one or more instructions; Executing the one or more instructions, Detecting a mobile device entering an area defined by the virtual geographic boundary; receiving identification information from the mobile device; Acquiring biometric information from an image captured near the device; Transmitting information about the area to the mobile device based on a match between the identification information and the biometric information. A processor configured as An apparatus comprising:

Images