Method, apparatus and product for luggage check-in
By enabling passengers to scan travel documents and use facial recognition with their smart devices, pre-registering for baggage check-in is achieved, solving the problem of long baggage check-in times in existing technologies and improving the passenger boarding experience and airline operational efficiency.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- NEC HONG KONG
- Filing Date
- 2024-12-13
- Publication Date
- 2026-06-26
AI Technical Summary
In the current technology, baggage check-in is done manually by airline operators or through self-service kiosks, which increases boarding time and affects passenger experience.
By scanning travel documents and using facial recognition with passengers' smart devices, passengers can pre-register for baggage check-in, simplifying the baggage check-in process. Passengers can complete online check-in and send their baggage using self-service baggage drop-off kiosks before arriving at the airport.
Baggage check-in time has been reduced from an average of 3 minutes at the counter to 45 seconds, improving the passenger boarding experience and simplifying airline operations.
Smart Images

Figure CN122295690A_ABST
Abstract
Description
Technical Field
[0001] This disclosure generally relates to computer technology, and more specifically to methods, apparatus and computer program products for baggage check-in. Background Technology
[0002] Currently, baggage check-in in passenger environments is done manually by airline operators or through self-service kiosks located at airports, which increases boarding time and thus affects the passenger boarding experience. Summary of the Invention
[0003] In a first aspect of this disclosure, a method for baggage check-in is provided. The method includes: in response to the initiation of baggage check-in for a passenger's intended trip, obtaining travel document information regarding the passenger's travel documents; verifying the passenger's identity based on a facial image of the passenger and facial data in the travel document information; and in response to successful verification of the passenger's identity, registering the baggage check-in for the passenger's intended trip with a transportation service.
[0004] In a second aspect of this disclosure, an electronic device is provided. The electronic device includes a computer processor coupled to a computer-readable storage unit, the storage unit including instructions that, when executed by the computer processor, implement the method according to the first aspect of this disclosure.
[0005] In a third aspect of this disclosure, a non-transitory computer program product is provided, the computer program product including a computer-readable storage medium having program instructions implemented therein, the program instructions being executable by an electronic device to cause the electronic device to perform the method according to the first aspect of this disclosure.
[0006] The present invention is provided to present, in a simplified form, the selection of concepts further described below in the detailed description. The present invention is not intended to identify key or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter. Attached Figure Description
[0007] The features, advantages, and other aspects of embodiments of this disclosure will become more apparent from the more detailed description in the accompanying drawings. Several embodiments of this disclosure are illustrated schematically and are not intended to limit the scope of this disclosure. In the drawings: Figure 1A An example passenger transport environment in which some embodiments of the present disclosure may be implemented is illustrated schematically; Figure 1B An example stage of baggage check-in is illustrated schematically according to some embodiments of the present disclosure; Figures 2A to 2PAn example user interface for advance baggage check-in is illustrated schematically according to some embodiments of the present disclosure; Figures 3A to 3C An example process workflow for Mobile Application Self-Service Baggage Delivery (MASBD) according to an embodiment of this disclosure is illustrated schematically; Figure 4 A flowchart illustrating a method for baggage check-in according to some embodiments of the present disclosure is shown schematically; and Figure 5 A block diagram of a computing device in which various embodiments of the present disclosure may be implemented is shown schematically. Detailed Implementation
[0008] The principles of this disclosure will now be described with reference to some embodiments. It should be understood that these embodiments are described for illustrative purposes only and to help those skilled in the art to understand and implement this disclosure, and do not imply any limitation on the scope of this disclosure. In addition to the methods described below, the disclosure described herein can be implemented in various other ways.
[0009] In the following description and claims, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains.
[0010] The terms "one embodiment," "implementation," "example embodiment," etc., used in this disclosure to describe embodiments may include specific features, structures, or characteristics, but not every embodiment must include that specific feature, structure, or characteristic. Furthermore, these phrases do not necessarily refer to the same embodiment. Moreover, when a specific feature, structure, or characteristic is described in connection with an example embodiment, it is claimed that, whether explicitly described or not, such a feature, structure, or characteristic affecting its relation to other embodiments is within the knowledge of those skilled in the art.
[0011] It should be understood that although terms such as “first” and “second” may be used herein to describe various elements, these elements should not be limited to these terms. These terms are used only to distinguish one element from another. For example, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element, without departing from the scope of the exemplary embodiments. As used herein, the term “and / or” includes any and all combinations of one or more of the listed terms.
[0012] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the exemplary embodiments. As used herein, the singular forms “a,” “an,” and “the” are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the terms “comprising,” “including,” “having,” “containing,” and / or “comprising” as used herein indicate the presence of the said features, elements, and / or components, but do not exclude the presence or addition of one or more other features, elements, components, and / or combinations thereof.
[0013] The principles of this disclosure will now be described with reference to some embodiments. It should be understood that these embodiments are described for illustrative purposes only and to assist those skilled in the art in understanding and implementing this disclosure, and do not imply any limitation on the scope of this disclosure. This disclosure described herein can be implemented in various ways other than those described below. In the following description and claims, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains.
[0014] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition of the data, or the use of the data) should comply with the requirements of relevant laws, regulations, and rules.
[0015] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be notified in an appropriate manner, in accordance with relevant laws and regulations, of the type, scope of use and usage scenarios of the personal information involved in this disclosure, and user authorization should be obtained.
[0016] For example, in response to receiving an active request from a user, a prompt message is sent to the user to explicitly notify the user that the requested operation will require the acquisition and use of the user's personal information. Therefore, the user can independently choose whether to provide personal information to the software or hardware (such as electronic devices, applications, servers, or storage media) performing the operations of the technical solutions disclosed herein, based on the prompt message.
[0017] As an optional but non-limiting implementation, the method of sending a prompt message to the user in response to an active request from the user may include, for example, a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to choose whether to "agree" or "disagree" to provide personal information to the electronic device.
[0018] It is understood that the above-described notification and user authorization process is merely exemplary and does not limit the implementation of this disclosure. Other methods that comply with applicable laws and regulations are also applicable to the implementation of this disclosure.
[0019] As mentioned above, baggage check-in in passenger transport environments is either done manually by airline operators or through self-service kiosks located at airports, which increases boarding time and thus impacts the passenger boarding experience. Specifically, both baggage check-in and drop-off are performed at counters in the airport. Passengers with at least one piece of baggage to check must go to the counter. Long queues may exist at the counter. Therefore, baggage check-in and drop-off can consume a very long time for passengers. Although the above problems regarding baggage check-in are relative to air travel, similar problems may exist for other types of transportation.
[0020] In view of the foregoing, this disclosure proposes a baggage check-in scheme. According to an embodiment of this disclosure, baggage check-in is initiated in advance for a passenger's intended trip. In response to this initiation, travel document information regarding the passenger's travel documents can be obtained. Based on the passenger's facial image and facial data from the travel document information, the passenger's identity is verified. If the passenger's identity is successfully verified, baggage check-in for the passenger's intended trip is registered with the transportation service.
[0021] For example, passengers can scan their passports using a terminal device (such as a smartphone), and baggage check-in can be pre-arranged for that passenger. Upon arrival at the airport, passengers can print baggage tags and pay for excess baggage if necessary. This process takes only a very small amount of time (e.g., 45 seconds), compared to an average of 3 minutes at a counter or service kiosk.
[0022] This solution allows passengers to complete online baggage check-in before heading to the airport, scan their travel documents using their smartphones, and then proceed directly to the fast self-service baggage drop-off counter to drop off their luggage themselves using their smartphones. This solution streamlines airline operations and enhances the passenger experience.
[0023] Some exemplary embodiments of this disclosure are described in detail with reference to the accompanying drawings.
[0024] Figure 1 schematically illustrates an example passenger transport environment 100 in which some embodiments of the present disclosure may be implemented. As shown in Figure 1, a passenger 110 may carry at least one piece of luggage (such as luggage 122). Checking in luggage 122 is required before boarding the vehicle 130. The passenger 110 can use a terminal device 150 (e.g., a smartphone) to perform self-service luggage check-in. The terminal device 150 may include or be deployed with an application (APP) 155 for luggage check-in. APP 155 may be an application dedicated to luggage check-in or may be a composite application that also provides other services. The scope of protection of this disclosure is not limited thereto. Hereinafter, the proposed solution is also referred to as "Mobile App Self-Service Luggage Check-in (MASBD)".
[0025] In some embodiments, terminal device 150 may communicate with server 140 to provide services to application 155. Terminal device 150 may be any type of mobile terminal, fixed terminal, or portable terminal, including smartphones, mobile phones, desktop computers, laptop computers, notebook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 150 may also support any type of user-facing interface (such as "wearable" circuitry). Server 140 may be various types of computing systems / servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, and computing devices in cloud environments.
[0026] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure. Furthermore, in the following description, some embodiments are described relative to a scenario of air travel. It should be understood that embodiments of this disclosure can be applied to any suitable transportation scenario.
[0027] Figure 1B An example process for baggage check-in and dispatch according to some embodiments of this disclosure is illustrated schematically. Figure 1B As shown, in the pre-check-in process 160, passengers can pre-check in their luggage anywhere using the terminal device, which only requires a few simple steps to reduce check-in time.
[0028] Now for reference Figures 2A to 2PThis example demonstrates a pre-check-in process. The process illustrates a sample check-in workflow at terminal device 150, focusing on the Travel Document (TD) scanning process. For example, passengers can check in their luggage online 24 or 48 hours before their scheduled flight.
[0029] Passenger 110 can initiate baggage check-in for a target trip. For example, the target trip could be an air trip. Baggage check-in can be initiated via APP 155. During the check-in process, passenger 110 can activate the check-in screen via APP 155. Figure 2A A sample user interface (UI) for the baggage check-in screen is shown. Figure 2A As shown, the UI prompts passenger 110 to ensure that at least one passenger has checked in.
[0030] In response to the initiation of baggage check-in for a targeted trip, travel document information regarding passenger 110's TD (Travel Notice) can be obtained. The TD information may include at least passenger 110's information, such as passenger 110's name and facial image. The TD information may also include details about the TD itself, such as the TD's validity period and the organization that issued the TD.
[0031] TD information can be obtained in any suitable manner. For example, an image of the TD information page can be captured by terminal device 150, and at least a portion of the TD information can be identified from the image. For example, optical character recognition (OCR) can be used to identify the TD information. Alternatively or additionally, terminal device 150 can read chip data from the chip in the TD, and at least a portion of the TD information can be based on the chip data. In some embodiments, the information identified from the image and the information in the chip data can be cross-checked. For example, terminal device 150 can check whether the TD ID (e.g., passport ID) from the image is the same as the TD ID in the chip data.
[0032] The example process is described with reference to the accompanying drawings. If as... Figure 2A When the "Next" button 201 shown is triggered (e.g., tapped), the baggage check-in process can be initiated. Figure 2B The interface shown can be displayed in APP 155. The verification phase can begin. As shown, APP 155 proceeds to the "Mobile Baggage Check-in by Scanning Travel Documents" interface. This interface explains the process and prompts passenger 110 with the "Start Scan" button 202. The purpose of scanning travel documents is to register the flight token. If the "Start Scan" button 202 is triggered, then... Figure 2C The interface can be displayed.
[0033] Figure 2CA sample interface for scanning travel documents is shown. It provides instructions and designated areas for scanning. The interface may include an area for the "Terms and Conditions" (T&C). Passengers can tap the T&C area to confirm the terms and conditions before being allowed to proceed to the passport information scanning page. Clicking the "T&C" area will guide you to an interface with information on how to properly scan your TD. Figure 2D This is an illustrative example of the interface. After viewing it, APP 155 can then return to the scanning interface (such as...). Figure 2C (as shown in the image).
[0034] If APP 155 is ready to scan TD, such as Figure 2H As shown, APP 155 can use an animated graphic window 203 with a “Ready to Scan” title displayed at the top of window 203 to prompt passenger 110. Window 203 can be a pop-up window.
[0035] During the reading phase, passenger 110 can keep their travel document (e.g., passport) near terminal device 150. APP 155 can actively read the travel document using any suitable wireless communication technology (e.g., using Near Field Communication (NFC) technology). Simultaneously with the scanning of the travel document, [the following is displayed / shown]... Figure 2J The interface. A pop-up window (204) is displayed with a message indicating that a TD scan is being performed.
[0036] If the scan fails, there may be a read error or a timeout. Explanatory user interfaces for read errors and timeouts are provided in [link to user interface]. Figure 2K and Figure 2M It is shown in the middle. If it is for Figure 2K Some conditions of the interface are met (e.g., Figure 2K If the interface has been displayed for a certain period of time, then... Figure 2C The interface can be displayed again. Passenger 110 can try scanning the TD again.
[0037] After scanning the current TD, it is shown Figure 2E or Figure 2F The interface prompts the passenger (110) if they have any other TDs to scan. If the "Yes" button is pressed, the app (155) can return to... Figure 2C The interface within the app. If the "No" button is pressed, APP 155 can switch to... Figure 2L The interface. If a read error occurs, a read error page is displayed (e.g., ...). Figure 2K (As shown). If a scan or read operation for TD times out, a timeout page will be displayed (e.g., Figure 2M (As shown).
[0038] In some embodiments, TD verification can be performed. As described above, in some embodiments, chip data can be read from the chip in the TD. For example, a passport chip can be read. In such embodiments, the TD can be verified based on the chip data. For example, the chip data may include specific information supporting TD verification.
[0039] In some embodiments, the public key for the TD can be determined from the chip data. For example, the chip data may include the public key. The authenticity of the travel document information can be verified by decrypting the signature in the chip data using the public key for the travel document. For example, the travel document can be checked by performing "passive authentication" to prove whether the TD is a fake or genuine copy (using digital signature technology). Alternatively or additionally, the authentication of the travel document can be verified by verifying the public key for the travel document. For example, the travel document can be checked by performing "active authentication" to ensure that the chip data is trustworthy and has not been altered.
[0040] Depending on whether the TD is successfully verified, different interfaces may be displayed. Figure 2G This is an illustrative example of the user interface if (multiple) authentication attempts on the scanned document fail. If the "OK" button 206 is triggered, then... Figure 2I The "Try Again" page is displayed. If the "Try Again" button 205 is triggered, then... Figure 2H The interface is displayed.
[0041] After successfully reading the travel documents, passenger details can be displayed. For example... Figure 2L As shown, APP 155 can display area 207, which shows passenger details including photo images, confirming the completion of this stage of the baggage check-in process.
[0042] If the TD verification is successful, passenger 110's identity can be verified based on passenger 110's facial image and facial data in the TD information. The facial image can be obtained through an image acquisition interface presented to the passenger. For example, APP 155 can display something like... Figure 2O The interface shown. The interface can prompt passenger 110 to place his or her face in box 221. Then, as... Figure 2P As shown, passenger 110 can press button 222 to trigger facial recognition.
[0043] Another facial image can be extracted from the travel document information. Then, the terminal device 150 or the app 155 can determine whether the acquired facial image matches the other facial image in the TD information. If the acquired facial image matches the other facial image, the passenger's identity is successfully verified. In other words, during the facial recognition phase, the app 155 can use facial recognition technology with liveness detection to perform facial recognition. In this way, the passenger's identity can be verified by matching the photo on the travel document using artificial intelligence (AI) technology.
[0044] If the passenger's identity is successfully verified, baggage check-in can be registered with the transportation service for passenger 110's intended trip. For example, APP 155 can communicate with the transportation service's server and provide passenger 110's registration information regarding baggage check-in. In the scenario of air travel, the transportation service can be provided or supplied by the airline.
[0045] In some embodiments, a travel token for a specific trip can be generated based on a facial image, travel document information, and the passenger's boarding information. The travel token can then be sent to the transportation service. A flight token can be a certificate for passenger 110 to board the transportation. In the scenario of air travel, the travel token can be a flight token that allows passenger 110 to board the aircraft. In such embodiments, the above process can also be referred to as a token registration process.
[0046] In process 160, some actions can be performed. For example, if there are more passengers, APP 155 can display a "Next Passenger" prompt. Figure 2N This is an illustrative example interface. If the "Yes" button is pressed, the interface can return to... Figure 2C If the "No" button is pressed, then Figure 2L The interface can be displayed. For example, other services (such as "selecting a seat" and "pre-ordering your preferred meal") can be selected in advance.
[0047] After completing baggage check-in, passengers can then use the mobile app to access self-service baggage drop-off kiosks for quick and easy baggage drop-off upon arrival at their destination (e.g., an airport).
[0048] Now return to the reference Figure 1B In some embodiments, the pre-delivery process 170 can be performed at the departure point. Process 170 allows passengers to complete certain steps using APP 155 before arriving at the baggage drop-off counter.
[0049] In process 170, after arriving at the departure point, passenger 110 can initiate a pre-delivery process. For example, passenger can click on APP 155 on terminal device 150 to initiate a pre-delivery process.
[0050] In some embodiments, if a pre-delivery process is initiated, APP 155 can determine whether passenger 110 has arrived at the departure point for the target trip. Any suitable positioning technology can be used (e.g., a Global Navigation Satellite System can be used) to determine the location of passenger 110 or terminal device 150.
[0051] In some embodiments, i-beacon technology can be used. For example, if the pre-delivery process for passenger 110's baggage is triggered via a terminal device 150 associated with passenger 110, APP 155 can determine the location of terminal device 150 based on corresponding beacon signals emitted from multiple beacon devices within the departure location. If the location of terminal device 150 is within the departure location, APP 150 can determine that the passenger has arrived at the departure location. For example, in the scenario of air travel, beacon signals in the airport can be used to locate terminal device 150.
[0052] If passenger 110 arrives at the departure point, APP 155 can determine whether baggage check-in has been registered for passenger 110's target trip. For example, APP 155 can query the transportation service to determine whether baggage check-in has been registered for the target trip. In some embodiments, APP 155 can check whether the token registration process has been performed.
[0053] In some embodiments, if baggage check-in is not registered for passenger 110's target trip, APP 155 may present a prompt message instructing passenger 110 to initiate baggage check-in for the target trip. For example, APP 155 may present a message guiding passenger 110 to pre-check in their baggage. Passenger 110 can then initiate baggage check-in. Accordingly, at least a portion of the process 160 described above can be performed. In other words, pre-checking in baggage can be performed after passenger 110 arrives at the departure point but before actual dispatch occurs.
[0054] As an example, the following steps can be performed. At the step displaying the travel document scanning page, APP 155 can guide passenger 110 through the travel document scanning process. At the travel document scanning step, passenger 110 can scan the travel document (e.g., using NFC technology) to extract passenger 110's personal information and photographic image. At the passport verification step, the travel document can be checked by: performing "passive authentication" to prove whether the passport is a fake or genuine copy (using digital signature technology), and performing "active authentication" to ensure that the chip data is credible and has not been altered.
[0055] App 155 can prompt passenger 110 to undergo facial recognition by presenting a facial recognition page. Facial recognition then takes place. App 155 verifies passenger 110's identity by matching real-time facial information with a photo in the TD (using facial recognition technology with liveness detection). The scanned data can then be verified against the airline's records. App 155 can then display a page showing dangerous goods notifications and safety clearance information. Passenger 110 can tap a confirmation button to confirm the dangerous goods and safety regulations. The pre-baggage check-in process can then be successfully completed.
[0056] In some embodiments, if baggage check-in is registered for passenger 110's target trip, APP 155 can determine the accessibility of the travel document based on real-time data obtained from the travel document. For example, if the token registration process has been completed, APP 155 can check whether passenger 110 is carrying the travel document.
[0057] In some embodiments, APP 155 may present a prompt message via terminal device 150 to instruct passenger 110 to scan their travel document. APP 155 may then detect wireless signals emitted from a chip in the travel document. If the wireless signal is detected, APP 155 can determine that the travel document is accessible to the passenger. For example, APP 155 may prompt passenger 110 to keep their TD (Travel TD) near terminal device 150. APP 155 may detect NFC signals from a chip in the TD. If the NFC signal is detected, APP 155 can determine that passenger 110 has their TD.
[0058] The purpose of process 170 is to check whether the token registration process has been completed at the point of departure (using i-beacon technology) to ensure that the passenger's travel documents are available and ready to be scanned at the airport.
[0059] It should be noted that process 170 may be performed at any suitable location at the departure point or at any suitable time after passenger 110 arrives at the departure point. For example, process 170 may occur while passenger 110 is queuing at the counter.
[0060] Now return to the reference Figure 1B In some embodiments, the baggage check-in process 180 can be performed at a counter at the departure point (e.g., a counter in an airport). Now refer to Figures 3A to 3CThe following diagram illustrates an example process for baggage drop-off at a counter, such as the process for a mobile app self-service baggage drop-off counter. This fast self-service baggage drop-off function is available from 75 minutes to 24 hours before the scheduled flight. It should be noted that the example diagram (Figure 3) shows a scenario where QR code scanning is performed before facial verification; however, APP 155 can also allow facial verification to be performed before QR code scanning.
[0061] generally, Figure 3A The idle phase is shown. In the idle state, the counter equipment at the counter can be in a waiting state, displaying a welcome screen 311 with a QR code. Then, QR code interaction is performed. When passenger 110 scans the QR code, the counter equipment can attempt to match the information with the information in the passenger's device. Then, a status check is performed. If all statuses are normal, the process proceeds. If there is a health abnormality or problem, an error screen will be displayed, and the counter equipment can enter an "Out of Service" state.
[0062] The counter equipment can check whether passengers are wearing face masks. If a face mask is detected, the user will be prompted to remove it, and the process will continue. If the face mask is not detected or has already been removed, the counter equipment can proceed with facial verification.
[0063] Figure 3B The facial verification phase is shown. During this phase, passengers may be prompted to look at the camera used for authentication. If the travel token (the user's identity data) is found and verified, the process can proceed to the next phase. If the token is not found or a session timeout occurs, an error screen may be displayed, instructing the passenger to seek assistance from staff. If the device disconnects during the process, an error will occur, halting the process.
[0064] Figure 3C This describes the baggage drop-off stage. Travel documents can be scanned. The passenger scans his / her travel documents (e.g., passport) to ensure they are with the passenger. If the travel document scan is performed at step 170, the scan at the counter can be skipped. In the event of a session timeout or device disconnection, similar to the previous stage, the process will stop and the passenger can restart. Baggage drop-off is then performed. The system checks for any issues with the baggage (e.g., oversized). For successful drop-off, if everything is in order, the baggage will be accepted, and the process will be completed with a success notification.
[0065] In some embodiments, the baggage check-in counter for passengers can be determined based on a visual code (e.g., a QR code) scanned by a terminal device 150 associated with passenger 110. Tag information for baggage carried by the passenger can be obtained based on one or more images captured around the baggage check-in counter. For example, one or more images can be captured by a camera (video analytics (VA) technology) / radio frequency identification (RFID) / scanner. The app 150 can then associate the tag information with passenger 110.
[0066] Now for reference Figures 3A to 3C An example is provided. APP 155 can display a welcome page 311 to passenger 110, requesting the passenger to scan a QR code for pairing. The passenger then uses the mobile APP 155 to scan the QR code on the counter touchscreen to pair with the corresponding counter. If the scan fails, there may be an error or a timeout. Illustrative user interfaces for errors and timeouts are shown in 313 and 314, respectively.
[0067] Then, APP 155 can use user interface 321 to prompt the passenger to look at the camera used for facial recognition. Facial recognition then occurs. (Reference) Figure 3B In step 321, the passenger looks at the camera used for facial recognition (using liveness detection technology) and identification. If APP 155 detects that the passenger is wearing a face mask, APP 155 can prompt the passenger at interface 312, requesting the passenger to remove the face mask. If the corresponding aircraft token can be found via facial recognition, APP 155 can prompt interface 331 to guide the passenger to continue the physical baggage check-in process. Otherwise, APP 155 can prompt interface 322, informing the passenger that "you are not eligible to use this service."
[0068] Passengers place their luggage on the conveyor belt for weighing and scanning. The system checks the height and weight of the luggage to check if it is oversized or overloaded.
[0069] Then, MASBD calls the airline's departure control system (DCS) and retrieves the booking via the barcode boarding pass (BCBP). The system retrieves the booking information from the departure control system, and if a match (token or BCBP) can be found, APP 155 allows the passenger to proceed.
[0070] The system checks if the booking includes allowance for excess baggage. If not, APP 155 requests payment for excess baggage from the passenger. If necessary, passenger 110 uses APP 155 to process the payment. APP 155 has in-app payment functionality.
[0071] The system checks if the luggage exceeds the allowed length. In the case of oversized luggage, APP 155 prompts the passenger to interface 332 to wait for assistance.
[0072] Then, MASBD calls DCS to obtain baggage tag information. If the passenger has completed pre-delivery of baggage or confirmed DG and security notifications, the system can obtain the necessary information from DCS to print the baggage tag.
[0073] The MSSBD prints out either a standard baggage tag or an overweight tag. The system checks the baggage weight before printing the appropriate tag. If the baggage exceeds the weight limit, the MSSBD prints an overweight tag. The passenger can then attach the baggage tag or overweight tag to their baggage.
[0074] The attached baggage tag barcode can be scanned by a camera (video analytics (VA) technology) / RFID / scanner. A baggage weight and information page can be displayed, and passengers can confirm the baggage information. If the passenger presses "Add another baggage" on App 155, App 155 allows the passenger to add more baggage.
[0075] APP 155 displays the final weight and confirmation to the passenger. The passenger then confirms the final information. If the passenger presses "Complete All Baggage" on APP 155, APP 155 confirms the completion of the baggage dispatch process. The system issues a digital tag for baggage retrieval. The baggage then departs and its status is updated on the DCS. The baggage is sent for processing, and its status is updated. Although the above paragraph describes the passenger transport environment using air travel as an example, the means of transport can include, but are not limited to, airplanes, ships, cars, trains, etc.
[0076] The preceding paragraphs have described the details of managing baggage carried by passengers in a passenger transport environment. In an exemplary embodiment of this disclosure, baggage check-in is completed using the passenger's personal device. This not only improves the efficiency and convenience of baggage check-in but also offers additional benefits. For example, contact with people or public facilities (e.g., self-service kiosks) is limited or even avoided during the process. In this way, the risk of infection can be reduced, especially during pandemic outbreaks.
[0077] According to embodiments of this disclosure, a method for baggage check-in is provided. Further details regarding this method will be provided in reference to... Figure 4 ,in Figure 4 A flowchart of a method 400 for baggage check-in according to an embodiment of the present disclosure is shown schematically.
[0078] At box 410, in response to the initiation of baggage check-in for the passenger's intended trip, terminal device 150 obtains travel document information regarding the passenger's travel documents. At box 420, terminal device 150 verifies the passenger's identity based on the passenger's facial image and facial data from the travel document information. At box 430, in response to successful verification of the passenger's identity, terminal device 150 registers the baggage check-in for the passenger with the transportation service.
[0079] In some embodiments, travel document information is obtained at least in part based on chip data read from a chip in the travel document, and method 400 further includes: verifying the travel document based on the chip data, wherein if it is determined that the verification of the travel document is successful, identity is verified.
[0080] In some embodiments, verifying travel documents based on chip data includes at least one of the following: verifying the authenticity of travel document information by decrypting the signature in the chip data using the public key for the travel document, or verifying the authentication of the travel document by verifying the public key for the travel document.
[0081] In some embodiments, verifying a passenger's identity includes: acquiring a facial image of the passenger through an image acquisition interface presented to the passenger; determining, using a machine learning model, whether the acquired facial image matches another facial image in travel document information; and if it is determined that the acquired facial image matches another facial image, determining that the verification of the passenger's identity is successful.
[0082] In some embodiments, registering a passenger's baggage check-in with a transportation service includes: generating a travel token for a target trip based on a facial image, travel document information, and the passenger's boarding information; and sending the travel token to the transportation service.
[0083] In some embodiments, method 400 further includes: if it is determined that the passenger has arrived at the departure point for the target trip, determining whether baggage check-in for the passenger's target trip has been registered; and if it is determined that baggage check-in for the target trip has been registered, determining the accessibility of the travel document based on real-time data obtained from the travel document.
[0084] In some implementations, method 400 further includes: in response to a pre-delivery process for a passenger's baggage being triggered via a terminal device associated with the passenger, determining the location of the terminal device based on corresponding beacon signals emitted from multiple beacon devices within the departure location; and if the location of the terminal device is determined to be within the departure location, determining that the passenger has arrived at the departure location.
[0085] In some embodiments, determining the accessibility of a travel document based on real-time data obtained from the travel document includes: presenting a prompt message via a terminal device to instruct the passenger to scan the travel document; detecting a wireless signal emitted from a chip in the travel document; and determining that the travel document is accessible to the passenger in response to the detection of the wireless signal.
[0086] In some embodiments, method 400 further includes: if it is determined that baggage check-in has not been registered for the target trip, presenting a prompt message to instruct the passenger to initiate baggage check-in for the target trip, wherein baggage check-in is initiated in response to the prompt message.
[0087] In some embodiments, method 400 further includes: determining a baggage check-in counter for a passenger based on a visual code scanned by a terminal device associated with the passenger; obtaining tag information for baggage carried by the passenger based on one or more images captured around the baggage check-in counter; and associating the tag information with the passenger.
[0088] According to embodiments of the present disclosure, an electronic device for implementing method 400 is provided. The electronic device includes a computer processor coupled to a computer-readable storage unit, the storage unit including instructions that, when executed by the computer processor, implement method 400.
[0089] Figure 5 A block diagram of an electronic device 500 in which various embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is for illustrative purposes only and does not in any way imply any limitation on the functionality and scope of this disclosure. The electronic device 500 can be used to implement the methods described above in the embodiments of this disclosure. Figure 5 As shown, electronic device 500 can be a general-purpose computing device. Electronic device 500 may include at least one or more processors or processing units 510, memory 520, storage unit 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560.
[0090] Processing unit 510 can be a physical processor or a virtual processor, and can perform various processes based on programs stored in memory 520. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500. Processing unit 510 may also be referred to as a central processing unit (CPU), graphics processing unit (GPU), microprocessor, controller, or microcontroller.
[0091] Electronic device 500 typically includes various computer storage media. Such media can be any media accessible by electronic device 500, including but not limited to volatile and non-volatile media, or removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), or flash memory) or any combination thereof. Storage cell 530 can be any removable or non-removable media and may include machine-readable media, such as memory, flash drives, disks, or other media that can be used to store information and / or data and can be accessed within electronic device 500.
[0092] Electronic device 500 may also include additional removable / non-removable storage media, volatile / non-volatile storage media. Although in Figure 5 Not shown, but disk drives for reading from and / or writing to removable non-volatile disks and optical disc drives for reading from and / or writing to removable non-volatile optical discs may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces.
[0093] Communication unit 540 communicates with another computing device via a communication medium. Furthermore, the functionality of the components in electronic device 500 can be implemented by a single computing cluster or multiple computing machines that can communicate via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers (PCs), or other general-purpose network nodes.
[0094] Input device 550 can be one or more of various input devices, such as a mouse, keyboard, trackball, voice input device, etc. Output device 560 can be one or more of various output devices, such as a monitor, speaker, printer, etc. With the aid of communication unit 540, electronic device 500 can also communicate with one or more external devices (not shown), such as storage devices, display devices, etc. Electronic device 500 can also communicate with one or more devices that enable a user to interact with electronic device 500, or, if necessary, with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).
[0095] In some implementations, some or all of the components of electronic device 500 may be arranged in a cloud computing architecture, rather than integrated into a single device. In a cloud computing architecture, components can be remotely provided and work together to achieve the functions described in this disclosure. In some implementations, cloud computing provides computing, software, data access, and storage services without requiring end users to know the physical location or configuration of the systems or hardware providing these services. In various implementations, cloud computing provides services via a wide area network (WAN), such as the Internet, using suitable protocols. For example, a cloud computing provider provides applications via a WAN that can be accessed through a web browser or any other computing component. The software or components of the cloud computing architecture, along with the corresponding data, may be stored on servers at remote locations. Computing resources in a cloud computing environment may be consolidated or distributed across remote data center locations. Cloud computing infrastructure may provide services through shared data centers, although to users they appear as a single access point. Therefore, a cloud computing architecture can be used to provide the components and functions described herein from service providers at remote locations. Alternatively, the components and functions described herein may be provided by conventional servers or installed directly or otherwise on client devices.
[0096] The functions described herein can be performed, at least in part, by one or more hardware logic components. For example, but not limited to, illustrative types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), etc.
[0097] Program code used to perform the methods described herein can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device so that, when executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program code can be executed entirely on the machine, or partially on the machine, partially on the machine as a standalone software package, partially on a remote machine, or entirely on a remote machine or server.
[0098] In the context of this disclosure, a machine-readable medium can be any tangible medium that can contain or store programs used by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. More specific examples of machine-readable storage media will include electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0099] Furthermore, although operations are shown in a specific order, this should not be construed as requiring such operations to be performed in the shown specific order or sequential order, or as requiring all shown operations to be performed to achieve the desired result. In some cases, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the subject matter described herein, but rather as descriptions of features that may be specific to particular implementations. Certain features described in the context of individual implementations may also be implemented in combination in a single implementation. Conversely, various features described in a single implementation may also be implemented individually or in any suitable sub-combination in multiple implementations.
[0100] Although the subject matter has been described in language specific to structural features and / or methodological logic, it should be understood that the subject matter specified in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are disclosed as exemplary forms for implementing the claims.
[0101] Based on the foregoing, it should be understood that specific embodiments of the disclosed technology have been described herein for illustrative purposes, but various modifications may be made without departing from the scope of this disclosure. Therefore, the technology disclosed herein is not limited except for the appended claims.
[0102] The embodiments of the subject matter and functional operation described in this disclosure can be implemented in various systems, digital electronic circuit systems, or computer software, firmware, or hardware (including the structures disclosed herein and their equivalents), or combinations thereof. Embodiments of the subject matter described herein can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible, non-transitory computer-readable medium for execution by a data processing apparatus or for controlling the operation of a data processing apparatus. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a combination of materials influencing machine-readable propagation signals, or combinations thereof. The terms "data processing unit" or "data processing apparatus" encompass all means, devices, and machines for processing data, including, for example, a programmable processor, a computer, or a plurality of processors or computers. In addition to hardware, the apparatus may include code that creates an execution environment for the computer program in question, such as code constituting processor firmware, a protocol stack, a database management system, an operating system, or combinations thereof.
[0103] Computer programs (also known as programs, software, software applications, scripts, or code) can be written in any programming language, including compiled or interpreted languages, and can be deployed in any form, including as standalone programs or as modules, components, subroutines, or other units suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored as part of a file containing other programs or data (e.g., as one or more scripts stored in a markup language document), as a single file dedicated to the program in question, or as multiple coordinating files (e.g., as a file storing portions of one or more modules, subroutines, or code). Computer programs can be deployed to be executed on one or more computers located at a single site or distributed across multiple sites and interconnected by a communication network.
[0104] For example, processors suitable for executing computer programs include both general-purpose microprocessors and special-purpose microprocessors, as well as any one or more processors in any type of digital computer. Typically, a processor receives instructions and data from read-only memory or random access memory, or both. The basic elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Typically, a computer will also include, or be operatively coupled to, one or more mass storage devices (e.g., magnetic disks, magneto-optical disks, or optical disks) for storing data, or transfer data to or from them. However, a computer does not need to have such devices. Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media, and memory devices, including, for example, semiconductor memory devices (e.g., EPROM, EEPROM) and flash memory devices. The processor and memory may be supplemented by or incorporated into a special-purpose logic circuit system.
[0105] The specification together with the accompanying drawings is intended to be considered as an example only, where "as an example" means "example". As used herein, the use of "or" is intended to include "and / or" unless the context clearly indicates otherwise.
[0106] While this disclosure contains numerous details, these details should not be construed as limiting any disclosure or the scope of the claims, but rather as descriptions of features that may be specific to particular embodiments of the disclosure. Certain features described in this disclosure in the context of individual embodiments may also be implemented in combination in individual embodiments. Conversely, various features described in the context of individual embodiments may also be implemented individually or in any suitable sub-combination in multiple embodiments. Furthermore, although the features described above may be described as acting on certain combinations, or even initially claimed in this way, in some cases, one or more features from the claimed combination may be removed from the combination, and the claimed combination may refer to a sub-combination or a variation of the sub-combination.
[0107] Similarly, although operations are shown in a specific order in the accompanying drawings, this should not be construed as requiring such operations to be performed in the specific order shown or in sequential order, or as requiring all shown operations to be performed to achieve the desired result. Furthermore, the separation of various system components in the embodiments described in this disclosure should not be construed as requiring such separation in all embodiments. Only some embodiments and examples have been described, and other embodiments, enhancements, and variations can be made based on what is described and shown in this disclosure.
Claims
1. A method for baggage check-in, comprising: In response to the initiation of baggage check-in for a passenger's intended trip, obtain travel document information regarding the passenger's travel documents; The passenger's identity is verified based on the passenger's facial image and facial data in the travel document information; as well as In response to the successful verification of the passenger's identity, baggage check-in for the passenger's intended trip is registered with the transportation service.
2. The method of claim 1, wherein the travel document information is obtained at least in part based on chip data read from a chip in the travel document, and the method further comprises: The travel document is verified based on the chip data, wherein if the verification of the travel document is successful, the identity is verified.
3. The method of claim 2, wherein verifying the travel document based on the chip data includes at least one of the following: The authenticity of the travel document information is verified by decrypting the signature in the chip data using the public key specific to the travel document, or... The authentication of the travel document is verified by verifying the public key used for the travel document.
4. The method of claim 1, wherein verifying the passenger's identity comprises: The passenger's facial image is acquired through an image acquisition interface presented to the passenger; By using a machine learning model, it is determined whether the acquired facial image matches another facial image in the travel document information; and If it is determined that the acquired facial image matches the other facial image, the verification of the passenger's identity is successful.
5. The method of claim 1, wherein registering the baggage check-in for the passenger to the transportation service comprises: Based on the facial image, the travel document information, and the passenger's boarding information, a travel token is generated for the target trip; as well as Send the travel token to the transportation service.
6. The method according to claim 1, further comprising: If it is determined that the passenger has arrived at the departure point for the target trip, determine whether the baggage check-in for the passenger's target trip has been registered; as well as If it is determined that the baggage check-in is registered for the target trip, the accessibility of the travel document is determined based on real-time data obtained from the travel document.
7. The method according to claim 6, further comprising: In response to the pre-delivery process for the passenger's baggage being triggered via a terminal device associated with the passenger, the location of the terminal device is determined based on corresponding beacon signals emitted from multiple beacon devices within the departure point; If the location of the terminal device is determined to be within the departure point, the passenger is determined to have arrived at the departure point.
8. The method of claim 7, wherein determining the accessibility of the travel document based on real-time data obtained from the travel document comprises: The terminal device displays a prompt message to instruct the passenger to scan the travel document; Detect the wireless signal emitted from the chip in the travel document; as well as In response to the detection of the wireless signal, it is determined that the travel document is accessible to the passenger.
9. The method according to claim 6, further comprising: If it is determined that the baggage check-in has not been registered for the target trip, a prompt message is displayed to instruct the passenger to initiate the baggage check-in for the target trip. The baggage check-in was initiated in response to the notification message.
10. The method according to claim 1, further comprising: The baggage check-in counter for the passenger is determined based on the visual code scanned by the terminal device associated with the passenger. Based on one or more images captured around the baggage check-in counter, tag information for the baggage carried by the passenger is obtained; as well as The tag information is associated with the passenger.
11. An electronic device, comprising: Processor, the processor being configured to cause the device to: In response to the initiation of baggage check-in for a passenger's intended trip, obtain travel document information regarding the passenger's travel documents; The passenger's identity is verified based on the passenger's facial image and facial data in the travel document information; as well as In response to the successful verification of the passenger's identity, baggage check-in for the passenger's intended trip is registered with the transportation service.
12. The device of claim 11, wherein the travel document information is obtained at least in part based on chip data read from a chip in the travel document, and the device is further configured such that: The travel document is verified based on the chip data, wherein if the verification of the travel document is successful, the identity is verified.
13. The apparatus of claim 12, wherein the apparatus is caused to perform at least one of the following: The authenticity of the travel document information is verified by decrypting the signature in the chip data using the public key specific to the travel document, or... The authentication of the travel document is verified by verifying the public key used for the travel document.
14. The apparatus of claim 11, wherein the apparatus is configured to: The passenger's facial image is acquired through an image acquisition interface presented to the passenger; By using a machine learning model, it is determined whether the acquired facial image matches another facial image in the travel document information; and If it is determined that the acquired facial image matches the other facial image, the verification of the passenger's identity is successful.
15. The apparatus of claim 11, wherein the apparatus is configured to: Based on the facial image, the travel document information, and the passenger's boarding information, a travel token for the target trip is generated; and Send the travel token to the transportation service.
16. The apparatus of claim 11, wherein the apparatus is further configured such that: If it is determined that the passenger has arrived at the departure point for the target trip, determine whether the baggage check-in for the passenger's target trip has been registered; and If it is determined that the baggage check-in is registered for the target trip, the accessibility of the travel document is determined based on real-time data obtained from the travel document.
17. The apparatus of claim 16, wherein the apparatus is further configured such that: In response to the pre-delivery process for the passenger's baggage being triggered via a terminal device associated with the passenger, the location of the terminal device is determined based on corresponding beacon signals emitted from multiple beacon devices within the departure point; If the location of the terminal device is determined to be within the departure point, the passenger is determined to have arrived at the departure point.
18. The apparatus of claim 17, wherein the apparatus is configured to: The terminal device displays a prompt message to instruct the passenger to scan the travel document; Detecting the wireless signal emitted from the chip in the travel document; and In response to the detection of the wireless signal, it is determined that the travel document is accessible to the passenger.
19. The apparatus of claim 16, wherein the apparatus is further configured such that: If it is determined that the baggage check-in has not been registered for the target trip, a prompt message is displayed to instruct the passenger to initiate the baggage check-in for the target trip. The baggage check-in was initiated in response to the notification message.
20. The apparatus of claim 11, wherein the apparatus is further configured such that: The baggage check-in counter for the passenger is determined based on the visual code scanned by the terminal device associated with the passenger. Based on one or more images captured around the baggage check-in counter, tag information for the baggage carried by the passenger is obtained; and The tag information is associated with the passenger.
21. A nontransitory computer program product comprising a computer-readable storage medium having program instructions implemented therein, the program instructions being executable by an electronic device to cause the electronic device to perform the method according to any one of claims 1 to 10.