Information processing device, information processing method, and program

Abstract

Provided are an information processing device and the like capable of preventing baggage from being mistaken for other baggage. The information processing device comprises: a face image acquisition means for acquiring a face image that is transmitted from a face authentication camera and includes the face of a user who has received baggage; a face information acquisition means for acquiring face information of the user on the basis of the face image; a baggage weight acquisition means for acquiring the weight of the baggage; a verification means for verifying whether or not at least the face information and the weight of the baggage are registered in a database, by associating the same with each other; and a verification result output means for outputting the result of the verification.

Description

Information Processing Apparatus, Information Processing Method, and Program 【0001】 The present disclosure relates to an information processing apparatus, an information processing method, and a program. 【0002】 When receiving checked baggage deposited at a departure airport at an arrival airport, technologies for preventing misappropriation of baggage have been proposed (see, for example, Patent Document 1 and Patent Document 2). 【0003】 In contrast, the inventor of the present invention considered registering at least the weight of the checked baggage deposited at the departure airport in association with the face information of the user of the baggage, and collating the registration information with the weight of the received baggage and the face information of the user at the arrival airport to prevent misappropriation of the baggage. 【0004】 Japanese Patent Application Laid-Open No. 2023-107921 International Publication No. 2022 / 038709 【0005】 However, Patent Documents 1 and 2 above do not describe at all registering at least the weight of the checked baggage deposited at the departure airport in association with the face information of the user of the baggage, and collating the registration information with the weight of the received baggage and the face information of the user at the arrival airport to prevent misappropriation of the baggage. 【0006】 An object of the present disclosure is to provide an information processing apparatus, an information processing method, and a program that can prevent misappropriation of baggage by registering at least the weight of the checked baggage deposited at the departure airport in association with the face information of the user of the baggage, and collating the registration information with the weight of the received baggage and the face information of the user at the arrival airport in view of the above-described problems. 【0007】 The information processing apparatus of the present disclosure includes: a face image acquisition unit that acquires a face image including the face of a user who has received baggage transmitted from a face authentication camera; a face information acquisition unit that acquires the face information of the user based on the face image; a baggage weight acquisition unit that acquires the weight of the baggage; and a collation unit that collates whether or not at least the face information and the weight of the baggage are registered in association with each other in a database. 【0008】Another information processing device of this disclosure includes: a face image acquisition means for acquiring a face image including the face of a user who is depositing luggage, transmitted from a face recognition camera; a face information acquisition means for acquiring the user's face information based on the face image; a luggage weight acquisition means for acquiring the weight of the luggage; and a registration means for registering the face information and the weight of the luggage in a database. 【0009】 The information processing method disclosed herein includes: a face image acquisition step of acquiring a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition step of acquiring the user's face information based on the face image; a luggage weight acquisition step of acquiring the weight of the luggage; a matching step of checking whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output step of outputting the result of the matching. 【0010】 The program disclosed herein is a program that causes a computer to execute the following steps: a face image acquisition step that acquires a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition step that acquires the user's face information based on the face image; a luggage weight acquisition step that acquires the weight of the luggage; a matching step that checks whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output step that outputs the result of the matching. 【0011】 This disclosure provides an information processing device, an information processing method, and a program that can prevent baggage mix-ups by registering at least the weight of checked baggage and the facial information of the baggage user linked at the departure airport, and then comparing this registered information with the weight of the received baggage and the facial information of the user at the arrival airport. 【0012】This is a schematic diagram of the customs declaration kiosk terminal 20. This is a flowchart showing an example of the operation of the customs declaration kiosk terminal 20. This is a diagram illustrating the flow of baggage at the departure and arrival airports. This is a schematic diagram showing the configuration of the baggage claim system 1. This is a flowchart showing an example of the operation of the registration device 10. This is a flowchart showing an example of the operation of the customs declaration kiosk terminal 20. This is a flowchart showing an example of the operation of the server 30 when it receives a registration request transmitted from the registration device 10. This is a flowchart showing an example of the operation of the server 30 when it receives a verification request transmitted from the customs declaration kiosk terminal 20. This is a modified example of the database 31 of the server 30. This is a diagram showing an example of the hardware configuration of the registration device 10 according to this disclosure. 【0013】 (Embodiment 1) First, an example of an information processing device of the present disclosure, a customs declaration kiosk terminal 20, will be described using Figure 1. 【0014】 Figure 1 is a schematic diagram of the customs declaration kiosk terminal 20. The customs declaration kiosk terminal 20 will be installed at the arrival airport. 【0015】 As shown in Figure 1, the customs declaration kiosk terminal 20 includes a face image acquisition means 20a that acquires a face image including the face of the user who receives the baggage transmitted from the face recognition camera 21 (the user who makes a customs declaration by operating the customs declaration kiosk terminal 20), a face information acquisition means 20b that acquires the user's face information based on the face image, a baggage weight acquisition means 20c that acquires the weight of the baggage transmitted from the weighing scale 23, a matching means 20g that checks whether at least the face information and the baggage weight are registered in the database in association with each other, and a matching result output means 20h that outputs the result of the matching. The database is registered in association with at least the weight of the baggage checked in at the departure airport and the face information of the user of that baggage. 【0016】 Next, an example of the operation of the customs declaration kiosk terminal 20 described above will be explained. 【0017】 Figure 2 is a flowchart showing an example of the operation of the customs declaration kiosk terminal 20. 【0018】First, the facial image acquisition means 20a acquires a facial image including the face of the user who received the baggage transmitted from the facial recognition camera 21 (the user who makes a customs declaration by operating the customs declaration kiosk terminal 20) (step S1). 【0019】 Next, the facial information acquisition means 20b acquires the user's facial information based on the facial image acquired in step S1 (step S2). 【0020】 Next, the baggage weight acquisition means 20c acquires the weight of the baggage transmitted from the weighing scale 23 (step S3). 【0021】 Next, the matching means 20g checks whether the facial information obtained in step S2 and the weight of the baggage obtained in step S3 are linked and registered in the database (step S4). 【0022】 Next, the matching result output means 20h outputs the matching result (step S5). 【0023】 As described above, according to Embodiment 1, at least the weight of checked baggage and the facial information of the baggage user are registered and linked at the departure airport, and at the arrival airport, this registered information is compared with the weight of the received baggage and the facial information of the user, thereby preventing baggage checked at the departure airport from being mistaken for another baggage at the arrival airport. 【0024】 (Embodiment 2) Next, Embodiment 2 will be described. Embodiment 2 is an embodiment that makes Embodiment 1 more concrete. In Embodiment 2, the face image acquisition means 20a, face information acquisition means 20b, baggage weight acquisition means 20c, matching means 20g, and matching result output means 20h will be described as the face image acquisition unit 20a, face information acquisition unit 20b, baggage weight acquisition unit 20c, matching unit 20g, and matching result output unit 20h, respectively. 【0025】 Figure 3 illustrates the flow of baggage at the departure and arrival airports. 【0026】As shown in Figure 3, user U checks in baggage L1 at the check-in counter at the departure airport, retrieves baggage L2 at the baggage claim area at the arrival airport, moves to the customs declaration kiosk terminal 20 with the retrieved baggage L2, and operates the customs declaration kiosk terminal 20 to make a customs declaration. When retrieving baggage at the baggage claim area at the arrival airport, there is a risk of baggage mix-ups. The baggage retrieval system 1 is a system designed to prevent such baggage mix-ups. 【0027】 Figure 4 is a schematic diagram showing the configuration of the baggage claim system 1. 【0028】 As shown in Figure 4, the baggage claim system 1 includes a registration device 10, a customs declaration kiosk terminal 20, a server 30, and a mobile terminal 40. The registration device 10, customs declaration kiosk terminal 20, server 30, and mobile terminal 40 communicate with each other via a network NW. The network NW is a wired or wireless communication line. For example, a wireless LAN (Local Area Network) or an internet connection can be used as the network NW. The type of communication is not limited. 【0029】 First, let me explain the registration device 10. The registration device 10 is installed at the check-in counter of the departure airport. The registration device 10 may be an information processing device such as a personal computer. 【0030】 As shown in Figure 4, the registration device 10 is electrically connected to a facial recognition camera 11, a baggage verification camera 12, a weight scale 13, and a tagging device 14. These are installed near the registration device 10 at the departure airport. 【0031】 The facial recognition camera 11 is, for example, a digital camera that includes an image sensor such as a CCD. The facial recognition camera 11 captures a facial image, including the face of user U, who is visiting the check-in counter to check in their baggage for boarding procedures, in response to an operation on the registration device 10 (operation by user U or operation by airport staff S). This captured facial image is transmitted to the registration device 10. 【0032】The baggage verification camera 12 is, for example, a digital camera that includes an image sensor such as a CCD. The baggage verification camera 12 captures an image of the baggage L1 checked in by user U in response to an operation on the registration device 10 (an operation by user U or an operation by airport staff S). This captured baggage image is transmitted to the registration device 10. 【0033】 The weighing scale 13 measures the weight of the baggage L1 placed on it. This measured weight is transmitted to the registration device 10. 【0034】 The tagging device 14 creates a tag (not shown) printed with tag information (such as user U's flight information) to be attached to baggage L1, in response to an operation on the registration device 10 (an operation by airport staff S). 【0035】 As shown in Figure 4, the registration device 10 includes a face image acquisition unit 10a, a face information acquisition unit 10b, a baggage weight acquisition unit 10c, a baggage image acquisition unit 10d, a baggage information acquisition unit 10e, a tag information acquisition unit 10f, a registration unit 10g, and a communication unit 10h. 【0036】 The facial image acquisition unit 10a acquires a facial image, including the face of user U who is checking in their luggage L1, which is transmitted from the facial recognition camera 11. 【0037】 The face information acquisition unit 10b acquires the face information of user U based on the face image acquired by the face image acquisition unit 10a. Specifically, the face information acquisition unit 10b acquires the face information of user U extracted from the face image by performing predetermined image processing on the face image acquired by the face image acquisition unit 10a. 【0038】 The baggage weight acquisition unit 10c acquires the weight of the baggage L transmitted from the weighing scale 13. 【0039】 The baggage image acquisition unit 10d acquires a baggage image, including the baggage L, transmitted from the baggage verification camera 12. 【0040】The carry-on baggage information acquisition unit 10e acquires carry-on baggage information based on the carry-on baggage image acquired by the carry-on baggage image acquisition unit 10d. Specifically, the carry-on baggage information acquisition unit 10e executes predetermined image processing on the carry-on baggage image acquired by the carry-on baggage image acquisition unit 10d to acquire the carry-on baggage information extracted from the carry-on baggage image. The acquired carry-on baggage information is, for example, the shape and color of the carry-on baggage L1. 【0041】 The tag information acquisition unit 10f acquires tag information printed on a tag attached to the carry-on baggage L1. The tag information is acquired from, for example, an airline company system (not shown). The acquired tag information includes, for example, the flight information of the user U. 【0042】 The registration unit 10g associates the face information of the user U acquired by the face information acquisition unit 10b, the weight of the carry-on baggage L1 acquired by the carry-on baggage weight acquisition unit 10c, the carry-on baggage information acquired by the carry-on baggage information acquisition unit 10e, and the tag information acquired by the tag information acquisition unit 10f, and registers them in the database 31 of the server 30. Note that the registration unit 10g may register at least the face information of the user U acquired by the face information acquisition unit 10b and the weight of the carry-on baggage L1 acquired by the carry-on baggage weight acquisition unit 10c in association with each other in the database 31. 【0043】 The communication unit 10h communicates with the server 30 and the like via the network NW. 【0044】 Next, an operation example of the registration device 10 having the above configuration will be described. 【0045】 FIG. 5 is a flowchart of an operation example of the registration device 10. 【0046】 Hereinafter, an operation example when the user U deposits the carry-on baggage L1 at the check-in counter at the departure airport will be described. In the following operation example, it is assumed that the tag with the tag information printed thereon is attached to the carry-on baggage L1 at an appropriate timing. 【0047】First, a face image including the face of user U who deposits the baggage L1 is acquired (step S10). This is realized by the face image acquisition unit 10a. Specifically, in response to an operation on the registration device 10 (operation of user U or operation of airport staff S), the face authentication camera 11 captures a face image including the face of user U. The captured face image is transmitted to the registration device 10. The face image acquisition unit 10a acquires the face image transmitted from the face authentication camera 11. 【0048】 Next, user face information is acquired based on the face image acquired in step S10 (step S11). This is realized by the face information acquisition unit 10b. Specifically, the face information acquisition unit 10b executes predetermined image processing on the face image acquired in step S10 to acquire the face information of user U extracted from the face image. 【0049】 Next, the weight of the baggage deposited by the user is acquired (step S12). This is realized by the baggage weight acquisition unit 10c. Specifically, the weighing scale 13 measures the weight of the baggage L1 placed thereon. The measured weight is transmitted to the registration device 10. The baggage weight acquisition unit 10c acquires the weight of the baggage L1 transmitted from the weighing scale 13. 【0050】 Next, a baggage image including the baggage L1 deposited by user U is acquired (step S13). This is realized by the baggage image acquisition unit 10d. Specifically, in response to an operation on the registration device 10 (operation of user U or operation of airport staff S), the baggage inspection camera 12 captures a baggage image including the baggage L1 (baggage L1 with a tag attached). The captured baggage image is transmitted to the registration device 10. The baggage image acquisition unit 10d acquires the baggage image transmitted from the baggage inspection camera 12. 【0051】Next, baggage information is acquired based on the baggage image acquired in step S13 (step S14). This is achieved by the baggage information acquisition unit 10e. Specifically, the baggage information acquisition unit 10e acquires baggage information extracted from the baggage image by performing predetermined image processing on the baggage image acquired in step S13. This acquired baggage information is, for example, the shape and color of baggage L1. 【0052】 Next, tag information is acquired (step S15). This is accomplished by the tag information acquisition unit 10f. 【0053】 Next, the facial information obtained in step S11, the weight of baggage L1 obtained in step S12, the baggage information obtained in step S14, and the tag information obtained in step S15 are linked and registered in the database 31 of the server 30 (step S16). This is achieved, for example, by the registration unit 10g sending a registration request to the server 30. The registration request includes the facial information obtained in step S11, the weight of baggage L1 obtained in step S12, the baggage information obtained in step S14, and the tag information obtained in step S15. The server 30, having received this registration request, links the facial information, baggage weight, baggage information, and tag information included in the registration request and registers them in the database 31. 【0054】 Next, the customs declaration kiosk terminal 20 will be described. The customs declaration kiosk terminal 20 is installed at the arrival airport. The customs declaration kiosk terminal 20 may be an information processing device such as a personal computer. 【0055】 As shown in Figure 4, the customs declaration kiosk terminal 20 is electrically connected to a facial recognition camera 21, a baggage verification camera 22, a weighing scale 23, and a display device 24. These are installed near the customs declaration kiosk terminal 20 at the arrival airport. The weighing scale 23 is intended to be used by user U as a place to put their baggage when they operate the customs declaration kiosk terminal 20 to make a customs declaration. 【0056】The facial recognition camera 21 is, for example, a digital camera that includes an image sensor such as a CCD. The facial recognition camera 21 captures a facial image, including the face of user U (the user who makes a customs declaration by operating the customs declaration kiosk terminal 20), in response to an operation on the customs declaration kiosk terminal 20 (an operation by user U). This captured facial image is transmitted to the customs declaration kiosk terminal 20. 【0057】 The baggage verification camera 22 is, for example, a digital camera that includes an image sensor such as a CCD. In response to an operation on the customs declaration kiosk terminal 20 (operation by user U), the baggage verification camera 22 captures an image of user U's baggage, including user U's baggage L2 (baggage received by user U at the baggage claim area), which is placed on the weighing scale 23. This captured baggage image is transmitted to the customs declaration kiosk terminal 20. 【0058】 The weighing scale 23 measures the weight of the baggage L2 placed on it. This measured weight is transmitted to the customs declaration kiosk terminal 20. 【0059】 The display device 24 is, for example, a display device such as a liquid crystal display. 【0060】 As shown in Figure 4, the customs declaration kiosk terminal 20 includes a face image acquisition unit 20a, a face information acquisition unit 20b, a baggage weight acquisition unit 20c, a baggage image acquisition unit 20d, a baggage information acquisition unit 20e, a tag information acquisition unit 20f, a matching unit 20g, a matching result output unit 20h, an alert processing unit 20i, and a communication unit 20j. 【0061】 The facial image acquisition unit 20a acquires a facial image, including the face of user U (a user who makes a customs declaration by operating the customs declaration kiosk terminal 20), which is transmitted from the facial recognition camera 21. 【0062】 The face information acquisition unit 20b acquires the face information of user U based on the face image acquired by the face image acquisition unit 20a. Specifically, the face information acquisition unit 20b acquires the face information of user U extracted from the face image by performing predetermined image processing on the face image acquired by the face image acquisition unit 20a. 【0063】The baggage weight acquisition unit 20c acquires the weight of baggage L2 (baggage received by user U at the baggage claim area) transmitted from the weighing scale 23. 【0064】 The baggage image acquisition unit 20d acquires a baggage image, including the baggage L2, transmitted from the baggage verification camera 22. 【0065】 The baggage information acquisition unit 20e acquires baggage information based on the baggage image acquired by the baggage image acquisition unit 20d. Specifically, the baggage information acquisition unit 20e acquires baggage information extracted from the baggage image by performing predetermined image processing on the baggage image acquired by the baggage image acquisition unit 20d. This acquired baggage information is, for example, the shape and color of baggage L2. 【0066】 The tag information acquisition unit 20f acquires tag information based on the baggage image acquired by the baggage image acquisition unit 20d. Specifically, the tag information acquisition unit 20f acquires tag information extracted from the baggage image by performing predetermined image processing on the baggage image acquired by the baggage image acquisition unit 20d. 【0067】 The matching unit 20g checks whether the facial information of user U acquired by the facial information acquisition unit 20b, the weight of baggage L2 acquired by the baggage weight acquisition unit 20c, the baggage information acquired by the baggage information acquisition unit 20e, and the tag information acquired by the tag information acquisition unit 20f are linked and registered in the database 31 of the server 30. 【0068】 The matching result output unit 20h outputs the matching result of the matching unit 20g. For example, the matching result output unit 20h displays the matching result of the matching unit 20g on the display device 24. The matching result is either "match OK," indicating that the item is registered in the database 31, or "match NG," indicating that the item is not registered in the database 31. 【0069】The alert processing unit 20i performs alert processing based on the verification result of the verification unit 20g. For example, if the verification result of the verification unit 20g is NG, the alert processing unit 20i sends a notification to the mobile terminal 40 to that effect (alert notification). This notification includes information that identifies the customs declaration kiosk terminal 20 that failed the verification (e.g., identification information or location information of the customs declaration kiosk terminal 20), and baggage information of the user operating the terminal at the time of baggage check-in. The mobile terminal 40 is a mobile terminal such as a smartphone or tablet carried by airport staff or security guards. 【0070】 The communication unit 20j communicates with the server 30 and other devices via the network NW. 【0071】 Next, an example of the operation of the customs declaration kiosk terminal 20 with the above configuration will be described. 【0072】 Figure 6 is a flowchart showing an example of the operation of the customs declaration kiosk terminal 20. 【0073】 The following describes an example of what happens when user U receives baggage L2 at the baggage claim area of ​​the arrival airport, moves to the customs declaration kiosk terminal 20 with the received baggage L2, and operates the customs declaration kiosk terminal 20 to make a customs declaration. It should be assumed that the facial recognition camera 21, baggage verification camera 22, and weighing scale 23 are not activated before user U starts operating the customs declaration kiosk terminal 20. 【0074】 First, when user U starts operating the customs declaration kiosk terminal 20 (step S20: YES), for example, when the application start button (not shown) displayed on the customs declaration kiosk terminal 20 is pressed, the facial recognition camera 21, the baggage verification camera 22, and the weighing scale 23 are activated (step S21). This is achieved by the customs declaration kiosk terminal 20 executing a predetermined program. 【0075】Next, a baggage image including the baggage placed on the weighing scale 23 is acquired (step S22). This is achieved by the baggage image acquisition unit 20d. Specifically, in response to an operation on the customs declaration kiosk terminal 20 (operation by user U), the baggage verification camera 22 captures a baggage image including the baggage. This captured baggage image is transmitted to the customs declaration kiosk terminal 20. The baggage image acquisition unit 20d acquires this baggage image transmitted from the baggage verification camera 22. 【0076】 Next, based on the baggage image acquired in step S22, it is determined whether or not a tag is attached to the baggage (step S23). This is achieved by the customs declaration kiosk terminal 20 executing a predetermined program. 【0077】 If, as a result, it is determined that the baggage does not have a tag attached (step S23: NO), the display device 24 displays a message prompting the user to place the tagged baggage on the weighing scale 23 (step S24). This is achieved by the customs declaration kiosk terminal 20 executing a predetermined program. For example, in step S23, it may be determined whether there is any other baggage besides the baggage being matched (for example, carry-on baggage), and if it is determined that there is other baggage, the display device 24 may display a message prompting the user to place the baggage being matched on the weighing scale 23 (alert screen). 【0078】 The processes in steps S22 to S24 are repeatedly executed until it is determined in step S23 that a tag has been attached to the baggage (step S23: YES). 【0079】On the other hand, if the determination in step S23 determines that a tag is attached to the baggage placed on the weighing scale 23 (step S23: YES), a facial image including the face of user U, who operates the customs declaration kiosk terminal 20 to make a customs declaration, is acquired (step S25). This is achieved by the facial image acquisition unit 20a. Specifically, in response to the operation on the customs declaration kiosk terminal 20 (operation by user U), the facial recognition camera 21 captures a facial image including the face of user U. This captured facial image is transmitted to the customs declaration kiosk terminal 20. The facial image acquisition unit 20a acquires the facial image transmitted from the facial recognition camera 21. 【0080】 Next, the user's face information is acquired based on the face image acquired in step S25 (step S26). This is achieved by the face information acquisition unit 20b. Specifically, the face information acquisition unit 20b acquires the face information of user U extracted from the face image by performing predetermined image processing on the face image acquired in step S25. If the user's face information cannot be acquired in step S26, the display device 24 may display an alert screen prompting the user to face the face recognition camera 21. 【0081】 Next, the weight of the baggage L2 (baggage received at the baggage claim area) placed on the weighing scale 23 is acquired (step S27). This is achieved by the baggage weight acquisition unit 20c. Specifically, the weighing scale 23 measures the weight of the baggage L2 placed on it. This measured weight is transmitted to the customs declaration kiosk terminal 20. The baggage weight acquisition unit 20c acquires the weight of the baggage L2 transmitted from the weighing scale 23. 【0082】 Next, baggage information is acquired based on the baggage image acquired in step S22 (step S28). This is achieved by the baggage information acquisition unit 20e. Specifically, the baggage information acquisition unit 20e acquires baggage information extracted from the baggage image by performing predetermined image processing on the baggage image acquired in step S22. This acquired baggage information is, for example, the shape and color of baggage L2. 【0083】Next, tag information is obtained based on the baggage image acquired in step S22 (step S29). This is achieved by the tag information acquisition unit 20f. Specifically, the tag information acquisition unit 20f acquires tag information extracted from the baggage image by performing predetermined image processing on the baggage image acquired in step S22. 【0084】 Next, step S30 checks whether the facial information of user U obtained in step S26, the weight of baggage L2 obtained in step S27, the baggage information obtained in step S28, and the tag information obtained in step S29 are linked and registered in the database 31 of the server 30. This is achieved, for example, by the matching unit 20g sending a matching request to the server 30. The matching request includes the facial information of user U obtained in step S26, the weight of baggage L2 obtained in step S27, the baggage information obtained in step S28, and the tag information obtained in step S29. The server 30, having received this matching request, checks whether the facial information, baggage weight, baggage information, and tag information included in the matching request are linked and registered in the database 31. This matching in step S30 is performed while user U is operating the customs declaration kiosk terminal 20 to make a customs declaration. 【0085】 As a result, if the matching is determined to be OK (step S31: matching OK), that is, if the server 30 receives a matching result of matching OK, the display device 24 displays matching OK (step S32). This is achieved by the matching result output unit 20h. Specifically, the matching result output unit 20h displays matching OK or an equivalent display on the display device 24 as the result of the matching. 【0086】On the other hand, if the matching is determined to be NG (step S31: matching NG), that is, if the server 30 receives a matching result of matching NG (the original owner of baggage L2 does not match the user operating the customs declaration kiosk terminal 20), the display device 24 displays matching NG (step S33). This is achieved by the matching result output unit 20h. Specifically, the matching result output unit 20h displays matching NG or an equivalent display (alert screen) on the display device 24 as the result of the matching. This display may be displayed, for example, on the screen immediately preceding the display of the completion of the customs application. Alternatively, instead of matching NG, or together with matching NG, the display device 24 may display a screen instructing the user to call airport staff. 【0087】 Next, an alert process is performed (step S34). This is carried out by the alert processing unit 20i. If the verification result of the verification unit 20g is NG (step S31: verification NG), the alert processing unit 20i sends a notification (alert notification) to the portable terminal 40 held by airport staff or security guards as an alert process. This notification includes information that identifies the customs declaration kiosk terminal 20 that failed verification (for example, identification information or location information of the customs declaration kiosk terminal 20), and baggage information of the user operating it at the time of baggage check-in. As a result, airport staff or security guards who receive this notification can identify users who may have mistakenly taken the wrong baggage. In this case, the verification result will also be displayed on the display device 24 for another user, indicating verification NG or an equivalent indication. When the above notifications are received from different customs declaration kiosk terminals 20 in this way, airport staff or security guards can take action to return the baggage to its rightful owner to the user in question. 【0088】 Next, let's describe server 30. Server 30 may be a physical server or a virtual server. Server 30 may be an information processing device such as a personal computer. 【0089】 Server 30 is equipped with a database 31. As shown in Figure 4, the database 31 includes items such as face information, baggage information, and tag information. 【0090】Figure 7 is a flowchart showing an example of the operation of the server 30 when it receives a registration request sent from the registration device 10. 【0091】 As shown in Figure 7, when the server 30 receives a registration request sent from the registration device 10 (step S40: YES), it links the face information obtained in step S11, the baggage weight obtained in step S12, the baggage information obtained in step S14, and the tag information obtained in step S15, which are included in the registration request, and registers them in the database 31 (step S41). Specifically, it registers the face information obtained in step S11 in the "face information" field, the baggage weight obtained in step S12 and the baggage information obtained in step S14 in the "baggage information" field, and the tag information obtained in step S15 in the "tag information" field. 【0092】 Figure 8 is a flowchart illustrating an example of the server 30's operation when it receives a verification request transmitted from the customs declaration kiosk terminal 20. 【0093】 As shown in Figure 8, when the server 30 receives a verification request sent from the customs declaration kiosk terminal 20 (step S50: YES), it checks whether the user U's facial information obtained in step S26, the baggage weight obtained in step S27, the baggage information obtained in step S28, and the tag information obtained in step S29, which are included in the verification request, are linked and registered in the database 31 (step S51). 【0094】Next, the server 30 returns the matching result to the customs declaration kiosk terminal 20 that sent the matching request (step S52). For example, if the facial information of user U obtained in step S26, the weight of the baggage obtained in step S27, the baggage information obtained in step S28, and the tag information obtained in step S29 are linked and registered in the database 31, the server 30 returns "Match OK" to the customs declaration kiosk terminal 20 that sent the matching request. On the other hand, if the facial information of user U obtained in step S26, the weight of the baggage obtained in step S27, the baggage information obtained in step S28, and the tag information obtained in step S29 are not linked and registered in the database 31, that is, if the original owner of the baggage does not match the user operating the customs declaration kiosk terminal 20, the server 30 returns "Match NG" to the customs declaration kiosk terminal 20 that sent the matching request. 【0095】 As described above, according to Embodiment 2, at least the weight of checked baggage and the facial information of the baggage user are registered and linked at the departure airport, and at the arrival airport, this registered information is compared with the weight of the received baggage and the facial information of the user, thereby preventing baggage checked at the departure airport from being mistaken for baggage at the arrival airport. 【0096】 Next, I will explain some variations. 【0097】 Figure 9 shows a modified example of the database 31 of the server 30. 【0098】 As shown in Figure 9, the database 31 may register multiple individuals' facial information, baggage information, and tag information linked together. The facial information of multiple individuals may be, for example, the facial information of each member of the same group, such as a family (for example, the facial information of three people: facial information A, facial information B, and facial information C in Figure 9). 【0099】 This method prevents other members of the same group from mistakenly taking the luggage of its rightful owner. 【0100】There are various possible timings for registering the facial information, baggage information, and tag information of multiple individuals into the database 31. For example, registration could be done at the check-in counter at the departure airport. Alternatively, for example, a facial recognition camera 50 (see Figure 3) could be installed in the baggage claim area of ​​the arrival airport. This camera could capture images including people who have come to the baggage claim area to collect their baggage, and by performing predetermined image processing on these captured images, people belonging to the same group could be recognized (determined). The facial information of these recognized individuals belonging to the same group could then be added to the database 31. 【0101】 Furthermore, it is conceivable that the weight of the baggage may increase if, while User U is receiving their baggage at the baggage claim area of ​​the arrival airport, moving with the received baggage to the customs declaration kiosk terminal 20, and operating the customs declaration kiosk terminal 20 to make a customs declaration, souvenirs or other items are placed in the baggage. In this case, before displaying "Matching NG" in step S33, a confirmation screen such as "The weight of your baggage has increased. Have you placed souvenirs or other items in your baggage?" may be displayed on the display device 24 to confirm whether or not an action that increased the weight has occurred. If User U responds with YES to the customs declaration kiosk terminal 20, the process in step S32 is executed. On the other hand, if User U responds with NO to the customs declaration kiosk terminal 20, the process from step S33 onwards may be executed. In addition, although the above embodiment describes an example in which the baggage weight acquisition unit 10c acquires the weight of baggage L transmitted from the weighing scale 13, it is not limited to this. For example, the weight of the baggage may be estimated using the image identification result using a camera, and the baggage weight acquisition unit 10c may acquire this estimated weight of the baggage. Furthermore, the weight of the baggage can be estimated, for example, by performing predetermined image processing based on images (or video) acquired from a baggage verification camera 22, etc. 【0102】 (Other Embodiments) The registration device 10 described in the embodiments described above may have the following hardware configuration. The same applies to the customs declaration kiosk terminal 20, server 30, and mobile terminal 40. Figure 10 is a diagram showing an example of the hardware configuration of the registration device 10 according to this disclosure. 【0103】 Referring to Figure 10, the registration device 10 includes a processor 1201 and a memory 1202. The processor 1201 reads and executes software (computer programs) from the memory 1202, thereby performing the processing of the registration device 10 as described using a flowchart in the above embodiment. The processor 1201 may be, for example, a microprocessor, an MPU (Micro Processing Unit), or a CPU (Central Processing Unit). The processor 1201 may include multiple processors. 【0104】 Memory 1202 is composed of a combination of volatile and non-volatile memory. Memory 1202 may include storage located away from the processor 1201. In this case, the processor 1201 may access memory 1202 via an I / O (Input / Output) interface, which is not shown. 【0105】 In the example shown in Figure 10, memory 1202 is used to store a group of software modules. The processor 1201 can read these software modules from memory 1202 and execute them, thereby enabling the registration device 10 to perform the processing described in the above embodiment. 【0106】 As explained with reference to Figure 10, each of the one or more processors in the registration device 10 executes one or more programs that include a set of instructions for causing the computer to perform the algorithm described in the diagram. 【0107】In the examples described above, the program includes a set of instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrical, optical, acoustic or other forms of propagating signals. 【0108】 Furthermore, the technical concepts in this disclosure are not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the invention. Each embodiment can also be combined with other embodiments as appropriate. 【0109】 Some or all of the above embodiments may also be described as follows, but are not limited to the following: 【0110】 (Note 1) An information processing device comprising: a face image acquisition means for acquiring a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition means for acquiring the user's face information based on the face image; a luggage weight acquisition means for acquiring the weight of the luggage; a matching means for checking whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output means for outputting the result of the matching. 【0111】 (Note 2) The matching result output means is the information processing apparatus described in Note 1, which displays the matching result on a display device. 【0112】 (Note 3) The information processing device according to Note 1, further comprising an alert processing means that performs an alert process based on the result of the verification, wherein if the result of the verification is NG, the alert processing means transmits a message to that effect to a mobile terminal as an alert. 【0113】 (Appendix 4) The information processing device according to Appendix 1 further comprises: a baggage image acquisition means for acquiring a baggage image including the baggage transmitted from a baggage verification camera; and a baggage information acquisition means for acquiring baggage information based on the baggage image, wherein the verification means verifies whether the face information, the weight of the baggage, and the baggage information are linked and registered in a database. 【0114】 (Note 5) The information processing device described in Note 3, wherein the baggage information is at least one of the following: the shape of the baggage, the color of the baggage, and the tag information of a tag attached to the baggage. 【0115】 (Appendix 6) The information processing device described in Appendix 1, wherein the database is registered with the facial information of multiple individuals linked to the weight of one piece of luggage. 【0116】 (Note 7) The information processing device according to Note 2, which, if the baggage included in the baggage image does not have a tag attached, displays a message on the display device prompting the user to place the tagged baggage on the weighing scale. 【0117】 (Note 8) An information processing device comprising: a face image acquisition means for acquiring a face image including the face of a user who is checking in luggage, transmitted from a face recognition camera; a face information acquisition means for acquiring the face information of the user based on the face image; a luggage weight acquisition means for acquiring the weight of the luggage; and a registration means for registering the face information and the weight of the luggage in a database. 【0118】(Note 9) An information processing method comprising: a face image acquisition step of acquiring a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition step of acquiring the user's face information based on the face image; a luggage weight acquisition step of acquiring the weight of the luggage; a matching step of checking whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output step of outputting the result of the matching. 【0119】 (Note 10) A program that causes a computer to execute the following steps: a face image acquisition step of acquiring a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition step of acquiring the user's face information based on the face image; a luggage weight acquisition step of acquiring the weight of the luggage; a matching step of checking whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output step of outputting the result of the matching. 【0120】 Some or all of the elements (e.g., configuration and function) described in Appendices 2 to 7 that are subordinate to Appendice 1 may also be subordinate to Appendices 9 and 10 in the same manner as those described in Appendices 2 to 7. Some or all of the elements described in any appendice may be applied to various hardware, software, recording means, systems, and methods for recording software. 【0121】 Although the present invention has been described above with reference to embodiments, the present invention is not limited thereto. Various modifications to the structure and details of the present invention can be made that are understandable to those skilled in the art within the scope of the invention. 【0122】 This application claims priority based on Japanese Patent Application No. 2024-217746, filed on 12 December 2024, and incorporates all of its disclosures herein. 【0123】1...Baggage claim system 10...Registration device 10a...Face image acquisition unit 10b...Face information acquisition unit 10c...Baggage weight acquisition unit 10d...Baggage image acquisition unit 10e...Baggage information acquisition unit 10f...Tag information acquisition unit 10g...Registration unit 10h...Communication unit 11...Face recognition camera 12...Baggage verification camera 13...Weighing scale 14...Tagging device 20...Customs declaration kiosk terminal 20a...Face image acquisition unit 20b...Face information acquisition unit 20c...Baggage weight acquisition unit 20d...Baggage image acquisition unit 20e...Baggage information acquisition unit 20f...Tag information acquisition unit 20g...Verification unit 20h...Verification result output unit 20i...Alert processing unit 20j...Communication unit 21...Face recognition camera 22...Baggage verification camera 23...Weighing scale 24...Display device 30...Server 31...Database 40...Mobile device 50...Facial recognition camera 1201...Processor 1202...Memory L1, L2...Baggage NW...Network

Claims

1. An information processing device comprising: a face image acquisition means for acquiring a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition means for acquiring the user's face information based on the face image; a luggage weight acquisition means for acquiring the weight of the luggage; a matching means for checking whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output means for outputting the result of the matching.

2. The information processing apparatus according to claim 1, wherein the matching result output means displays the matching result on a display device.

3. The information processing apparatus according to claim 1, further comprising an alert processing means for performing an alert process based on the result of the matching, wherein if the result of the matching is a matching failure, the alert processing means transmits a message to that effect to a mobile terminal as an alert.

4. The information processing device according to claim 1, further comprising: a baggage image acquisition means for acquiring a baggage image including the baggage transmitted from a baggage verification camera; and a baggage information acquisition means for acquiring baggage information based on the baggage image, wherein the verification means verifies whether the face information, the weight of the baggage, and the baggage information are linked and registered in a database.

5. The information processing device according to claim 4, wherein the baggage information is at least one of the shape, color, and tag information of a tag attached to the baggage.

6. The information processing device according to claim 1, wherein the database is registered with the facial information of multiple individuals and the weight of one piece of luggage linked together.

7. The information processing device according to claim 2, wherein if the luggage included in the luggage image does not have a tag attached, the display device prompts the user to place the luggage with a tag attached onto the weighing scale.

8. An information processing device comprising: a face image acquisition means for acquiring a face image including the face of a user who is checking in luggage, transmitted from a face recognition camera; a face information acquisition means for acquiring the face information of the user based on the face image; a luggage weight acquisition means for acquiring the weight of the luggage; and a registration means for registering the face information and the weight of the luggage in a database.

9. An information processing method comprising: a face image acquisition step of acquiring a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition step of acquiring the user's face information based on the face image; a luggage weight acquisition step of acquiring the weight of the luggage; a matching step of checking whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output step of outputting the result of the matching.

10. A program that causes a computer to execute the following steps: a face image acquisition step of acquiring a face image including the face of a user who has received luggage transmitted from a face recognition camera; a face information acquisition step of acquiring the user's face information based on the face image; a luggage weight acquisition step of acquiring the weight of the luggage; a matching step of checking whether at least the face information and the weight of the luggage are registered in a database in association with each other; and a matching result output step of outputting the result of the matching.

Images