Luggage storage machine

By imaging aerial images around the luggage storage machine, the problem of the traditional luggage storage machine's touch panel being easily infected by viruses is solved, and contactless operation is achieved, reducing the risk of infection and improving operational efficiency.

CN116157328BActive Publication Date: 2025-09-16DAIFUKU CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202180050164.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-08-20
Filing Date
2021-07-08
Publication Date
2025-09-16
Estimated Expiration
2041-07-08

AI Technical Summary

Technical Problem

The touch panels of traditional luggage storage machines can easily expose users to risks such as virus infection, and existing technology is unable to effectively reduce this risk.

Method used

By combining the display unit and the imaging unit, an aerial image is formed around the luggage storage machine, and the user can operate it through the aerial image without directly touching the touch panel.

Benefits of technology

It reduces the risk of users contracting viruses through contact with the touch panel, ensures the visibility and operability of aerial images, adapts to the needs of users in different standing positions, prevents misoperation, and provides a contactless operation mode.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116157328B_ABST
    Figure CN116157328B_ABST
Patent Text Reader

Abstract

The risk of users of a luggage storage machine being infected with viruses, etc. is reduced. The luggage storage machine (1) comprises: an internal display (11) that displays an image related to luggage storage including an operation target area; an imaging unit (30) that projects the image displayed on the internal display (11) as an aerial image in the air around the machine; an operation determination unit (102) that determines an operation on a portion of the aerial image corresponding to the operation target area; and a process execution unit (105) that executes a process related to luggage storage corresponding to the determined operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a luggage storage machine. Background Art

[0002] Patent Documents 1 and 2 disclose a self-service baggage drop (hereinafter referred to as "SBD") system in which a user deposits their own luggage. In the SBD system, a user operates a baggage drop machine to register their luggage, and the luggage is then automatically transported.

[0003] (Prior art literature)

[0004] Patent Document 1: European Patent Application Publication No. 2886466

[0005] Patent Document 2: U.S. Patent No. 10,252,821 Summary of the Invention

[0006] (Problem to be solved by the invention)

[0007] Conventional luggage storage machines have a touch panel as an interface for operation input, and many users directly touch the touch panel. Therefore, users may be infected with viruses through the touch panel.

[0008] An object of one aspect of the present invention is to realize a luggage storage machine that reduces the risk of users contracting viruses, etc.

[0009] (Technical means used to solve the problem)

[0010] To solve the above-mentioned problem, a luggage storage machine according to one aspect of the present invention comprises: a display unit that displays an image related to luggage storage including an operation target area; an imaging unit that projects the image displayed on the display unit as an aerial image in the air around the machine; an operation determination unit that determines an operation performed by a user on a portion of the aerial image corresponding to the operation target area; and a processing execution unit that executes a process related to luggage storage corresponding to the determined operation.

[0011] According to this solution, the portion of the aerial image corresponding to the operation target area becomes the operation target for the luggage storage machine user. Therefore, the user can perform luggage storage operations without touching an operating surface such as a touch panel. This reduces the risk of infection from viruses and other infections caused by contact with touch panels, which is common with conventional luggage storage machines.

[0012] The luggage storage machine according to one aspect of the present invention can be installed near a luggage storage area of ​​a transport device that transports the luggage. The user is the person who deposits the luggage in the luggage storage area. The display unit and the imaging unit are configured to project the aerial image at a position where the user can see it and perform the operation.

[0013] According to the above solution, the aerial image is formed at a position where the user who has checked luggage can see and operate the luggage, thereby ensuring visibility of the aerial image and operability of the portion corresponding to the operation target area.

[0014] The luggage storage machine according to one aspect of the present invention may further include a face detection unit configured to detect a position of the user's face, wherein the imaging unit may image the aerial image toward the detected position.

[0015] Aerial images typically have a narrow viewing angle (i.e., a narrow observable range), so depending on the user's standing position, the aerial image may not be properly visible. In response to this, according to the described solution, the aerial image is oriented toward the face of the user who is checking their luggage. Therefore, for example, if a user moves to a luggage storage area to deposit their luggage, the aerial image will also be oriented toward the user's face after they move. Furthermore, for example, the aerial image 20 is oriented toward a position corresponding to the user's height. This further ensures visibility of the aerial image and operability of the portion corresponding to the operation target area.

[0016] The luggage storage machine according to one aspect of the present invention may be configured such that when the detected position is within a specified area including a position where the user is facing the front of the luggage storage machine, the operation determination unit performs the determination, and when the detected position is outside the specified area, the operation determination unit stops the determination.

[0017] According to the above embodiment, the operation can be restricted to when the user is in a predetermined area including the position facing the front of the luggage storage machine, and the operation is not accepted in other cases. This can prevent the user from making an erroneous operation when leaving the position substantially facing the luggage storage machine.

[0018] The luggage storage machine of one aspect of the present invention may be configured as follows: when the detected position exists within a specified area including the position of the user facing the front of the luggage storage machine, an object detection unit for detecting objects in the vicinity of the position imaged by the aerial image performs the detection; when the detected position exists outside the specified area, the object detection unit stops detecting the object.

[0019] According to this embodiment, detection of objects in the vicinity (typically, a pointer such as a user's finger) can be limited to when the user is within a predetermined area, including a position directly facing the front of the luggage storage machine. Objects in the vicinity are not detected in other circumstances. This prevents users from operating the luggage storage machine incorrectly by moving away from a position substantially facing the machine.

[0020] The luggage storage machine according to one aspect of the present invention may include a display control unit that displays the image on the display unit and the display device, wherein the operation determination unit further determines the operation performed on the operation object area in the image displayed on the display device, and the luggage storage machine may also include a mode switching unit that switches the mode in which the display control unit displays the image on the display unit and the mode in which the display control unit displays the image on the display device.

[0021] According to the above scheme, the system switches between a mode for detecting operations performed on a portion of an aerial image corresponding to an operation target area and a mode for detecting operations performed on an image displayed on a display device. This allows for differentiating usage modes. For example, the former mode can be used for users storing luggage to reduce the risk of virus infection, while the latter mode can be used for airline staff and maintenance providers to improve work efficiency.

[0022] The luggage storage machine according to one aspect of the present invention may further include a display control unit configured to display a display-only image excluding the operation target area on a display device.

[0023] According to the above scheme, the display device displays the dedicated image in addition to the aerial image, thereby enabling the display device to display supplementary information not shown in the aerial image or information that should always be displayed regardless of how the aerial image changes.

[0024] In addition, the display surface of the display device is generally wider than the viewing angle of the aerial image (i.e., the observable range is wide). Therefore, for example, when the user moves slightly or when there are multiple users standing in different positions, the visibility of the displayed information can be maintained.

[0025] In the luggage storage machine according to one aspect of the present invention, the aerial image may be a stereoscopic image.

[0026] According to the above scheme, the 3D image is formed in the air. Therefore, it can improve the understanding of users viewing the aerial image. For example, the 3D image can be used to illustrate the depth of luggage or luggage storage areas, thereby improving understanding.

[0027] The luggage storage machine according to one aspect of the present invention may further include an image projecting unit configured to project an image showing the user's standing position onto the floor in front of the luggage storage machine.

[0028] According to the above aspect, the projection image is projected onto the ground in front of the luggage storage machine, so the user can recognize the appropriate standing position.

[0029] The luggage storage machine according to one aspect of the present invention may further include: a face detection unit that detects a position of the user's face; and a projection control unit that determines a projection position of the projection image based on the detected position.

[0030] Aerial images typically have a narrow viewing angle (i.e., a narrow observable range). Therefore, depending on the user's standing position, the aerial image may not be properly visible. In this regard, the projected image position is determined based on the detected position of the user's face. This allows the user to be shown different standing positions that bring their face within the observable range, depending on their height. This ensures visibility of the aerial image and operability of the portion corresponding to the operation target area.

[0031] In the luggage storage machine according to one aspect of the present invention, the projection control unit may move the projection position further away from the luggage storage machine as the height of the detected position from the ground increases.

[0032] The observable range of the aerial image typically extends from the aerial image toward the front of the luggage storage machine. Therefore, a relatively tall user needs to be relatively far away from the luggage storage machine to keep their face within the observable range. On the other hand, a relatively short user needs to be relatively close to the luggage storage machine to keep their face within the observable range. In other words, the appropriate standing position varies depending on the height of the user's face. Here, according to the described solution, the higher the detected position of the user's face from the ground, the further the projection image is projected from the luggage storage machine. Therefore, regardless of the user's height, the appropriate standing position can be shown to the user.

[0033] The luggage storage machines of each embodiment of the present invention can be implemented by a computer. In this case, a control program of the luggage storage machine that causes the computer to operate as the various parts (software elements) possessed by the luggage storage machine, thereby implementing the luggage storage machine by the computer; and a computer-readable storage medium storing the control program are also included in the scope of the present invention.

[0034] (Effects of the Invention)

[0035] According to the present invention, the risk of users of the luggage storage machine being infected with viruses or the like can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 This is an example of luggage storage performed by the SBD system including the luggage storage machine of the first embodiment.

[0037] Figure 2 is through Figure 1 Another example of luggage storage using the SBD system is shown.

[0038] Figure 3 is through Figure 1 An example of an aerial image forming method performed by the luggage storage machine shown.

[0039] Figure 4 yes Figure 1 The following is a block diagram showing an example of the main parts of the luggage storage machine.

[0040] Figure 5 This is an example of an aerial image.

[0041] Figure 6 This is an example of an aerial image.

[0042] Figure 7 This is an example of an aerial image.

[0043] Figure 8 This is an example of an aerial image.

[0044] Figure 9 This is an overview of the luggage storage machine according to the second embodiment.

[0045] Figure 10 yes Figure 9 The following is a block diagram showing an example of the main parts of the luggage storage machine.

[0046] Figure 11 This is a specific example of adjusting the imaging direction of an aerial image.

[0047] Figure 12 This is a specific example of adjusting the imaging direction of an aerial image.

[0048] Figure 13 This is another example of adjusting the imaging direction of an aerial image.

[0049] Figure 14 This is another example of adjusting the imaging direction of an aerial image.

[0050] Figure 15 This is another example of adjusting the imaging direction of an aerial image.

[0051] Figure 16 This is a block diagram showing an example of the configuration of the main parts of the luggage storage machine according to the third embodiment.

[0052] Figure 17 yes Figure 16 The following is an example of the configuration of a luggage storage machine, an external display, and an input device.

[0053] Figure 18 This is a block diagram showing an example of the configuration of the main parts of the luggage storage machine according to the fourth embodiment.

[0054] Figure 19 yes Figure 18 An example of a display on a luggage storage machine is shown.

[0055] Figure 20 This is an overview of the luggage storage machine according to the fifth embodiment.

[0056] Figure 21 This is an overview of the luggage storage machine according to the fifth embodiment.

[0057] Figure 22 yes Figure 20 、 21 The following is a block diagram showing an example of the main parts of the luggage storage machine.

[0058] <Description of Reference Numerals>

[0059] 1, 1A, 1B, 1C, 1D luggage storage machines

[0060] 2 transport device

[0061] 4 External monitors (display devices)

[0062] 11 Internal display (display unit)

[0063] 12 Operation detection unit (object detection unit)

[0064] 14Ticket issuing device (label issuing unit, exchange voucher issuing unit)

[0065] 17 Image Projection Unit

[0066] Aerial images of 20, 20A, 20B, 20C, 20D, 20E, 20F, 20G, 20H, 20I, 20J, 20K, 20L, and 20M

[0067] 30, 30A imaging unit

[0068] 80 Luggage Storage

[0069] 99 Luggage

[0070] 101, 101B, 101C display control unit

[0071] 102, 102B, 102C operation determination unit

[0072] 105 Processing Execution Department

[0073] 106 Face Detection Unit

[0074] 108 Display mode switching unit (mode switching unit)

[0075] 109 Projection Control Unit

[0076] 141 luggage tag (label) DETAILED DESCRIPTION

[0077] [Implementation Method 1]

[0078] Hereinafter, one embodiment of the present invention will be described in detail.

[0079] Overview of the SBD System

[0080] refer to Figure 1 and Figure 2 , an example of storing luggage using the SBD system of this embodiment is described. Figure 1 The SBD system 100 of this embodiment is shown. The SBD system 100 is mainly installed in airports and is a system that allows airport users to store their luggage by themselves before boarding a plane. The SBD system 100 includes a luggage storage machine 1 and a transport device 2. Figure 1 As shown, the SBD system 100 may further include a door 3 .

[0081] The luggage storage machine 1 is a device for users to store their luggage. It has the function of projecting an aerial image 20, including an area for receiving user input, in the air around the luggage storage machine 1. The aerial image 20 is projected above the luggage storage machine 1, where the user can see and operate it. The location of the aerial image 20 is not limited to this example; it can be located within the space where the user is storing their luggage. The aerial image 20 may also include an area for displaying information.

[0082] As an example, the luggage storage machine 1 includes a reader 13 and a ticket issuing device 14 (a tag issuing unit and an exchange voucher issuing unit). The reader 13 reads information from a code (e.g., a barcode or QR code (registered trademark)) printed on a user's boarding pass. The ticket issuing device 14 issues a luggage tag (label) containing luggage-related information and an exchange voucher used to collect the checked luggage at the destination.

[0083] The transport device 2 is a transport device for loading the checked luggage onto the aircraft that the user plans to board. A typical example of the transport device 2 is a conveyor belt, but the present invention is not limited thereto.

[0084] like Figure 2 As shown, the user stores luggage 99 with a luggage tag 141 in the luggage storage 80 that is part of the transport device 2. A weight meter (not shown) is installed in the luggage storage 80. The weight meter outputs the measured weight of the luggage 99 to the luggage storage machine 1.

[0085] In order to effectively use the luggage storage machine 1 and effectively store the luggage in the luggage storage area 80 , the luggage storage machine 1 is preferably provided close to the luggage storage area 80 .

[0086] As an example, the door 3 is installed upright so as to straddle a portion of the transport device 2. As an example, the door 3 is equipped with a camera (not shown). This camera is configured to capture images of the luggage 99 and the luggage tag 141 passing through the door 3 and output the captured images to the luggage storage machine 1. Based on the captured images, the luggage storage machine 1 can read the code printed on the luggage tag 141 or determine the size and shape of the luggage 99. Figure 2 The aerial image 20 shown shows the code printed on the luggage tag 141 being read (scanned).

[0087] In addition, the door 3 is not necessarily separated from the conveying device 2 , and may be provided integrally with the conveying device 2 as a component of the conveying device 2 .

[0088] <Imaging Method of Aerial Image 20 and Operation Detection Method>

[0089] Figure 3 An example of an imaging method of the aerial image 20 will be described. The luggage storage machine 1 includes an internal display 11 (display unit), an imaging unit 30, and an operation detection unit 12 (object detection unit).

[0090] The internal display 11 is used to display an image related to luggage storage, i.e., the image serving as the basis for the aerial image 20. The internal display 11 is typically a liquid crystal display. The imaging unit 30 projects the image displayed on the internal display 11 into the air surrounding the luggage storage machine 1. This imaging method can employ a well-known method. For example, the imaging unit 30 refracts light incident on the internal display 11 and emits it, focusing the light at a position line-symmetrical with the internal display 11, thereby imaging the aerial image 20. Figure 3 In the example, the aerial image 20 is formed above the top surface of the luggage storage machine 1. The imaging method shown here is just one example, and the imaging method of the aerial image 20 is not limited to this example. A scheme in which multiple imaging units 30 are provided and light is refracted in multiple stages may also be adopted.

[0091] The operation detection unit 12 detects an object (typically, a pointer such as a user's finger) in a vicinity 120 of the position of the aerial image 20 and outputs a detection signal. The operation detection unit 12 can also detect the position of the object in the vicinity 120. As an example, the operation detection unit 12 can be configured as a non-contact sensor such as an infrared sensor. As an example, the operation detection unit 12 is disposed on the top surface of the luggage storage machine 1.

[0092] <Structure of Main Parts of Luggage Storage Machine 1>

[0093] Figure 4 This is a block diagram illustrating an example of the structure of the main components of the luggage storage machine 1. The luggage storage machine 1 includes a control unit 10, an internal display 11, an operation detection unit 12, a reader 13, a ticket dispenser 14, and an imaging unit 30. The internal display 11, operation detection unit 12, reader 13, ticket dispenser 14, and imaging unit 30 have already been described and will not be repeated here.

[0094] The control unit 10 controls the entirety of the luggage storage machine 1. The control unit 10 includes a display control unit 101, an operation determination unit 102, a read data acquisition unit 103, a luggage data acquisition unit 104, and a process execution unit 105.

[0095] The display control unit 101 causes the internal display 11 to display an image serving as the basis for the aerial image 20. The image displayed by the internal display 11 includes a display area and an operation target area. The display area is used to display information to be presented to the user. As an example, the operation target area simulates an input interface such as a button. The portion of the aerial image 20 corresponding to the operation target area corresponds to a graphical user interface (hereinafter referred to as "GUI"). Hereinafter, the action of the user bringing an indicator close to the GUI is also referred to as "operation."

[0096] The operation determination unit 102 acquires a detection signal from the operation detection unit 12. The operation determination unit 102 determines the operation based on the acquired detection signal and the image displayed on the internal display 11 by the display control unit 101. The operation determination unit 102 outputs instructions corresponding to the determined operation to various parts of the control unit 10. As an example, the operation determination unit 102 outputs an instruction to the display control unit 101 to switch the display image of the internal display 11. In addition, as an example, the operation determination unit 102 issues an instruction to the ticket issuance control unit 151 of the processing execution unit 105 to issue a luggage tag or exchange voucher. In addition, as an example, the operation determination unit 102 issues an instruction to the transport instruction unit 153 of the processing execution unit 105 to transport luggage. In addition, as an example, the operation determination unit 102 issues an instruction to the registration unit 152 of the processing execution unit 105 to register various information.

[0097] The read data acquisition unit 103 acquires data read from the reading device 13 and outputs instructions corresponding to the acquired data to various components of the control unit 10. For example, the read data acquisition unit 103 outputs an instruction to the display control unit 101 to switch the display image of the internal display 11.

[0098] The baggage data acquisition unit 104 acquires baggage-related data from the transporter 2 and the door 3 and outputs instructions corresponding to the acquired data to various components of the control unit 10. Specifically, the baggage data acquisition unit 104 acquires data indicating the baggage weight measured by a scale included in the transporter 2 and images captured by a camera included in the door 3. These data are merely examples, and the data acquired by the baggage data acquisition unit 104 is not limited to these.

[0099] The process execution unit 105 executes various processes related to baggage storage. The process execution unit 105 includes a ticket issuance control unit 151, a registration unit 152, and a transfer instruction unit 153.

[0100] The ticket issuing control unit 151 outputs a ticket issuing instruction to the ticket issuing device 14, causing the ticket issuing device 14 to issue a baggage tag or an exchange voucher.

[0101] The registration unit 152 registers the information of the checked luggage. For example, the registration unit 152 associates the information about the checked luggage with the user's boarding pass information and stores it in a storage unit (not shown). The information about the luggage is, for example, an ID used to identify the luggage. The boarding pass information is, for example, information read from the boarding pass by the reader 13, including information identifying the user, the scheduled flight, and the destination.

[0102] The transport instruction unit 153 outputs a transport instruction to the transport device 2 to cause the transport device 2 to transport the baggage 99. The transport instruction unit 153 may output a transport stop instruction to the transport device 2 to stop the transport of the baggage.

[0103] <Flow of Luggage Storage Processing in the SBD System 100>

[0104] Below, reference Figures 5 to 7 , an example flow of luggage storage processing in the SBD system 100 is described. Figures 5 to 7 An example of an aerial image 20 that changes as the baggage storage process progresses is shown. In this example, the user has already obtained a boarding pass. The boarding pass may be issued by a device separate from the baggage storage machine 1, or it may be a so-called mobile boarding pass that can be viewed on a mobile device or the like.

[0105] first, Figure 5The aerial image 20A shown is an example of an aerial image captured by the luggage storage machine 1 at the start of the luggage check-in process. Aerial image 20A displays a message urging the user to have their boarding pass read. Following the display of aerial image 20A, the user causes the reading device 13 of the luggage storage machine 1 to read the boarding pass code. The reading device 13 outputs the information obtained from the code to the read data acquisition unit 103. The read data acquisition unit 103 then outputs the acquired information to the display control unit 101 and the registration unit 152.

[0106] Figure 5 The illustrated aerial image 20A includes a button 211 as an example of a GUI. Based on the acquired detection signal indicating the operation of the button 211, the display control unit 101 causes the internal display 11 to display an image (not shown) for the user to select a language.

[0107] then, Figure 5 The aerial image 20B shown is an example of an aerial image generated by the baggage storage machine 1 after the boarding pass code is read. After the display control unit 101 acquires the read information from the reading device 13 from the read data acquisition unit 103, the image underlying the aerial image 20B is displayed on the internal display 11, thereby generating the aerial image 20B. Furthermore, all aerial images described below are generated by the display control unit 101 displaying the underlying image on the internal display 11.

[0108] The aerial image 20B displays information about items that cannot be brought into the aircraft cabin or stored. The aerial image 20B includes a button 221 as an example of a GUI. The user confirms the display content of the aerial image 20B and operates the button 221.

[0109] then, Figure 5 The aerial image 20C shown is an example of the aerial image produced by the luggage storage machine 1 when button 221 is operated. Aerial image 20C displays information related to the aircraft the user plans to board. This information is the boarding pass information read by the reader 13. Furthermore, aerial image 20C includes button 231 as an example of a GUI. The user confirms the display content of aerial image 20C and operates button 231.

[0110] then, Figure 5The aerial image 20D shown is an example of the aerial image produced by the luggage storage machine 1 when button 231 is operated. Aerial image 20D displays information related to the user's name and seat number on the aircraft. This information is the boarding pass information read by the reader 13. Furthermore, aerial image 20D includes button 241 as an example of a GUI. The user confirms the display content of aerial image 20D and operates button 241.

[0111] then, Figure 6 The aerial image 20E shown is an example of the aerial image produced by the luggage storage machine 1 when button 241 is pressed. Aerial image 20E allows the user to select whether to store luggage. As an example of a GUI, aerial image 20E includes buttons 251 and 252. The user presses button 251 to store luggage, and presses button 252 to not store luggage. Pressing button 252 completes the luggage storage process in the SBD system 100.

[0112] then, Figure 6 The aerial image 20F shown is an example of the aerial image that appears when button 251 is pressed. Aerial image 20F allows the user to enter the number of luggage to be stored. For example, aerial image 20F includes a counter 261 for displaying the entered number, a button 262 for inputting a decrease, a button 263 for inputting an increase, and a button 264 for confirming the number. Buttons 262, 263, and 264 form a GUI. To decrease the number of luggage, the user presses button 262; to increase the number, the user presses button 263. Once the user has completed entering the number of luggage, the user presses button 264.

[0113] then, Figure 6 The aerial image 20G shown is an example of the aerial image produced by the luggage storage machine 1 when button 264 is operated. Aerial image 20G displays the boarding pass information read by the reader 13 and the number of luggage items input by the user. Furthermore, aerial image 20G includes button 271 as an example of a GUI. The user confirms the display content of aerial image 20G and operates button 271.

[0114] then, Figure 6 The aerial image 20H shown is an example of an aerial image formed by the luggage storage machine 1 when the button 271 is operated. The aerial image 20H displays "Baggage tag issuing" and a method for attaching the issued luggage tag to the luggage.

[0115] When aerial image 20H is generated, ticket issuing control unit 151, receiving an instruction from operation determination unit 102, causes ticket issuing device 14 to issue baggage tags. Ticket issuing device 14 issues a number of baggage tags equal to the number of pieces of luggage input in aerial image 20F. The user attaches the issued baggage tags to the luggage as shown in aerial image 20H and deposits the luggage in luggage storage area 80. A weight meter installed in luggage storage area 80 measures the weight of the stored luggage and outputs weight data indicating the weight to luggage storage machine 1.

[0116] The luggage data acquisition unit 104 of the luggage storage machine 1 outputs the weight data acquired from the scale to the display control unit 101. Furthermore, the luggage data acquisition unit 104 notifies the transport instruction unit 153 that the weight data has been acquired. The transport instruction unit 153 outputs a transport instruction to the transport device 2, causing the luggage stored in the luggage storage area 80 to be moved to the position of the door 3. The transport device 2 activates the camera installed at the door 3 and begins photographing the luggage, including scanning the luggage tag. The transport device 2 then outputs a "Scanning in Progress" message to the luggage storage machine 1.

[0117] then, Figure 7 The aerial image 20I shown is an example of an aerial image formed by the luggage storage machine 1 during scanning. The aerial image 20I displays "Luggage tag scanning in progress."

[0118] After the camera installed at the door 3 finishes photographing the luggage, it outputs the photographed image to the luggage storage machine 1. The luggage data acquisition unit 104 outputs the image acquired by the camera to the registration unit 152.

[0119] The registration unit 152 performs image recognition on the image received from the baggage data acquisition unit 104 to confirm the baggage identification ID written on the baggage tag. This image recognition can employ well-known techniques. The registration unit 152 then associates the confirmed ID with the read information received from the operation determination unit 102, namely, the boarding pass information, and stores it in the storage unit. The registration unit 152 then notifies the display control unit 101, the ticket issuance control unit 151, and the handling instruction unit 153 that the process has been completed.

[0120] then, Figure 7 The aerial image 20J shown is an example of an aerial image formed by the luggage storage machine 1 when the exchange coupon is issued. The aerial image 20J displays "Exchange coupon issued."

[0121] The ticket issuing control unit 151, based on the notification from the registration unit 152, instructs the ticket issuing device 14 to issue the exchange ticket. The ticket issuing device 14 issues the exchange ticket. After the ticket issuing control unit 151 completes issuing the exchange ticket, it notifies the display control unit 101 of the completion. Meanwhile, the transport instruction unit 153, based on the notification from the registration unit 152, outputs a transport instruction to the transport device 2, and transports the luggage on the transport device 2 to the loading location.

[0122] then, Figure 7 The aerial image 20K shown is an example of an aerial image formed by the luggage storage machine 1 when the luggage storage process is completed. The aerial image 20K displays "Luggage storage completed" and "Exchange voucher issued."

[0123] <Other examples of aerial image 20>

[0124] Figure 8 The aerial image 20L shown is an example of an aerial image captured by the luggage storage machine 1 when the luggage stored in the luggage storage area 80 exceeds a specified weight. For example, when the weight of the stored luggage exceeds a specified amount, the weight meter outputs overweight information indicating this fact along with the weight data to the luggage storage machine 1. Upon acquiring the overweight information, the luggage data acquisition unit 104 outputs the overweight information to the display control unit 101.

[0125] The aerial image 20L displays information related to overweight. In addition, the aerial image 20L includes a button 311 as an example of a GUI. The user confirms the display content of the aerial image 20L and operates the button 311.

[0126] Figure 8 The aerial image 20M shown is an example of an aerial image captured by the luggage storage machine 1 when luggage stored in the luggage storage area 80 needs to be placed on a tray. For example, the luggage data acquisition unit 104 performs image recognition on the image captured by the camera installed on the door 3. If it confirms based on the size and shape of the luggage that it is luggage that needs to be placed on the tray, it notifies the display control unit 101 of this fact.

[0127] The aerial image 20M displays a message urging the user to place the luggage on the tray. The aerial image 20M also includes a button 321 as an example of a GUI. The user confirms the display content of the aerial image 20M and operates the button 321.

[0128] <Function and Effect>

[0129] As described above, the luggage storage machine 1 of this embodiment includes an internal display 11 that displays an image related to luggage storage, including an operation target area. Furthermore, the luggage storage machine 1 includes an imaging unit 30 that projects this image in the air around the machine as an aerial image 20. Furthermore, the luggage storage machine 1 includes an operation determination unit 102 that determines an operation performed on the portion of the aerial image 20 corresponding to the operation target area, i.e., the GUI. Furthermore, the luggage storage machine 1 includes a process execution unit 105 that executes a process related to luggage storage corresponding to the determined operation.

[0130] According to the above arrangement, the GUI included in the aerial image 20 becomes the object of operation for the user of the luggage storage machine 1. Therefore, the user can perform luggage storage-related operations without touching an operating surface such as a touch panel. This reduces the risk of infection with viruses and other viruses caused by contact with the operating surface, which is common with conventional luggage storage machines equipped with touch panels.

[0131] The luggage storage machine 1 is installed near a luggage storage area 80 provided by the transport device 2. Furthermore, the internal display 11 and the imaging unit 30 are installed so that the aerial image 20 is displayed at a position where the user can see and operate it. This ensures visibility of the aerial image 20 and operability of the GUI included in the aerial image 20.

[0132] As an example, the operation target area includes an area for inputting confirmation results. Therefore, as an example, the aerial image 20 includes a GUI for inputting confirmation results (e.g., buttons 221, 231, 241, 264, 271, 311, and 321). According to this embodiment, various confirmation results can be input through contactless operation.

[0133] In addition, as an example, the operation target area includes an area for inputting the number of luggage. Therefore, as an example, the aerial image 20 includes a GUI (e.g., buttons 262 and 263) for inputting the number of luggage. According to this embodiment, the number of luggage can be input through contactless operation.

[0134] The baggage storage machine 1 also includes a ticket issuing device 14 for issuing baggage tags. The ticket issuing control unit 151 included in the process execution unit 105 issues a ticket issuing instruction to the ticket issuing device 14. This configuration allows baggage tags to be issued through contactless operation.

[0135] The ticket issuing device 14 issues the exchange ticket. The ticket issuing control unit 151 issues an instruction to the ticket issuing device 14 to issue the exchange ticket. According to this embodiment, the exchange ticket can be issued by a contactless operation.

[0136] Furthermore, the transport instruction unit 153 included in the process execution unit 105 issues an instruction to transport the checked luggage to the transport device 2. According to this embodiment, the luggage can be transported by a contactless operation.

[0137] [Implementation Method 2]

[0138] In the following embodiments, for ease of description, components having the same functions as those described in the above embodiments are denoted by the same reference numerals and will not be described in detail.

[0139] <Overview of this embodiment>

[0140] Figure 9 This is an overview of the luggage storage machine 1A of this embodiment. The luggage storage machine 1A adjusts the imaging direction of the aerial image 20. Specifically, the luggage storage machine 1A images the aerial image 20 at a position facing the user's face. To achieve this function, the luggage storage machine 1A is equipped with an actuator 16 that changes the orientation of the display surface of the internal display 11. As an example, Figure 9 As shown, with the internal display 11 positioned, the actuator 16 rotates about a line extending vertically along the luggage storage machine 1A. This changes the orientation of the display surface of the internal display 11, and with this change, the imaging direction of the aerial image 20. This adjustment ensures that the user's face is within the visible range of the aerial image 20, ensuring visibility of the aerial image 20 even if the user's standing position changes.

[0141] <Structure of the Main Parts of the Luggage Storage Machine 1A>

[0142] Figure 10 1A is a block diagram showing an example of the configuration of the main parts of the luggage storage machine 1A. The luggage storage machine 1A differs from the above-described luggage storage machine 1 in that it includes a control unit 10A instead of the control unit 10, and includes a camera 15 and an actuator 16.

[0143] The camera 15 is positioned to capture the face of the user of the luggage storage machine 1A and output the captured image to the control unit 10A. Considering that the user moves to store luggage in the luggage storage area 80, the camera 15 preferably has a field of view that captures the area near the luggage storage area 80.

[0144] The actuator 16 changes the orientation of the display surface of the internal display 11 as described above under the control of the control unit 10A.

[0145] The control section 10A differs from the aforementioned control section 10 in that it includes a face detection section 106 and a drive control section 107 .

[0146] The face detection unit 106 detects the position of the face of the user of the luggage storage machine 1A based on the image acquired by the camera 15. The face detection unit 106 outputs position information indicating the detected position to the drive control unit 107.

[0147] The drive control unit 107 controls the actuator 16 based on the acquired position information to adjust the orientation of the display surface of the internal display 11 so that the aerial image 20 is formed toward the position of the user's face.

[0148] <Specific example of adjusting the imaging direction>

[0149] Figure 11 and Figure 12 This is a specific example of adjusting the imaging direction of an aerial image. Figure 11 The figure shows a situation in which the user 5 operates the luggage storage machine 1A while facing almost the front of the luggage storage machine 1A, at a stage before the user 5 stores the luggage 99 in the luggage storage area 80 .

[0150] In this case, the user 5 is almost facing the front of the luggage storage machine 1A, so the face detection unit 106 detects the position of the user 5's face in the front direction of the luggage storage machine 1A. Therefore, the drive control unit 107 controls the actuator 16 to adjust the direction of the display surface of the internal display 11 so that the aerial image 20 is imaged in the front direction of the luggage storage machine 1A. The result is as follows: Figure 11 As shown, an aerial image 20 is formed in the front direction of the luggage storage machine 1A.

[0151] on the other hand, Figure 12 The figure shows a case where the user 5 stores the luggage 99 in the luggage storage 80. In order to store the luggage 99 in the luggage storage 80, the user 5 Figure 11 Compared to the standing position shown, the user 5 is closer to the luggage storage area 80. Therefore, the face detection unit 106 detects the position of the user 5's face not in the front direction of the luggage storage machine 1A, but in the oblique direction of the side of the luggage storage area 80. Therefore, the drive control unit 107 controls the actuator 16 to adjust the direction of the display surface of the internal display 11 so that the aerial image 20 is imaged in the oblique direction of the luggage storage machine 1A. The result is as follows Figure 12As shown, the aerial image 20 is formed in a direction oblique to the front direction of the luggage storage machine 1A. In this way, the luggage storage machine 1A adjusts the imaging direction of the aerial image 20 in the left-right direction so that the aerial image 20 follows the standing position of the user 5.

[0152] <Stop accepting operations during imaging direction adjustment>

[0153] When the aerial image 20 is imaged toward a user who is moving away from a position substantially facing the front of the luggage storage machine 1A, the luggage storage machine 1A may be set to not accept an operation on the aerial image 20 .

[0154] As an example of a method for implementing this function, if the position of the face detected by the face detection unit 106 is within a specified area including the position of the user facing the front of the luggage storage machine 1A, the operation determination unit 102 may execute the determination process (i.e., the operation determination unit 102 is activated). On the other hand, if the position of the face detected by the face detection unit 106 is outside the specified area, the operation determination unit 102 may stop the determination process (i.e., the operation determination unit 102 is deactivated). Alternatively, the operation determination unit 102 may ignore the detection signal from the operation detection unit 12 instead of completely stopping the determination process.

[0155] As another example, if the position of the face detected by the face detection unit 106 is within the predetermined area, the operation detection unit 12 may execute the detection process (i.e., the operation detection unit 12 is activated). On the other hand, if the position of the face detected by the face detection unit 106 is outside the predetermined area, the operation detection unit 12 may stop the detection process (i.e., the operation detection unit 12 is deactivated). Furthermore, the operation detection unit 12 may not completely stop the detection process, but may stop outputting the detection signal.

[0156] With these configurations, while operations on the aerial image 20 can be accepted when the user is in a predetermined area, including a position directly facing the front of the luggage storage machine 1A, in other cases, operations on the aerial image 20 are restricted so as not to be accepted. Therefore, erroneous operations by users who are away from a position substantially facing the front of the luggage storage machine 1A can be prevented.

[0157] Other examples of adjusting the imaging direction

[0158] Figure 13 and Figure 14This is another example of adjusting the imaging direction. The drive control unit 107 can adjust the angle of the aerial image 20 relative to the top surface of the luggage storage machine 1A based on the position of the face detected by the face detection unit 106. This allows the imaging direction of the aerial image 20 to be adjusted vertically for users of varying heights.

[0159] In order to realize this function, the luggage storage machine 1A includes an actuator 16 that moves in the left-right direction ( Figure 13 and 14 The display surface of the internal display 11 is rotated with the straight line extending from the direction of the paper (entry and exit) as the axis. Figure 13 and Figure 14 As shown, the imaging direction of the aerial image 20 can be adjusted in the vertical direction according to the height of the user. Figure 13 User 5A is shown with Figure 14 Compared with user 5B shown in FIG. 1 , the position of user 5A's face is relatively high, while the position of user 5B's face is relatively low. In other words, the height h1 of user 5A's face from the ground is higher than the height h2 of user 5B's face from the ground (h1>h2). Therefore, the drive control unit 107 controls the actuator 16 for user 5A so that the display surface of the internal display 11 rotates to a direction with a relatively small angle relative to the top surface of the luggage storage machine 1A. As a result, Figure 13 In the example, the angle of the aerial image 20 relative to the top surface of the luggage storage machine 1A is angle θ1. On the other hand, the user 5B controls the actuator 16 to rotate the display surface of the internal display 11 to a direction in which the angle of the aerial image 20 relative to the top surface of the luggage storage machine 1A is relatively large. Figure 14 In the example of FIG. 1 , the angle θ2 of the aerial image 20 relative to the top surface of the luggage storage machine 1A is greater than the angle θ1. Figure 13 and Figure 14 As shown, the faces of the user 5A and the user 5B both enter the observable range 21 of the aerial image 20 , and thus the visibility of the aerial image 20 can be ensured.

[0160] Figure 15 are other examples of imaging direction adjustments. Figure 15 As shown, the actuator 16 can be moved in the left and right directions ( Figure 15By moving the imaging unit 30 about a straight line extending from the image plane (directions of entry and exit from the paper) as an axis, the imaging unit 30 is adjusted vertically. For example, the imaging unit 30 projects the aerial image 20, while the imaging unit 30A projects the aerial image 20A at a different angle to the imaging unit 30. This arrangement also allows the vertical adjustment of the imaging direction of the aerial image 20 based on the user's height.

[0161] Furthermore, the actuator 16 can also move both the internal display 11 and the imaging unit 30. This allows the imaging direction to be flexibly adjusted.

[0162] <Function and Effect>

[0163] As described above, the luggage storage machine 1A according to the present embodiment includes the face detection unit 106 that detects the position of the user's face, and the imaging unit 30 images the aerial image 20 toward the detected position.

[0164] Aerial image 20, projected in mid-air, typically has a narrow viewing angle. Therefore, depending on the user's standing position, aerial image 20 may not be properly visible. In contrast, according to the above configuration, aerial image 20 is projected toward the face of the user who is leaving their luggage. Therefore, for example, if a user moves to the side of luggage storage 80 to deposit their luggage there, aerial image 20 will also be projected toward the user's face after they move. Furthermore, aerial image 20 is projected toward a position corresponding to the user's height, for example. This further ensures the visibility of aerial image 20 and the operability of the GUI included in aerial image 20.

[0165] [Implementation Method 3]

[0166] The following describes another embodiment of the present invention. The luggage storage machine 1B of this embodiment switches between a first mode in which an aerial image 20 is displayed, and a second mode in which the display displays the image. The second mode is intended for use by airline staff, maintenance providers, and the like (hereinafter referred to as "staff, etc."), in addition to users who store luggage.

[0167] <Structure of the Main Parts of the Luggage Storage Machine 1B>

[0168] Figure 16This is a block diagram of an example of the structure of the main parts of the luggage storage machine 1B. The luggage storage machine 1B differs from the luggage storage machine 1 in that it includes a control unit 10B in place of the control unit 10 and is connected to the external display 4 (display device) and input device 6 in a manner that enables communication with the external display 4 (display device) and input device 6. In the luggage storage machine 1B, the external display 4 and input device 6 implement equivalent functions based on the display and operation reception of the aerial image 20. It is assumed that the external display 4 and input device 6 are basically used by staff, etc. However, if the operation detection unit 12 or the operation determination unit 102 fails and cannot determine the operation performed on the portion of the aerial image 20 corresponding to the operation target area, the user can use the external display 4 and input device 6 as a backup device.

[0169] The external display 4 is a display that displays images based on instructions from the display control unit 101B of the control unit 10B, and is typically a liquid crystal display. The image displayed on the external display 4 is the same as the image displayed on the internal display 11, and includes a display area and an operation target area.

[0170] The input device 6 receives an input operation and outputs an operation signal indicating the input operation to the operation determination unit 102B of the control unit 10B. The input operation received by the input device 6 is an operation performed on the operation target area displayed on the external display 4, namely, the GUI. Typical examples of the input device 6 are a keyboard and a mouse, but are not limited to these examples. For example, the input device 6 may be a touch panel. In this example, the external display 4 and the input device 6 may be integrated into a touch panel display.

[0171] The control unit 10B differs from the control unit 10 described above in that it includes a display control unit 101B and an operation determination unit 102B instead of the display control unit 101 and the operation determination unit 102 ; and also includes a display mode switching unit 108 (mode switching unit).

[0172] The display mode switching unit 108 switches the display mode of the luggage storage machine 1B. The display modes of the luggage storage machine 1B include a first mode in which the internal display 11 displays an image, and a second mode in which the external display 4 displays an image. In other words, the first mode displays the aerial image 20, while the second mode does not display the aerial image 20 but displays an image on the external display 4.

[0173] The display control unit 101B causes either the internal display 11 or the external display 4 to display an image, depending on the display mode of the luggage storage machine 1B. When the display mode is the first mode, the display control unit 101B causes the internal display 11 to display an image, thereby forming the aerial image 20. On the other hand, when the display mode is the second mode, the display control unit 101B causes the external display 4 to display an image.

[0174] Operation determination unit 102B has the functions of receiving a detection signal from operation detection unit 12 and determining an operation, and receiving an operation signal from input device 6 and determining an operation. Operation determination unit 102B determines an operation based on the received operation signal and the image displayed on external display 4.

[0175] As an example, the display mode switching unit 108 instructs the display control unit 101B to switch the display mode based on an operation signal of a mode switching operation from the input device 6 .

[0176] As an example, the external display 4 and the input device 6 are preferably installed at a location that does not interfere with the luggage storage user. Figure 17 4 and the input device 6. As an example, Figure 17 As shown, the external display 4 and the input device 6 can be provided so that the staff etc. can use it from the back side of the luggage storage machine 1B. In addition, the external display 4 and the input device 6 can be provided in a position that is completely invisible to the luggage storage user.

[0177] <Function and Effect>

[0178] As described above, the luggage storage machine 1B of this embodiment switches between a first mode in which an aerial image 20 is generated to determine operations performed on the GUI, and a second mode in which an image is displayed on the external display 4 to receive operations. Thus, for example, the machine can be used in a differentiated manner: the first mode can be used for users storing luggage to reduce the risk of infection from viruses, etc., while the second mode can be used for staff, etc., to improve work efficiency.

[0179] Furthermore, since it is assumed that the luggage storage user does not use the external display 4 and the input device 6 , the risk of the staff using the external display 4 and the input device 6 being infected with a virus is relatively low.

[0180] [Implementation Method 4]

[0181] The luggage storage machine 1C of this embodiment not only images the aerial image 20 but also displays an image excluding the operation target area (hereinafter referred to as a "display-only image") on the external display 4 .

[0182] <Structure of the main parts of the luggage storage machine 1C>

[0183] Figure 18 This is a block diagram illustrating an example of the structure of the main components of a luggage storage machine 1C according to this embodiment. The luggage storage machine 1C differs from the aforementioned luggage storage machine 1 in that it includes a control unit 10C in place of the control unit 10 and is connected to the external display 4 in a manner enabling communication therewith.

[0184] The control unit 10C differs from the control unit 10 described above in that it includes a display control unit 101C instead of the display control unit 101. The display control unit 101C displays a display-only image on the external display 4 in addition to the functions of the display control unit 101.

[0185] Figure 19 A display example of the luggage storage machine 1C is shown. Figure 19 In the example, Figure 6 Based on the illustrated aerial image 20E, a portion of the image that is the basis of the aerial image 20B is displayed on the external display 4 as a display-only image.

[0186] <Function and Effect>

[0187] With the above arrangement, after the aerial image 20 is formed, a dedicated display image without any operation is displayed on the external display 4. Therefore, supplementary information not shown on the aerial image 20 or information that should always be displayed regardless of how the aerial image 20 is transformed can be displayed on the external display 4.

[0188] Furthermore, the display surface of the external display 4 generally has a wider viewing angle than the aerial image 20. Therefore, for example, even when the user moves slightly or when there are multiple users standing at different positions, visibility of the information displayed on the external display 4 can be ensured.

[0189] In addition, if Figure 19 As shown, when viewed from the user's perspective, external display 4 is preferably positioned farther from the position where aerial image 20 is imaged. This is because the user typically does not need to touch external display 4. However, the placement of external display 4 is not limited to this location and may be within reach of the user's hand. For example, external display 4 may be positioned adjacent to aerial image 20 in the direction in which aerial image 20 extends (above, below, to the left, or to the right of aerial image 20).

[0190] [Implementation method 5]

[0191] Other embodiments of the present invention will be described below.

[0192] <Overview of this embodiment>

[0193] Figure 20 and Figure 21 This is an overview of the luggage storage machine 1D of this embodiment. The luggage storage machine 1D does not adjust the imaging direction of the aerial image 20, as the luggage storage machine 1A of Embodiment 2 does. In other words, the luggage storage machine 1D does not include a mechanism for changing the orientation of the display surface of the internal display 11. Consequently, the imaging direction of the aerial image 20 remains unchanged, and the observable range 21 of the aerial image 20 remains unchanged.

[0194] The luggage storage machine 1D does not adjust the imaging direction of the aerial image 20, but projects a projection image 70 showing the user's standing position onto the ground in front of the luggage storage machine 1D. The standing position refers to, for example, the position of the ground where the user should stand in order to view and operate the aerial image 20. Therefore, the luggage storage machine 1D detects the position of the user's face and determines the projection position of the projection image based on the detected position. In addition, as is usually the case, Figure 20 and Figure 21 As shown, the projected image 70 is a marker image that prompts the user to stand at the projection position.

[0195] More specifically, the luggage storage machine 1D projects the projection image 70 onto a standing position such that the user's face enters the observable range 21. For example, Figure 20 As shown, user 5A, whose face is above observable range 21, moves back to projection image 70 shown as a standing position, thereby bringing his or her face into observable range 21. As a result, user 5A can see aerial image 20 and operate the GUI of aerial image 20.

[0196] Likewise, if Figure 21 As shown, user 5B, whose face is deviated to the lower side of observable range 21, moves toward projection image 70 shown in a standing position, thereby bringing his or her face into observable range 21. As a result, user 5B can see aerial image 20 and operate the GUI of aerial image 20.

[0197] In order to project the projection image 70 onto the ground, as shown in FIG. Figure 20 and Figure 21 As shown, the luggage storage machine 1D includes an image projecting unit 17. As an example, the image projecting unit 17 may be a projector that projects an image onto the floor. Figure 20 and Figure 21In the example shown, the image projecting unit 17 is disposed in front of the luggage storage machine 1D with the projection direction facing downward in order to project the projection image 70 onto the floor in front of the luggage storage machine 1D. The image projecting unit 17 may be disposed in a location other than the front of the luggage storage machine 1D as long as the projection image 70 can be projected onto the floor in front of the luggage storage machine 1D.

[0198] like Figure 20 and Figure 21 As shown, the observable range 21 of the aerial image 20 generally extends from the aerial image 20 toward the front and above the luggage storage machine 1D. Therefore, a relatively tall user needs to be relatively far away from the luggage storage machine 1D in order to have their face within the observable range 21. On the other hand, a relatively short user needs to be relatively close to the luggage storage machine 1D in order to have their face within the observable range 21. In other words, the appropriate standing position varies depending on the height of the user's face. Therefore, to adjust the standing position according to the user, in this example, the higher the height of the user's face detected from the ground, the farther the projection image 70 is projected from the luggage storage machine 1D.

[0199] Specifically, Figure 20 User 5A is shown with Figure 21 Compared with user 5B shown in the figure, the position of user 5A's face is relatively high, and the position of user 5B's face is relatively low. In other words, the height h1 of user 5A's face from the ground is higher than the height h2 of user 5B's face from the ground (h1>h2). Therefore, for user 5A, the luggage storage machine 1D makes the projection position of the projected image 70 relatively far away from the luggage storage machine 1D, for example, the distance between the projection position of the projected image 70 and the luggage storage machine 1D is d1. On the other hand, for user 5B, the luggage storage machine 1D makes the projection position of the projected image 70 relatively close to the luggage storage machine 1D, for example, the distance between the projection position of the projected image 70 and the luggage storage machine 1D is d2 (d1>d2). As a result, Figure 20 and Figure 21 In either case, if the user stands at the position where the projected image 70 is projected, the face enters the observable range 21, and the user can see the aerial image 20. That is, regardless of the height of the user, the luggage storage machine 1D can show the appropriate standing position corresponding to the user.

[0200] <Main Structure of Luggage Storage Machine 1D>

[0201] Figure 22This is a block diagram illustrating the main components of a luggage storage machine 1D. The luggage storage machine 1D differs from the aforementioned luggage storage machine 1 in that it includes a control unit 10D in place of the control unit 10, a camera 15, and an image projection unit 17. The camera 15 has already been described in Embodiment 2 and will not be repeated here.

[0202] The image projecting unit 17 projects the projection image 70 onto the ground as described above under the control of the control unit 10D.

[0203] The control unit 10D differs from the control unit 10 described above in that it includes a face detection unit 106 and a projection control unit 109. The face detection unit 106 has already been described in Embodiment 2 and will not be repeated here. The face detection unit 106 of this embodiment outputs position information indicating the detected position to the projection control unit 109.

[0204] The projection control unit 109 controls the image projection unit 17 so that the projection image 70 is projected onto the ground position based on the acquired position information. For example, the projection control unit 109 determines a standing position of the user that allows the user's face to enter the observable range 21 based on the acquired position information and the information indicating the observable range 21, and controls the image projection unit 17 so that the projection image 70 is projected onto the standing position.

[0205] Specifically, the higher the height of the user's face from the ground as indicated by the acquired position information, the further the projection control unit 109 moves the projection position of the projection image 70 away from the luggage storage machine 1D. In other words, when the user's face is relatively high, the projection control unit 109 moves the projection position of the projection image 70 relatively far away from the luggage storage machine 1D, and when the user's face is relatively low, the projection position of the projection image 70 is relatively close to the luggage storage machine 1D. For example, for user 5A whose face is relatively high, as shown in FIG. Figure 20 As shown, the projection position of the projected image 70 is set to a distance d1 from the luggage storage machine 1D. On the other hand, for the user 5B whose face is relatively low, as shown in FIG. Figure 21 As shown, the projection position of the projected image 70 is set to a distance d2 from the luggage storage machine 1D, and d2 is shorter than d1.

[0206] <Function and Effect>

[0207] As described above, the luggage storage machine 1D according to the present embodiment includes the image projection unit 17 that projects the projection image 70 indicating the user's standing position onto the floor in front of the luggage storage machine 1D.

[0208] According to the above configuration, the projection image 70 is projected onto the floor in front of the luggage storage machine 1D, so the user can recognize an appropriate standing position.

[0209] The luggage storage machine 1D further includes a face detection unit 106 for detecting the position of the user's face, and a projection control unit 109 for determining the projection position of the projection image 70 based on the detected position.

[0210] Aerial image 20, projected in mid-air, generally has a narrow viewing angle, and depending on the user's standing position, it may be difficult to properly view aerial image 20. In response to this, according to the above-described configuration, image projection unit 17 projects projection image 70 at a position corresponding to the position of the user's face. This allows the user to be shown different standing positions that bring the user's face within observable range 21, depending on the user's height. Consequently, the luggage storage machine 1D ensures visibility of aerial image 20 and operability of the GUI included in aerial image 20.

[0211] Furthermore, as the height of the detected position of the user's face from the ground increases, the projection control unit 109 moves the projection position of the projection image 70 further away from the luggage storage machine 1D.

[0212] The observable range 21 of the aerial image 20 is typically a range extending from the aerial image 20 toward the front of the luggage storage machine 1D. Therefore, a user of relatively tall stature needs to be relatively far away from the luggage storage machine 1D in order to bring their face into the observable range 21. On the other hand, a user of relatively short stature needs to be relatively close to the luggage storage machine 1D in order to bring their face into the observable range 21. In other words, the appropriate standing position varies depending on the height of the user's face. Here, through the above scheme, the higher the height of the detected user's face from the ground, the farther the projection position of the projected image 70 is from the luggage storage machine 1D. Therefore, regardless of the user's height, the appropriate standing position can be shown to any user.

[0213] While the luggage storage machine 1D has been described as not adjusting the imaging direction of the aerial image 20, it is also possible to project the projection image 70 while adjusting the imaging direction of the aerial image 20. In this example, the luggage storage machine 1D includes the actuator 16 and drive control unit 107 described in Embodiment 2. A detailed description of the actuator 16 and drive control unit 107 will not be repeated.

[0214] If the adjustment range of the imaging direction of aerial image 20 is limited, then depending on the user's height, aerial image 20 may not be imaged toward the user's face even if the imaging direction is adjusted. In this regard, according to the above embodiment, since projected image 70 is projected, the user can be encouraged to move to a standing position where the user's face is within observable range 21.

[0215] Alternatively, the luggage storage machine 1D may not include the face detection unit 106. In this case, the luggage storage machine 1D may project multiple projection images 70 onto the front of the luggage storage machine 1D. For example, these multiple projection images 70 may each represent a different numerical range related to the user's height, such as an image showing "150-159 cm," an image showing "160-169 cm," and an image showing "170-179 cm." In this case, the user of the luggage storage machine 1D can view the aerial image 20 by standing at a projection position where the projection images 70 showing the numerical range that includes their own height are projected.

[0216] In addition, the projected image 70 is not limited to Figure 20 and Figure 21 The image showing the standing position area itself can be any image that allows the user to recognize the standing position. For example, the projection image 70 can be an image (eg, an arrow, etc.) projected around the standing position to indicate the standing position.

[0217] [Variation]

[0218] In each of the above embodiments, the aerial image 20 may be a stereoscopic image. This approach can improve the understanding of the user viewing the aerial image 20. For example, the stereoscopic image can be used to explain the depth of the luggage or the luggage storage area 80, or to explain the placement of a luggage tag relative to the luggage shown in the stereoscopic image.

[0219] In the above embodiments, the luggage storage machines 1, 1A to 1D are described as having a luggage tag ticketing function. However, the luggage tags may be issued in advance by a device different from the luggage storage machines 1, 1A to 1D. In this case, the luggage storage machines 1, 1A to 1D may not have a luggage tag ticketing function. Figure 5 and Figure 6 The functionality described.

[0220] In the above embodiments, the user has already obtained a boarding pass when using the luggage storage machines 1, 1A-1D. However, the luggage storage machines 1, 1A-1D can also issue boarding passes. In this case, the luggage storage machines 1, 1A-1D can issue boarding passes using the aerial image 20, similar to other operations, and the boarding pass can be issued by the ticket issuing device 14. This reduces the risk of infection from the boarding pass issuance stage.

[0221] [Software-based implementation example]

[0222] The control blocks of the luggage storage machines 1 and 1A to 1D (particularly the control units 10 and 10A to 10D) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or by software.

[0223] When implemented by software, the luggage storage machines 1, 1A to 1D include a computer that executes software program instructions for implementing each function. The computer may include, for example, one or more processors and a storage medium that stores the program in a computer-readable manner. Furthermore, in the computer, the purpose of the present invention can be achieved by the processor reading the program from the storage medium and executing it. As the processor, for example, a CPU (Central Processing Unit) can be used. As the storage medium, a "non-transitory tangible medium" such as a ROM (Read Only Memory) can be used, as well as a storage tape, a storage disk, a memory card, a semiconductor memory, a programmable logic circuit, etc. can be used. Furthermore, a RAM (Random Access Memory) or the like for developing the program can also be provided. Furthermore, the program can also be provided to the computer via any transmission medium (such as a communication network and broadcast waves) that can transmit the program. Furthermore, even if the program is in the form of a data signal carried on a carrier wave that is embodied through electronic transmission, one aspect of the present invention can be achieved.

[0224] The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the specification. Embodiments obtained by appropriately combining technical means disclosed in different embodiments are also included in the technical scope of the present invention.

Claims

1. A luggage storage machine comprising: a display unit that displays an image related to luggage storage including an operation target area; an imaging unit configured to image the image displayed on the display unit as an aerial image in the air around the aircraft; an operation determining unit for determining a user's operation on a portion of the aerial image corresponding to the operation target area; a process execution unit configured to execute a process related to the luggage storage corresponding to the determined operation; as well as a face detection unit configured to detect a position of the user's face; When the detected position exists within a predetermined area including a position where the user faces the front of the luggage storage machine, the operation determination unit determines the operation. When the detected position is outside the predetermined area, the operation determination unit stops determining the operation.

2. A luggage storage machine comprising: a display unit that displays an image related to luggage storage including an operation target area; an imaging unit configured to image the image displayed on the display unit as an aerial image in the air around the aircraft; an operation determining unit for determining a user's operation on a portion of the aerial image corresponding to the operation target area; a process execution unit configured to execute a process related to the luggage storage corresponding to the determined operation; as well as a face detection unit configured to detect a position of the user's face; When the detected position exists within a predetermined area including the position of the user facing the front of the luggage storage machine, an object detection unit for detecting an object in the vicinity of the position formed by the aerial image performs the detection. When the detected position is outside the predetermined area, the object detection unit stops detecting the object.

3. A luggage storage machine comprising: a display unit that displays an image related to luggage storage including an operation target area; an imaging unit configured to image the image displayed on the display unit as an aerial image in the air around the aircraft; an operation determining unit for determining a user's operation on a portion of the aerial image corresponding to the operation target area; a process execution unit configured to execute a process related to the luggage storage corresponding to the determined operation; an image projection unit configured to project an image showing the user's standing position onto the ground in front of the luggage storage machine; a face detection unit that detects the position of the user's face; as well as A projection control unit determines a projection position of the projection image based on the detected position.

4. The luggage storage machine according to any one of claims 1 to 3, wherein The luggage storage machine is installed near a luggage storage area of ​​a transport device that transports the luggage. The user is the person who deposits the luggage at the luggage storage. The display unit and the imaging unit are provided to image the aerial image at a position where the user can see it and perform the operation.

5. The luggage storage machine according to claim 4, in, The imaging unit images the aerial image toward the detected position.

6. The luggage storage machine according to any one of claims 1 to 3, It further includes a display control unit configured to display the image on the display unit and the display device. in, The operation determination unit further determines an operation performed on the operation target area in the image displayed on the display device. The luggage storage machine further includes a mode switching unit configured to switch between a mode in which the display control unit displays the image on the display unit and a mode in which the display control unit displays the image on the display device.

7. The luggage storage machine according to any one of claims 1 to 3, The device further includes a display control unit configured to display a display-only image excluding the operation target area on a display device.

8. The luggage storage machine according to any one of claims 1 to 3, wherein: The aerial image is a stereoscopic image.

9. The luggage storage machine according to claim 3, wherein: The projection control unit moves the projection position farther away from the luggage storage machine as the height of the detected position from the ground increases.

Citation Information

Patent Citations

  • Luggage processing station and system thereof

    US10252821B2

  • Real-time touch system to provide aerial imaging according to facial recognition and laser images

    CN108196681A

  • Method and system for preventing mistaken touch of mobile terminal and mobile terminal

    CN111078097A

  • Check-in unit

    EP2886466A1

  • Image generating apparatus and photographing method of same

    JP2007243634A