User recognition and dispatch by elevator interface apparatus
The elevator interface apparatus addresses inefficiencies in tall buildings by capturing user images, guiding and identifying them, and providing dispatch information, thereby reducing waiting and travel times while enhancing security and personalization.
Patent Information
- Application Number
- PCT/EP2025/078212
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-10-09
- Filing Date
- 2025-10-01
- Publication Date
- 2026-04-16
AI Technical Summary
In tall buildings with multiple elevators, passengers face long waiting times and increased travel times due to inefficient queuing and access to the landing operating panel (LOP), with access rights management adding to the complexity.
An elevator interface apparatus captures user images, determines distance conditions, guides users to meet these conditions, identifies them, and provides dispatch information, optimizing elevator dispatch and reducing physical interaction.
This approach reduces waiting and travel times, enhances security, and provides a seamless, efficient, and personalized experience by minimizing queue formation and optimizing elevator usage.
Smart Images

Figure EP2025078212_16042026_PF_FP_ABST
Abstract
Description
USER RECOGNITION AND DISPATCH BY ELEVATOR INTERFACE APPARATUSTECHNICAL FIELD OF THE INVENTION
[0001] Embodiments of the invention relate to recognizing and dispatching a user, and in particular to the recognition and dispatch of a user of an elevator system. Specifically, embodiments relate to a method of dispatching a user of an elevator system by an elevator interface apparatus, and an elevator interface apparatus for user recognition and dispatch.BACKGROUND OF THE INVENTION
[0002] Buildings, for example commercial buildings or residential buildings, with more than two levels, can include elevators as a means of transporting passengers. The larger the building is, particularly, the more levels a building has, the more elevators the building will have, to accommodate the requirements. For example, a building with 50 stones can have two elevators, one elevator which services stones 1 through 25, while the second elevator services stories 26-50. However, taller buildings typically have a higher quantity of passengers. The greater the number of passengers, the bigger the requirement to have additional elevators.
[0003] One common problem in taller buildings, particularly with multiple elevators, is that the users of the elevators are all following the exact same procedure of having to wait in line for an elevator to have sufficient space for them to travel in. This creates the effect of a larger number of passengers building up while queuing for the next available elevator. The procedure of calling an elevator can include pressing a button indicating the need to travel upwards or pressing a button indicating the need to travel downwards. Both buttons can also be pressed simultaneously. Thereafter it is required to press a button indicating a destination.
[0004] In addition to the waiting time being longer when there is a queue, the travel time can also be longer than if the queue was minimal or non-existent. The travel time can be increased because the elevator will have more passengers, and each- 2 - 2024P00187WG passenger may require to exit at a different floor. Another common problem is the need for all users to access the landing operating panel (LOP) of an elevator, because as the elevator fills up, the access to the LOP is reduced thus requiring more time. Additionally, not all users may be permitted to access all of the levels, thus, access rights need to be managed, as access rights management can require more time.
[0005] Thus, there is a need for handling of the queue of passengers in a more efficient and effective manner.SUMMARY OF THE INVENTION
[0006] In view of the background of the invention, a method of dispatching a user of an elevator system by an elevator interface apparatus, and an elevator interface apparatus for user recognition and dispatch, as claimed, are provided. Further advantages, features, aspects, and details are evident from the claims, the description, and the drawings.
[0007] According to an embodiment, a method of dispatching a user of an elevator system by an elevator interface apparatus is described. The method includes: (a) capturing, by an image capturing device, an image of the user; (b) determining, based on the captured image, whether a distance condition is met, wherein the distance condition is related to a distance from the user to the image capturing device; (c) upon having determined that the distance condition is not met, guiding the user towards meeting the distance condition; (d) repeating the steps (a) to (c) until the distance condition is met; (e) identifying, based on the captured image, the user; and (f) providing, based on the identification of the user, a user output with dispatch information to the user.
[0008] According to an embodiment, an elevator interface apparatus for user recognition and dispatch is described. The elevator interface apparatus includes an image capturing device. The image capturing device is configured to capture at least one image of a user. The elevator interface apparatus further includes a display screen. The display screen displays the at least one captured image. The elevator interface apparatus further includes a memory and a processor. The elevator interface apparatus further includes a graphical user interface (GUI). The GUI is visible on thedisplay screen. The processor of the elevator interface apparatus is configured to perform the method of dispatching a user of an elevator system by an elevator interface apparatus according to any of the embodiments described herein.
[0009] Embodiments are also directed at elevator systems, for example, the elevator system which beneficially utilize the method of dispatching a user of an elevator system by an elevator interface apparatus. Embodiments are also directed at elevator systems, for example, the elevator system which beneficially utilize the elevator interface apparatus for user recognition and dispatch. These method steps can be performed by way of hardware components, such as a computing device, a motor, or any other applicable device. Furthermore, embodiments according to the invention are also directed at methods by which the described apparatus can perform. It includes method steps for dispatching a user, particularly of an elevator system, by an elevator device, and can allow for the user to interact with the elevator device, particularly the elevator interface apparatus, and more particularly, the landing operating panel (LOP).BRIEF DESCRIPTION OF THE DRAWINGS
[0010] So that the manner in which the above recited features of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, can be had by reference to embodiments. The accompanying drawings relate to embodiments of the invention and are described in the following:FIG 1 illustrates, schematically, a flow chart of a method of dispatching a user of an elevator system by an elevator interface apparatus according to embodiments described herein;FIG. 2 is a collection of three screenshots of a graphical user interface according to an embodiment of the invention illustrating, schematically, guiding a user of an elevator system;FIG. 3 is a flowchart illustrating, schematically, a method of dispatching a user of an elevator system by an elevator interface apparatus according to embodiments described herein; andFIG. 4 is a schematic view of an elevator interface apparatus for user recognition and dispatch according to embodiments described herein.DETAILED DESCRIPTION OF EMBODIMENTS
[0011] Reference will now be made in detail to the various embodiments of the invention, one or more examples of which are illustrated in the figures. Within the following description of the drawings, the same reference numbers refer to same components. Generally, only the differences with respect to individual embodiments are described. Each example is provided by way of explanation of the invention and is not meant as a limitation of the invention. Further, features illustrated or described as part of one embodiment can be used on or in conjunction with other embodiments to yield yet a further embodiment. It is intended that such exemplary modifications and variations are included.
[0012] A method of dispatching a user of an elevator system by an elevator interface apparatus, and a corresponding elevator interface apparatus for user recognition and dispatch, is beneficial in improving the throughput of users of an elevator system. The term “user” can be understood as a person and / or robot operating an elevator system, and particularly an elevator interface apparatus, such as for example, a landing operating panel (LOP). The elevator interface apparatus can be any of a LOP, a tablet, a portable computer, an application on a device, etc. Improving the throughput of users can be beneficial in reducing the waiting time of the user. Improving the throughput of users can be beneficial in reducing the interaction the user needs to have with the elevator interface apparatus.
[0013] An elevator system comprising any of the embodiments as described herein can transport people quickly and safely. The time required can be reduced by selecting the shortest trip. For example, the shortest trip includes the least amount of stops priorto the destination. The time required can be reduced by optimizing the control of the elevator interface apparatus. The time required can be reduced by reducing the active input required from the user. The time required can be reduced by a combination of any of the aforementioned means.
[0014] Embodiments as described herein can offer fast identification of the user. Fast identification of the user, particularly in an environment where many users can simultaneously seek access to the elevator system, is beneficial as it minimizes and / or avoids a queue. Identification of the user can be understood as correlating the user with a destination, and pre-selecting a correlated destination. This pre-selection would not require for the user to interact with any physical components. Despite this preselection, the elevator interface apparatus can offer an option to override the preselected destination. For example, if the user is seeking to travel from the ground floor to the 17thfloor using an elevator, the elevator interface apparatus can identify the user and their (likely) desire to go to the 17thfloor based on a correlation determined from the data provided. For example, the data provided can include the local time, which can for example indicate that the user is on their way to work. Additionally, or alternatively, it can also be permitted for the user to simply input a destination, particularly inputting a destination prior to a preselected destination being provided.
[0015] Embodiments as described herein can provide a smart system with high efficiency. The smart system can be in the form of the user being dispatched according to their typical patterns. High efficiency can be in the form of dispatching the user to the elevator, particularly an elevator car, which could transport the user the quickest to their destination. This would eliminate the need to wait in the queue amongst a crowd of users.
[0016] Embodiments as described herein can offer a higher degree of security to the building in which the elevator system is located, and / or neighbouring buildings. If the identification of the user determines where the user is permitted to travel to, this provides the benefit of reducing unwanted visitors. For example, a user is employed to work on level 23, but might not be granted permission to access levels 22 and 24. The elevator system and / or the elevator interface apparatus can include a rights management module. The rights management module can control the access to theelevator system, by for example, granting or denying access to a user, based on the identification of the user.
[0017] Embodiments as described herein can offer a seamless, efficient, and personalized experience with the elevator system. For example, the user can be identified and be given dispatch information all while approaching the elevator interface apparatus, providing a unique manner in operating the elevator system. This seamless, efficient, and personalized nature subsequently can allow for a more energy efficient operation of the elevator system. The elevator system can be more efficient by for example calling a single elevator car instead of all the elevator cars. The elevator interface apparatus can be more efficient by learning new patterns. For example, if the user enters the building at 08:00, then a first trip with an elevator could be to the 33rdfloor, as that is where the employer of the user is located. At 09:00, the user could seek to travel to level 5, as their favourite cafe is located on level 5. After the cafe, the user seeks to return to the 33rdfloor. At 12:00, the user can seek to travel to level -2, as that is where they eat lunch. After lunch the user returns to the 33rdfloor. At 16:00, the user can be heading home, so they could seek to travel to the ground floor. These patterns can be learned by the elevator interface apparatus, and thus the user can have a seamless experience, all the while requiring a minimal amount of time.
[0018] A standard LOP may not be sufficient in offering the user the seamless, efficient, and personalized experience as described herein. Without limiting the scope of protection of the invention described herein, a method of dispatching a user and an elevator interface apparatus will be exemplarily described.
[0019] FIG. 1 illustrates, schematically, a flowchart of a method 100 of dispatching a user of an elevator system by an elevator interface apparatus according to embodiments described herein. The method includes: (a) capturing, by an image capturing device, an image of the user 102; (b) determining, based on the captured image, whether a distance condition is met, were in the distance condition is related to a distance from the user to the image capturing device 104; (c) upon having determined that the distance condition is not met, guiding the user towards meeting the distance condition 106; (d) repeating the steps (a) to (c) until the distance condition is met 108;- 7 - 2024P00187WG(e) identifying, based on the captured image, the user 110; and (f) providing, based on the identification of the user, a user output with dispatch information to the user 112.
[0020] The repetition of steps (a) to (c) can be completed any (theoretically unlimited) number of times. The repetition of steps (a) to (c) can be completed a limited number of times (for example, be aborted after a predetermined number of iterations has been reached). For example, the repetition of steps (a) to (c) can be completed (aborted after) 2 times, 5 times, 10 times, 20 times, or any other predetermined number of times. The repetition of steps (a) to (c) can be completed with or without time limitation. The repetition of steps (a) to (c) can be completed for a limited amount of time (for example, be aborted after a predetermined timeout has been reached, either overall or per iteration). For example, the repetition of steps (a) to (c) can be completed within (aborted after, overall or per iteration) 5 seconds, 10 seconds, 20 seconds, or any predetermined amount of time. The repetition of steps (a) to (c) is done until the distance condition is met, in order for the identification of the user to be completed. For example, if the user meets the distance condition and then makes a motion which no longer meets the distance condition, and the identification of the user cannot be completed, steps (a) to (c) could be repeated. The repetition of step (d) is only done if the distance condition is not met. For example, if the distance condition is met initially, then there would be no repetition of steps (a) to (c). In addition to the distance condition, other conditions may apply as well for determining, in step (d), whether or not another loop of steps (a) to (c) shall be carried out.
[0021] According to some embodiments, the guiding the user towards meeting the distance condition includes issuing an audible command to the user. The audible command can be in a language of choice such as for example, English, French, German, Spanish, Italian, Mandarin, Cantonese, Japanese, or any other selected language. The audible command can also include a particular dialect or accent as selected. The audible command can be spoken from a speaker and / or an audio system. The audible command will be of an appropriate noise level considering the environment where the user finds themselves.
[0022] The method can include a standby operation in which the image capturing device captures a continuous image of a field of view in order to determine when theuser is approaching the elevator system. Considering that an elevator system can have multiple people in its vicinity, it shall be clear that the term “user” defines an individual with an intent to use the elevator system. This can mean for example, that all other individuals that do not have an intent of using the elevator system are not disrupted by the guiding of the elevator interface apparatus according to embodiments described herein. For example, when the user is approaching the elevator system, the elevator interface apparatus is capable of distinguishing between the user and another individual in the vicinity of the elevator system. The system can be configured for identifying such a relevant user, for example, based on distance, the user’s face and / or eyes being directed towards the display and / or image capturing device, user’s lip movement (e.g., indicating a keyword spoken by the user), or other visual or other clue identified by the image capturing device. The guiding of the user towards meeting the distance condition through issuing the audible command can be adapted for each iteration in order to meet the distance condition. For example, if the user is standing too far away from the elevator interface apparatus, the audible command can instruct the user to, for example, “Get closer”. However, the user can come too close to the elevator interface apparatus, at which point the audible command can be, for example, “Please take a step back”. Guiding the user through the audible command can be beneficial when for example, the user is visually impaired. The audible command can reduce the amount of time required for the user to be identified.
[0023] FIG. 2 illustrates, schematically, guiding a user of an elevator system by an elevator interface apparatus according to embodiments described herein.
[0024] According to some embodiments, guiding the user towards meeting the distance condition includes issuing a legible command to the user. For example, the method as described herein is illustrated in an example application. The user is seen by the image capturing device, however, a position of the user does not meet the distance condition, and therefore, the legible command 204 is presented to the user by the elevator interface apparatus. The legible command 204 can be in any language which is selected. The legible command 204 can be presented simultaneously with an audible command, and can be in the same language as the audible command, or a different language. The legible command is of a font size and type which can beperceived by a standard eye. The legible command can be beneficial if the user has a hearing impairment.
[0025] According to some embodiments, guiding the user further comprises guiding the user in a longitudinal direction away from or towards the image capturing device and or the elevator interface apparatus. The longitudinal direction is defined as a direction of the user towards and away from the elevator interface apparatus, in particular towards and away from display and / or the image capturing device. For example, in FIG. 2 the legible command reads, “Get closer” and “Move backward”. The legible command is providing instructions to the user on how to move in the longitudinal direction, for example, forward or backward. The audible command can also guide the user in the longitudinal direction away from or towards the image capturing device and or the elevator interface apparatus. The method can only be concerned with the longitudinal direction, as it can be understood that the individual who is not in the vicinity of and in sight of the image capturing device, is not the intended user. For example, if the individual is standing too far in either horizontal direction, it would not be clear to the elevator interface apparatus if the individual intends to use the elevator system, and as such, is not perceived as the user. For example, it could be that the individual standing too far in either horizontal direction of a field of view of the image capturing device is in the vicinity of the elevator system as they are communicating with the user of the elevator system. The user is not supposed to get too close to the elevator interface apparatus as a door and / or an opening of an elevator should remain clear.
[0026] According to some embodiments, the method, and in particular the elevator interface apparatus, can include a lateral condition based on a lateral (i.e. , left-or-right) position of the user relative to the image capturing device. The lateral condition can be in addition to the distance condition. The lateral condition can be such that it requires the user to be in a predetermined lateral field of view of the captured image, particularly of the width of the captured image (the predetermined lateral field may be an angular field of view and / or depend on the distance). The elevator interface apparatus may be configured for processing the lateral condition in a different manner than the distance condition. For example, the user may, contrary to the distance condition, not receive any user feedback when the lateral condition is not met, but simply may no longer betreated as a user, and any identification or guidance may be aborted. Further, the elevator interface apparatus may be configured for guiding the user which is fully in view of the captured image in the longitudinal direction. However, for example, if the user is not fully in view in the lateral direction, then the user does not meet the lateral condition, and the user would no long be treated as the user, but rather as an individual, and no more guidance would be provided. Furthermore, the lateral range of positions meeting the lateral condition may be larger, in absolute distance units, than the longitudinal range of positions meeting the distance condition.
[0027] The term, “image capturing device”, can refer to one or more image capturing devices, for example, three, five, etc. image capturing devices. The term, “image” or “captured image”, can refer to one or more images captured by the image capturing device, for example, two, four, nine, etc. images. The images can be still images or video images. For example, if the image capturing device is configured to capture a video, 30 frames per second, 60 frames per second, etc. can be captured by the image capturing device.
[0028] According to some embodiments, the distance condition comprises at least one of: a face of the user being fully visible in a field of view of the image capturing device; a face of the user exceeding a predetermined minimum size in the captured image; and a face of the user not exceeding a predetermined maximum size in the captured image. The size of the face of the user, in particular a facial feature such as a distance between two eyes, a width of the face, a height of the face, a distance between a nose and a mouth, etc.... can be determined in a number of ways, such as image processing, matching, measuring, etc. The interface may be configured for showing, on the screen showing the image captured by the image capturing device, an equivalent circle representing the size of the face, as shown in Fig. 2. Alternatively, or additionally, the distance condition may be based on other variables such as a crowd size, a queue size, lighting, time of day, sound, etc.
[0029] For example, in the first captured image of FIG. 2, the face of the user does not exceed a predetermined minimum size, because the circle 202 does not, for example, have sufficient dimensions such as an area of the circle, a width of the circle, a diameter of the circle, etc. It can also be that a single circle indicates that the userdoes not yet meet the distance condition. The distance condition can also be dependent on the user and their physical traits, for example, a height of user. The face of the user being fully visible can be determined by a degree of focus of the captured image. The distance condition can also be dependent on an approaching elevator because, for example, if the approaching elevator is not empty, then the user can need to find an appropriate spot to locate themselves inside of the elevator, and not stand by the entrance of the approaching elevator. The distance condition can also be determined by the image capturing device and a quality there of. The distance condition can also be determined by the environment and / or vicinity of the elevator system.
[0030] According to some embodiments, identifying the user is carried out through facial recognition. The facial recognition can be handled by the elevator interface apparatus. For example, the facial recognition can include matching the captured image to a registered user of the elevator interface apparatus. The facial recognition can be dependent on a variety of factors, such as for example, characteristics of an appearance of the user.
[0031] According to some embodiments, the method of dispatching the user of the elevator system by the elevator device further comprises, displaying a visual indicator of the identifying of the user being in progress. Once the user is determined to meet the distance condition, identification of the user can begin. For example, in FIG.2, the two circles 206, also referred to as double circle, illustrate that identification is in progress, and are therefore the visual indicator of the identifying the user being in progress. There can be a legible command 208 stating that the identification is in progress, for example, “Identifying...”. The status of notification can be provided through an audible command, for example, with a quieter beeping noise.
[0032] According to some embodiments, in case of failure to identify the user based on the captured image, inviting the user to register or update their identification. If the user cannot be identified, it could be that the user is not registered with the elevator system and / or the elevator interface apparatus or doubt the appearance of the user differs from the appearance of the user during registration. For example, if a new employee starts their first day at work, the new employee will need to register with the- 12 - 2024P00187WG elevator interface apparatus as a user of the elevator interface apparatus. For example, if the user has changed their appearance with for example, a new haircut, the user may need to register with the elevator interface apparatus to account for the new haircut. In FIG. 2, it can be seen that the elevator interface apparatus offers an opportunity for the user to register themselves by presenting verification where it states, for example, “Show your card or QR code below”. Thus, inviting the user to register or update their identification comprises verifying an identity and collecting identification data.
[0033] FIG. 3 illustrates, schematically, a method 300 of dispatching a user of an elevator system by an elevator interface apparatus according to embodiments described herein. Fig. 3 illustrates three possible scenarios of dispatch information being provided upon successful identification of the user. A first scenario 304 is in the top line, a second scenario 306 is in the middle line, a third scenario 308 is in the bottom line of Fig. 3. Generally, the system may be configured for dispatching the user according to different scenarios. These scenarios may also be combined, for example, which can be selected based on the user identification and / or other circumstances.
[0034] The first scenario 304 involves successful identification of the user. Without successful identification of the user, the security of the building can be compromised. Upon successful identification of the user, an elevator is assigned to the user based on an internal algorithm, and the elevator is called automatically for the user. The call of the elevator is based on the successful identification of the user. For example, if the user is employed on level 31 , then the elevator is called to take the user to level 31. The destination can be determined by the user during registration and / or updating of their identification. The automatic call is not limited to a single destination, and the destination can be dependent on the time of day.
[0035] The second scenario 306 involves successful identification of the user. Without successful identification of the user, the security of the building can be compromised. Upon successful identification of the user, the user is prompted to enter the destination. For example, this can be beneficial if the building is owned, operated, and resided by a single entity, wherein each user has access to all destinations.
[0036] The third scenario 308 involves successful identification of the user. Upon successful identification of the user, an elevator is assigned to the user based on an internal algorithm, and the elevator is called automatically for the user. The call of the elevator is based on the successful identification of the user. However, the user can be prompted with an option to select a different destination. In this example, the user was instructed to proceed to elevator “A” which would take the user to destination “3”, however, the user entered the destination “4” when prompted for to enter a different destination, at which point the elevator “B” is called, and the user is instructed to proceed to elevator “B”.
[0037] When providing the user with the dispatch information, an arrow can be provided. The arrow can indicate which direction the called elevator is in. This arrow illustrating the direction can be beneficial in quickly and correctly orienting the user
[0038] According to some embodiments the elevator system comprises a plurality of elevators and where in the comprises which elevator of the plurality of elevators to proceed to. For example, upon identification of the user 302, the user can be provided, as the dispatch information, with an instruction to proceed to a specific elevator 304. To better identify which elevator the user is to proceed to, a reference to the elevator 312 can be provided, for example, the elevator corresponds to “A”. This is beneficial in that it can reduce the queue at the other elevators in the plurality of elevators, because if this was not provided, the user could proceed to wait with the remainder of the queue for the next elevator that should be arriving. However, the next elevator to arrive is not necessarily the fastest elevator for the user to reach a destination.
[0039] According to some embodiments, the dispatch information comprises a destination landing. For example, upon the identification of the user, the user is instructed to proceed to a specific elevator, and that elevator will bring the user to the destination landing number “54”, as seen by reference numeral 318 in FIG. 3. Additionally, the dispatch information can include an estimated time of arrival of the designated elevator 314. This can be beneficial in allowing the user to know how much time they have until they need to be at the designated elevator. The user knowing how much time they have is beneficial in that they would know, for example, for how much longer they could keep a conversation for.
[0040] According to some embodiments, the method further comprises the user inputting a destination 306. For example, if the user seeks to travel to the 12thfloor, the user can input floor 12 as their destination. The user can be identified prior to inputting the destination. However, the user can also input the destination prior to being identified. Upon the user inputting the destination, the elevator interface apparatus can then provide the dispatch information to the user, for example, to proceed to elevator “A”, this can be beneficial if the user is in a rush and is seeking to go to a different level, in which case the user can simply proceed to inputting the destination.
[0041] Another alternative can be, that the user is identified and is provided with the dispatch information, however, the user seeks to override the dispatch instructions because they want to, for example, go to a different level. In this case, upon identification of the user 302, the user is provided dispatch information 308, then the user inputs the destination 316, and then the user is provided with the dispatch information according to the input destination.
[0042] Once the dispatch information has been displayed to the user, the elevator interface apparatus can return to a main screen waiting for another user to approach the elevator interface apparatus.
[0043] The dispatch information which is based on the identification of the user is beneficial in that it reduces the requirement of input from the user. For example, the user can approach the elevator interface apparatus, and with some experience, understand where to position themselves for the quickest identification, resulting in a quick dispatch of the elevator. The user would nonetheless be provided the opportunity to interact with the elevator interface apparatus if so desired, for example, to visit an individual on a different level.
[0044] A benefit of less interaction with the elevator interface apparatus, be it by not having to press a call button and a floor button, the user can also minimize contact with surfaces, and in turn reduce exposure to unknown matter.
[0045] FIG. 4 illustrates, schematically, an elevator interface apparatus 400 for user recognition and dispatch according to embodiments described herein. The embodiment of FIG. 4 does not limit the scope of protection to merely the illustratedembodiment, rather any embodiment comprising the features described herein. For example, the elevator interface apparatus can include a flat surface a curved surface or a combination thereof. The elevator interface apparatus includes an image capturing device 402, configured to capture an image of a user. The elevator interface apparatus further includes a display screen 410, when the display screen displays the captured image, the elevator interface apparatus further includes a memory 406, a processor 408, and an audio system 412. The elevator interface apparatus further includes a graphical user interface (GUI) 404, wherein the graphical user interface (GUI) is visible on the display screen. Additionally, this apparatus may also include a detector 413 for detecting an ID card or a chip card, etc, so that a user can also be identified for this elevator in this way if necessary. The processor is configured to perform the method according to any of the embodiments described herein.
[0046] According to some embodiments, the display screen is touch sensitive. Touch sensitivity would allow the user to interact with the elevator interface apparatus should they seek to input a destination.
[0047] According to some embodiments, the elevator interface apparatus can further comprise a card reader. The card reader can be used to verify an identity of the user. Thus, the card reader can allow for registration and / or updating of user information, by for example, verifying a piece of identity such as an ID card or a QR code, and collecting new or updated user information.
[0048] According to some embodiments, the audio system can be used to output an audible command. The audio system can also be used to input audio. For example, the audio input can be in the form of a microphone, and the microphone can be used to take orders from the user. For example, the user can order the elevator system to call an elevator to travel to a different floor. The audio system can be another form of interaction between the user and the elevator interface apparatus.
[0049] The memory 406 can be used to store the user information which is provided to the elevator interface apparatus. The memory 406 can be used as a databank, which is then used in cooperation with the processor 408, to identify the user. For example, if a user wants to register with the elevator interface apparatus, they can prove theiridentity using an identification card or a QR code or another means, and an image can be taken of the user. This image can be stored in the memory, such that every time that the user seeks to use the elevator system, the image capturing device of the elevator interface apparatus can capture an image of the user and compare the captured image with the images stored in the memory, for example, the databank. The captured image is compared with the stored images to find a match. Once the captured image is matched to one of the stored images, the user can then be identified.
[0050] Upon identification of the user, an automatic call to the elevator system can be made and dispatch information can be provided to the user based on the matching of images, for example, by facial recognition.
[0051] It could also be the case that the elevator interface apparatus does not provide an automatic call to the elevator system but rather only seeks to identify the user in order to permit the user access to the elevator system. This can be beneficial in providing restricted access to users of the elevator system. Thus, this increases the security of the building and in particular of the elevator system.
[0052] According to some embodiments, the image capturing device can be integrated with the elevator interface apparatus within a single housing. This single housing can be beneficial if a replacement would be needed, because for example, the elevator interface apparatus does not properly function, since the single housing can be replaced, rather than halved to invest more time in finding the problem. The last time that is spent on maintenance the better because a building is most functional when all elevators are working.
[0053] The present invention is beneficial in providing a seamless experience with the elevator interface apparatus because it, for example, can reduce the physical interaction with various elevator components and / or buttons. If for example, the user is not capable of pressing the button to call the elevator, the user could be recognised and identified by the elevator interface apparatus, and the elevator interface apparatus could call the quickest elevator and provide the required dispatch information to the user. It is important that the dispatch information provided to the user is unique to the user and not to another user.
[0054] While the foregoing is directed to embodiments of the invention, other and further embodiments of the invention can be devised without departing from the basic scope thereof, and the scope thereof is determined by the appended claims.
Claims
CLAIMS1. A method (100) of dispatching a user of an elevator system by an elevator interface apparatus, the method comprising:(a) capturing, by an image capturing device, an image of the user (102);(b) determining, based on the captured image, whether a distance condition is met, wherein the distance condition is related to a distance from the user to the image capturing device (104);(c) upon having determined that the distance condition is not met, guiding the user towards meeting the distance condition (106);(d) repeating the steps (a) to (c) until the distance condition is met (108);(e) identifying, based on the captured image, the user (110); and(f) providing, based on the identification of the user, a user output with dispatch information to the user (112).
2. The method of claim 1 , wherein guiding the user towards meeting the distance condition includes issuing an audible command to the user.
3. The method of any of claims 1 or 2, wherein guiding the user towards meeting the distance condition includes issuing a legible command (204) to the user.
4. The method of any of claims 1 to 3, wherein guiding the user further comprises guiding the user in a longitudinal direction away from or towards the image capturing device and / or the elevator interface apparatus.
5. The method of any of claims 1 to 4, wherein the distance condition comprises at least one of:- a face of the user being fully visible in a field of view of the image capturing device;- a face of the user exceeding a predetermined minimum size in the captured image;- a face of the user not exceeding a predetermined maximum size in the captured image.
6. The method of any of claims 1 to 5, wherein identifying the user is carried out through facial recognition.
7. The method of any of claims 1 to 6, further comprising, displaying a visual indicator (206, 208) of the identifying of the user being in progress.
8. The method of any of claims 1 to 7, wherein the elevator system comprises a plurality of elevators, and wherein the dispatch information comprises which elevator (312) of the plurality of elevators to proceed to.
9. The method of any of claims 1 to 8, wherein the dispatch information comprises a destination landing (318).
10. The method of any of claims 1 to 9, further comprising the user inputting a destination.
11. The method of any of claims 1 to 10, further comprising, in case of failure to identify the user based on the captured image, inviting the user to register or update their identification.
12. The method of claim 11 , wherein inviting the user to register or update their identification comprises verifying an identity and collecting identification data.
13. An elevator interface apparatus (400) for user recognition and dispatch, comprising: an image capturing device (402), configured to capture an image of a user; a display screen (410), wherein the display screen displays captured image; a memory (406); a processor (408); an audio system (412);- 20 - 2024P00187WG a graphical user interface (GUI) (404), wherein the graphical user interface (GUI) is visible on the display screen; and wherein the elevator interface apparatus (400) is configured to perform the method of any of claims 1 to 10.
14. The elevator interface apparatus of claim 13, wherein the display screen is touch-sensitive.
15. The elevator interface apparatus of claim 14, further comprising: a card reader.
Citation Information
Patent Citations
Method for controlling an input device based on the detection of attitude or eye gaze
EP2261772A1
Elevator dispatch using facial recognition
US20160214830A1