Building system and human-machine interface device for facial expressions

Abstract

A system for performing one or more services for a person (2) in an environment accessible to the person (2), comprising a control device (9) and a human-machine interface device (5) which is communicatively connected to the control device and which is arranged in the environment and is designed to transmit the services required by the person (2) to the control device (9). Detecting the presence of a person (2) within the detection range of the human-machine interface device (5) by means of the system; a screen device (14) of the human-machine interface device (5) is activated when the presence of a person (2) is detected, the screen device (14) remaining in an inactive state when no person is present. When the presence of a person is detected, the screen device (14) is controlled to display a first animation, the first animation comprising an active first type of human facial expression.

Description

Technical Field

[0001] The technology introduced here generally relates to systems for performing one or more services for a person in an environment accessible to the person. Embodiments of the present technology particularly relate to a human-machine interface device and a system having such a human-machine interface device. Background Art

[0002] An example of a system for performing one or more services for a person in an environment accessible to the person (such as in a building) is a building system. Building systems can be designed in various ways for a wide variety of applications. An example of a building system is an access monitoring system that monitors access to restricted areas (such as the interior space of a building or an elevator lobby). In such an access monitoring system, a person who wishes to use the access monitoring system service can be identified as authorized to access at a human-machine interface device in different ways, such as by using different authorization credentials, such as having biometrics, keys, magnetic cards, chip cards, or RFID cards, or a mobile phone, as disclosed in WO2010 / 112586A1. Access to the building or its interior can be allowed or denied at a gate having a door, a turnstile, a barrier, or other types of obstacles, and the gate is blocked or released (i.e., unblocked or unlocked) according to the access authorization.

[0003] US2014 / 0015978A1 describes an access monitoring system that works without a barrier and is therefore referred to as a barrier-free gate. The passage is open and unobstructed, so in principle, a person can freely pass through the gate without delay or obstruction. To monitor the passage, a detection device for checking authorization credentials (especially a valid ticket or proof of fare payment) is arranged at the passage. In addition, an image detection device is provided that can detect at least a part of the face of each person approaching the detection device. By combining the information of the authorization credentials and the image information, a person who has not paid the fare is determined and identified by an inspector. For this purpose, the image information can be presented to the inspector on their mobile device.

[0004] Another example of a building system is an elevator system installed in a building. To use the service of the elevator system, a person can, for example, enter an elevator call on a human-machine interface device (also called an elevator operation device or a floor call terminal) so as to be transported from the boarding floor to the target floor. Depending on the type and use of the building, the elevator system and the access monitoring system can be designed in such a way that an elevator call is triggered by the user's access right; the elevator call can, for example, reach a determined target floor stored in the user profile created for the person. Summary of the Invention

[0005] Various requirements are imposed on such building systems. The interaction between people and the human-machine interface devices of these building systems should be designed to be user-friendly and safe. For example, when a person presents a valid authorization credential, the building system responds thereto, for example, by granting access permission and / or displaying on the screen of an elevator control device the elevator assigned to an elevator call. Especially in buildings with a large flow of people, such as office buildings during the morning rush hour, access permission should be granted and call assignment should be made as soon as possible to reduce the risk of congestion or queuing. An unobstructed gate can reduce this risk, but it must be ensured that only authorized personnel can pass through the gate. Those who inadvertently fail to present an authorization credential may cause chaos if an alarm is triggered or they are publicly inspected by an inspector. Therefore, a technology is needed to make the interaction between people and the human-machine interface device as efficient as possible without sacrificing comfort or safety.

[0006] One aspect of this technology relates to a method for operating a system that performs one or more services for people in an environment accessible to people. The system includes a control device and a human-machine interface device communicatively connected to the control device. The human-machine interface device is arranged in the environment and is designed to transmit the services requested by people to the control device. According to this method, the presence of a person is detected in the detection area of the human-machine interface device. When the presence of a person is detected, the screen device of the human-machine interface device is activated; if no person is present, the screen device remains in an inactive state. If the presence of a person is detected, the screen device is controlled to display a first animation, wherein the first animation includes an active or animated first type of human facial expression diagram.

[0007] Another aspect of this technology relates to a system for performing one or more services for people in an environment accessible to people. The system includes a communication network, a control device communicatively connected to the communication network, and a human-machine interface device communicatively connected to the control device via the communication network. The human-machine interface device has a screen device, a sensor device, and a processor device. The processor device is configured to detect the presence of a person within the detection range of the human-machine interface device and to activate the screen device of the human-machine interface device when the presence of a person is detected. If not, the screen device remains in an inactive state. In addition, when the presence of a person is detected, the screen device is controlled to display a first animation, wherein the first animation includes an active first type of human facial expression diagram.

[0008] The technology introduced here can manipulate the screen device as appropriate to display an animated facial expression diagram. The facial expression diagram may include not only friendly, inviting, or encouraging facial expressions, but also unfriendly, rejecting, or punitive facial expressions (if the person behaves incorrectly with respect to the service, for example, if they want to use the service without proper authorization). The purpose of the animated facial expression diagram is to improve the user-friendliness of using the service. For example, because the person receives feedback through the animated facial expression diagram, they will pay more attention to the animated facial expression diagram. This helps to reduce the frequency of incorrect behavior and the resulting alarms.

[0009] In an embodiment that can be applied in combination with one or more of the foregoing embodiments, the movement process of a person can be determined. The movement process includes information about the distance of the person relative to the man-machine interface device. Through the movement process, the situation where the person approaches the man-machine interface device can be detected. When the person approaches, the control device can check whether the person is authorized to use the required service determined by the man-machine interface device. If there is authorization and the distance between the person and the man-machine interface device is lower than the determined minimum distance, the control device can generate a release signal, and thus the required service can be used. However, if there is no authorization and the distance is lower than the specified minimum distance, the screen device can be manipulated to display a second animation, which includes an active second human facial expression diagram. The second animation informs the person at or relatively close to the man-machine interface device that the required service cannot be used or has not been released. The person may not be authorized or their credentials may not be recognized; for example, they may have forgotten to present the authorization or their credentials. In the latter case, the person can also perform the above process at the man-machine interface device. This can also improve the user-friendliness.

[0010] In an embodiment that can be applied in combination with one or more of the foregoing embodiments, the control device can thus check whether the approaching person presents a credential to the man-machine interface device in response to the second animation. If there is authorization, the control device generates a release signal. Since the person then presents their authorization credential, no alarm information is generated, which reduces the alarm information.

[0011] In an embodiment that can be applied in combination with one or more of the foregoing embodiments, if the authorization or authorization credential is missing and the distance is lower than the minimum distance, the control device can generate an alarm signal. Especially in the case of a barrier gate without obstacles, this can ensure that only authorized personnel can pass through the barrier gate, or unauthorized personnel can be identified and corresponding measures can be taken.

[0012] In an embodiment that can be applied in combination with the foregoing one or more embodiments, the human-machine interface device can generate audible and / or visible prompts as alarm signals to remind a person to present an authorization credential. The notification can include a voice message; the visible prompt can include the display of a voice message and / or visual effects combined with a second animation.

[0013] In an embodiment that can be applied in combination with the foregoing one or more embodiments, a suitable facial expression diagram can be read from a storage device. Depending on the situation, that is, whether the person is authorized or unauthorized, a friendly, inviting or encouraging facial expression or an unfriendly, rejecting or punitive facial expression can be read from the storage device. A large number of animations can be stored in the storage device to change the facial expression diagram as needed or after a certain period of time. The animations can also be stored by specific country / region and / or adapted to specific cultures.

[0014] In an embodiment that can be applied in combination with the foregoing one or more embodiments, the desired service can include an elevator ride in an elevator system, an access permit to an access monitoring system, or a combination of an elevator ride and an access permit. Therefore, the technology introduced here can be used in various building applications.

[0015] In an embodiment that can be applied in combination with the foregoing one or more embodiments, the human-machine interface device can include a detection device designed to detect an authorization credential. The authorization credential can be detected as an optical code, a biometric, or a radio signal. Therefore, the technology introduced here can be adapted to the types of credentials used in buildings. Description of the Drawings

[0016] Next, various aspects of the improved technology will be described in more detail with reference to embodiments in conjunction with the drawings. In the figures, similar elements have the same reference numerals. Among them:

[0017] Figure 1 A schematic diagram showing an application example of a building system with a human-machine interface device in combination with an exemplary situation in a building;

[0018] Figure 2 A schematic diagram showing an embodiment of the interaction between the human-machine interface device and a person authorized to enter;

[0019] Figure 3 A schematic diagram showing an embodiment of the interaction between the human-machine interface device and a person without access rights; and

[0020] Figure 4 A flowchart showing an embodiment of a method for operating a building system. Detailed Description of the Embodiment

[0021] Figure 1Schematic diagram of an application example of a system that performs one or more services for person 2 in an environment accessible to person 2; this environment is particularly suitable for person 2 to stay for a relatively long time. In Figure 1 In the application example, the environment refers to a building; the term "building" includes, for example: residential buildings, commercial buildings, stadiums, and shopping centers. In another application example, the environment can be a ship (such as a passenger ship). The technology disclosed in this article will be introduced below with reference to, but not limited to, buildings; therefore, this system is also referred to as a building system.

[0022] In Figure 1 In the exemplary case shown, the technology introduced here can be applied in an advantageous manner. In short, for example, the technology introduced here enables person 2 in the environment (building) to use services provided when using, for example, the elevator system 3, the access monitoring system 1, or a combination of these two systems (1, 3). In order to be able to request the required services, a human-machine interface device 5 is arranged in the environment, and the human-machine interface device interacts with person 2 in a human-like manner, especially by means of animations including human-like facial expression diagrams. The facial expression diagrams can be displayed in a situation-adaptive manner and are displayed according to the presence of a person or the movement process recognized by using a screen device, for example, as a friendly, inviting, or encouraging facial expression, in order for the person to request services that they may wish to use. However, if the person's performance of the service is incorrect, for example, if they want to use the service without proper authorization, then the facial expression diagrams can also show unfriendly, rejecting, or punitive facial expressions. An exemplary design of the performance of such facial expression diagrams is as shown in Figure 2 and Figure 3 shown.

[0023] For the convenience of graphical expression, only some walls, rooms 4, and partitions 8, 12 are shown in the building shown in Figure 1 because they can exist on a floor in an exemplary manner. The room 4 can be, for example, an office, an apartment, a hall, or the elevator car of the elevator system 3. Here, on the floor of the building, the partition 8 is not restricted from entry; hereinafter it is also referred to as the public partition 8. The public partition 8 can be an area inside or outside the building. The gate 10 separates the public partition 8 from the partition 12, and the partition 12 is restricted from access and is adjacent to the room 4 in Figure 1 In the following, the partition 12 can also be referred to as a non-public partition or an access-restricted partition 12. Those skilled in the art know that: the technology introduced here is not limited to being divided into a public partition 8 and a non-public partition 12.

[0024] In the embodiment introduced here, the building system includes an elevator system 3 and an access monitoring system 1, and the access monitoring system includes a gate 10. In Figure 1In the application shown, a person 2 carrying an authorization credential 6 (represented as a mobile phone and a card) is located in a common partition 8. The room 4 shown may belong to a group of elevators, for example, including four elevators (A - D). In addition to the four elevators shown, the elevator system 3 may have a greater or smaller number of elevators. The elevator control device ECS controls the elevator system 3 to perform a transportation service (e.g., an elevator journey). The access monitoring device ACS controls the access monitoring system 1 to perform a monitoring service (e.g., entry permission). In Figure 1 this case, these controllers (ECS, ACS) are centralized in a control device 9 for illustration purposes, and the control device 9 is communicatively connected to the devices of the access monitoring system 1 and the elevators (A - D) and their devices (e.g., call input terminals 11) via a communication network 22. As is known to those skilled in the art: the access control device ACS and the elevator control device ECS can be arranged separately from each other within a building.

[0025] Figure 1 Also shown are two embodiments of a human - machine interface device 5, which are respectively communicatively connected to the control device 9 via a communication network 22 and enable the person 2 to request and use the required services. In the first embodiment, the human - machine interface device 5 is assigned to a gate 10; its components can, for example, be integrated into the gate 10 or arranged on the gate (or in its surrounding environment). In the second embodiment, the human - machine interface device 5 is assigned to an operating terminal 11, particularly a call input terminal of the elevator system 3; hereinafter, the operating terminal 11 will be referred to as the call input terminal 11. The components of the human - machine interface device 5 can, for example, be integrated into the call input terminal 11, and the call input terminal 11 itself can also be regarded as a human - machine interface device. Depending on the design of the building system, the human - machine interface device 5 according to the first or second embodiment can be arranged on a floor; multiple human - machine interface devices 5 according to the first and / or second embodiment can also be provided.

[0026] Referring to Figure 1 the gate 10 shown, in one embodiment, the human - machine interface device 5 includes a screen device 14 (e.g., including an LED or LCD display), a processor device 21 (P), and a sensor device 24. Depending on the design, there may also additionally be Figure 1 a detection device 16 for detecting the authorization credential 6 as shown. These components (14, 16, 21, 24) are, for example, arranged on or in the (right - hand side) structure 10a of the gate 10, but are not limited to this arrangement. For illustration purposes, the components are shown on the front of the structure 10a; as is known to those skilled in the art: at least one component can be arranged on other sides of the structure 10a, particularly the upper side.

[0027] In one embodiment, the sensor device 24 can be arranged near the gate 10. In Figure 1In it, the sensor device 24 is arranged, for example, on the (left) structure 10b of the gate 10, but is not limited to this arrangement; the sensor device can also be arranged on the (right) structure 10a or other suitable positions. The sensor device 24 is designed and arranged accordingly so as to detect the presence of the person 2 and / or the situation of approaching the human-machine interface device 5 once the person 2 is within the detection range of the sensor device 24. The sensor device 24 can also detect the situation where the person 2 enters the gate 10 and passes through the gate. The sensor device 24 can include a camera (2D or 3D camera), a 3D sensor (such as a time-of-flight (ToF) sensor), a grating, or other sensors suitable for detecting people or objects; the sensor device can also include a radio device, such as for communicating with the mobile phone of the person 2, wherein the detection range is substantially equivalent to the radio effective range of the radio device. What is known to those skilled in the art is that the sensor device 24 generates a sensor signal, which is transmitted to the processor device 21 for signal processing to determine the presence and / or movement process of the person 2, especially regarding the movement direction and the distance relative to the human-machine interface device 5. The processor device 21, for example, recognizes according to the movement process whether the person 2 is approaching the human-machine interface device.

[0028] In Figure 1 In the situation shown, according to an embodiment, the call input terminal 11 of the elevator system 3 or the access monitoring system 1 can be arranged on the floor; the call input terminal can be arranged additionally to the gate 10 and its equipment, for example, spatially separated from the gate 10 (for example, in another floor area), or instead of the gate 10. In Figure 1 it, the call input terminal 11 is also connected to the communication network 22, and the call input terminal 11 communicates with the control device 9 (ECS, ACS) through this communication network. In an embodiment, the human-machine interface device 5 of the call input terminal 11 also includes a screen device 14, a processor device 21, and a sensor device 24.

[0029] What is known to those skilled in the art is that the human-machine interface device 5 can include a speaker system for transmitting service-related information, such as by broadcasting voice messages; this is especially helpful for visually impaired people. The call input terminal 11 can include such a speaker system; a speaker system can also be arranged inside or on the gate 10.

[0030] The human-machine interface device 5 detects the presence and / or movement process of the person 2 in the detection area by means of the sensor device 24 and the processor device 21. The movement process includes, for example, the direction and distance of movement relative to the human-machine interface device 5. When the presence or approach of the human-machine interface device is recognized, the screen device 14 of the human-machine interface device is activated; otherwise, the screen device 14 remains in an inactive state. When the presence or approach is detected, the screen device 14 is controlled: a first animation is displayed on the screen 30 ( Figure 2 and Figure 3 ), and the first animation particularly includes an active human-like first type of facial expression diagram. The human-like facial expression diagram can include, for example, an active smile and / or a wink.

[0031] In Figure 2 and Figure 3 exemplary facial expression diagrams are shown as they can be displayed on the screen 30 by the screen device 14. The facial expression diagrams are preferably active, that is, these are not static representations (similar to a single image), but the types of facial expressions change over time (similar to a sequence of multiple images (movie)). In Figure 2 and Figure 3 , the animation (time change) is represented by continuously arranged facial expression diagrams; in Figure 2 and Figure 3 the positions of the corners of the mouth and the eyebrows can be seen to change, giving the impression that the human-like facial expression diagram is moving. Those skilled in the art know that: the screen device 14 is controlled accordingly, for example, the facial expression diagrams adapted to the situation can be read from the storage device, and then the facial expression diagrams are displayed by the screen device 14.

[0032] In Figure 2 and Figure 3 the "moving" smile is shown on the left side of the arrow arranged approximately in the center. Facial expression diagrams are shown on the right side of the arrow, and their types depend on the recognized situation (suitable situation), especially whether the person 2 is authorized. In Figure 2 , the person 2 has been authorized (represented by the authorization certificate 6 above the arrow), so the facial expression diagram on the right side of the arrow still includes a "moving" smile. However, in Figure 3 , the person 2 is not authorized (represented by the crossed-out authorization 6 above the arrow), so the facial expression diagram on the right side of the arrow includes an "moving" unfriendly or angry facial expression. Those skilled in the art know that: the shown facial expression diagrams are exemplary, and other facial expression diagrams can be used to represent other emotions according to the situation.

[0033] The access monitoring system 1 is designed to monitor access to the access-restricted partition 12 so that only authorized persons 2 can enter the partition 12. The access is through the gate 10, which is designed as an obstacle-free gate 10. InFigure 1 In [description], the gate 10 is shown by two structures 10a, 10b standing on the ground. There is a passage between the structures 10a, 10b. If a person 2 wants to enter the partition 12 from the partition 8, they must pass through this passage in the direction of the arrow. Those skilled in the art know that the shown gate 10 is exemplary. Depending on the building and / or the expected traffic volume, the gate 10 can consist of multiple individual gates, and each gate has a passage between two adjacent structures. Those skilled in the art also know that the gate 10 can be designed in different ways, for example, using only one structure to replace Figure 1 the two shown structures 10a, 10b; then, the passage can be located, for example, between this structure and the building wall. The structures or at least one of its components described below can also be arranged on the building wall, where the passage is located in the area in front of the building wall or the component. In particular, in the last-mentioned embodiment, the gate 10 can be designed such that the person 2 does not recognize the gate as the gate 10.

[0034] According to Figure 1 the design of the shown gate 10, there can be a signal transmission device 20, which is at least arranged in or on at least one of the two structures 10a, 10b; in Figure 1 [description], the two structures 10a, 10b are respectively equipped with a signal transmission device 20, where the signal transmission device 20 is, for example, arranged along the vertical edges of the structures 10a, 10b respectively. In one embodiment, the signal transmission device 20 is correspondingly designed and arranged on the gate 10 to generate light and / or sound signals of different colors (for example, red and green) and / or sound signals (for example, alarm signals), where the light and / or sound signals can be respectively perceived by the person 2. Those skilled in the art know that the signal transmission device 20 can be designed in different ways as long as the signal transmission device or its signal can be perceived by the person 2.

[0035] In Figure 1The building system shown in the figure may include one or more camera systems 26, which may be arranged in the area of the gate 10 and / or within the access-restricted partition 12. In one embodiment, such a camera system 26 may be used in combination with the sensor device 24 to detect a person 2 and track their movement within the partition 12. As is known to those skilled in the art, the number and spatial arrangement of the camera systems 26 may be adjusted according to the size of the building and / or the partition 12. Those skilled in the art also know that the camera system 26 is optional, for example, if the tracking function is not provided. Such a camera system 26 is known to those skilled in the art; for example, 2D or 3D cameras may be used, each equipped with associated image processing means. For example, EP1345445A1 discloses a 3D camera or sensor device related to an elevator system for detecting three dimensions in order to detect the position of a person or other object, the distance between persons or other objects, and the movement and direction of movement of persons or other objects.

[0036] The identification device 16 may be designed in various ways and may in particular be designed for one or more types of authorization credentials 6. The authorization credentials 6 are typically assigned to a person 2 or a group of persons in the building system (for example, in a database of user profiles) and must be presented by the person 2 when entering the access-restricted partition 12. The authorization credentials 6 may be stored or presented (for example, in the form of a QR code, barcode or optical code in the form of a color code) as a password (encoded) on an information carrier (for example, in the chip of a chip card, the magnetic stripe of a magnetic stripe card or the memory of a mobile phone). In one embodiment, the authorization credentials 6 may be biometric, such as the facial pattern of the person 2.

[0037] The identification device 16 is suitable for the authorization credentials 6 used within the building. In one embodiment, the identification device 16 may include an optical reading device (such as a digital camera) for detecting, for example, an optical code from an information carrier. The information carrier may be designed, for example, in the form of an employee identification card shaped like a credit card or a similar form; in another embodiment, the mobile phone (or a similar electronic device) of the person 2 displays an optical code on the screen and serves as the information carrier. In one embodiment, the digital camera of the optical reading device (or an additional digital camera) may be used to detect biometric authorization credentials 6. The detected biometric authorization credentials 6 may then be used in combination with the identification device and the biometric data of the person 2 registered in the building may be stored in order to obtain access authorization by means of, for example, facial recognition.

[0038] Additionally or alternatively, there may be a radio-based reading device as the identification device 16, which reads the authorization credential 6 from the chip of an RFID transponder, for example. What can be used as an RFID transponder is, for example, an employee ID card or the like or a mobile phone. In one embodiment, the radio-based reading device may be designed to communicate with a mobile phone or a similar device according to near field communication (NFC) or Bluetooth technology. In one embodiment, once the mobile phone is within the radio effective range of the reading device, the mobile phone uses Bluetooth technology to transmit the (electronic) authorization credential 6 to the radio-based reading device.

[0039] As is known to those skilled in the art: In one embodiment, the function of the identification device 16, in particular the function of the radio-based reading device or the face recognition device, can be integrated in the sensor device 24. For example, the sensor device 24 configured in this way can both detect the presence or proximity of the person 2 and obtain their authorization through face recognition or (radio) authorization credentials.

[0040] According to the embodiments disclosed in this specification, the authorization credential 6 must be presented. As is known to those skilled in the art: The authorization credential 6 represents information for checking access authorization, specifically regardless of the information type (encoded or biometric) and the design of the information carrier. In the figure, a card-shaped information carrier is shown, on which the authorization credential 6 is stored or displayed; therefore, the information carrier is also referred to as the authorization credential 6; this similarly applies to the mobile phone shown in the figure.

[0041] In Figure 1 the building shown, the technology introduced here can be advantageously applied. Referring to Figure 1 the situation shown and with an understanding of the above system components and their functions, the following describes Figure 4 an exemplary method for operating a system that performs one or more services for the person 2 in an environment accessible to the person 2. The first part of the method is an introduction for the person 2 who moves from the partition 8 to the human-machine interface device 5 in order to use the required services of the building system. Depending on the application, the first part of the method may be followed by a second part. The second part of the introduction is based on the person 2 who wants to move from the partition 8 to the restricted access partition 12 in order to, for example, use the elevator (A - D), for which the service requires entry permission and an elevator journey. In particular, in the second part, the person 2 carries the authorization credential 6, which is used here to illustrate, for example, Figure 1 designed as an employee ID card in the shape of a credit card as shown or related to a mobile radio device (specifically as an encoded to be transmitted via radio). The authorization credential 6 can be presented at the gate 10 or can be received when the person 2 is within the radio effective range to enter the restricted access partition 12. The building system is activated.

[0042] The method shown starts at step S1 and ends at step S8, where steps S5, S6, and S7 can be assigned to the second part of the method; for illustration, Figure 4 a dashed border is shown in which these steps are circled. It is known to those skilled in the art that: Figure 4 the step division shown in is exemplary, there can be further steps, and one or more of these steps can be divided into one or more sub-steps, or multiple steps can be combined into one step.

[0043] In Figure 1 the situation shown, person 2 moves within zone 8, and when person 2 enters the detection range of the sensor device 24, person 2 can be detected by the sensor device 24. If person 2, for example, moves in the Figure 1 direction of the arrow shown to enter the access-restricted zone 12 on the floor, then this person enters the detection range of the sensor device 24 at or in the area of the gate 10. In step S2, the presence of person 2 is detected. In one embodiment, the sensor device 24 generates a sensor signal, and the correspondingly programmed processor device 21 (P) receives and processes this sensor signal. By design, the movement process of person 2 can also be obtained here; in particular, the movement direction of the person and the distance from the human-machine interface device 5 can be determined. In one embodiment, the sensor device 24 can detect alone or together with the processor device 21: the situation where the distance between person 2 and the human-machine interface device 5 is below a determined minimum distance.

[0044] In Figure 4 step S3 of, it is checked whether person 2 is present or whether the person is approaching the human-machine interface device 5. For example, this approach process is detected by a decreasing distance from the human-machine interface device 5. If person 2 is present or approaching, the method continues along the "yes" branch to step S4; otherwise, the method proceeds along the no branch to step S8 and ends.

[0045] In step S4, the screen device 14 of the human-machine interface device 5 is activated. When presence or approach is detected, the screen device 14 is controlled to display a first animation. The first animation includes an active first-class human facial expression diagram. Such facial expression diagrams are shown in Figure 2 and Figure 3 (each on the left).

[0046] However, if presence or approach is not detected in step S3, the screen device 14 remains in an inactive state and the method ends at step S8. In this inactive state, for example, the brightness of the display device 14 can be turned off or reduced, a standby mode can be activated, and / or static screen content can be displayed.

[0047] In one embodiment, the first part of the above method ends in step S8 after step S4. According to this embodiment, an active anthropomorphic facial expression map can contribute to improving user-friendliness, for example, in such a way that Person 2 can perceive the human-machine interface device better and / or faster, feel the feedback and / or be requested, be able to respond to requests faster, and generally be able to use the required services smoothly. Thus, the risk of congestion or queuing can be reduced.

[0048] The above second part of the method can help improve the user experience and take into account the safety requirements of the building. The second part of the method follows step S4 with step S5 Figure 4 in it.

[0049] In step S5, it is checked whether Person 2 is authorized to use the required service. In Figure 1 the case shown, Person 2 wants to travel from zone 8 to the restricted access zone 12 in order to use the elevator there. According to the design of the building system, the proof of authorization is carried out in the following way. In one embodiment, a (physical) authorization voucher 6 can be presented on the human-machine interface device 5, for example, by holding the authorization voucher in front of or on the identification device 16. In another embodiment, it is required that when the mobile radio device is within the radio effective range, the mobile radio device of Person 2 executes the following software application (App), which communicates with the human-machine interface device and transmits an electronic access code as the authorization voucher 6 via radio (for example, using Bluetooth technology). For the authorized Person 2, the access code is stored in the user database. In another embodiment, a camera combined with a face recognition process can generate a face template based on the face image of Person 2 in order to determine whether this face template is assigned to the Person 2 authorized to access in the user database. In this case, the face serves as the authorization voucher 6.

[0050] Depending on the design of the authorization voucher 6, the authorization can be checked at different distances from the human-machine interface device 5. Person 2 must present the physical authorization voucher 6 at the human-machine interface device 5; if the person continues to move towards zone 12, the person is below the determined minimum distance. This is set so that the building system can react before Person 2 enters zone 12.

[0051] If the authorization voucher 6 is detected via radio or face recognition, the authorization check can be carried out when Person 2 is farther away from the human-machine interface device 5. If Person 2 continues to walk towards the human-machine interface device 5, in these application examples, the person will also be below the specified minimum distance, which is also set so that the building system can react before Person 2 reaches zone 12.

[0052] If the check in step S5 indicates that person 2 is authorized, the method continues along the "Yes" branch to step S6. However, if person 2 is not authorized, the method continues along the "No" branch to step S7.

[0053] In step S6, it is checked whether the distance between person 2 and the human-machine interface device 5 has dropped below a determined minimum distance. If this is the case and there is authorization, the first animation is displayed unchanged, as Figure 2 (shown on the right); additionally, the control device 9 generates a release signal so as to release the required service for utilization.

[0054] In one embodiment, the screen device 14 may display the permitted access, for example by optically highlighting the first animation. Additionally, the signal communication device 20 may be activated, for example by lighting up a green light. This enables both person 2 and possibly present security personnel to see that the person has been granted access rights. Then, the method ends at step S8.

[0055] In step S7, it is also checked whether the distance between person 2 and the human-machine interface device 5 is below the determined minimum distance. If this is the case and if authorization is missing, the control device 9 blocks the required service and causes the human-machine interface device 5 to manipulate the screen device 14 to display a second animation, as Figure 3 (shown on the right). The second animation also includes an active human facial expression diagram; however, this is chosen so that the human facial expression diagram reminds person 2 of the incorrect behavior. The second animation may include unfriendly, rejecting, or punishing facial expressions.

[0056] In one embodiment, the screen device 14 may indicate the denied access, for example by optically highlighting the second animation. Additionally, the signal communication device 20 may be activated, for example by lighting up a red light. This enables both person 2 and possibly present security personnel to see that the person has no right of entry. In Figure 4 this, the method then ends at step S8.

[0057] Depending on the design of the building and the building system, it may be stipulated that person 2 can correct their incorrect behavior, in particular in response to the second animation. In one embodiment, in addition to the second animation, the human-machine interface device 5 may also generate prompts that person 2 can hear and / or see. The audible prompt may include a voice message, while the visible prompt may include the display of the voice message and / or a visual effect combined with the second animation.

[0058] As described above, person 2 must verify their identity at the (obstacle-free) gate 10, in particular by presenting the authorization credential 6 at the identification device 16. If person 2 is aware of this requirement, the person verifies their identity themselves; the person will also be required to identify themselves and may be reminded of this. In one embodiment, this is supported by the active screen device 14 so that, especially when person 2 is located at the gate 10, person 2 can see the second animation. The second animation may represent an authentication request.

[0059] If person 2 forgets to present their authorization credential 6, they can supplement the presentation in response to the second activation without the need for a surveillance person to request it. Thus, in one embodiment, the method introduced in combination with Figure 4 can be checked by the control device 9: whether person 2 presents the authorization credential 6 to the man-machine interface device 5 within a specified time period in response to the second animation. If authorization exists, the control device 9 generates a release signal. Since person 2 is authorized to access in this case, this method may be more comfortable for person 2 in a public place. However, if person 2 is not authorized to enter and still tries to pass through the door 10, security personnel can intervene or initiate other security measures.

[0060] If person 2 moves in the Figure 1 direction of the arrow shown, in the situation shown it means that person 2 wants to be transported to the required target floor by one of the elevators (A - D). The target floor can be stored in the user profile created for person 2 in the building management system of the building system. The elevator controller ECS can be designed, for example, as a group control system with destination call control technology. For example, when person 2 is recognized, a destination call is issued that gives the target floor stored in the user profile of person 2 and the floor where the gate 10 is located as the boarding floor. If the access monitoring occurs, for example, in the entrance hall of the building and person 2 has to pass through this entrance hall to reach elevators A - D, a destination call can be issued each time access permission is granted to the relevant person 2. The elevator controller ECS determines the elevator to serve the destination call and conveys the determined elevator to person 2, for example, via the screen device 14.

[0061] In combination with the services blocked in step S7, the elevator control system ECS can be designed to take one or more specified measures in response to a security vulnerability indicated by an alarm signal. Depending on the defined measures, the elevator controller ECS can, for example, block elevator services leaving the access-restricted zone 12, so that, for example, on the floors of the access-restricted zone 12, elevators A-D do not depart or stop, and no elevator doors open or close. Depending on the building, the elevator system 3, and the security vulnerability, it may be that only one of the multiple elevators or the entire elevator system 3 stops service. The measures taken may remain in effect until the security vulnerability is under control.

[0062] In one embodiment, the camera system 26 can be used to track the person 2 in the event of a security vulnerability. In Figure 1 the situation shown, the camera 24 detects that the person 2 is passing through the gate 10, and the camera system 24 determines the movement process of the person 2. From the movement process, it can be detected in which direction the person 2 is walking and / or to which elevator A-D the person 2 is going, or which elevator A-D the person 2 boards. The measure taken can, for example, block the elevator that the person 2 is approaching or has entered.

[0063] A user profile is created for each person 2 registered in the building system, i.e., the user profile is stored as a data group in the database. In one embodiment, the database is established in the storage device 36. In Figure 1 the figure, the storage device 36 is shown as a separate unit; the storage device can also be implemented in the human-machine interface device 5, the elevator control device ECS, or the access control device ACS. The user profile includes the personal data of the person 2 (such as name, reason for authorization (resident, employee, external service provider, visitor)), access authorization (such as determined rooms 4 and floors), and, if necessary, time-related access restrictions (such as access time from 7:00 am to 8:00 pm from Monday to Friday). As an alternative to creating a user profile in the building system, the user profile can be loaded in the database of the remote building management system, so that the building system can access the database via the Internet and / or cloud computing technology.

Claims

1. A method for a system that runs in an environment accessible to a person (2) and performs one or more services for the person (2), the system comprising a control device (9) and a man-machine interface device (5) communicatively connected to the control device, the man-machine interface device being arranged in the environment and being designed to transmit the services required by the person (2) to the control device (9), wherein, The method includes: detecting whether a person (2) exists within the detection range of a human-machine interface device (5); activating a screen device (14) of the human-machine interface device (5) when a person (2) is detected, wherein the screen device (14) remains in an inactive state when no person is present; and when a person is recognized as existing, controlling the screen device (14) to display a first animation, wherein the first animation includes an active first type of human facial expression diagram.

2. The method according to claim 1, the method further includes: determining the movement process of the person (2), wherein the movement process includes information on the distance of the person (2) relative to the human-machine interface device (5), and wherein the situation of the person (2) approaching the human-machine interface device (5) can be recognized based on the movement process; when the person (2) approaches, checking by a control device (9): whether the person (2) is authorized to use the required service determined by the human-machine interface device (5); when there is authorization and the distance between the person (2) and the human-machine interface device (5) is lower than a determined minimum distance, generating a release signal by the control device (9) so as to release the required service for use; and when there is no authorization and the distance is lower than the determined minimum distance, controlling the screen device (14) to display a second animation, the second animation including an active second human facial expression diagram.

3. The method according to claim 2, the method further comprising: Checking by the control device (9) whether the approaching person (2) presents an authorization certificate (6) at the human-machine interface device (5) in response to the second animation, and when there is authorization, generating a release signal by the control device (9).

4. The method according to claim 3, wherein the method further comprises: When there is no authorization certificate or there is no authorization and the distance is lower than the minimum distance, generating an alarm signal by the control device (9) and blocking the required service.

5. The method according to claim 4, wherein, Generating a prompt that the person (2) can hear and / or see through an alarm signal from the human-machine interface device (5) so as to present the authorization certificate (6), wherein the audible prompt includes a voice message, and the visible prompt includes displaying the voice message and / or a visual effect combined with the second animation.

6. The method according to any one of the preceding claims, wherein, The required service includes an elevator trip in an elevator system (3), an entry permit to an access monitoring system (1), or a combination of an elevator trip and an entry permit.

7. The method according to any one of the preceding claims, the method further comprising: Reading a facial expression diagram suitable for the situation from a storage device, wherein the read facial expression diagram suitable for the situation is a first human facial expression diagram or a second human facial expression diagram.

8. A system (1, 3) configured to perform one or more services for a person (2) in an environment accessible to the person (2), wherein, The system (1, 3) includes: a communication network (22); a control device (9) communicatively connected to the communication network (22); and a human-machine interface device (5), the human-machine interface device being communicatively connected to the control device (9) through the communication network (22), wherein the human-machine interface device (5) includes a screen device (14), a sensor device (24), and a processor device (21), and wherein the processor device (21) is designed to: detect whether a person (2) exists within the detection range of the human-machine interface device (5); When a person (2) is detected to be present, activate the screen device (14) of the human-machine interface device (5), wherein, when no person is present, the screen device (14) remains in an inactive state; and When a person is detected to be present, control the screen device (14) to display a first animation, wherein the first animation includes an active first type of human facial expression diagram.

9. The system (1, 3) according to claim 8, wherein, The processor device (21) is further configured to determine the movement process of the person (2), wherein the movement process contains information about the distance of the person (2) relative to the human-machine interface device (5), wherein the situation that the person (2) approaches the human-machine interface device (5) can be recognized based on the movement process, and the control device (9) is designed to: When the person (2) approaches, check: whether the person (2) is authorized to use the required service determined by the human-machine interface device (5), and when there is authorization and the distance between the person (2) and the human-machine interface device (5) is lower than the determined minimum distance, generate a release signal so as to release the required service for utilization; and In the case of no authorization and a distance lower than the determined minimum distance, control the screen device (14) to display a second animation, wherein the second animation includes an active second human facial expression diagram.

10. The system (1, 3) according to claim 9, wherein, The control device (9) is further configured to check whether the approaching person (2) presents an authorization credential (6) at the human-machine interface device (5) in response to the second animation, and when there is authorization, generate the release signal.

11. The system (1, 3) according to claim 10, wherein, The control device (9) is further configured to: in the case of no authorization and a distance lower than the minimum distance, generate an alarm signal and block the required service.

12. The system (1, 3) according to claim 11, wherein, The human-machine interface device (5) is designed to generate a prompt that the person (2) can hear and / or see in response to the alarm signal, so as to present the authorization credential (6), wherein the audible prompt includes a voice message, and the visible prompt includes displaying the voice message and / or a visual effect combined with the second animation.

13. The system (1, 3) according to any one of claims 8 to 12, wherein, The required service includes an elevator trip in the elevator system (3), an entry permit to the access monitoring system (1), or a combination of an elevator trip and an entry permit.

14. The system (1, 3) according to any one of claims 8 - 13, wherein, The human-machine interface device (5) includes a detection device (16), and the detection device is designed to detect the authorization credential (6), wherein the authorization credential (6) can be detected as an optical code, a biometric feature, or a radio signal.

Images