Building system and human-machine interface device for facial expression representations

Abstract

The invention relates to a system which performs one or more services for a person (2) in an environment accessible to said person (2), said system comprising: a control device (9); and a human-machine interface device (5) which is communicatively connected thereto and which is located in the environment and is designed to transmit a service desired by the person (2) to the control device (9). The system detects the presence of the person (2) within a detection region of the human-machine interface device (5). If the person (2) is present, a screen device (14) of the human-machine interface device (5) is activated, the screen device (14) remaining in an inactive state if the person is not present. When a presence is detected, the display device (14) is triggered to display a first animation, the first animation comprising an animated first human-like facial expression representation.

Description

[0001] Building system and human-machine interface device for facial expressions

[0002] Description

[0003] The technology described here generally relates to a system that performs one or more services for a person in an environment accessible to the person. Embodiments of the technology particularly relate to a human-machine interface device and a system having such a human-machine interface device.

[0004] An example of a system that performs one or more services for a person in an environment accessible to that person (e.g., in a building) is a building system. A building system can be designed in a variety of ways for a wide variety of applications. An example building system is an access control system that controls access to a restricted-access zone (e.g., an interior of a building or an elevator lobby). In such an access control system, people wishing to use the access control system's service can identify themselves as authorized to access a human-machine interface device in different ways, e.g., with different authorization credentials, e.g., with biometric features, with a key, a magnetic, chip, or RFID card, or a mobile phone, as disclosed in WO 2010 / 112586 A1.Access to the building or its interior may be granted or denied at gates with doors, revolving doors, barriers or other types of barriers that are blocked or released (i.e. unlocked or unblocked) depending on access authorization.

[0005] US 2014 / 0015978 A1 describes an access control system that does not require a barrier and is therefore referred to as a barrier-free gate. The passage is open and barrier-free, so that a person can, in principle, pass freely through the gate without delay or obstruction. To control the passage, a detection device for checking proof of authorization (in particular a valid ticket or proof of payment of a fare) is arranged at the gate. In addition, an image capture device is provided that captures at least part of a face of each person approaching the detection device. From the combination of information from the proof of authorization and image information, a person who has not paid the fare can be determined and identified by an inspector. The image information is displayed to the inspector on their mobile device.

[0006] Another example of a building system is an elevator system installed in a building. To use the elevator system's service, a person can, for example, enter an elevator call at a human-machine interface device, also known as an elevator operating device or landing call terminal, to be transported from a boarding floor to a destination floor. Depending on the type and purpose of a building, the elevator system and the access control system can be designed so that granting access to the user triggers an elevator call. The elevator call can, for example, be directed to a specified destination floor that is stored in a user profile created for the person.

[0007] Such building systems must meet various requirements. Interactions between people and the human-machine interface devices in these systems should be designed to be user-friendly and secure. If a person presents valid credentials, for example, the building system reacts by granting access and / or displaying a lift assigned to the lift call on a screen in the lift control device. Particularly in buildings with high traffic volumes, such as office buildings during rush hour in the morning, access should be granted and calls allocated as quickly as possible to reduce the risk of crowding or queuing. An accessible airlock can reduce this risk, but it must ensure that only authorized persons go through the airlock.inadvertently fail to provide their credentials, find it disruptive to trigger an alarm, or be publicly inspected by an inspector. There is therefore a need for technology that enables interactions between people and human-machine interface devices to be as efficient as possible, yet without compromising comfort or security.

[0008] One aspect of such a technology relates to a method for operating a system that performs one or more services for a person in an environment accessible to the person. The system comprises a control device and a human-machine interface device communicatively connected thereto, which is arranged in the environment and is configured to transmit a service requested by the person to the control device. According to the method, the presence of the person is detected within a detection range of the human-machine interface device. A screen device of the human-machine interface device is activated when the presence of the person is detected; if there is no presence, the screen device remains in an inactive state.If a presence is detected, the screen device is controlled to display a first animation, wherein the first animation includes an animated first human-like facial expression.

[0009] Another aspect of the technology relates to a system configured to perform one or more services for a person in an environment accessible to the person. The system comprises a communications network, a control device communicatively connected to the communications network, and a human-machine interface device communicatively connected to the control device through the communications network. The human-machine interface device has a display device, a sensor device, and a processor device. The processor device is configured to detect a presence of the person within a detection range of the human-machine interface device and to activate the display device of the human-machine interface device upon a detected presence of the person. If the person is not present, the display device remains in an inactive state.In addition, when presence is detected, the screen device is controlled to display a first animation, wherein the first animation includes an animated first human-like facial expression.

[0010] The technology described here enables situation-appropriate control of the screen device to display animated facial expressions. These facial expressions can include not only friendly, inviting, or encouraging expressions, but also unfriendly, rejecting, or punitive expressions if the person behaves incorrectly with regard to the service, for example, if they attempt to use the service without the appropriate authorization. The aim of the animated facial expressions is to improve the user-friendliness of using a service, for example, because people are attracted to the animated facial expressions and therefore pay more attention to them. This can help reduce the frequency of incorrect behavior and the resulting alarm messages.

[0011] In one embodiment, which can be used in conjunction with one or more of the preceding embodiments, a movement pattern of the person can be determined, which includes information on a distance of the person relative to the human-machine interface device. From the movement pattern, an approach of the person to the human-machine interface device can be detected. When the person approaches, the control device can check whether the person is authorized to use the desired service determined by the human-machine interface device. If authorization exists and the person falls below a specified minimum distance from the human-machine interface device, an enable signal can be generated by the control device, whereby the desired service is enabled for use.If authorization is lacking and the specified minimum distance is not met, the screen device can be controlled to display a second animation, whereby the second animation includes a second animated human facial expression. The second animation informs the person at or relatively close to the human-machine interface device that the desired service is not or not yet authorized for use. The person may either not be authorized or their credentials cannot be recognized; for example, they may have forgotten to present them. In the latter case, the person may then be able to do so at the human-machine interface device. This can also improve user-friendliness.

[0012] In one embodiment, which can be used in conjunction with one or more of the preceding embodiments, the control device can therefore check whether the approaching person presents a credential at the human-machine interface device in response to the second animation. If the person is authorized, the release signal is generated by the control device. Because the person subsequently presents their credential, no alarm is triggered, which leads to a reduction in alarm messages.

[0013] In one embodiment, which can be used in conjunction with one or more of the preceding embodiments, an alarm signal can be generated by the control device if the authorization or proof of authorization is missing and the minimum distance is not maintained. This can ensure, particularly at a barrier-free lock, that only authorized persons pass through the lock, or that unauthorized persons passing through are detected and appropriate measures initiated.

[0014] In one embodiment, which may be applicable in conjunction with one or more of the preceding embodiments, the human-machine interface device may generate an audible and / or visible indication for the person to present credentials as an alarm signal. The indication may include a voice message; a visible indication may include a display of the voice message and / or a visual effect in conjunction with the second animation.

[0015] In one embodiment, which can be used in conjunction with one or more of the preceding embodiments, a situation-appropriate facial expression can be read from a storage device. Depending on the situation, i.e., whether the person is authorized or not authorized, or no proof of authorization was recognized, a friendly, inviting, or encouraging facial expression, or an unfriendly, rejecting, or punitive facial expression, can be read from the storage device. A plurality of animations can be stored in the storage device, allowing the facial expressions to be varied as needed or over time. The animations can also be stored country-specifically and / or adapted to a specific culture.

[0016] In one embodiment, which may be applicable in conjunction with one or more of the preceding embodiments, the desired service may include an elevator ride in an elevator system, granting access to an access control system, or a combination of an elevator ride and granting access. The technology described here can thus be used in various building applications.

[0017] In one embodiment, which may be applicable in conjunction with one or more of the preceding embodiments, the human-machine interface device may comprise a detection device configured to detect a credential. The credential may be detectable as an optical code, a biometric feature, or a radio signal. The technology described here can therefore be adapted to the type of credential used in the building.

[0018] Various aspects of the improved technology are explained in more detail below using exemplary embodiments in conjunction with the figures. In the figures, like elements have like reference numerals. They show:

[0019] Fig. 1 is a schematic representation of an application example of a building system with a human-machine interface device in connection with an exemplary situation in a building;

[0020] Fig. 2 is a schematic representation of an embodiment of an interaction between the human-machine interface device and an authorized person;

[0021] Fig. 3 is a schematic representation of an embodiment of an interaction between the human-machine interface device and a person without access authorization; and

[0022] Fig. 4 is a flowchart of an embodiment of a method for operating the building system.

[0023] Fig. 1 is a schematic representation of an application example of a system that performs one or more services for a person 2 in an environment accessible to the person 2; the environment is particularly suitable for an extended stay of the person 2. In the application example of Fig. 1, the environment is a building; the term "building" includes, for example, residential buildings, commercial buildings, sports arenas, and shopping centers. In another application example, the environment may be a ship (e.g., a passenger ship). The technology disclosed herein is described below with reference to a building, but is not limited thereto; accordingly, the system is also referred to as a building system.

[0024] In the exemplary situation shown in Fig. 1, the technology described here can be advantageously applied. Briefly and by way of example, the technology described here enables a person 2, while in the environment (building), to use a service provided, for example, by an elevator system 3, an access control system 1, or a combination of these two systems (1, 3). In order to be able to request a desired service, a human-machine interface device 5 is arranged in the environment, which interacts with the person 2 in a human-like manner, in particular by means of animations that include human-like facial expressions. The facial expressions can be displayed in a situation-appropriate manner and as a function of a presence or a recognized movement pattern of the person using a screen device, e.g.as a friendly, inviting, or encouraging facial expression in anticipation of a request for the service that the person may wish to use. However, the facial expressions can also be depicted with an unfriendly, rejecting, or punitive facial expression if the person behaves incorrectly with regard to the service, for example, if they attempt to use the service without the appropriate authorization. Examples of such facial expressions are shown in Fig. 2 and Fig. 3.

[0025] For illustrative purposes, only a few walls, rooms 4, and zones 8, 12 of the building indicated in Fig. 1 are shown, as they may be present in an exemplary situation on a floor. The rooms 4 may, for example, be offices, apartments, halls, or elevator cars of an elevator system 3. On the floor of this building, zone 8 is not subject to any access restrictions; it is also referred to below as public zone 8. The public zone 8 can be an area inside or outside the building. A lock 10 separates the public zone 8 from a zone 12, which is subject to access restrictions and borders the rooms 4 in Fig. 1. The zone 12 may also be referred to below as a non-public or access-restricted zone 12. A person skilled in the art will recognize that the technology described here is not limited to a division into a public zone 8 and a non-public zone 12.

[0026] In the embodiments described here, the building system comprises an elevator system 3 and an access control system 1, which includes the airlock 10. In the application shown in Fig. 1, a person 2 carrying an authorization credential 6 (shown as a mobile phone and card) is located in the public zone 8. The rooms 4 shown can belong to a group of elevators, which includes, for example, four elevators (AD). Instead of the four elevators shown, the elevator system 3 can have a larger or smaller number of elevators. An elevator control device ECS controls the elevator system 3 to perform a transport service (e.g., an elevator ride). An access control device ACS controls the access control system 1 to perform a control service (e.g., granting access). In Fig.1, these controllers (ECS, ACS) are combined for illustrative purposes in a control device 9, which is communicatively connected via a communications network 22 to devices of the access control system 1 and the elevators (AD) and their devices (e.g., call input terminal 11). Those skilled in the art will recognize that the access control device ACS and the elevator controller ECS can be arranged separately from one another in the building.

[0027] Fig. 1 also shows two exemplary embodiments of the human-machine interface device 5, which are each communicatively connected to the control device 9 via the communication network 22 and enable the person 2 to request and use a desired service. In the first exemplary embodiment, the human-machine interface device 5 is assigned to the lock 10; its components can, for example, be integrated into the lock 10 or arranged on it (or in its surroundings). In the second exemplary embodiment, the human-machine interface device 5 is assigned to an operating terminal 11, in particular a call input terminal of the elevator system 3; hereinafter, the operating terminal 11 is referred to as the call input terminal 11. The components of the human-machine interface device 5 can, for example,be integrated into the call input terminal 11; the call input terminal 11 itself can also be considered a human-machine interface device. Depending on the design of the building system, one human-machine interface device 5 according to the first or second embodiment can be arranged on the floor; moreover, several human-machine interface devices 5 according to the first and / or second embodiment can be arranged.

[0028] Referring to the lock 10 shown in Fig. 1, the human-machine interface device 5 comprises, in one exemplary embodiment, a screen device 14 (e.g., comprising an LED or LCD display), a processor device 21 (P), and a sensor device 24. Depending on the configuration, a detection device 16 for detecting an authorization credential 6 may additionally be present, as shown in Fig. 1. These components (14, 16, 21, 24) are arranged, by way of example, on or in a (right-hand) structure 10a of the lock 10, but are not limited to this arrangement. For illustration, the components are shown on a front side of the structure 10a; those skilled in the art will recognize that at least one of the components may be arranged on another side of the structure 10a, in particular on a top side.

[0029] In one embodiment, the sensor device 24 can be arranged near the lock 10. In Fig. 1, the sensor device 24 is arranged, by way of example, on a (left) structure 10b of the lock 10, but is not limited to this arrangement; it can also be arranged on the (right) structure 10a or another suitable location. The sensor device 24 is designed and arranged accordingly to detect a presence and / or approach of the person 2 to the human-machine interface device 5 as soon as the person 2 is located in a detection range of the sensor device 24. The sensor device 24 can also detect when the person 2 enters and passes through the lock 10. The sensor device 24 can be a camera (2D or 3D camera), a 3D sensor (e.g.a time-of-flight (ToF) sensor), a light barrier, or another sensor suitable for person or object detection; it can also comprise a radio device, e.g., for communication with a mobile phone of person 2, wherein the detection range substantially corresponds to a radio range of the radio device. Those skilled in the art will recognize that the sensor device 24 generates a sensor signal that is transmitted to the processor device 21 for signal processing in order to determine the presence and / or movement pattern of person 2, in particular with regard to a direction of movement and a distance relative to the human-machine interface device 5. The processor device 21 recognizes, for example, from the movement pattern whether the person 2 is approaching the human-machine interface device.

[0030] In the situation shown in Fig. 1, according to one embodiment, the call input terminal 11 for the elevator system 3 or the access control system 1 can be arranged on the floor; it can be arranged in addition to the interlock 10 and its devices, for example, spatially separated therefrom (e.g., in another floor area) or instead of the interlock 10. In Fig. 1, the call input terminal 11 is also connected to the communications network 22, via which the call input terminal 11 communicates with the control device 9 (ECS, ACS). In one embodiment, the human-machine interface device 5 of the call input terminal 11 also comprises a display device 14, a processor device 21, and a sensor device 24.

[0031] Those skilled in the art will recognize that the human-machine interface device 5 may include a loudspeaker system for announcing information concerning the service, e.g., by means of a voice message. This may be particularly helpful for persons 2 with limited vision. The call input terminal 11 may include such a loudspeaker system; a loudspeaker system may also be arranged in or on the lock 10.

[0032] The human-machine interface device 5 detects, with the aid of the sensor device 24 and the processor device 21, the presence in the detection area and / or a movement pattern of the person 2, which includes, for example, their direction of movement and distance relative to the human-machine interface device 5. If a presence or approach to the human-machine interface device is detected, the screen device 14 of the human-machine interface device is activated; otherwise, the screen device 14 remains in an inactive state. If a presence or approach is detected, the screen device 14 is controlled to display a first animation on a screen 30 (Fig. 2 and Fig. 3), which in particular comprises an animated first human-like facial expression. The human-like facial expression can include, for example, an animated smile and / or a wink. In Fig. 2 and Fig.3 shows exemplary facial expressions such as can be displayed by the screen device 14 on the screen 30. The facial expressions are preferably animated, i.e. they are not static representations (similar to a single image), but rather the type of facial expression changes over time (similar to a sequence of multiple images (film)). In Fig. 2 and Fig. 3, the animation (temporal change) is indicated by consecutively arranged facial expressions; in Fig. 2 and Fig. 3 it is evident that the position of the corners of the mouth and the position of the eyebrows change, thus creating the impression that the human-like facial expression is moving. The person skilled in the art will recognize that the screen device 14 is controlled accordingly; for example, a situation-appropriate facial expression can be read from a storage device in order to then display it on the screen device 14.

[0033] An "animated" smile is shown in Fig. 2 and Fig. 3, each to the left of an approximately centrally positioned arrow. To the right of this, facial expressions are shown, the type of which depends on a recognized situation (situation-appropriate), in particular whether person 2 is authorized or not. In Fig. 2, person 2 is authorized (indicated by the authorization credential 6 above the arrow), so that the facial expression to the right of the arrow still includes a "animated" smile. In Fig. 3, however, person 2 is not authorized (indicated by the crossed-out authorization credential 6 above the arrow), so that the facial expression to the right of the arrow includes an "animated" unfriendly or angry facial expression. The person skilled in the art will recognize that the facial expressions shown are examples and that other facial expressions are possible, for example, to depict other emotions depending on the situation.

[0034] The access control system 1 is designed to monitor access to the restricted-access zone 12 so that only authorized persons 2 can enter zone 12. Access is via the lock 10, which is designed as a barrier-free lock 10. In Fig. 1, the lock 10 is shown as the two structures 10a, 10b standing on the ground, with a passageway between the structures 10a, 10b through which the person 2 must go in the direction of the arrow if they want to go from zone 8 to zone 12. The person skilled in the art will recognize that the lock 10 shown is exemplary. Depending on the building and / or expected traffic volume, the lock 10 can consist of several individual locks, each with passageways between two adjacent structures. The person skilled in the art will also recognize that the lock 10 can be designed in a different way, for example, instead of the structure shown in Fig.1 with only one structure; a passage can then exist, for example, between this structure and a building wall. The structure or at least one of its components described below can also be arranged on a building wall, with the passage then being in the area in front of the building wall or the components. Particularly in the latter embodiment, the lock 10 can be designed such that it is not recognizable as a lock 10 for person 2.

[0035] Depending on the design of the lock 10 shown in Fig. 1, a signaling device 20 may be present, which is arranged at least in or on one of the two structures 10a, 10b; in Fig. 1, both structures 10a, 10b are equipped with the signaling device 20, wherein the signaling device 20 is provided, for example, along a vertical edge of the structure 10a, 10b. In one embodiment, the signaling device 20 is designed and arranged accordingly on the lock 10 to generate light of different colors (e.g., red and green) and / or an acoustic signal (e.g., an alarm signal), wherein the light and / or the acoustic signal are each perceptible to the person 2. Those skilled in the art will recognize that the signaling device 20 can be designed in a different way, as long as it or its signaling is perceptible to the person 2.

[0036] The building system shown in Fig. 1 can comprise one or more camera systems 26, which can be arranged in the area of ​​the airlock 10 and / or in the access-restricted zone 12. In conjunction with the sensor device 24, such a camera system 26 can be designed in one exemplary embodiment to detect the person 2 and track their movement within the zone 12. The person skilled in the art recognizes that the number of camera systems 26 and their spatial arrangements can be adapted to the building and / or to the size of the zone 12. The person skilled in the art also recognizes that the camera system(s) 26 are optional, for example, if no tracking is provided. Such a camera system 26 is known to the person skilled in the art; it can, for example, comprise a 2D or 3D video camera, each with an associated image processing device. For example, EP 1 345 445 A1 discloses a 3D camera ora sensor device for detecting three dimensions in order to detect the positions of persons or other objects, the distances between them and their movements and directions of movement.

[0037] The recognition device 16 can be configured in various ways; in particular, it can be configured for one or more types of authorization credentials 6. An authorization credential 6 is typically assigned to a person 2 or group of persons in the building system (e.g., in a database for user profiles) and must be presented by the person 2 at the entrance to the restricted-access zone 12. The authorization credential 6 can be stored as a password (code) on an information carrier (e.g., in a chip of a chip card, a magnetic stripe of a magnetic stripe card, or a memory of a mobile phone) or represented (e.g., as an optical code in the form of a QR code, a barcode, or a color code). In one embodiment, the authorization credential 6 can be a biometric feature, e.g., a facial pattern of the person 2.

[0038] The recognition device 16 is adapted to the authorization credential(s) 6 to be used in the building. In one embodiment, the recognition device 16 can have an optical reading device (e.g., a digital camera) to capture, for example, an optical code from an information carrier. The information carrier can be configured, for example, in the form of a credit card-shaped employee ID card or the like; in another embodiment, a mobile phone (or a similar electronic device) of the person 2, which displays the optical code on a screen, serves as the information carrier. The digital camera of the optical reading device (or an additional digital camera) can be used in one embodiment to capture a biometric authorization credential 6.The captured biometric credential 6 can then be used in conjunction with a recognition device and stored biometric data of persons 2 registered in the building to determine access authorization, e.g., by means of facial recognition.

[0039] Additionally or alternatively, a radio-based reading device can be present as the recognition device 16, which reads the authorization credential 6, for example, from a chip of an RFID transponder. An employee ID card or similar device or a mobile phone can serve as the RFID transponder, for example. In one embodiment, the radio-based reading device can be configured for communication with the mobile phone or similar device using near-field communication (NFC) or Bluetooth technology. In one embodiment, the mobile phone transmits the (electronic) authorization credential 6 to the radio-based reading device using Bluetooth technology as soon as the mobile phone is within radio range of the reading device.

[0040] The person skilled in the art will recognize that, in one exemplary embodiment, the functionality of the recognition device 16, in particular that of a radio-based reading device or a facial recognition device, can be integrated into the sensor device 24. For example, the sensor device 24 configured in this way can both detect the presence or approach of the person 2 and determine their authorization using facial recognition or (radio) authorization verification.

[0041] According to an embodiment disclosed in this description, the credential 6 must be presented. Those skilled in the art will recognize that the credential 6 represents the information used to verify access authorization, regardless of the type of information (code or biometric feature) and the design of any information carrier. The figures show, for example, a card-shaped information carrier on which the credential 6 is stored or displayed; the information carrier is therefore also referred to as credential 6; this applies analogously to the mobile phone shown in the figures.

[0042] In the situation in the building shown in Fig. 1, the technology described here can be advantageously applied. Based on the situation shown in Fig. 1 and with an understanding of the system components and their functionalities described above, the following, in conjunction with Fig. 4, describes an exemplary method for operating a system that performs one or more services for a person 2 in an environment accessible to the person 2. The description of a first part of the method is given with reference to the person 2, who moves from the zone 8 towards the human-machine interface device 5 in order to use a desired service of the building system. Depending on the application, this first part can be followed by a second part of the method.The description of the second part is based on person 2, who wishes to enter the restricted-access zone 12 from zone 8, for example, to use an elevator (AD), for which the access granting and elevator ride services are desired. In particular, in the second part, person 2 carries an authorization credential 6, which is designed here for illustration and, for example, as shown in Fig. 1, as a credit card-shaped employee ID card or as a mobile device (in particular, as a code to be transmitted wirelessly). The authorization credential 6 can be presented at the gate 10 or can be received when person 2 is within radio range to enter the restricted-access zone 12. The building system is activated.

[0043] The illustrated method begins in a step S1 and ends in a step S8, wherein steps S5, S6, and S7 can be assigned to the second part of the method; for illustration, a dashed border is shown in Fig. 4 that encloses these steps. Those skilled in the art will recognize that the division into the steps shown in Fig. 4 is exemplary, that further steps may be present, and that one or more of these steps can be divided into one or more substeps, or that several of the steps can be combined into one step.

[0044] In the situation shown in Fig. 1, person 2 is moving in zone 8 and can be detected by sensor device 24 if person 2 enters a detection range of sensor device 24. If person 2 moves, for example, in the direction of the arrow shown in Fig. 1 to reach the restricted-access zone 12 on the floor, they enter the detection range of sensor device 24 at or in the area of ​​airlock 10. In a step S2, the presence of person 2 is detected. In one embodiment, sensor device 24 generates a sensor signal, which the correspondingly programmed processor device 21 (P) receives and processes. Depending on the configuration, a movement pattern of person 2 can also be determined; in particular, their direction of movement and distance from the human-machine interface device 5 can be determined.In one embodiment, the sensor device 24 can detect alone or in conjunction with the processor device 21 when the person 2 falls below a specified minimum distance from the human-machine interface device 5.

[0045] In a step S3 of Fig. 4, it is checked whether person 2 is present or whether they are approaching the human-machine interface device 5. Such an approach is detected, for example, by the distance to the human-machine interface device 5 decreasing. If person 2 is present or is approaching, the method proceeds along a "yes" branch to step S4; otherwise, the method proceeds along a "no" branch to step S8 and ends there.

[0046] In step S4, the screen device 14 of the human-machine interface device 5 is activated. Upon detection of presence or approach, the screen device 14 is triggered to display a first animation. The first animation comprises an animated, human-like facial expression. Such a facial expression is shown as an example in Fig. 2 and Fig. 3 (left, respectively).

[0047] If, however, no presence or approach is detected in step S3, the display device 14 remains in an inactive state and the method ends in step S8. In this inactive state, for example, the illumination of the display device 14 may be switched off or reduced, a standby mode may be active, and / or a static screen content may be displayed.

[0048] In one embodiment, the above-mentioned first part of the method ends following step S4 in step S8. According to this embodiment, the animated human-like facial expression representation can contribute to improving user-friendliness, for example, by enabling person 2 to perceive the human-machine interface device better and / or more quickly, to feel addressed and / or prompted, to respond more quickly to a prompt, and to use the desired service more smoothly overall. This can reduce the risk of crowding or queues.

[0049] The above-mentioned second part of the method can contribute to both improving user-friendliness and taking security concerns into account in the building. The second part of the method follows step S4 in Fig. 4 with a step S5.

[0050] In step S5, a check is performed to determine whether person 2 is authorized to use the desired service. In the situation shown in Fig. 1, person 2 wishes to go from zone 8 to the restricted-access zone 12 in order to use an elevator there. Depending on the design of the building system, verification of authorization can be achieved by, in one embodiment, presenting a (physical) credential 6 at the human-machine interface device 5, for example, by holding it at or in front of the recognition device 16. In another embodiment, it may be necessary for the mobile device of person 2 to execute a software application (app) that communicates with the human-machine interface device 5 and transmits an electronic access code as credential 6 wirelessly (e.g., using Bluetooth technology) when the mobile device is within wireless range.The access code for an authorized person 2 is stored in a user database. In another embodiment, a camera, in conjunction with a facial recognition process, can generate a facial template from an image of the face of person 2 to determine whether this facial template is assigned to an authorized person 2 in the user database. In this case, the face serves as proof of authorization 6.

[0051] Depending on the design of the authorization credential 6, the authorization check can be performed at different distances from the human-machine interface device 5. Person 2 must present a physical authorization credential 6 at the human-machine interface device 5. If they then proceed toward Zone 12, they fall below a specified minimum distance. This minimum distance is set so that a reaction from the building system is possible before Person 2 enters Zone 12.

[0052] If the credential 6 is captured wirelessly or via facial recognition, the authorization check can be performed while person 2 is even further away from the human-machine interface device 5. If person 2 continues walking toward the human-machine interface device 5, they will also fall below a specified minimum distance in these application examples, which is also set to allow the building system to react before person 2 enters zone 12.

[0053] If the check in step S5 shows that person 2 is authorized, the process proceeds along the "yes" branch to step S6. If, however, person 2 is not authorized, the process proceeds along the "no" branch to step S7.

[0054] In step S6, a check is made to determine whether person 2 has fallen below the specified minimum distance from the human-machine interface device 5. If this is the case and authorization exists, the first animation is displayed unchanged, as shown in Fig. 2 (right). Additionally, the control device 9 generates an enable signal, enabling the desired service for use.

[0055] In one embodiment, the screen device 14 can display the granted access, for example, by visually highlighting the first animation. Additionally, the signaling device 20 can be activated and, for example, illuminate green. This makes it visible to person 2 and any security guard present that they have been granted access. The method then ends in step S8.

[0056] In step S7, a check is also performed to determine whether person 2 has fallen below the specified minimum distance from the human-machine interface device 5. If this is the case and authorization is missing, the control device 9 blocks the requested service and causes the human-machine interface device 5 to control the screen device 14 to display a second animation, as shown in Fig. 3 (right). The second animation also includes an animated human facial expression; however, this is selected to alert person 2 to incorrect behavior. The second animation can include an unfriendly, rejecting, or punitive facial expression.

[0057] In one embodiment, the screen device 14 can indicate the denied access, for example, by visually highlighting the second animation. Additionally, the signaling device 20 can be activated and, for example, illuminate red. This makes it visible to person 2 and any security guard present that they are denied access. In Fig. 4, the method then ends in step S8.

[0058] Depending on the building and the design of the building system, it may be provided that person 2 can correct their erroneous behavior, particularly in response to the second animation. In one embodiment, the human-machine interface device 5 can, in addition to the second animation, generate an audible and / or visible indication for person 2 to identify themselves. The audible indication may include a voice message, and the visible indication may include a display of the voice message and / or a visual effect in conjunction with the second animation.

[0059] As mentioned above, person 2 must identify themselves at the (barrier-free) gate 10, in particular by presenting the credential 6 at the recognition device 16. If person 2 is aware of this requirement, they will identify themselves; they will also be asked to identify themselves and, if necessary, reminded of this. In one embodiment, this is supported by the screen device 14 displaying the animations so that person 2 can see, in particular, the second animation when they are at the gate 10. The second animation can represent a request for identification.

[0060] If person 2 has forgotten to present their credential 6, they can do so in response to the second animation without being prompted to do so by a security guard. The method described in conjunction with Fig. 4 can therefore, in one embodiment, have the control device 9 check whether person 2 presents credential 6 at the human-machine interface device 5 within a specified period of time in response to the second animation. If authorization exists, the release signal is then generated by the control device 9. Since person 2 is authorized to access in such a case, this procedure can be more pleasant for person 2 in public. If, on the other hand, person 2 is not authorized to access and still attempts to go through the lock 10, a security guard can intervene or another security measure can be initiated. If person 2 moves in the direction of the area shown in Fig.1, this means in the situation shown that person 2 wishes to be transported to a desired destination floor using one of the elevators (AD). The destination floor can be stored in a user profile of a building management system of the building system created for person 2. The elevator control ECS can, for example, be designed as a group control with destination call control technology. Upon recognition of person 2, for example, a destination call is initiated which specifies the destination floor stored in the user profile of person 2 and the floor on which the airlock 10 is located as the boarding floor. If access control takes place, for example, in an entrance hall of the building, which people 2 must pass through to reach the elevators AD, a destination call can be initiated each time access is granted to the person 2 in question.The elevator control ECS determines an elevator to serve the destination call and communicates the determined elevator to person 2, for example by means of the screen device 14.

[0061] In connection with the service blocked in step S7, the elevator control system ECS can be configured to initiate one or more specified measures in response to a security violation indicated by the alarm signal. According to a specified measure, the elevator control system ECS can, for example, block an elevator service departing from the restricted-access zone 12, so that, for example, no elevators AD depart or stop, or no elevator doors open or close, on the floor of the restricted-access zone 12. Depending on the building, elevator system 3, and the circumstances of the security violation, only one of several elevators or the entire elevator system 3 can be taken out of service. An initiated measure can remain in effect until the security violation is under control.

[0062] In one embodiment, the camera system 26 can be used in the event of a security breach to track person 2. In the situation shown in Fig. 1, the camera 24 detects that person 2 is passing through the lock 10, and the camera system 24 determines the movement path of person 2. From the movement path, it can be determined in which direction and / or to which elevator AD person 2 is walking or which elevator AD person 2 is boarding. The initiated measure can, for example, block the elevator that person 2 is approaching or has already boarded.

[0063] A user profile is created for each person 2 registered in the building system, i.e., it is stored as a data record in a database. In one embodiment, the database is configured in a storage device 36. In Fig. 1, the storage device 36 is shown as a separate unit; it can also be implemented in the human-machine interface device 5, the elevator control device ECS, or the access control device ACS. The user profile includes personal data of person 2 (e.g., name, reason for authorization (resident, employee, external service provider, visitor)), access authorizations (e.g., specific rooms 4 and floors), and possibly time-based access restrictions (e.g., access from Monday to Friday, from 7:00 a.m. to 8:00 p.m.).As an alternative to creating the user profile in the building system, the user profile can be created in a database of a remote building management system, whereby the building system can access this database via the Internet and / or cloud computing technology.

Claims

Patent claims 1. A method for operating a system which performs one or more services for a person (2) in an environment accessible to the person (2), and which comprises a control device (9) and a human-machine interface device (5) communicatively connected thereto, which is arranged in the environment and is designed to transmit a service desired by the person (2) to the control device (9), the method comprising: Detecting a presence of the person (2) within a detection range of the human-machine interface device (5); Activating a screen device (14) of the human-machine interface device (5) upon detecting the presence of the person (2), wherein in the absence of presence the screen device (14) remains in an inactive state; and upon detecting presence, controlling the screen device (14) to display a first animation, wherein the first animation comprises an animated first human-like facial expression.

2. The method of claim 1, further comprising: Determining a movement pattern of the person (2), wherein the movement pattern includes information on a distance of the person (2) relative to the human-machine interface device (5), wherein an approach of the person (2) to the human-machine interface device (5) is detected from the movement pattern; upon approach of the person (2), checking by the control device (9) whether the person (2) is authorized to use the desired service determined by the human-machine interface device (5); if authorization exists and the person (2) falls below a specified minimum distance from the human-machine interface device (5), generating an enable signal by the control device (9), whereby the desired service is enabled for use;and if there is no authorization and the specified minimum distance is not reached, controlling the screen device (14) to display a second animation, wherein the second animation comprises an animated second human facial expression.; 3. The method according to claim 2, further comprising checking by the control device (9) whether the approaching person (2) presents an authorization proof (6) at the human-machine interface device (5) in response to the second animation, wherein the release signal is generated by the control device (9) if authorization exists.

4. Method according to claim 3, further comprising generating an alarm signal and blocking the desired service by the control device (9) in the event of missing authorization verification or missing authorization and the minimum distance being undershot.

5. The method according to claim 4, wherein the alarm signal by the human-machine interface device (5) generates an audible and / or visible indication for the person (2) to present an authorization credential (6), wherein an audible indication comprises a voice message and wherein a visible indication comprises a display of the voice message and / or a visual effect in connection with the second animation.

6. Method according to one of the preceding claims, wherein the desired service comprises an elevator ride in an elevator system (3), a granting of access to an access control system (1) or a combination of an elevator ride and a granting of access.

7. Method according to one of the preceding claims, further comprising reading a situation-appropriate facial expression representation from a storage device, wherein the read situation-appropriate facial expression representation is the first human facial expression representation or the second human facial expression representation.

8. A system (1, 3) designed to perform one or more services for a person (2) in an environment accessible to the person (2), the system (1, 3) comprising: a communication network (22); a control device (9) connected to the communication network (22) is communicatively connected; and a human-machine interface device (5) which is communicatively connected to the control device (9) via the communication network (22), wherein the human-machine interface device (5) comprises a screen device (14), a sensor device (24) and a processor device (21), wherein the processor device (21) is designed to: detect a presence of the person (2) within a detection range of the human-machine interface device (5); activate the screen device (14) of the human-machine interface device (5) when the presence of the person (2) is detected, wherein in the absence of presence the screen device (14) remains in an inactive state; and when presence is detected, to control the screen device (14) to display a first animation, wherein the first animation comprises an animated first human-like facial expression.

9. System (1, 3) according to claim 8, in which the processor device (21) is further designed to determine a movement pattern of the person (2), wherein the movement pattern comprises information on a distance of the person (2) relative to the human-machine interface device (5), wherein an approach of the person (2) to the human-machine interface device (5) can be recognized from the movement pattern, and in which the control device (9) is designed to check, when the person (2) approaches, whether the person (2) is authorized to use the desired service determined by the human-machine interface device (5), and, if authorized and the person (2) falls below a specified minimum distance from the human-machine interface device (5), to generate an enable signal, whereby the desired service is enabled for use;and in the event of a lack of authorization and if the specified minimum distance is not reached, to control the screen device (14) to display a second animation, wherein the second animation comprises an animated second human facial expression; 10. System (1, 3) according to claim 9, wherein the control device (9) is further designed to check whether the approaching person (2) reacts to the second Animation presents proof of authorization (6) at the human-machine interface device (5) and, if authorization exists, generates the release signal.

11. System (1, 3) according to claim 10, wherein the control device (9) is further configured to generate an alarm signal and block the desired service in the event of a lack of authorization and a failure to reach the minimum distance.

12. System (1, 3) according to claim 11, wherein the human-machine interface device (5) is designed to generate, in response to the alarm signal, an audible and / or visible indication for the person (2) to present an authorization credential (6), wherein an audible indication comprises a voice message and wherein a visible indication comprises a display of the voice message and / or a visual effect in connection with the second animation.

13. System (1, 3) according to one of claims 8 - 12, wherein the desired service comprises an elevator ride in an elevator system (3), a granting of access to an access control system (1) or a combination of an elevator ride and a granting of access.

14. System (1, 3) according to one of claims 8 - 13, wherein the human-machine interface device (5) comprises a detection device (16) which is designed to detect an authorization credential (6), wherein the authorization credential (6) can be detected as an optical code, biometric feature or radio signal.

Images