Building systems for private user communications.

Abstract

The building system (1) comprises a camera system (4) and an image processing device (22) that generates a real-time face template for the facial features of the user (2, 2a) from a camera capture of the user (2, 2a) when the user (2, 2a) is in the building zone (12). The control and processing device (8) searches storage devices (26, 28) for a reference face template that matches the real-time face template to a specified degree, and if there is a match, the user (2, 2a) is a registered user (2). A two-way communication channel (18) for private communication between the building system (1) and the mobile phone (6) of the user (2, 2a) is determined from the user profile of the user (2, 2a).

Description

[Technical Field]

[0001] The technology described herein relates generally to building systems that perform one or more services in or for a building. In particular, embodiments of the technology relate to building systems that perform communication services and methods for operating such building systems. [Background technology]

[0002] Building systems can be designed in a wide variety of ways for a wide variety of applications. For example, in a building, it may be desirable to detect the presence of a user within the building. This desire may be on the part of a user who wants to locate themselves within the building, for example, after entering the building. The desire may also be on the part of a building manager who wants to know, for example, if and when a user is within the building, and what services the user wants to use within the building.

[0003] The presence of a user can be detected, for example, using an access control system, which is an example of a building system. The access control system, for example, controls access to restricted areas (e.g., building entrances or elevator access corridors). In such an access control system, a user who wants to use the services of the access control system can identify themselves as authorized in various ways, for example, using a key, a magnetic card, a chip card, an RFID card, or a mobile electronic device (e.g., a mobile phone). WO 2010 / 112586 A1 describes an access control system in which a mobile phone carried by a user transmits an identification code to an access node. If the identification code is identified as valid, the access node transmits an access code to the mobile phone, which then displays the access code on a display. When the user holds the displayed access code up to a camera, the access control system checks whether the detected access code is valid. If the code is valid, the user is granted access.

[0004] Another example of a building system is an elevator system installed in a building. To use the services of the elevator system, a user can, for example, enter an elevator call at a floor call terminal to travel from a boarding floor to a destination floor. Depending on the type and purpose of the building, the elevator system and access control system can be configured so that an elevator call is initiated when a user is granted access; the elevator call can be made to a specified destination floor stored in a user profile created for that user. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2010 / 112586 [Patent Document 2] U.S. Patent No. 8,494,231 [Non-patent literature]

[0006] [Non-Patent Document 1] German Federal Office for Information Security Publication "Gesichtserkennung" Summary of the Invention [Problem to be solved by the invention]

[0007] These building systems recognize the presence of a user, infer which services the user wants to use, and react accordingly. The user can, for example, change the designated destination floor to go to a different floor, but there are generally no other interaction options between the building system and the user. Therefore, there is a need for building systems that offer more interaction options. [Means for solving the problem]

[0008] One aspect of such technology relates to a method for operating a building system for a building, particularly one in which an elevator system and / or an access control system is present. The building system includes a camera system, an image processing device communicatively connected to the camera system, a control and processing device communicatively connected to the image processing device, a storage device communicatively connected to the control and processing device, and a communication device communicatively connected to the control and processing device. The camera system is disposed in a building zone accessible to users carrying mobile devices and users not carrying mobile devices. A real-time face template for the user's facial features is generated when the user is in the building zone, the real-time face template being generated by the image processing device from a camera capture of the user. Under control of the control and processing device, the storage device is searched for reference face templates stored therein that match the real-time face template to a specified degree. If the templates match, the user is recognized as a registered user whose user profile is stored in the storage device. The user's user profile is read by the control and processing device to determine a two-way communication channel for private communication between the building system and the user. Controlled by the control and processing device, a first data signal is transmitted by the communication device to the user's mobile phone via the determined two-way communication channel.

[0009] Another aspect of the present technology relates to a building system for a building, particularly for a building where an elevator system and / or an access control system are present. The building system includes a camera system disposed in a building zone accessible to users carrying mobile devices and users not carrying mobile devices, and an image processing device communicatively connected to the camera system and configured to generate a real-time face template for a user's facial features from a camera capture of the user when the user is in the building zone. The building system also includes a storage device in which a plurality of user profiles are stored, each user profile being assigned to a user and including the user's reference face template and information regarding the user's preferred communication channel. The communication device is configured to send and receive data signals over a communication network. The control and processing device is communicatively connected to the image processing device, the storage device, and the communication device and is configured to search the storage device for a reference face template that matches the real-time face template to a specified degree, and if there is a match, the user is a registered user. The control and processing device is also configured to read the user's user profile to determine a two-way communication channel for private communication between the building system and the user, and to transmit a first data signal to the user by the communication device via the two-way communication channel determined for the user.

[0010] The technology described herein creates a building system that can recognize registered users through facial recognition and then communicate with them via a communication channel selected by the user. Preferably, facial recognition is performed as unobtrusively as possible to the user and does not disrupt the user's flow of movement; therefore, authentication information (e.g., photo ID, RFID card) does not need to be displayed. This reduces the risk of queues forming before access, especially during periods of high traffic.

[0011] A registered user who saves their reference face template may be considered to have consented to the use of facial recognition technology. Additionally, in one embodiment, a user's initial response (and any subsequent responses) to a message received on a private communication channel may be considered to have consented to the use of the technology.

[0012] In contrast to known building systems in which communication for all users is performed in the same way through information devices and / or operating devices permanently installed in the building as the communication channel, according to the technology described herein, the communication channel is selected by the user. The communication channel is established through the user's mobile device, which the user is familiar with. Thus, the user does not need to first go to the information device and / or operating device, possibly waiting there behind other users, and then deal with the operation of the information device and / or operating device. Instead, the technology described herein enables location-independent communication using a mobile phone. Any input by the user (manual and / or voice) is performed using the user's (own) mobile phone. There is no need to input to an information device and / or operating device that is contacted by multiple users, which can be advantageous from a hygiene standpoint.

[0013] Furthermore, the technology described herein can advantageously be used by visually impaired or blind users. Such users can, for example, locate the information device and / or operating device, identify the location of the information device and / or operating device by touch, and be recognized by the above-mentioned facial recognition without having to perform an action using the information device and / or operating device. If such users select their mobile phone as a communication channel, communication will be via the mobile phone they are familiar with; information can be sent, for example, as a voice message via the mobile phone. Any input can be made manually and / or by voice by the user on their own mobile device.

[0014] The technology described herein also protects the privacy of users because it is a private communication, i.e., information transmitted from the building system to the user or vice versa cannot be seen by bystanders. A user who wants to keep their destination within the building or the purpose of their stay in the building secret can see this as a benefit; a female user, for example, may find it advantageous that her destination and her assigned elevator are not visible to bystanders. The same is true for a user who wants to visit a debt counselor or specialist in the building.

[0015] The techniques described herein also provide flexibility with regard to communication channels. Two-way communication channels can include, for example, telephone services, email services, multimedia or text messaging services, or services for social media, and two-way communication channels for users can be used by mobile phones. These services are communication channels that users are familiar with.

[0016] Multiple communication channels may be specified in a user profile. If multiple communication channels are specified, one of them may be specified as a preferred communication channel. A user may specify, for example, by one or more rules and / or conditions, when to use another communication channel rather than a preferred communication channel. For example, a ranking may be established; if a preferred communication channel (e.g., a particular chat service) is not available, another chat service should be used before, for example, a telephone service is selected. For example, a rule may specify a time period during which a private communication channel is selected.

[0017] In one embodiment, a second data signal is received by the communication device via the determined two-way communication channel, the second data signal relating to a user's response to the first data signal, the user being able to input the response into his or her mobile device.

[0018] In one embodiment, the message transmitted by the first data signal includes user-specific information, e.g., a question or request for confirmation, denial, or modification of the user-specific information. Accordingly, the second data signal may include a response to the question or a confirmation, denial, or modification of the user-specific information.

[0019] In one embodiment, the control and processing device can generate a control signal responsive to the second data signal, the control signal relating to the execution of a building action specified by the user-specific information. The user-specific information can, for example, relate to an elevator call. Thus, the user can use their familiar mobile phone to enter the elevator call and / or confirm the suggested destination floor.

[0020] In one embodiment, the techniques described herein may also be used when a user profile does not include information about a two-way communication channel or when the user does not have a mobile phone. To this end, the building system is configured to transmit a first data signal to an information device located within a building zone. Information can then be transmitted to such user from there.

[0021] Various aspects of the improved technology are described in more detail below with reference to embodiments in conjunction with the drawings, in which like elements have like reference numerals. [Brief explanation of the drawings]

[0022] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of an application of a building system in relation to an example of a situation inside a building. [Figure 2] 1 is a flow diagram of an embodiment of a method for operating an access control system. [Figure 3] 1 is a flow chart of a second embodiment of a method for operating a building system. [Figure 4] FIG. 1 is a schematic diagram of an embodiment of an access control system. DETAILED DESCRIPTION OF THE INVENTION

[0023] FIG. 1 is a schematic diagram illustrating an application example of the access control system 1 in relation to an example of a situation within a building. For illustrative purposes, only some walls of the building, a room 5, and a zone 12 are shown. The room 5 may be, for example, a residence, a hall, and / or an elevator car of the elevator system 16. In one embodiment, the building zone 12 may be a public zone that allows access to a restricted-access zone, such as the room 5 or the elevator system 16. In this embodiment, the building system 1 may be a subsystem or a subordinate system of an access control system that monitors the building zone 12 and / or the elevator system 16. In further embodiments, the building system 1 may be a system independent of another system, in particular an access control system or an elevator system. In the application of the building system 1 shown in FIG. 1, several users 2, 2a are present within the building zone 12. One user 2 carries a mobile electronic device 6 (hereinafter also referred to as a mobile phone 6), while another user 2a does not carry such a mobile phone 6.

[0024] FIG. 1 also shows a camera system 4, an information device 14, and a control and processing device 8 (CTRL in FIG. 1) communicatively connected to the communication network 10. As shown in FIG. 4, the control and processing device 8 includes an image processing device 22 and a storage device 26 that stores user profiles and associated face templates of registered users 2, 2a. The control and processing device 8 may be located inside or outside the building. In one embodiment, the control and processing device 8 may be located wholly or partially in an off-site control center or may be realized as an IT infrastructure made available via the Internet (also referred to as "cloud computing"). The communication connection between the control and processing device 8 and the communication network 10 is indicated by a communication connection 30. Also shown is the fact that a communication connection 18 may exist between the mobile phone 6 of the user 2 and the communication network 10. Further structural characteristics of the building system 1 and the control and processing device 8 are described in relation to FIG. 4.

[0025] In the example scenario shown in FIG. 1 , the technology described herein can be used, according to one embodiment, to create further interaction options between the building system 1 and the user 2, 2a. The technology described herein utilizes facial recognition technology based on a comparison of a real-time facial template of the user 2, 2a with stored reference facial templates of registered users 2, 2a. The technology described herein also utilizes one or more communication services, such as a telephone service, a text messaging service, an email service, or a social media service (chat app). Such services, including technical characteristics regarding, for example, transmission media (e.g., wireless, cable, Internet), addressing (Uniform Resource Locator (URL)), and transmission protocols (e.g., Internet protocols such as Internet Protocol (IP)), Transmission Control Protocol (TCP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), Simple Mail Transfer Protocol (SMTP), and File Transfer Protocol (FTP)), are known to those skilled in the art. Well-known social media or social networks are known, for example, by the following names: Facebook, Instagram, WhatsApp, and WeChat.

[0026] FIG. 2 shows an example flowchart of a first embodiment of a method for operating the building system 1. The method begins in step S1. If the user 2, 2a is in the building zone 12 within the detection area of ​​the camera system 4, the image processing device 22 generates a real-time face template of the user 2, 2a from a camera capture of the user 2, 2a in step S2. In step S3, under the control of the control and processing device 8, the storage device 26 is searched for a reference face template that matches the real-time face template to a specified degree. If the templates match, the real-time face template is a registered user 2, 2a whose user profile is stored in the storage device 26. In step S4, the control and processing device 8 reads the user profile of the user 2, 2a to determine a bidirectional communication channel 18 for communication between the building system 1 and the user 2, 2a. The communication channel 18 indicates how the user 2, 2a wants to communicate with the building system 1 or which communication service should be used for that purpose, and in particular, how the user 2, 2a wants to be contacted by the building system 1, for example, when entering a building. Once the communication channel 18 has been determined, in step S5 a data signal may be transmitted to the mobile phone 6 of the user 2 via the communication channel 18. The method ends in step S6.

[0027] Figure 3 shows an example of a flow chart of a second embodiment of a method for operating a building system 1. The method starts with step A1 and ends with step A11; between these, the method comprises steps A2, A3, A5 and A9, which correspond substantially to steps S2, S3, S4 and S5, respectively, of the method shown in Figure 2 and therefore will not be described in more detail below.

[0028] In step A4, a check is made to determine whether there is a match, i.e., whether a reference face template was determined during the search in step A3 that matches the real-time face template to a specified degree. If there is a match, i.e., if it is a registered user 2, 2a, the method proceeds along the YES branch to step A5 to read the user profile of user 2, 2a. On the other hand, if there is no match, the method proceeds along the NO branch to step A6.

[0029] In step A6, the user 2, 2a is defined as an unregistered user; then, the method ends in step A11. Because no reference face template matching the real-time face template was found in steps A3, A4, the user 2, 2a may be an unregistered user 2, 2a, e.g., a visitor, or may be a registered user 2, 2a who is not mistakenly recognized by face recognition. From the perspective of the building system 1, both cases represent an unregistered user. In such a case, the mistakenly recognized user 2, 2a may contact, for example, a customer service counter (e.g., a receptionist or porter) and identify themselves there in a different way. Meanwhile, depending on the building design, the visitor may be guided to a visitor information desk by way of signage or may be greeted by building staff.

[0030] In step A5, the communication channel designated as preferred by the user 2, 2a in the user profile is determined. In step A7, it is determined whether a communication channel is established via the mobile phone 6. As explained above, the user 2a does not carry a mobile phone 6. For this user 2a, the user profile specifies that a communication channel is established via the information device 14. The information device 14 can display, for example, building-specific information (e.g., building map information, site plan information), situation-specific information (e.g., route / direction information, elevator information), and / or personalized information (e.g., notifications, messages), with or without a voice message or prompt for input. For this user 2a, the method proceeds along the NO branch to step A8. In step A8, the control and processing device 8 sends a data signal to the information device 14 to display the information. The method then ends in step A11.

[0031] As shown in FIG. 1, user 2 carries mobile phone 6. In one embodiment, one of the communication services mentioned above is defined in the user profile as a preferred communication channel for user 2, such that communication occurs via mobile phone 6. Additionally, alternative communication channels may be defined in the user profile, but these communication channels are not considered preferred and are used only in exceptional cases. Exceptional cases may exist, for example, when the preferred communication channel is unavailable. Information device 14 may also be defined as a communication channel for user 2 (e.g., when there is a system interruption or when mobile phone 6 is unavailable or unusable); in this case, information may be communicated via information device 14 as described in connection with step A8.

[0032] If in step A7 it is determined that the communication channel is to be established via the mobile phone 6, the method proceeds along the YES branch to step A9. In step A9, the control and processing device 8 transmits a (first) data signal to the mobile phone 6 to initiate the transmission of information therefrom, for example by displaying the information on a display device of the mobile phone 6. The information may include the building-specific information, situation-specific information, and / or personalized information described above. In one embodiment, the method then ends in step A11. In a further embodiment, as shown in FIG. 3, the control and processing device 8 waits for a (second) data signal to be transmitted by the mobile phone 6. In FIG. 3, the mobile phone 6 transmits this data signal to the transceiver device 8 in step A10. The data signal may, for example, comprise a response to the received (first) data signal, for example, a message constituting a confirmation or correction of a message, or a reply to or input in response to a message.

[0033] Those skilled in the art will recognize that several users 2, 2a may be present within the building zone 12 at a given time. Those skilled in the art will recognize that in such a case, the method according to Figure 2 or the method according to Figure 3 may be performed for several of these users 2, 2a or for all of these users. Depending on the number of users 2, 2a, the execution may take place substantially simultaneously or one after the other. If several users 2 are present and each desires a communication channel via their respective mobile phones 6, a two-way private communication channel exists for each of these users 2.

[0034] 2 and 3 may be used in an embodiment that does not limit the scope of protection as follows: if it is recognized that registered user 2 (having mobile phone 6) prefers a chat service as a communication channel, the control and processing device causes the chat service to send a message to user 2's mobile phone 6, i.e. user 2 is contacted by his preferred private communication channel. For this purpose, user 2 uses his familiar mobile phone 6. The message may contain, for example, a greeting by name, an inquiry as to which building action is desired at a given time, and / or a request to confirm the building action proposed by the building system 1 according to the user profile. User 2's reaction (response or confirmation) is effected, for example in step A10 (FIG. 3), by user 2's mobile phone 6 sending a corresponding data signal to the control and processing device.

[0035] In one embodiment, the control and processing device can use what is known as a chatbot for two-way communication with user 2 via a communication channel. A chatbot (also called a chatterbot, bot, or virtual personal assistant) is a text-based dialogue system that enables chatting with a technical system in real time (usually via the Internet), i.e., electronic communication using written text. A chatbot can, for example, respond to specific commands; recognizing a registered user 2 can, for example, trigger a greeting or a specific message. Thus, technically, a chatbot is similar to a full-text search engine that responds to commands and searches a defined database for a corresponding response; as a result, a relatively intelligent and private dialogue with user 2 is also possible.

[0036] The general communication via the private communication channel preferred by user 2 described in the previous embodiment may be used for specific purposes in a building, for example, in conjunction with an access control system and / or an elevator system. As described above, in one embodiment, building system 1 may be a subsystem or subordinate system of access control system and / or elevator system 16. The access control system may, for example, monitor building zone 12 so that only authorized users 2, 2a can enter room 5 or elevator system 16 if an unauthorized user 2, 2a is detected, for example, by blocking or unlocking a door, gate, turnstile, or another physical barrier or lock, or by controlling (e.g., activating) an alarm device in the case of access without a physical barrier, or by a combination of these means. The alarm device may, for example, trigger a visual and / or audible alarm or initiate a security service notification. Room 5 shown in FIG. 1 may, for example, belong to an elevator group (e.g., elevators A and B). If the user 2, 2a is recognized, this may mean, in one embodiment, that the user 2, 2a desires access and wishes to be transported by one of the elevators to a destination floor specified for this user 2, 2a. In one embodiment, a destination call may be initiated to the user 2, 2a, to which the elevator controller assigns an elevator. The assigned elevator may be communicated to the user 2, 2a via a preferred communication channel. Access control systems and elevator systems, and their functions, are known to those skilled in the art. Such skilled persons may also be skilled in access control systems and / or elevator systems. Therefore, further explanation of the structural and functional characteristics of these systems is deemed unnecessary.

[0037] In one embodiment, registered user 2 specifies in his / her user profile that a private communication channel should be used via his / her mobile phone 6. User 2 may be a user who lives or works in the building and enters the building regularly, e.g., daily. User 2 may also be a visitor for whom a temporary user profile (visitor profile) has been created in advance. The associated reference face template may be generated from a photograph in which user 2's face is clearly visible, which the visitor sends to his / her host, e.g., by email. In addition to the data described above, the temporary user profile may include reservation information, information about the host, e.g., name, phone number, floor and / or residence or office number, and information about the visitor, e.g., the visitor's name or status (VIP). Furthermore, a time window during which the visitor is allowed access may be specified. The time window may indicate, for example, that visitor 2 has access approximately half an hour before or after the start of the appointment in case visitor 2 arrives too early or too late. The user profile may be deleted after visitor 2 arrives or at a later time. The technology described herein is particularly advantageous for visitors, as they can use their regular services without the need for a system or building-specific app.

[0038] If user 2 is recognized by building system 1 as a registered user, user 2 is granted access by the access control system. In this case, the user can be contacted by building system 1 via a private communication channel according to one of the aforementioned services. In some cases, the contact may consist of only a greeting, possibly along with current building information. The visitor may be informed which room 5 their host is in and how to get there. In further cases, the contact may include, for example, a request for a specific building action. The building action may consist, for example, of a destination call to elevator system 16 being initiated for user 2 according to data in a user profile existing for this user 2 or according to a call input on mobile phone 6 sent to building system 1 via a private communication channel. User 2 may also input a destination or location within the building (e.g., a store, department store, business, parking lot, restaurant, public restroom, etc.). The destination or location may be selected by user 2, for example, from a list previously sent from building system 1 to mobile phone 6 via the private communication channel. The building system 1 then notifies the user 2 via a private communication channel of the assigned elevator or desired destination / location information, e.g., the route to follow, with or without a building map.

[0039] In one embodiment, the access control system 1 is connected to an elevator system, in particular to an elevator controller. Communication between the building system 1 and the elevator controller can occur via a communication network 37 (as shown in FIG. 1). For example, if access control is performed in a building entrance hall through which user 2 must pass to reach the elevator, a destination call may be initiated each time access is granted to that user 2. The elevator control of the elevator system processes the destination call and assigns an elevator to the call. The elevator assigned to the destination call can be communicated to user 2 via a private communication channel. Thus, user 2 can go directly to the assigned elevator without having to enter the elevator call.

[0040] In addition to understanding the mode of operation of the building system 1 described above as an example, the following provides an explanation of example components of the building system 1 and their functions in conjunction with Figures 1 and 4.

[0041] The communication network 10 may include a building's internal communication network to which the camera system 4 and the information device 14 are connected within the building. In one embodiment, the control and processing device 8 may be connected to the building's internal communication network, particularly if the control and processing device 8 is also located within the building. The building's internal communication network may include a wired network topology (e.g., bus, ring, mesh topology) and / or a wireless-based network topology (WLAN). In further embodiments, the control and processing device 8 may be located entirely or partially at a location remote from the building. In this case, the control and processing device 8 may be connected to the building's internal communication network via an external communication network. For this purpose, an interface device exists in the building's internal communication network, enabling communication between the building's internal network and the external communication network.

[0042] 4 shows a schematic diagram of an embodiment of a building system 1 that includes components of an embodiment of a control and processing device 8. In addition to the image processing device 22 (image processing in FIG. 2 ) and the storage device 26 (memory in FIG. 2 ), also described above, the control and processing device 8 includes a communication device 24 (COM in FIG. 2 ) and a processor 20 (μP in FIG. 2 ). Those skilled in the art will recognize that the illustrated arrangement of components represents one example of a basic structure of the building system 1, and that the components may be located within a unit (e.g., within a housing, computer system, or server system) or may be spatially distributed, for example, via the cloud computing infrastructure described above.

[0043] The storage device 26 may include, for example, a hard disk drive (HDD), a CD / DVD drive, a solid-state drive / solid-state disk (SSD), or a combination thereof, or other storage device for digital data; as shown in FIG. 4 , the storage device 26 is connected to the image processing device 22 and includes a database system 28 (also referred to as database 28, DB in FIG. 2 ). The database system 28 consists of two parts: management software, called a database management system, and a set of managed data. The management software internally organizes the structured storage of data and controls all read and write access to the database. In one embodiment, the database system 28 is a relational database system. The database system provides a database language for querying and managing data, e.g., the language SQL for relational database systems.

[0044] The database system 28 stores a data set for each registered user 2, 2a, also called a user profile. The user profile includes the user's 2, 2a's personal data (e.g., name, reason for permission (resident, employee, external service provider, visitor)), access permissions (e.g., specific room 4 and floor), and any potential time restrictions (e.g., access Monday through Friday, 7:00 AM to 8:00 PM). The user profile also specifies how the user 2, 2a wants to be contacted when they are in the building. For this purpose, at least one communication channel can be specified. If multiple communication channels are specified, one of them can be specified as a preferred communication channel. The user 2, 2a can specify when different communication channels should be used, for example, by one or more rules and / or conditions. For example, rankings can be established; if a preferred communication channel (e.g., a specific chat service) is not available, another chat service should be used before the telephone service is selected. For example, rules can specify the time of day during which a private communication channel is selected.

[0045] The connection between the image processing device 22 and the database system 28 is configured to allow the image processing device 22 to query (or access) data stored in the database system 28. In particular, the database management system can search for stored reference face templates that match the real-time face template.

[0046] In the illustrated embodiment, the processor 20 is connected to an image processing device 22 and a communication device 24. The results of the image processing can be transmitted to the processor 20 through the connection to the image processing device 22, i.e., the user 2, 2a is either registered or unregistered based on the image processing. Unregistered users can be ignored by the building system 1 or served by an administrator (see step A6 in FIG. 3). On the other hand, if the user 2, 2a is registered, a computer program implemented in the processor 20 performs one of the methods shown in FIGS. 2 and 3.

[0047] In the illustrated embodiment, image processing device 22 and communication device 24 are each connected to communication network 10. Image processing device 22 can receive camera captures from camera system 4 via communication network 10, without this reception occurring via communication device 24. In further embodiments, image processing device 22 can be connected to communication device 24 to receive the camera captures. In FIG. 2 , these options for connecting image processing device 22 to communication network 10 to receive the camera captures are illustrated by communication connection 30. Those skilled in the art will recognize that communication link 30 can be established in various ways, for example, using wired transmission techniques (such as point-to-point connections and / or bus systems) and / or wireless techniques.

[0048] The camera system 4 generates camera captures of users 2, 2a (particularly their faces) within the detection range of the camera system 4 when the users 2, 2a are within the building zone 12. In one embodiment, the camera system 4 comprises a digital camera with selectable and / or adjustable characteristics; thus, in this embodiment, the camera capture is available as a digital data set (digital camera capture (also called digital image)). The characteristics of the digital camera, such as resolution (e.g., in megapixels), exposure, and focal length, are selected or adjusted so that the camera image (digital image) can be evaluated and the faces of the users 2, 2a can be recognized on the digital image with assessable quality. The digital image is, for example, in JPEG format, but may also be in a different format, such as BMP format or JPEG2000 format.

[0049] The camera system 4 may be equipped with or connected to a separate sensor module that activates the camera system 4 upon detecting the presence of the user 2, 2a within the detection range of the camera system 4. The sensor module may include a proximity sensor, which may be configured, for example, as an ultrasonic sensor, an infrared sensor, or an optical sensor (e.g., a light barrier, a brightness sensor). Alternatively, the presence of the user 2, 2a in the detection area of ​​the camera 4 may be recognized, in one embodiment, as a result of changes detected in the detection area. For example, if the user 2, 2a enters the detection area and the camera system 4 is always active, the camera system 4 will capture any preceding changes in the substantially static background; these changes will be interpreted as a presence.

[0050] Those skilled in the art will recognize that the camera system 4 may, in one embodiment, be configured with image processing capabilities, in which case the image processing device 22 in the control and processing device 8 may be omitted. Depending on the configuration of the building system 1, several camera systems 4 may be present, for example, in the building's foyer and on individual floors.

[0051] The image processing device 22 includes at least one processor unit that executes a computer-assisted method for image processing. Image processing methods are known, for example, from U.S. Pat. No. 8,494,231 B2. A basic description of image processing for face recognition is provided in the German Federal Office for Information Security's publication "Gesichtserkennung" ("Face Recognition") (available at the Internet address www.bsi.bund.de under the topic of biometric authentication). This publication distinguishes three main steps: "template creation," "reference data set creation," and "face image comparison." To make the comparison of two face images as simple and fast as possible, facial features are located and stored in the form of a feature data set called a "face template." Once a face is found and normalized in a user's image, features in addition to the eyes, nose, and mouth / chin are searched for, measured, and correlated. These extracted features are coded, compressed, and stored as a feature data set (face template). The similarity of the face templates of two face images is determined by combining the face images using a mathematical algorithm. This gives a measure of the similarity of the face templates: if the result is within certain tolerance limits, the two face templates, and therefore their underlying face images, are classified as identical.

[0052] 2 and 3, steps S3 and A4 check whether the real-time facial template matches the reference facial template to a specified degree. In one embodiment, the real-time template and the reference template each include a specified number of specified facial parameters and their values ​​(e.g., eye distance, mouth width, distance between the upper edge of the lips and the lower edge of the lips, distance between the nose and the lower edge of the lips, etc.). During the search, the parameter values ​​of the real-time template are compared with the parameter values ​​of the reference template. A match exists when the degree of similarity of the templates is at least equal to the specified degree. The specified degree indicates the matching rate between the facial parameters of the real-time template and the facial parameters of the reference template. Depending on the accuracy requirement, the specified degree may be selected to be, for example, about 60% to about 90%.

[0053] The mobile phone 6 may be, for example, a mobile phone, a smartphone, a tablet PC, or a smartwatch; these devices are typically equipped with hardware that enables communication over local wireless networks (WLAN / WiFi) and / or global mobile radio networks according to mobile radio standards (e.g., GSM, LTE, G4, G5). However, the mobile phone 6 may also be small computer goggles or another body-worn computer-assisted device (also called a "wearable device") if these devices are intended for short-range communication. Depending on the configuration of the mobile phone 6, the mobile phone 6 may, for example, be equipped with application-specific software (so-called apps) and may have a graphical user interface (GUI) so that its functions (e.g., individual apps) can be selectively activated and deactivated.

Claims

1. A method for operating a building system (1) for a building in which an elevator system (16) and / or an access control system is present, the building system (1) having a camera system (4), an image processing device (22), a control and processing device (8) communicatively connected to the image processing device (22), storage devices (26, 28) communicatively connected to the control and processing device (8), and a communication device (24) communicatively connected to the control and processing device (8), the camera system (4) is located in a building zone (12) accessible to users (2) carrying a mobile device (6) and users (2a) not carrying a mobile device (6), the storage device stores a plurality of user profiles, each one of the user profiles being assigned to a respective user registered with the building system and containing data associated with the registered user's reference face template, the method comprising: generating a real-time face template of the facial features of the user (2, 2a) when the user (2, 2a) is within the building zone (12), the real-time face template being generated by an image processing device (22) from a camera capture of the user (2, 2a) by a camera system; searching the storage devices (26, 28) for reference face templates stored therein that match the real-time face template to a specified degree, controlled by the control and processing device (8), whereby if there is a match, the user (2, 2a) is recognized as a registered user (2) whose user profile is stored in the storage devices (26, 28); reading a user profile of the user (2, 2a) by the control and processing device (8) to determine whether the read user profile contains information about a user-specified preferred two-way communication channel (18) through which private communication of data will be effected via the user's mobile device and between the building system (1) and the user (2, 2a); If such a communication channel is included in the user profile, transmitting, under control of the control and processing device (8), a first data signal by the communication device (24) via the determined two-way communication channel (18) to the mobile device (6) of the user (2), where it is provided to the user (2) as a message containing user-specific information regarding the elevator call; A method comprising:

2. 10. The method of claim 1, further comprising receiving, by the communication device (24), a second data signal over the determined two-way communication channel (18), the second data signal relating to a user's (2) response to the first data signal.

3. 3. The method of claim 1 or 2, wherein the two-way communication channel (18) comprises a telephone service, an email service, a multimedia or text messaging service, or a social media service, and the two-way communication channel (18) can be used by the user (2) using a mobile device (6) carried by the user (2).

4. The method of claim 2, wherein the second data signal includes confirmation, denial, or modification of user-specific information.

5. 5. The method of claim 4, further comprising the step of generating, by the control and processing device (8), a control signal in response to the second data signal, the control signal relating to the execution of a building action specified by the user-specific information.

6. 6. The method according to claim 1, further comprising the step of transmitting a first data signal to an information device (14) located in the building zone (12) if the user profile does not contain information about a two-way communication channel (18) or if the user is a user (2a) without a mobile device (6).

7. A building system (1) for a building equipped with an elevator system (16), comprising: a camera system (4) located in a building zone (12) accessible to users (2) carrying a mobile device (6) and users (2a) not carrying a mobile device (6); an image processing device (22) communicatively connected to the camera system (4) and configured to generate a real-time face template for the facial features of the user (2, 2a) from a camera capture of the user (2, 2a) when the user (2, 2a) is in the building zone (12); a storage device (26, 28) storing a plurality of user profiles, each user profile being assigned to a user (2, 2a) and including information about the user's reference face template and a communication channel (18) preferred by the user (2a); a communication device (24) configured to transmit and receive data signals over a communication network (10); a control and processing device (8) communicatively connected to an elevator system (16), an image processing device (22), a storage device (26, 28), and a communication device (24), wherein the control and processing device (8) searching the storage device (26, 28) for a reference face template that matches the real-time face template to a specified degree, and if there is a match, determining that the user (2, 2a) is a registered user (2); reading a user profile of the user (2, 2 a) to determine whether it contains information about a user-specified preferred two-way communication channel (18) over which private communication of data is to be effected via the user's mobile device and between the building system (1) and the user (2, 2 a); If such a communication channel is included in the user profile, causing the communication device (24) to transmit a first data signal to the user (2) over the two-way communication channel (18) determined for the user (2), where it is provided to the user (2) as a message containing user-specific information regarding the elevator call. It is configured as follows: Building Systems (1).

8. 8. The building system (1) according to claim 7, wherein the control and processing device (8) is also configured to process a second data signal received by the communication device (24) via the determined bidirectional communication channel (18), the second data signal relating to a reaction of the user (2) to the first data signal.

9. 9. The building system (1) according to claim 7 or 8, wherein the two-way communication channel (18) comprises a telephone service, an email service, a multimedia or text messaging service, or a social media service, and the two-way communication channel (18) can be used by the user (2) using a mobile device (6) carried by the user (2).

10. 10. The building system (1) according to any one of claims 7 to 9, wherein the control and processing device (8) is also configured to transmit a first data signal to an information device (14) arranged in the building zone (12) if the user profile does not contain information about the two-way communication channel (18) or if the user is a user (2a) that does not have a mobile device (6).

11. A building system (1) as described in claim 8, wherein the second data signal indicates an elevator call sent to the elevator system (16).

Images