Building system for private user communications

Abstract

A building system (1) comprises a camera system (4) and an image processing device (22), wherein when a user (2, 2a) stays in a building area (12), the image processing device generates a real-time face template for the face features of the user (2, 2a) based on a camera photo of the user (2, 2a). A control and processing device (8) searches a storage device (26, 28) for a reference face template that matches the real-time face template to a certain degree, and if there is a match, the user (2, 2a) is a registered user (2). A two-way communication channel (18) for private communication between the building system (1) and a mobile radio device (6) of the user (2, 2a) is determined based on the user profile of the user (2, 2a).

Description

Technical Field

[0001] The technology described herein generally relates to a building system that performs one or more services in or for a building. In particular, embodiments of the technology relate to a building system that performs communication services and to a method for operating such a building system. Background Art

[0002] Building systems can be designed in different ways for a variety of applications. In buildings, for example, it is of interest to identify the presence of users in the building. This interest may exist on the part of users who want to be guided in the building, for example after entering the building. This interest may also exist on the part of building managers, who want to know, for example, whether and when users are staying in the building and what services users want to use in the building.

[0003] For example, an access monitoring system as an example of a building system can be used to detect the presence of a user. For example, an access monitoring system monitors access to restricted access areas (e.g., building entrances or floor corridors leading to elevators). In such an access monitoring system, a user who wants to use the services of the access monitoring system can prove that he has obtained access authorization in different ways, such as using a key, a magnetic card, a chip card or an RFID card or a mobile electronic device (e.g., a mobile phone). WO2010 / 112586A1 introduces an access monitoring system, in which a mobile phone carried by a user sends an identification code to an access node. If the identification code is valid, the access node sends an access code to the mobile phone, and the mobile phone displays the access code on a display. If the user holds the displayed access code in front of the camera, the access monitoring system checks whether the detected access code is valid. If valid, the user is allowed access.

[0004] Another example of a building system is an elevator system installed in a building. In order to use the services of the elevator system, a user can, for example, enter an elevator call at a floor call terminal in order to be transported from an entry floor to a target floor. Depending on the type and purpose of the building, the elevator system and the access monitoring system can be designed to trigger an elevator call when a user is allowed access; the elevator call can reach a determined target floor, which is stored in a user profile created for the user.

[0005] These building systems recognize the presence of a user, infer the service the user wants to use, and respond accordingly. Although the user may change the determined target floor, for example because the user wants to be transported to another floor, there are usually no other interactive options between the building system and the user. Therefore, there is a need for a building system that provides additional interactive options. Summary of the invention

[0006] One aspect of this technology relates to a method for operating a building system for a building, in particular a building in which an elevator system and / or an access monitoring system is provided. The building system comprises a camera system, an image processing device connected to the camera system in communication, a control and processing device connected to the image processing device in communication, a storage device connected to the control and processing device in communication, and a communication device connected to the control and processing device in communication. The camera system is arranged in a building area accessible to users carrying mobile radio devices and users not carrying mobile radio devices. When a user stays in the building area, a real-time face template for the user's facial features is generated, the real-time face template being generated by the image processing device based on a camera photo of the user. Under the control of the control and processing device, a reference face template stored in the storage device that matches the real-time face template to a certain degree is searched in the storage device. If there is a match, the user is identified as a registered user, for whom a user profile is stored in the storage device. The user profile of the user is read by the control and processing device to determine a two-way communication channel or communication method for private communication between the building system and the user. Under the control of the control and processing device, the first data signal is sent from the communication device to the user's mobile radio device via a two-way communication channel.

[0007] Another aspect of the present technology relates to a building system for a building, in particular a building in which an elevator system and / or an access monitoring system is provided. The building system has a camera system and an image processing device, the camera system being arranged in an area of ​​the building accessible to both users carrying mobile radio devices and users not carrying mobile radio devices; the image processing device is communicatively connected to the camera system and configured to generate a real-time face template for the user's facial features based on the user's camera photo when the user stays in the building area. The building system also has a storage device, in which a large number of user profiles are stored, each user profile being associated with a user and including a reference face template for the user and content about the user's preferred communication channel. The communication device is designed to send and receive data signals via a communication network. The control and processing device is communicatively connected to the image processing device, the storage device and the communication device, and is designed to search the storage device for a reference face template that matches the real-time face template to a certain degree. If there is a match, the user is a registered user. The control and processing device is further designed to read the user profile of the user to determine a bidirectional communication channel for private communication between the building system and the user, and to send the first data signal from the communication device to the user via the bidirectional communication channel determined for the user.

[0008] The technology presented herein proposes a building system which, when a registered user is identified by means of facial recognition, can communicate with the user via a communication channel selected by the user. The facial recognition is preferably performed in a manner which is as unobtrusive as possible to the user and does not interfere with the user's mobility process; therefore, there is no need to show proof of authorization (e.g. photo identification, RFID card). This reduces the risk of queues forming in front of the entrance, especially in heavy traffic conditions.

[0009] It can be assumed that the registered user who has stored the reference face template agrees to use the face recognition technology. In addition, in one embodiment, the user's first response to the message received through the private communication channel indicates consent to use the technology.

[0010] Compared to known building systems, the communication channel is selected by the user according to the technology presented here, in which the communication for all users is carried out in the same way via an information and / or service device permanently installed in the building as a communication channel. The communication channel is carried out via the user's mobile radio device, which the user is familiar with. Therefore, the user does not have to go to the information and / or service device first, where he may have to wait behind other users and then have to figure out the operation of the information and / or service device. On the contrary, the technology presented here allows the use of mobile radio devices for communication that is independent of location. Any input (manual and / or voice) of the user is carried out using (his own) mobile radio device. There is no need to make inputs on the information and / or service device that a large number of users touch, which is advantageous from a hygiene point of view.

[0011] Furthermore, the technology presented here can also be used for users who are visually impaired or blind. For example, such users can be identified by means of the aforementioned face recognition, without having to search for and touch the information and / or service device and perform operations there. If such a user selects his mobile phone as a communication channel, the communication takes place via the mobile phone with which he is familiar; for example, the information can be transmitted by the mobile radio device as a voice message. The user can make any inputs manually and / or by voice on his own mobile radio device.

[0012] The technology presented here also protects the privacy of the user, since what is involved is a private communication, i.e. the information transmitted from the building system to the user or from the user to the building system is not visible to people around. For example, a user may value concealing his destination in the building or the purpose of his stay in the building; for a female user, it may be advantageous, for example, that her destination floor and the elevator assigned to her are not visible to people around her, and similarly for a user who, for example, wants to visit a debt counselor or specialist in the building.

[0013] The technology described here also provides flexibility in communication channels. Two-way communication channels can include, for example, telephone services, email services, multimedia or text messaging services, or social media services, wherein the user's two-way communication channels can be used through the mobile radio device carried with them. These are communication channels that users are familiar with.

[0014] A plurality of communication channels may be defined in the user profile. If a plurality of communication channels are defined, one of them may be defined as a preferred communication channel. The user may define, for example, one or more rules and / or conditions, when non-preferred communication channels are used. For example, a ranking may be established; if a preferred communication channel (e.g. a particular chat service) is not available, then, for example, another chat service should be used, followed by a telephone service. For example, a rule may define when a private communication channel may be selected.

[0015] In one embodiment, the second data signal is received by the communication device via a defined bidirectional communication channel. The second data signal relates to a user's response to the first data signal. The user can enter the response on his mobile radio device.

[0016] In one embodiment, the message transmitted by the first data signal includes user-specific information, such as an inquiry or request for confirmation, rejection or modification of the user-specific information. Therefore, the second data signal may include a response to the inquiry or a confirmation, rejection or modification of the user-specific information.

[0017] In one embodiment, the control and processing means may generate a control signal as a function of the second data signal, the control signal relating to the execution of a building action specified by the user-specific information. For example, the user-specific information may relate to an elevator call. Thus, the user may use his familiar mobile radio device to input an elevator call and / or confirm a suggested target floor.

[0018] In one embodiment, the technology presented here can also be used if the user profile does not contain any content about a two-way communication channel or if the user does not have a mobile radio device. For this purpose, the building system is designed to send a first data signal to an information device arranged in the building area. There, information can be transmitted to such a user. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The various aspects of the improved technology are explained in more detail based on embodiments in conjunction with the accompanying drawings. In the accompanying drawings, the same elements have the same reference numerals.

[0020] Figure 1 A schematic diagram showing an example of application of a building system in conjunction with an example situation in a building;

[0021] Figure 2 A flow chart showing a first embodiment of a method for operating a building system;

[0022] Figure 3 a flow chart showing a second embodiment of a method for operating a building system; and

[0023] Figure 4 A schematic diagram showing an embodiment of a building system is shown. DETAILED DESCRIPTION

[0024] Figure 1 is a schematic diagram of an example of an application of a building system 1 in an example case in a building, wherein for illustration purposes only some walls, rooms 5 and building areas 12 are shown. The room 5 can be, for example, an office, an apartment, a hall and / or an elevator car of an elevator system 16. In one embodiment, the building area 12 can be a public area from which access-restricted areas, such as the room 5 or the elevator system 16, can be accessed. In this embodiment, the building system 1 can be a part or a subsystem of an access monitoring system and / or an elevator system 16 that monitors the building area 12. In another embodiment, the building system 1 can be a system that is independent of other systems, in particular independent of the access monitoring system or the elevator system. In the case of the building system 1, the building system 1 can be a subsystem of an access monitoring system and / or an elevator system. Figure 1 In the application shown in FIG. 1 , a plurality of users 2 , 2 a are present in a building area 12 . User 2 carries with him a mobile electronic device 6 (hereinafter also referred to as a mobile radio device 6 ), while user 2 a does not carry with him such a mobile radio device 6 .

[0025] Figure 1 Also shown are the camera system 4, the information device 14 and the control and processing device 8 ( Figure 1 CTRL in), these components are communicatively connected to the communication network 10. Figure 4 As shown, the control and processing device 8 includes an image processing device 22 and a storage device 26, which stores the user data of the registered users 2, 2a and the related face templates. The control and processing device 8 can be arranged inside or outside the building. In one embodiment, the control and processing device 8 can be completely or partially arranged in a remote center, or implemented as an IT infrastructure available via the Internet (also known as "cloud computing"). The communication connection between the control and processing device 8 and the communication network 10 is represented by a communication connection 30. It is also shown that a communication connection 18 can exist between the mobile radio device 6 of the user 2 and the communication network 10. In combination Figure 4 Further structural features of the building system 1 and the control and processing device 8 are presented.

[0026] exist Figure 1 In the example case shown in , the technology presented here according to the embodiments can be used to create other interaction possibilities between the building system 1 and the users 2, 2a. The technology presented here uses face recognition technology based on comparing the real-time face template of the users 2, 2a with the stored reference face template of the registered users 2, 2a. The technology presented here also uses one or more communication services, such as telephone services, text messaging services, email services or social media services (chat applications). Such services, including their technical characteristics, such as regarding transmission media (e.g. radio, cable, Internet), addressing (Uniform Resource Locator (URL) and transmission protocols (e.g. Internet protocols, such as Internet Protocol (IP)), Transmission Control Protocol (TCP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), Simple Mail Transfer Protocol (SMTP), File Transfer Protocol (FTP)) are known to those skilled in the art. Known social media or social networks are known by the following names, for example: Facebook, Instagram, WhatsApp and WeChat.

[0027] Figure 2 An exemplary flow chart of a first embodiment of a method for operating a building system 1 is shown. The method starts in step S1. If a user 2, 2a is within the detection range of the camera system 4 in the building area 12, then in step S2, the image processing device 22 generates a real-time face template of the user 2, 2a based on the camera photo of the user 2, 2a. Under the control of the control and processing device 8, in step S3, a reference face template that matches the real-time face template to a certain degree is searched in the storage device 26; if there is a match, it is a registered user 2, 2a, for which a user profile is stored in the storage device 26. In step S4, the control and processing device 8 reads the user profile of the user 2, 2a to determine a bidirectional communication channel 18 for communication between the building system 1 and the user 2, 2a. The communication channel 18 indicates in what manner the user 2, 2a wishes to communicate with the building system 1 or what communication service to use for this purpose, in particular, for example, in what manner the user wishes to contact the building system 1 when the user 2, 2a enters the building. If the communication channel 18 is determined, in step S5 the data signal can be sent via the communication channel 18 to the mobile radio device 6 of the user 2. The method ends in step S6.

[0028] Figure 3 An exemplary flow chart of a second embodiment of a method for operating a building system 1 is shown. The method starts at step A1 and ends at step A11, wherein the method comprises steps A2, A3, A5 and A9, which correspond essentially to Figure 1The individual steps S2, S3, S4 and S5 of the method shown will therefore not be discussed in more detail below.

[0029] In step A4, it is checked whether there is a match, i.e. whether it was determined during the search in step A3 that there is a reference face template that matches the real-time face template to a determined degree. If there is a match, it is the registered user 2, 2a involved, and the method proceeds along the "yes" branch to step A5, where the user profile of the user 2, 2a is read. On the other hand, if there is no match, the method proceeds along the "no" branch to step A6.

[0030] In step A6, users 2, 2a are defined as unregistered users; the method then ends in step A11. Since no reference face template matching the real-time face template is found in steps A3 and A4, users 2, 2a may be unregistered users 2, 2a, such as visitors, or registered users 2, 2a who are mistakenly not recognized by the face recognition mechanism. From the perspective of the building system 1, both situations involve unregistered users. In this case, the user 2, 2a who is mistakenly not recognized can, for example, contact a customer service counter (such as a reception desk or doorman) and prove himself there in different ways. On the contrary, depending on the design of the building, visitors can be specifically guided to the visitor information desk or received by building personnel through route guidance.

[0031] In step A5, the communication channel determined as preferred by the user 2, 2a in the user profile is determined. In step A7, it is determined whether the communication channel is implemented via the mobile radio device 6. As mentioned above, the user 2a does not carry the mobile radio device 6 with him. In the user profile of the user 2a, it is determined for the user 2a that the communication channel is implemented via the information device 14. The information device 14 can, for example, display building-specific information (e.g. building floor plan information, site floor plan information), situation-specific information (e.g. route guidance / orientation information, elevator information) and / or personalized information with or without voice messages (e.g. notifications, messages), or prompts for input. If the user 2a is involved, the method proceeds along the "No" branch to step A8. In step A8, the control and processing device 8 sends a data signal to the information device 14 to display the information. The method then ends in step A11.

[0032] like Figure 1As shown, the user 2 carries a mobile radio 6. In one embodiment, one of the mentioned communication services is determined for the user 2 in his user profile as a preferred communication channel, so that communication is carried out via the mobile radio 6. In addition, alternative communication channels can be determined in the user profile, but these are not considered preferred and are only used in special cases. Exceptions may exist, for example, if the preferred communication channel is not available. The information device 14 can also be determined as a communication channel for the user 2 (for example in the case of a system outage or the mobile radio 6 is not available or not ready for use); in this case, the information can be transmitted via the information device 14, as described in conjunction with step A8.

[0033] If it is determined in step A7 that the communication channel is implemented by means of the mobile radio device 6, the method proceeds along the "yes" branch to step A9. In step A9, the control and processing device 8 sends a (first) data signal to the mobile radio device 6 in order to cause the information to be transmitted there, for example by displaying the information on a display device of the mobile radio device 6. The information can be building-specific, situation-specific and / or include personalized information. In one embodiment, the method then ends in step A11. In another embodiment, if Figure 3 As shown, the control and processing device 8 waits for a (second) data signal to be sent by the mobile radio device 6. Figure 3 In step A10, the mobile radio device 6 sends the data signal to the transmitting and receiving device 8. The data signal may include, for example, a message which represents a response to the received (first) data signal, such as a confirmation or modification of a message or a reply or input to a message.

[0034] The person skilled in the art realizes that a large number of users 2, 2a may be in the building area 12 at a certain point in time. The person skilled in the art realizes that in this case, several or all of these users 2, 2a may be executed according to Figure 2 method or according to Figure 3 Depending on the number of users 2, 2a, the execution can be carried out essentially simultaneously or one after another in time. If multiple users 2 present want a communication channel via a corresponding mobile radio device 6, a two-way private communication channel is provided to each of these users 2.

[0035] according to Figure 2 and Figure 3The determined communication channel can be used in the following manner in an embodiment which does not limit the scope of protection: if it is recognized that a registered user 2 (carrying a mobile radio device 6) prefers a chat service as a communication channel, the control and processing device causes the chat service to send a message to the mobile radio device 6 of the user 2, i.e. to contact the user 2 via the private communication channel preferred by him; for this purpose, the user uses his familiar mobile radio device 6. The message can include, for example, a named greeting, a query as to which building action is required at a given time and / or a confirmation of a request for a building action made by the building system 1 based on the user profile. The response (answer or confirmation) of the user 2 occurs, for example, in step A10 ( Figure 3 ) in which the mobile radio device 6 of the user 2 sends a corresponding data signal to the control and processing device.

[0036] In one embodiment, the control and processing device can use a so-called chatbot for bidirectional communication with the user 2 via the communication channel. A chatbot (also called a conversational robot, robot or virtual personal assistant) is a text-based dialogue system that can chat, i.e. communicate electronically with a technical system in real time (usually via the Internet) via written text. The chatbot can, for example, respond to special commands; the recognition of a registered user 2 can, for example, trigger a greeting or a determined message. Technically, the chatbot is therefore similar to a full-text search engine, which searches for a corresponding response in a specified database according to a command; thus, a relatively intelligent private dialogue with the user 2 is also possible.

[0037] The general communication via a communication channel preferred by the user 2 as described in the previous embodiments may be used for special applications in buildings, for example in combination with an access monitoring system and / or an elevator system. As described above, in one embodiment, the building system 1 may be a subsystem or a subsystem of an access monitoring system and / or an elevator system 16. The access monitoring system may, for example, monitor the building area 12 so that only authorized users 2, 2a may enter the room 5 or the elevator system 16, for example by blocking or releasing doors, barriers, turnstiles or other physical barriers or door locks, by operating (e.g. activating) an alarm device when an unauthorized user 2, 2a is detected, in the absence of physical obstacles, or by a combination of these measures. The alarm may, for example, be used to trigger a visual and / or audible alarm or to announce a security service notification. For example, Figure 1The room 5 shown in can be associated with a group of elevators (e.g. elevators A, B). If a user 2, 2a is identified, in one embodiment, this may mean that the user 2, 2a wants to enter and wants to be transported to a target floor determined for the user 2, 2a by one of the elevators. In one embodiment, a target call can be initiated for the user 2, 2a, and the elevator controller dispatches an elevator according to the target call. The dispatched elevator can be notified to the user 2, 2a via a preferred communication channel. Access monitoring systems and elevator systems and their operating principles are known to a person skilled in the art, who is a professional in access monitoring systems and elevator systems; therefore, other embodiments for the structure and functional characteristics of these systems do not seem necessary.

[0038] In one embodiment, the registered user 2 has already determined in his user profile that he needs to use a private communication channel via his mobile radio device 6. The user 2 can be, for example, a user who enters the building regularly, for example, every day, because he lives or works there. It can also be a visitor, for whom a temporary user profile (visitor profile) has been created in advance. The reference face template can be generated based on a photo in which the face of the user 2 is clearly visible, and the visitor sends the photo to his inviter, for example, by email. In addition to the above data, the temporary user profile can also include the content of the appointment and the content about the inviter, such as the name, telephone number, floor and / or apartment or office number and the visitor (for example, the name or identity (VIP) of the visitor). In addition, a time window can be specified within which the visitor is granted access rights. For example, the time window can indicate that the visitor 2 is allowed access approximately half an hour before and after the start of the appointment in case the visitor 2 arrives early or late. The user profile can be deleted after the visitor 2 arrives or at a later time. The technology described here is particularly advantageous for visitors, because visitors do not need system-specific or building-specific applications, but can use their usual services.

[0039] If the user 2 is recognized as a registered user by the building system 1, the user 2 is granted access rights by the access monitoring system. In this case, the building system 1 can contact the user via a private communication channel according to one of the mentioned services. In one case, the contact can only include a greeting, possibly with current building information. The visitor can be told in which room 5 his inviter is and how to get there. In another case, the contact may include an inquiry, for example, whether a specific building action is required. The building action can include, for example, either based on the data of the user profile existing for the user 2 or based on a call input on the mobile radio device 6, a target call to the elevator system 16 is initiated for the user 2, which is transmitted to the building system 1 via a private communication channel. The user 2 can also enter a target or location in the building (e.g. a store, department store, company, multi-storey car park, restaurant, public toilet, etc.). The target or location can be selected by the user 2, for example, from a list previously sent from the building system 1 to the mobile radio device 6 via a private communication channel. The building system 1 then transmits the assigned elevator or the desired target / location information, for example route guidance with or without a floor plan.

[0040] In one embodiment, the building system 1 is connected to an elevator system, in particular to an elevator controller. The communication between the building system 1 and the elevator controller can be carried out via a communication network 37 (eg, Figure 1 ). If access monitoring takes place, for example, in the entrance hall of a building, through which a user 2 must pass to reach an elevator, a target call can be initiated each time the user 2 in question is granted access. The elevator controller of the elevator system processes the target call and assigns it an elevator. The elevator assigned to the target call can be communicated to the user 2 via a private communication channel. The user 2 can thus go directly to the assigned elevator without having to enter an elevator call.

[0041] With the above example of the operation of the building system 1 understood, Figure 1 and Figure 4 Exemplary components of building system 1 and the manner in which they operate are described.

[0042] The communication network 10 may include a communication network built into the building, to which the camera system 4 and the information device 14 are connected inside the building. In one embodiment, the control and processing device 8 may be connected to the communication network built into the building, in particular when the control and processing device 8 is also arranged in the building. The communication network built into the building may include a wired network topology (e.g., bus, ring, mesh topology) and / or a radio-based network topology (WLAN). In another embodiment, the control and processing device 8 may be completely or partially away from the building. In this case, the control and processing device 8 may be connected to the communication network built into the building via an external communication network. For this purpose, an interface device is provided in the communication network built into the building, which interface device enables communication between the communication network built into the building and the external communication network.

[0043] Figure 4 A schematic diagram of an embodiment of a building system 1 is shown, wherein components of an embodiment of a control and processing device 8 are shown. In addition to the above-mentioned image processing device 22 ( Figure 2 image processing in) and the storage device 26 ( Figure 2 In addition to the memory in the control and processing device 8, the control and processing device 8 also includes a communication device 24 ( Figure 2 COM) and processor 20 ( Figure 2 Those skilled in the art recognize that the arrangement of the components shown reflects the basic structure of the example of the building system 1, and these components can be arranged in a unit or in a spatially distributed manner (e.g., in a house, a computer system, or a server system), for example, through the cloud computing infrastructure.

[0044] The storage device 26 includes, for example, a hard disk drive (HDD), a CD / DVD drive, a semiconductor drive / solid state disk (SSD) or a combination thereof, or other storage devices for digital data; Figure 4 As shown, the storage device is connected to the image processing device 22, including a database system 28 (also referred to as database 28, Figure 2 The database system 28 consists of two parts: management software called a database management system, and a large amount of data to be managed. The management software organizes the structured storage of data internally and controls all read and write access to the database. In one embodiment, the database system 28 is a relational database system. The database system provides a database language for querying and managing data, such as the SQL language.

[0045] The database system 28 stores a data set for each registered user 2, 2a, which is also referred to as a user profile. For example, the user profile can contain personal data of the user 2, 2a (e.g. name, authorization reason (resident, employee, external service provider, visitor), telephone number, email address), access rights (e.g. determined room 4 and floor) and possible access time restrictions (e.g. access from 7:00 am to 8:00 pm Monday to Friday). The user profile also determines how the user 2, 2a wants to be contacted when in the building. For this purpose, at least one communication channel can be determined. If multiple communication channels are specified, one of them can be defined as the preferred communication channel. The user 2, 2a can specify, for example, by one or more rules and / or conditions: when different communication channels need to be used. For example, a ranking can be established; if the preferred communication channel (e.g. a specific chat service) is not available, then, for example, another chat service should be used, and then the telephone service should be selected. For example, the rules can determine the time when a private communication channel is selected.

[0046] The connection between the image processing device 22 and the database system 28 is designed so that the image processing device 22 can query (or access) the data stored in the database system 28. Specifically, the database management system can search for a stored reference face template that matches the real-time face template.

[0047] In the embodiment shown, the processor 20 is connected to the image processing device 22 and the communication device 24. Through the connection with the image processing device 22, the result of the image processing can be transmitted to the processor 20, that is, based on the image processing, the user 2, 2a is either registered or unregistered. An unregistered user may be ignored by the building system 1, or the user may be accommodated by the administrator (see Figure 3 On the other hand, if the user 2, 2a is already registered, the computer program implemented in the processor 20 executes Figure 2 and Figure 3 One of the methods shown.

[0048] In the illustrated embodiment, the image processing device 22 and the communication device 24 are respectively connected to the communication network 10. The image processing device 22 can receive camera photos from the camera system 4 via the communication network 10, and the reception is not affected by the communication device 24. In another embodiment, the image processing device 22 can be connected to the communication device 24 to receive camera photos. Figure 2 , these possibilities for connecting the image processing device 22 to the communication network 10 for receiving camera pictures are illustrated by a communication connection 30. A person skilled in the art recognizes that the communication connection 30 can be established in a variety of ways, for example by means of wired transmission technology (e.g. point-to-point connection and / or bus system) and / or radio technology.

[0049] When the user 2, 2a is in the building area 12, the camera system 4 generates a camera picture of the user 2, 2a (in particular his face) in the detection area of ​​the camera system 4. In one embodiment, the camera system 4 comprises a digital camera with selectable and / or adjustable characteristics; in this embodiment, the camera picture is present as a digital data set (digital camera picture (also called digital image)). The characteristics of the digital camera, such as resolution (for example in megapixels), exposure and focus, are selected or adjusted so that the camera picture (digital image) can be evaluated and the face of the user 2, 2a can be recognized in terms of an assessable quality on the digital image. For example, the digital image is in JPEG format, but it can also be in a different format, such as BMP or JPEG2000 format.

[0050] The camera system 4 may be equipped with a sensor module or connected to a separate sensor module, which activates the camera system 4 when the presence of the user 2, 2a is detected in the detection range of the camera system 4. The sensor module may include, for example, a proximity sensor, which may be designed as an ultrasonic sensor, an infrared sensor or an optical sensor (e.g., a light barrier, a brightness sensor). Alternatively, in one embodiment, the presence of the user 2, 2a in the detection area of ​​the camera system 4 may be detected by detecting a change in the detection area. If the user 2, 2a, for example, enters the detection area and the camera system 4 remains activated, the camera system 4 captures the change in front of a substantially static background; this change is interpreted as presence.

[0051] Those skilled in the art recognize that, in one embodiment, the camera system 4 can be designed to have an image processing function. In this case, the image processing device 22 in the control and processing device 8 can be omitted. According to the configuration of the building system 1, multiple camera systems 4 can be set up, for example, in the entrance hall and on each floor of the building.

[0052] The image processing device 22 comprises at least one processor unit which executes a computer-aided method for image processing. The image processing method is known, for example from US 8,494,231 B2. A basic introduction to image processing for face recognition is presented in the publication "Face Recognition (Gesichtserkennung)" of the German Federal Office for Information Security (under the subject of biometrics on the Internet address www.bsi.bund.de). The document distinguishes three main working steps "Creating a template", "Creating a reference data set" and "Comparing face images". In order to make the comparison of two face images as simple and fast as possible, the features of the face are determined and stored in the form of a feature data set called a "face template". If the user's face has been found in the image and standardized, in addition to the eyes, nose and mouth / chin area, other features are also searched, measured and correlated with each other. These extracted features are encoded, compressed and stored as a feature data set (face template). In order to determine the similarity of the face templates of two face images, a mathematical algorithm is used for combination. This obtains the degree of similarity of the face templates. Two face templates and the face images they are based on are classified as identical if the results are within certain tolerances.

[0053] refer to Figure 2 and Figure 3 , in steps S3 and A4, it is checked whether the real-time face template matches the reference face template to a determined degree. In one embodiment, both the real-time face template and the reference face template include a determined number of determined face parameters and their values ​​(e.g., eye distance, mouth width, distance between the upper edge of the lip and the lower edge of the lip, distance between the nose and the lower edge of the lip, etc.). During the search, the parameter values ​​of the real-time face template are compared with the parameter values ​​of the reference face template. If the degree of similarity of the face templates is at least equivalent to the determined degree, there is a match. The determined degree indicates the percentage matching degree of the face parameters of the real-time face template with the face parameters of the reference face template. For example, depending on the accuracy requirements, the determined degree can be selected between about 60% and about 90%.

[0054] The mobile radio device 6 can be, for example, a mobile phone, a smart mobile phone, a tablet or a smart watch, which are usually equipped with hardware that can communicate via a local radio network (WLAN / WiFi) and / or a global mobile radio network that complies with a mobile radio standard (e.g. GSM, LTE, G4, G5). The mobile radio device 6 can also have glasses or other wearable computer auxiliary devices (also called "wearable devices") with a microcomputer, wherein these devices are used to communicate via local radio networks and global radio networks. Depending on the design of the mobile radio device 6, the mobile radio device can be software with specific applications (so-called apps) and have a graphical user interface (also called Graphical User Interface, GUI) so that functions of the mobile radio device (e.g. individual apps) can be selectively activated and deactivated.

Claims

1. A method for operating a building system (1) for a building, the building being a building in which an elevator system (16) and / or an access control system is present, wherein: The building system (1) comprises a camera system (4), an image processing device (22) communicatively connected to the camera system, a control and processing device (8) communicatively connected to the image processing device (22), a storage device (26, 28) communicatively connected to the control and processing device (8), and a communication device (24) communicatively connected to the control and processing device (8), the camera system (4) being arranged in a building area (12) which is accessible to users (2) carrying a mobile radio device (6) and to users (2a) not carrying a mobile radio device (6), a plurality of user profiles being stored in the storage device, wherein each user profile is associated with a user (2, 2a) and comprises a reference face template of the user and content about a communication channel (18) preferred by the user (2a), the method comprising: When the user (2, 2a) stays in the building area (12), a real-time face template is generated for the face features of the user (2, 2a), wherein the real-time face template is generated by an image processing device (22) based on a camera photo of the user (2, 2a); Under the control of the control and processing device (8), searching the storage device (26, 28) for a reference face template stored in the storage device (26, 28) that matches the real-time face template to a determined degree, and identifying the user (2, 2a) as a registered user (2) for whom a user profile is stored in the storage device (26, 28) when there is a match; Reading the user data of the user (2, 2a) by means of the control and processing device (8) to determine a two-way communication channel (18) for private communication between the building system (1) and the user (2, 2a); and Under the control of the control and processing device (8), when the user profile contains content about a bidirectional communication channel (18) and when the user (2) is carrying a mobile radio device (6), a first data signal is sent by means of a communication device (24) via the determined bidirectional communication channel (18) to the mobile radio device (6) of the user (2) in order to be communicated there to the user (2) as a message, Under the control of the control and processing device (8), a first data signal is sent to an information device (14) arranged in the building area (12) when the user profile does not contain content about the two-way communication channel (18) or when the user (2a) is not carrying a mobile radio device (6) with him, A second data signal is received by the communication device (24) via the determined bidirectional communication channel (18), wherein the second data signal relates to a response of the user (2) to the first data.

2. The method according to claim 1, wherein: The two-way communication channel (18) includes a telephone service, an e-mail service, a multimedia or text message service or a social media service, and the two-way communication channel (18) is available to the user (2) using a mobile radio device (6) carried with him.

3. The method according to claim 1 or 2, wherein: The message conveyed by the first data signal comprises user-specific information and the second data signal comprises a confirmation, a rejection or a modification of the user-specific information.

4. The method according to claim 3, further comprising generating, by the control and processing means (8) as a function of the second data signal, a control signal relating to the execution of the building action specified by the user-specific information.

5. The method according to claim 3, wherein: The user-specific information relates to elevator calls.

6. A building system (1) for a building, comprising: A camera system (4) arranged in a building area (12) which is accessible both to a user (2) who is carrying a mobile radio device (6) and to a user (2a) who is not carrying a mobile radio device (6); An image processing device (22) is communicatively connected to the camera system (4) and is designed to generate a real-time face template for the face features of the user (2, 2a) based on a camera photo of the user (2, 2a) when the user (2, 2a) is in the building area (12); a storage device (26, 28) in which a plurality of user profiles are stored, wherein each user profile is associated with a user (2, 2a) and comprises a reference face template of the user and content about a communication channel (18) preferred by the user (2a); a communication device (24) configured to send and receive data signals via a communication network (10); and A control and processing device (8), the control and processing device being communicatively connected to the image processing device (22), the storage device (26, 28) and the communication device (24), wherein the control and processing device (8) is configured to: Searching the storage device (26, 28) for a reference face template that matches the real-time face template to a determined degree, and when there is a match, the user (2, 2a) is a registered user (2), reading a user profile of a user (2, 2a) to determine a bidirectional communication channel (18) for private communication between the building system (1) and the user (2, 2a), and If the user profile contains content about a bidirectional communication channel (18) and if the user (2) is carrying a mobile radio device (6), a first data signal is sent by the communication device (24) via the bidirectional communication channel (18) defined for the user (2) to the mobile radio device (6) of the user (2) for transmission there as a message to the user (2), If the user profile does not contain any content about the two-way communication channel (18) or if the user (2a) is not carrying a mobile radio device (6), a first data signal is sent to an information device (14) arranged in the building area (12), A second data signal received by the communication device (24) via the determined bidirectional communication channel (18) is processed, the second data signal relating to a response of the user (2) to the first data signal.

7. The building system (1) according to claim 6, wherein: The two-way communication channel (18) comprises a telephone service, an e-mail service, a multimedia or text message service or a social media service and is available to the user (2) using a mobile radio device (6) carried with him.

8. A building system (1) according to claim 6 or 7, wherein: The control and processing device (8) is communicatively connected to the elevator system (16), and the second data signal represents an elevator call that needs to be transmitted to the elevator system (16).

Images