Building system with credential and body temperature verification features
Patent Information
- Authority / Receiving Office
- HK · HK
- Patent Type
- Patents
- Current Assignee / Owner
- INVENTIO AG
- Filing Date
- 2023-02-13
- Publication Date
- 2026-07-17
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] This disclosure generally relates to elevator systems and their operation, with various embodiments. More specifically, the various embodiments described herein relate to an elevator system that provides improved passenger comfort and reliability when using the elevator, and a method for controlling the operation of such an elevator system. Background Technology
[0002] Multi-story residential and commercial buildings typically have elevator systems to transport users (such as tenants and visitors) from the boarding floor to the destination floor. The elevator systems and elevator control technologies implemented therein are generally known. Some of these buildings may also have physical building control systems to allow only authorized users access to the building and / or areas within the building. When a user presents some form of credentials (e.g., a key, optical code (e.g., barcode, QR code), RFID tag, or biometrics), the physical building control system releases or unlocks physical barriers (e.g., doors, gates, or revolving doors) to grant authorized user access. US 9,077,716 describes a building control system in which a mobile electronic device communicates with an electronic door lock via a Bluetooth or WLAN radio link and with a network server via a WAN (wide area network) radio link to open the electronic lock. For example, one of these building control systems may be configured to automatically enter an authorized user's elevator call based on a default destination stored in a user profile.
[0003] In addition to providing traffic and physical access control, building owners and / or building operators (hereinafter referred to as "building management") also provide a safe and clean environment within the building. Of particular concern are elevator lobbies and elevator cars, where users wait or stand relatively close to each other. In these areas, users may worry that nearby users may have infectious diseases (with or without visible or obvious symptoms) and spread bacteria and / or viruses to healthy users. To address these issues, building management can enhance its cleaning and disinfection efforts and / or establish procedures for building staff to measure users' body temperatures. For this purpose, handheld non-contact infrared thermometers can be used. Users with elevated body temperatures may be screened out.
[0004] Such efforts and procedures can increase user trust when seeking access to restricted building areas or using elevators. However, procedures involving such temperature measurements require building personnel and are relatively slow. Furthermore, individually selecting users may be seen as an invasion of their privacy. Therefore, a technology is needed to overcome at least one of these problems. Summary of the Invention
[0005] One aspect of this technology relates to building systems, particularly elevator systems, physical access control systems, or a combination of elevator and physical access control systems. The building system includes a controller system and a credential acquisition unit. The controller system is configured to control the building system to perform building actions. The credential acquisition unit is communicatively connected to the controller system and configured to acquire credentials presented by a user. The credentials determine whether the user is an authorized user within the building. The building system's camera system has a thermal imaging camera configured to operate in the infrared spectrum and generate an infrared image of at least a portion of the user's face. An image processing system is communicatively connected to the camera system and the controller system. The image processing system is configured to process the infrared image to determine whether it includes an area of the user's face with a temperature value higher than a set threshold temperature value, and generates a first result signal indicating whether the temperature value is higher than the threshold temperature value. The controller system is configured to enable or disable building actions based on the acquired user credentials and the result signal.
[0006] On the other hand, methods for operating building systems are involved, particularly methods for operating elevator systems, physical access control systems, or combined elevator and physical access control systems installed in a building. The building system includes a controller system configured to control the building system to perform building actions, a credential acquisition unit communicatively connected to the controller system, a camera system having a thermal imaging camera configured to operate in the infrared spectrum, and an image processing system communicatively connected to the camera system and the controller system. According to the method, a credential presented by a user is acquired using the credential acquisition unit. The credential determines whether the user is an authorized user within the building. The method includes operating the thermal imaging camera to generate an infrared image of at least a portion of the user's face, and processing the infrared image using the image processing system to determine whether it includes an area of the user's face with a temperature value higher than a set threshold temperature value, and generating a first result signal indicating whether the temperature value is higher than the threshold temperature value. The method includes the controller system further controlling the building system to enable or disable building actions based on the acquired user credential and the first result signal.
[0007] The techniques described herein provide a building system that operates while measuring a user's body temperature in consideration of a user requesting a building action. In some embodiments, this allows for timely identification of users with fever at a relatively early stage, such as at or shortly after the building entrance, particularly before the user mixes with other users in the building when a building action is offered. Therefore, the risk of a feverish user potentially infecting other users is reduced.
[0008] Early measurement of a user's body temperature allows for mitigation measures to be taken. In one embodiment, the building system automatically measures a user's body temperature and reacts based on acquired user credentials and resulting signals. For example, controlling the building system involves registering an elevator call only if the user is an authorized user and the temperature value is below a threshold temperature value. However, if the measured body temperature is elevated due to the user having a fever, i.e., above a set threshold temperature value, the building system may have one or more pre-defined (mitigation) procedures to respond to such a feverish user.
[0009] In one embodiment, a relief procedure is performed in response to a first result signal indicating that the user's facial temperature is higher than a threshold temperature value. The relief procedure includes one of the following operations:
[0010] -Refuse actions targeting the user's building.
[0011] -Disable the user terminal used for elevator calls entered by the user.
[0012] - Enable user terminals for elevator calls entered by the user and avoid registering elevator calls.
[0013] - Notify the user to undergo secondary treatment, and if the result of the secondary treatment is that the user's body temperature does not rise, provide the user with a secondary authorization credential authorizing access to the building services without travel restrictions, and
[0014] - Notify the user to undergo secondary processing, and if the secondary processing confirms that the user's body temperature is elevated, provide the user with a secondary credential authorizing access to the building services with travel restrictions, wherein the travel restrictions include assigning an empty elevator car to the user or assigning the user an elevator car that will be designated for transporting other users with elevated body temperatures.
[0015] One or more of these procedures may be implemented in a building, depending on how the building management decides to handle users with fevers.
[0016] In one embodiment, the credential acquisition unit and camera system are located within a user terminal that is accessible to the user. This facilitates the measurement of the user's body temperature when the user requests building movement. In another embodiment, the camera system may be located at a position spaced apart from the location where the user terminal is located.
[0017] The techniques described herein offer flexibility regarding the types of credentials used in buildings. A credential acquisition unit may include at least one of the following: a radio-frequency reader configured to read encoded information from a radio-frequency-based data carrier; a scanner configured to process optical codes read from a data carrier; and an image capture device configured to acquire biometric credentials. At least some of these exemplary credential acquisition units can be used without the user physically touching a user terminal accessible to all users. This contactless credential acquisition reduces the risk of bacteria or viruses spreading from one user to another.
[0018] In one embodiment, a user's face serves as a biometric credential that can be obtained without the user touching a user terminal or similar object. To this end, the credential acquisition system includes an image capture device configured to operate in the visible light spectrum and generate a digital image of at least a portion of the user's face. An image processing system is configured to generate a real-time facial template of the user's facial features from the digital image, compare the real-time facial template with a plurality of stored reference facial templates of the authorized user's facial features, and generate a second result signal indicating whether the real-time facial template matches one of the reference facial templates. A controller system is configured to enable or disable building actions based on the first and second result signals.
[0019] In one embodiment, the building system includes a storage device with a database storing multiple user profiles. Each user profile is assigned to a user authorized to enjoy at least one prescribed building action. The storage device may be located centrally within the building or remotely and may be accessible via a communication network. In another embodiment, user profiles may be created and stored in a database of the building management system, which may be accessible via a communication network. Flexibility exists regarding where user profiles are maintained.
[0020] User profiles can be used for various purposes. In some embodiments, at least one user profile includes a reference facial template of an authorized user, and at least one user profile also includes at least one access permission and / or at least one default destination floor.
[0021] In one embodiment, the user terminal includes a first credential reader comprising a radio frequency (RF) module configured to communicate with an RF module of a first data carrier presented by the user. In another embodiment, the user terminal further includes a second credential reader comprising a camera configured to acquire an optical code from a second data carrier presented by the user. In some embodiments, these additional credential readers allow the user to access building activities after secondary processing, even if initially (potentially incorrectly) identified as unauthorized or with elevated body temperature.
[0022] In one embodiment, the building system includes an information device configured to generate an alarm signal if the user is not an authorized user based on credentials presented to a credential acquisition unit and / or if the temperature value exceeds a threshold temperature value. The alarm signal can be used to notify the user and / or, for example, building personnel. In some embodiments, building personnel can then allow the user to undergo secondary processing. Attached Figure Description
[0023] The various aspects of the improved technology are described in more detail below with reference to the accompanying drawings and exemplary embodiments. In the drawings, the same elements have the same reference numerals. In the drawings:
[0024] Figure 1 A schematic diagram illustrating an exemplary situation in a building with a building system is shown;
[0025] Figure 2 It shows Figure 1 A schematic diagram of an exemplary embodiment of one aspect of the building system shown; and
[0026] Figure 3 A flowchart illustrating an exemplary embodiment of a method for operating a building system is shown. Detailed Implementation
[0027] Figure 1 This is a schematic diagram of an exemplary embodiment of building system 1. Building system 1 can be configured for various applications. For example, building system 1 may include an elevator system to transport user 2 from an access floor to a destination floor within the building. An elevator controller (ECS) controls the operation of the elevator system. In another example, building system 1 may include a physical access control system to control access to restricted areas of the building. For example, access may be controlled at the building entrance, in designated restricted areas within the building, and / or at building floors (e.g., lobbies) where user 2 can transfer to and from the elevator. An access controller (ACS) controls the operation of the physical access control system. It is conceivable that a building may be equipped with one of these systems, or both an elevator system and a physical access control system; the latter, such as... Figure 1 As shown. In the illustrated embodiment, building system 1 performs elevator control functions (e.g., transporting user 2 from the boarding floor to the destination floor) and access control functions (e.g., granting user 2 access to restricted areas and / or elevators), which is an example of building operations.
[0028] exist Figure 1In the exemplary embodiment shown, the building has an access-restricted area 8 and an unrestricted area 10; area 10 is also referred to as public area 10. Access-restricted area 8 may be an elevator lobby where user 2 transitions to one or more elevator cars or from one or more elevator cars. In another embodiment, access-restricted area 8 may be a lobby leading to room 14, such as an office, apartment, or hallway. Hereinafter, room 14 refers to an elevator car, and embodiments of the technology are described with reference to elevator car 14. Entrance 12 (with or without a physical barrier) separates public area 10 from access-restricted area 8.
[0029] First, referring to physical access control, the access control function of building system 1 controls access to restricted areas 8 so that only authorized user 2 can enter area 8. If the credentials presented by user 2 (e.g., key, (α-)digital code, optical code (e.g., barcode, QR code), RFID tag, or biometrics) are determined to be valid, user 2 is authorized. For example, entrance 12 may be equipped with barriers controlled by building system 1 (e.g., doors, gates, revolving doors, or other physical or non-physical (e.g., light / sensor barriers) barriers). For illustrative purposes, user terminal 4 of building system 1 is as follows: Figure 1 The entrance 12 is shown; furthermore, the revolving door 16 is shown as an exemplary physical barrier. For example, the user terminal 4 may be positioned at the main door or revolving door 16. Those skilled in the art will recognize that, in certain embodiments, the user terminal 4 may be arranged in different ways and at different locations.
[0030] In another exemplary embodiment, the user terminal 4 of the building system 1 may be located at an entrance leading to at least one room 14, possibly at each entrance. Depending on the nature of the room 14, the entrance may include, for example, an office door, a floor door, an apartment door, or an elevator door 19, where each door represents a physical barrier. In this exemplary embodiment, each room 14 corresponds to an access restriction area 8, and the area in front of the entrance corresponds to a public area 10. Hereinafter, the room 14 is also referred to as "elevator car 14". In response to determining that the presented credentials are valid, the access control function of the building system 1 unlocks, for example, the electronic lock of an office door or apartment door. In elevator-related applications, for example, when an unauthorized user 2 (i.e., user 2 does not present credentials or presents invalid credentials) enters or wishes to enter the elevator car 14, the building system 1 may prevent the elevator car from leaving.
[0031] Referring to the elevator control function of building system 1, an elevator call can be registered for user 2 approximately when user 2 presents a valid credential. Once the credential is confirmed to be valid, the elevator control panel (e.g., provided by terminal 4) can be switched to an enabled (unlocked) state to allow user 2 to enter an elevator call. Depending on the control technology implemented in the elevator system (conventional up / down control or destination calling technology), user 2 can enter the desired direction of travel (up or down) or destination floor at the enabled elevator control panel. Alternatively, if the credential is valid, an elevator call can be entered automatically for user 2; the elevator call can be based on a default destination floor stored in the user profile set for user 2. In one embodiment, user 2 can change the default destination floor at the elevator control panel. In response to an elevator call entered in one of these possibilities, the elevator controller registers the elevator call and initiates its execution.
[0032] like Figure 1 As shown in the embodiment, the user terminal 4 of the building system 1 is located at entrance 12 and is communicatively connected to network 22. Network 22 communicatively connects the user terminal 4 to controller system 18, which is configured to control the building system 1 to perform building actions. The illustrated user terminal 4 includes a camera system 24 and a processing system (CPU) 6, an information device 20, and a communication unit (COM) 30 connecting the user terminal 4 to controller system 18, which are part of an image processing system. The image processing system (6, 24) is configured as a facial recognition system. Figure 1 (represented by facial symbol 26) and thermal imaging system ( Figure 1 The operation is performed using the temperature symbol 28. Therefore, in the example shown, user terminal 4 includes components of a facial recognition system and a thermal imaging system. Other components of user terminal 4 include... Figure 2 As shown, and described below.
[0033] A facial recognition system is an example of a credential acquisition unit 24a, which is as follows: Figure 2 The credential acquisition unit is shown and communicatively connected to the controller system and configured to acquire credentials presented by the user. The credentials determine whether the user is an authorized user within the building. Those skilled in the art will understand that other examples of the credential acquisition unit can be used to verify authorization, such as a radio frequency based reader (RFID reader) configured to read encoded information from a radio frequency based data carrier, a scanner configured to process optical codes read from a data carrier, or a keyboard for inputting numeric codes. In embodiments of the present technology described below, the credential acquisition unit 24a is configured for a facial recognition system.
[0034] A facial recognition system is a technology capable of identifying or verifying a user from digital images or video frames generated by a video source operating in the visible light spectrum. Typically, a facial recognition system compares selected facial features from a given image with facial features (“faces”) stored in a database. A thermal imaging system is a technology that uses a thermal imaging camera (also known as an infrared camera or thermal imager) to create an image of an object (here, the user's face) based on the infrared radiation emitted by the object (wavelengths ranging from about 1 μm to about 14 μm).
[0035] When user 2 approaches user terminal 4 at entrance 12 and the user's face is within the detection range of camera system 24, camera system 24 operates according to these techniques. The image generated by camera system 24 is then further processed. In the illustrated embodiment, camera system 24 (including other components of the image processing device) is arranged within user terminal 4; preferably, this arrangement allows for an unobstructed view of user 2. Alternatively, camera system 24 (including other components of the image processing device) may be positioned as a separate unit spaced apart from user terminal 4, for example, spatially spaced apart from user terminal 2 in the area surrounding entrance 12. In one embodiment, camera system 24 is positioned such that essentially only one user 2 is detected, who actually expects a service or building action (delivery or access) provided by building system 1.
[0036] exist Figure 1 In the illustrated scenario, the techniques described herein can be advantageously used to operate building system 1 with minimal human interaction and to enable user 2 to operate building system 1 in a manner that allows for greater confidence in using one or more building actions provided by building system 1. Briefly summarizing and illustratively, according to an exemplary embodiment, building system 1 processes images generated by camera system 24 to determine whether user 2 is an authorized user and whether user 2 is not feverish (i.e., no fever / elevated body temperature). That is, only if both conditions are met can user 2 seamlessly continue using building actions. For example, building system 1 then automatically registers an elevator call for user 2 to a default destination floor, or user terminal 4 used by user 2 is able to input an elevator call. If an elevated temperature is detected, call input and / or call registration are blocked. For example, if building system 1 determines that user 2's body temperature has risen, it notifies building personnel to handle the situation; for example, user 2 may undergo secondary processing separate from other users 2, as described elsewhere herein. Figure 2A schematic diagram illustrating an exemplary embodiment of one aspect of building system 1 (i.e., the aspect related to interaction with user 2) is shown. In one exemplary embodiment, building system 1 has a modular structure and includes components and subsystems that can be arranged according to the required configuration of building system 1. Some components may be arranged within user terminal 4, while others may be arranged remotely from user terminal 4; for example, all or some tasks related to image processing may be performed at a central location serving multiple user terminals 4 (within or away from the building).
[0037] like Figure 2 As shown, building system 1 includes camera system 24, storage device 36 storing database 38, processor 40, and image processing module 32 communicatively connected to camera system 24, storage device 36, and processor 40. Information device 20 and communication unit 30 communicatively connected to processor 40 are also shown. Camera system 24 has image capture device 24a (labeled "Vis") and thermal imaging camera 24b (labeled "IR"). In one embodiment, image capture device 24a is a digital camera (it may also be a point projection sensor); hereinafter, image capture device 24a is referred to as "digital camera 24a". Digital camera 24a is configured to operate in the visible light spectrum (wavelengths between about 400 nm and about 800 nm) and generate a digital image of at least a portion of the face of user 2. Thermal imaging camera 24b is configured to operate in the infrared spectrum (wavelengths between about 1 μm and about 14 μm) and generate an infrared image of at least a portion of the user's face.
[0038] The digital camera 24a may have selectable and / or adjustable features; therefore, the camera image is presented as a digital dataset in this exemplary embodiment. Attributes of the digital camera, such as resolution (e.g., in megapixels), exposure, and focal length, are selected or set so that the camera image (digital image) can be evaluated, and the user's face can be identified on the digital image in a manner with assessable quality. For example, the digital image is in JPEG format, but it can also be in other formats, such as BMP format, JPEG2000 format, or a base64 image string.
[0039] The thermal imaging camera 24b may have an image sensor unit that generates monochrome images or a color image unit that generates color images. Images generated by such a sensor unit detect changes in infrared radiation emitted from the entire user's face. Changes in intensity are related to temperature changes across the entire user's face, with the highest intensity typically indicating the highest temperature. To ensure that the thermal imaging camera 24b can accurately measure the radiation it detects, the thermal imaging camera 24b is calibrated. Calibration is the process of associating the image sensor's "seeing" (infrared radiation) with known temperatures (e.g., selected for measurements within a specific temperature range). For example, for human applications, the temperature range could be between 20°C and 50°C.
[0040] Camera system 24 may be equipped with a sensor module or may be connected to a separate sensor module that activates camera system 24 when the sensor module detects the presence of user 2 within its detection area. The sensor module may include, for example, a proximity sensor, which may be designed as an ultrasonic sensor, an infrared sensor, or an optical sensor (e.g., a light barrier, a brightness sensor). Alternatively, camera system 24 may be used to identify the presence of user 2 within its detection area. For example, if user 2 enters the detection area and camera system 24 remains operational, camera system 24 records changes against a substantially static background; these changes indicate the presence of the user.
[0041] For each registered user 2, a user profile is created in building system 1, i.e., stored as a dataset in database 38. In the illustrated embodiment, database 38 is established on storage device 36 or other digital data storage device for digital data. Storage device 36 can be any device configured to store digital data, such as a hard disk drive (HDD) or CD / DVD drive, semiconductor drive / solid-state drive (SSD), or a combination thereof. The user profile includes user 2's personal data (e.g., name, reason for authorization (resident, employee, external service provider), and facial features in the form of a facial template), access authorization (e.g., specific room 14 and floor), and possible temporary access restrictions (e.g., from Monday to Friday, from 7:00 AM to 8:00 PM). As an alternative to creating user profiles in building system 1, user profiles can be created in a database of a building management system, which building system 1 can access via a communication network. Figure 2 In this context, storage device 36 is connected to image processing device 32 to indicate that image processing device 32 accesses user files. However, it is conceivable that, for example, since storage device 36 is located remotely, storage device 36 could instead be connected to processor 40 or communication unit 30.
[0042] Image processing module 32 is configured to process digital images generated by digital camera 24a by executing computer-aided methods for image processing. Image processing methods are known, for example, from U.S. Patent No. 8,494,231 B2. The publication "Gesichtserkennung" ["Facial Recognition"] (available at www.bsi.bund.de under the Biometrics section) of the German Federal Office for Information Security describes an introduction to the field of image processing for facial recognition. This publication distinguishes three main steps: "creating templates," "creating reference datasets," and "comparing facial images." To make the comparison of two facial images as simple and fast as possible, facial features are determined and stored in the form of a feature dataset called a "template." Once a face on a user image has been identified and normalized, features other than the eyes, nose, and mouth / chin are sought, measured, and correlated. These extracted features are encoded, compressed, and stored as a feature dataset (template). The similarity of two facial images is determined by combining their templates using mathematical algorithms. This produces a degree of similarity between the templates. If the results are within a certain tolerance range, the two templates and their underlying facial images are classified as the same.
[0043] like Figure 2 As shown, the image processing module 32 is communicatively connected to the storage device 36. At least some user profiles stored in the database 38 include facial templates of each user 2. For example, a facial template can be generated when user 2 registers as an authorized user 2. These stored facial templates are referred to as reference facial templates. The image processing module 32 is configured to access the storage device 36 and the database 38 to search for reference facial templates that can be classified as identical to the real-time facial template of user 2 generated when user 2 approaches the digital camera 24a. The image processing module 32 generates a result signal indicating whether such reference facial templates are stored in the database 38.
[0044] Referring to the infrared image generated by the thermal imaging camera 24b, the image processing module 32 is configured to process the infrared image. This processing includes comparing the temperature corresponding to the intensity of the entire user's face with a threshold temperature value. For example, the threshold temperature value is set to 37.5°C. If the image processing module 32 determines that the temperature of a region of the user's face deviates from the normal body temperature of approximately 37°C, for example, equal to or higher than the threshold temperature value, then the user is considered to have a condition accompanied by elevated body temperature (fever). The image processing module 32 generates a result signal indicating whether the user has an elevated temperature.
[0045] Therefore, the image processing system is configured to generate two result signals; one is based on a comparison between a real-time facial template of user 2 and a reference facial template to indicate whether user 2 is authorized. In this authorization verification process, the user's face serves as a biometric credential implemented in building system 1. The other result signal is based on a comparison between the temperature corresponding to the infrared radiation intensity of the entire user's face and a threshold temperature value to indicate whether user 2 has a condition involving elevated body temperature. Image processing module 32 sends the result signals to processor 40 for further analysis.
[0046] Processor 40 is configured to analyze the received result signal according to a predetermined algorithm. For example, if the result signal indicates that user 2 is authorized and his / her body temperature is not elevated, the algorithm determines that a building action can be performed. However, if the result signal indicates that user 2 is not identified as authorized or user 2's body temperature is elevated, the algorithm determines that a building action cannot be performed for user 2. In one embodiment, the algorithm may allow an unauthorized user 2 with an elevated body temperature to make a call to, for example, a public floor, but require user 2 to proceed alone, for example, by assigning an empty elevator car 14 to the unauthorized user. Processor 40 is configured to transmit the analysis result to controller system 18 via communication unit 30, controller system 18 being configured to enable or disable building actions based on a first result signal and a second result signal. For example, controller system 18 controls building system 1 to allow or deny user 2 access. For example, if a physical barrier (e.g., Figure 1 If a revolving door (36) separates areas 8 and 10, a control signal will release or block the barrier. Depending on the building system, authorized access may include registering an elevator call for user 2, or if no access control is provided, building actions may involve registering an elevator call.
[0047] In the illustrated embodiment, processor 40 is configured to indicate analysis results via information device 20. Information device 20 can be arranged and configured according to building system 1. Information device 20 can be noticed by user 2 and / or, for example, building personnel (via audio and / or vision); it can display text, symbols, or pictographs, or generate different colored lights (e.g., a green light indicating that user 2 can continue). For example, if the aforementioned area separation occurs without physical barriers, in the case of an unauthorized or feverish user 2, control signals activate, for example, information device 20 to generate an alarm or alert building personnel. Exemplary usage examples are described elsewhere in this document.
[0048] exist Figure 2In the illustrated embodiment, building system 1 includes additional mechanisms for obtaining user credentials. A first credential reader (42, 44) is connected to processor 40 and configured to read data from a first data carrier 48 presented by user 2. The first credential reader includes an RF module 42 and an antenna 44; in one embodiment, the first credential reader is configured as an RFID reader, and the first data carrier 48 is an RFID transponder. A second credential reader 46 is connected to processor 40 and configured to read optical codes from a second data carrier 34 presented by user 2. The second credential reader 46 may include a camera or scanner to read barcodes, quick-response (QR) codes, color codes, or any other optical images printed or displayed on the second data carrier 34 (e.g., configured as a tag, remote key, or smartphone). Although Figure 2 Two credential readers are shown, but it is conceivable that only one, or none at all, may be provided. For example, if an unregistered user (e.g., a visitor) requests a building action or facial recognition fails to identify a registered user, both credential readers can serve as backup credential readers. Exemplary use cases are described elsewhere in this document.
[0049] Having understood the basic system components and their functions mentioned above, the following section combines... Figure 3 A description of an exemplary method for operating building system 1 is provided. This description refers to a user 2 who wishes to access a restricted area 8 at entrance 12, for example, to use an elevator there. The exemplary method shown begins with step S1 and ends with step S12.
[0050] In step S2, user 2 is detected. As described above, user 2 can be detected by camera system 24 or sensor system when user 2 is in the detection area. For example, if user 2 wishes to access restricted area 8, user 2 will move in public area 10, for example, moving from the main entrance of the building along the direction of entrance 12. User terminal 4 and / or camera system 24 may be in a non-operating or standby state and may be activated by an approaching user; alternatively, user terminal 4 and / or camera system 24 may always be in an operating state.
[0051] Proceeding to step S3, the user's face is scanned. Scanning the user's face obtains the user's credentials (face) and the temperature distribution of the entire face. When user 2 enters the detection area of the camera system 24 located there, digital camera 24a generates one or more digital images or video recordings, each of which is available as a digital dataset and temporarily stored for further processing. Essentially simultaneously, thermal imaging camera 24b generates an infrared image. This infrared image can be temporarily stored for further processing. Image processing module 32 determines a real-time template based on the dataset, as described elsewhere in this specification.
[0052] Proceed to step S4 to determine if the user's body temperature is within a preset temperature range. The temperature range can be set between approximately 36°C and 37.5°C. If the user's body temperature is within the range, meaning the user 2 does not have a condition involving a body temperature deviating from the normal range of approximately 37°C (especially an elevated body temperature), the method proceeds along the "Yes" branch to step S5; otherwise, the method proceeds along the "No" branch to step S8.
[0053] Proceeding to step S5, determine whether user 2 is authorized. If a real-time template for user 2 has been determined (step S3), the image processing module 32 initiates a search algorithm to check whether the determined real-time template has been assigned to a registered user. For example, the user profile in database 38 is searched using the determined real-time template. During the search, it is checked whether the real-time template matches a reference template to a predetermined degree. In an exemplary embodiment, the real-time template and the reference template each include a predetermined number of predetermined facial parameters and their values (e.g., eye distance, mouth width, distance between the upper and lower edges of the lips, distance between the nose and the lower edge of the lips, etc.). During the search, the parameter values of the real-time template are compared with the parameter values of the reference template. A match exists when the similarity of the templates is at least equal to the predetermined degree. The predetermined degree indicates the percentage of match between the facial parameters of the real-time template and the facial parameters of the reference template. The predetermined degree can be selected according to accuracy requirements, for example, between approximately 60% and approximately 90%. The image processing module 32 generates a result signal indicating whether user 2 is authorized, which is sent to the processor 40. If user 2 is identified as an authorized user, the method proceeds to step S6 along the "yes" branch; otherwise, the method proceeds to step S8 along the "no" branch.
[0054] In step S6, a building action is registered for user 2. Processor 40 analyzes the result signal and sends the result to controller system 18. Depending on the building and the implemented building system 1, the building action can be an elevator call, access permission, and / or a combination of elevator call and access permission.
[0055] Proceed to step S7 to execute building actions. For example, control system 18 releases the entrance barrier, assigns an elevator to serve an elevator call, and moves elevator car 14 according to the assignment. The method ends at step S12.
[0056] As described above, if the user's body temperature is outside the preset temperature range, for example, due to user 2 having a fever or due to an incorrect measurement, the method proceeds to step S8. Processor 40 is configured to generate an alarm signal, which can be sent to information device 20. In response, information device 20 can generate an alarm that user 2 and / or, for example, building personnel can see and / or hear. In one embodiment, building actions against user 2 can be denied without further action; the method can then terminate at step S12.
[0057] In another embodiment following the alarm generated in step S8, the method may initiate secondary processing. For example, building personnel may approach user 2 and perform an additional temperature measurement on user 2. This can be done using a handheld non-contact infrared thermometer. If the additional measurement does not indicate an elevated temperature (i.e., the infrared measurement is incorrect), building personnel may verify user 2's authorization (e.g., by checking an ID card), and if user 2 is authorized, issue an alternative credential that can be linked to the user's profile. The alternative credential may be an access code (e.g., in the form of an optical code), which may be printed on an access card, stored on an RFID-enabled access card, or sent to the user's mobile phone for display. User 2 may then present the alternative credential to the corresponding secondary reader 42, 46, and the method proceeds to step S6. The alternative credential may expire (i.e., become invalid) after it has been presented once or after a set period of time (e.g., a few minutes).
[0058] However, additional measurements can confirm that User 2's body temperature is elevated. In this case, building personnel must also verify that the user is authorized and issue a substitute credential, as described above. However, in one embodiment, if User 2 wishes to use the elevator, the substitute credential is linked to a transport restriction. For example, the transport restriction might require (feverish) User 2 to travel alone in elevator car 12 to reduce the risk of the user infecting other users, or require User 2 to travel in elevator car 14 with other users 2 who also have elevated body temperatures. The transport restriction can be encoded in the substitute credential (access code) or stored in the user's profile. When User 2 subsequently presents the substitute credential to the corresponding secondary reader 42, 46, the method proceeds to step S6, where a building action is registered based on the transport restriction. That is, for example, the controller system 18 allocates an empty elevator car 14 to User 2 and moves the elevator car to User 2's desired destination floor without any intermediate stops.
[0059] User authorization verification based on facial recognition technology can be error-prone. For example, this could be due to changes in the user's appearance (e.g., due to a hat, beard, or sunglasses), shadows, incomplete facial view, or poor lighting. If such an error occurs, User 2 is not identified as an authorized user, and the method proceeds along the "No" branch to step S8. Similar to the processing of a detected elevated body temperature, processor 40 is configured to generate an alarm signal, which can be sent to information device 20 as described above if User 2 cannot be authorized in step S5. In response, building personnel can approach User 2 and perform personal verification (e.g., by checking an ID card). If User 2 is authorized, an alternative credential can be issued, which can be linked to the user's profile, as described above. User 2 can present the alternative credential to the corresponding secondary readers 42, 46, and the method proceeds to step S6. If it is determined that User 2 is not authorized, any building action against User 2 is refused, and the process ends in step S12.
[0060] In one embodiment, the method can be modified to provide additional temperature measurements. This is in Figure 3 The steps S9-S11 are described in the text; these steps are assumed to be optional. In one embodiment, the additional temperature measurement can be performed in the elevator car 14, i.e., when the user 2 has already boarded the elevator car 14. In another embodiment, the additional temperature measurement can occur at the elevator door 19 or in the immediate vicinity in front of the elevator door 19, i.e., when the user 2 is about to board the elevator car 4. To perform the additional temperature measurement, for example, another thermal imaging camera 21 is installed at the elevator door 19 or inside the elevator car 14. As described above, the analysis of the infrared image generated by the thermal imaging camera 24 corresponds to the analysis of the infrared image generated by the thermal imaging camera 24b.
[0061] Referring to step S9, determine whether the body temperature of any user 2 who has boarded or is about to board the elevator car 14 is within the preset temperature range. If so, the method proceeds along the "yes" branch to step S7; otherwise, the method proceeds along the "no" branch to step S10.
[0062] In step S10, any building action that has started or is about to start is interrupted. For example, if an elevator call has been registered in step S6 and the assigned elevator car 14 is about to depart from the boarding floor, the departure of elevator car 14 is prevented. In one embodiment, building personnel may be notified, and they can then perform secondary processing as shown in step S11. Building personnel may, for example, check the body temperature of any current users and only release elevator car 14 from the blocked state if the situation has been clarified. If this is not feasible, the building action can be abandoned; otherwise, the method proceeds to step S7.
[0063] The additional temperature measurement described in steps S9-S11 provides an additional level of confidence. For example, it reduces the risk involved when other users follow user 2, whose body temperature was not checked.
[0064] According to the foregoing description of various embodiments of the improved technology, building system 1 can respond to feverish user 2 by executing one or more predetermined (mitigation) procedures. Such mitigation procedures may include:
[0065] - Deny building actions for User 2 or users of the elevator system; for example, deny User 2 access to the building or access to restricted areas.
[0066] -Disable user terminal 4 used for elevator call input by user 2.
[0067] - Enable user terminal 4 for elevator call input by user 2 and prevent elevator call registration, wherein in the aforementioned example, user 2 can be notified (e.g., via information device 20) of the rejection or inability to input elevator call.
[0068] -(For example, via information device 20) Notify user 2 to undergo secondary treatment, for example, provided by building personnel, and if the result of the secondary treatment is that user 2's body temperature does not rise, provide user 2 with a secondary certificate authorizing access to building services without travel restrictions, and
[0069] - (e.g., via information device 20) Notify user 2 to accept secondary treatment, for example, provided by building personnel, and if the secondary treatment confirms that user 2's body temperature is elevated, provide user 2 with a secondary credential authorizing access to building services with travel restrictions, wherein the travel restrictions include allocating an empty elevator car 14 to user 2 or allocating user 2 to an elevator car 14 that will be designated for transporting other users with elevated body temperatures.
[0070] One or more of these procedures may be implemented in a building, depending on how the building management decides to handle users with fevers.
[0071] In the foregoing description, secondary processing according to certain embodiments involves actions performed by building personnel. It is conceivable that in other embodiments, secondary processing may not involve building personnel, or may involve them only to a reduced or minimal extent. In one embodiment, a self-service terminal (also known as a self-service checkpoint) may be provided in the building. During secondary processing, User 2 may be asked to proceed to such a self-service terminal and undergo a (re)check. In another embodiment, a robot may be provided to assist or perform secondary processing. The robot may approach User 2 with an elevated temperature, or User 2 may need to go to the robot to have their temperature measured. It is also conceivable that a self-service terminal or robot may be used in the event that User 2's initial authentication fails. For these purposes, the self-service terminal or robot is equipped with appropriate mechanisms for measuring body temperature. Furthermore, the self-service terminal or robot may be configured to issue secondary credentials (i.e., print a QR code, update a record, etc.).
Claims
1. A building system (1), the building system comprising: A controller system (18) configured to control the building system (1) to perform building actions; A credential acquisition unit (24a) is communicatively connected to the controller system (18) and configured to acquire a credential presented by a user (2), wherein the credential determines whether the user (2) is an authorized user (2) within the building. A camera system (24) having a thermal imaging camera (24b) configured to operate in the infrared spectrum and generate an infrared image of at least a portion of the face of the user (2); An image processing system (6), communicatively connected to the camera system (24) and the controller system (18), wherein the image processing system (6) is configured to process the infrared image to determine whether the infrared image includes a region of the user's face with a temperature value higher than a set threshold temperature value, and to generate a first result signal indicating whether the temperature value is higher than the threshold temperature value; and The controller system (18) is configured to enable or disable the building action based on the acquired user credentials and the first result signal. The controller system (18) is configured to execute a mitigation procedure in response to a first result signal indicating that the temperature value of the user's face is higher than the threshold temperature value, wherein the mitigation procedure includes: - Notify the user (2) to undergo secondary processing, and if the result of the secondary processing is that the user (2)'s body temperature does not rise, provide the user (2) with a secondary certificate authorizing the provision of building services without travel restrictions, and if the secondary processing confirms that the user (2)'s body temperature has risen, provide the user (2) with a secondary certificate authorizing the provision of building services with travel restrictions, wherein the travel restrictions include allocating an empty elevator car (14) to the user (2) or allocating the user (2) an elevator car (14) that will be designated for transporting other users with elevated body temperatures.
2. The building system (1) according to claim 1, wherein, The credential acquisition unit (24a) and the camera system (24) are arranged in the user terminal (4) that the user (2) can use.
3. The building system (1) according to claim 1 or 2, wherein, The credential acquisition unit (24a) includes at least one of a radio frequency-based reader, a scanner, and an image capture device, wherein the radio frequency-based reader is configured to read encoded information from a radio frequency-based data carrier (48), the scanner is configured to process optical codes read from the data carrier (34), and the image capture device is configured to acquire biometric credentials.
4. The building system (1) according to claim 1 or 2, wherein, The credential acquisition unit (24a) includes an image capture device configured to acquire biometric credentials, wherein the image capture device is arranged in the camera system (24) and is communicatively connected to the image processing system (6).
5. The building system (1) according to claim 4, wherein, The image capture device is configured to operate in the visible light spectrum and generate a digital image of at least a portion of the user's face. The image processing system (6) is configured to generate a real-time facial template of the user's (2) facial features from the digital image, compare the real-time facial template with a plurality of stored reference facial templates of the authorized user's facial features, and generate a second result signal indicating whether the real-time facial template matches one of the reference facial templates. The controller system (18) is configured to enable or disable the building action based on the first result signal and the second result signal.
6. The building system (1) according to claim 5 further includes a storage device (36) comprising a database (38) storing a plurality of user profiles, each user profile being assigned to a user (2) authorized to enjoy at least one prescribed building action.
7. The building system (1) according to claim 6, wherein, At least one user profile in the user profile includes a reference facial template of an authorized user (2), wherein the at least one user profile includes at least one access permission, and / or wherein the at least one user profile contains at least one default destination floor.
8. The building system (1) according to claim 7, wherein, The user terminal (4) further includes a first credential reader, which includes a radio frequency module (42) configured to communicate with a radio frequency module of a first data carrier (48) presented by the user (2); and / or, wherein the user terminal (4) further includes a second credential reader (46) which includes a camera configured to acquire optical codes from a second data carrier (34) presented by the user (2).
9. The building system (1) according to claim 1 or 2 further includes an information device (20) configured to generate an alarm signal if the user (2) is not an authorized user based on the credential presented to the credential acquisition unit (24a), and / or if the temperature value is higher than the threshold temperature value.
10. The building system (1) according to claim 1 or 2, wherein, The building action involves registering an elevator call, wherein the elevator call is registered only if the user (2) is an authorized user and the first result signal indicates that the temperature value is below the threshold temperature value.
11. The building system (1) according to claim 1 or 2, wherein, The mitigation procedure also includes one of the following operations: - Deny the building action for the user (2). - Disable the user terminal (4) used for elevator calls input by the user (2). - Enable the user terminal (4) for the elevator call input by the user (2) and prevent the registration of the elevator call.
12. The building system (1) according to claim 1 or 2, wherein, The building system (1) is an elevator system, a physical access control system, or a combination of elevator and physical access control system.
13. A method of operating a building system (1), the building system (1) comprising: A controller system (18) configured to control the building system (1) to perform building actions; a credential acquisition unit (24a) communicatively connected to the controller system (18); and a camera system (24) having a thermal imaging camera (24b) configured to operate in the infrared spectrum. and an image processing system (6), the image processing system being communicatively connected to the camera system (24) and the controller system (18), the method comprising: The credential acquisition unit (24a) is used to acquire a credential presented by the user (2), wherein the credential determines whether the user (2) is an authorized user (2) in the building. Operate the thermal imaging camera (24b) to generate an infrared image of at least a portion of the user's (2) face; The infrared image is processed using the image processing system (6) to determine whether the infrared image includes a region of the user's face with a temperature value higher than a set threshold temperature value, and to generate a first result signal indicating whether the temperature value is higher than the threshold temperature value; and The controller system (18) controls the building system (1) to enable or disable building actions based on the acquired user credentials and the first result signal. The control system for the building includes executing a mitigation procedure in response to a first result signal indicating that the temperature value of the user's face is higher than the threshold temperature value, wherein the mitigation procedure includes: - Notify the user (2) to undergo secondary processing, and if the result of the secondary processing is that the user (2)'s body temperature does not rise, provide the user (2) with a secondary certificate authorizing the provision of building services without travel restrictions, and if the secondary processing confirms that the user (2)'s body temperature has risen, provide the user (2) with a secondary certificate authorizing the provision of building services with travel restrictions, wherein the travel restrictions include allocating an empty elevator car (14) to the user (2) or allocating the user (2) an elevator car (14) that will be designated for transporting other users with elevated body temperatures.
14. The method of claim 13, further comprising: The image processing system (6) processes a digital image of at least a portion of the user's face, wherein the digital image is generated by an image capture device configured to operate in the visible light spectrum. The process includes: generating a real-time facial template of the user's (2) facial features from the digital image; comparing the real-time facial template with a plurality of stored reference facial templates of the authorized user's facial features; and generating a second result signal indicating whether the real-time facial template matches one of the reference facial templates. The controller system (18) is configured to enable or disable the building action based on the first result signal and the second result signal.
15. The method according to any one of claims 13-14, wherein, The control system for the building includes registering an elevator call only when the user (2) is an authorized user and the temperature value is below the threshold temperature value.
16. The method according to any one of claims 13-14, wherein, The mitigation procedure also includes one of the following operations: - Deny the building action for the user (2). - Disable the user terminal (4) used for elevator calls input by the user (2). - Enable the user terminal (4) for the elevator call input by the user (2) and avoid registering the elevator call.
17. The method according to any one of claims 13-14, wherein, The building system (1) is an elevator system, a physical access control system, or a combination of elevator and physical access control systems installed in the building.