Facial recognition system and temperature measurement method

Abstract

To provide a face authentication system capable of performing thermometry of a person at an appropriate position.SOLUTION: A face authentication system includes: a marker; a first imaging section that generates first image data of a visible light region and temperature distribution data of an infrared light region corresponding to the first image data; a second imaging section that is arranged to include the marker in an angle of view and generates second image data of the visible light region; a marker determination section that determines whether or not the marker in the second image data is detected; a face information generation section that generates face information of a person from the first image data; and a temperature information generation section that generates temperature information including temperature of the person from the temperature distribution data on the basis of the face information. When the marker determination section detects the marker, the face information and the temperature information are generated.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to a face recognition system for measuring a person's temperature. Also, an embodiment of the present invention relates to a method for measuring a person's temperature using a face recognition system. [Background technology]

[0002] Conventionally, there has been known a method of managing admission of visitors by using a so-called walk-through type face authentication system that photographs a person walking and performs face authentication of that person (see, for example, Patent Document 1). A walk-through type face authentication system can complete the authentication process by the time a walking person (visitor) reaches the entrance gate, and can determine whether or not to permit admission to the visitor. Therefore, a walk-through type face authentication system can be said to be highly convenient with less of a burden on visitors.

[0003] In recent years, there have been an increasing number of cases where people's body temperatures are measured and entrance is controlled in order to prevent the spread of infectious diseases such as influenza viruses and coronaviruses. For example, Patent Document 2 describes an authentication device that performs personal authentication and temperature measurement of visitors. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-1790 A [Patent Document 2] JP 2012-219539 A Summary of the Invention [Problem to be solved by the invention]

[0005] One method for measuring a person's temperature without contact is to detect the person's temperature (body temperature) using a camera that captures infrared light (thermal camera). With this temperature measurement method, the person's temperature can be measured based on the temperature of a blackbody furnace, so the person's temperature can be measured accurately. However, even if the reference temperature can be detected using a blackbody furnace, there is an appropriate distance for photographing a person with a thermal camera. In other words, if a person is too close or too far away from the thermal camera, the person's temperature cannot be detected accurately. Therefore, in order to detect a person's temperature with a thermal camera with high accuracy, it is important to photograph the person at an appropriate position.

[0006] In view of the above problems, an object of an embodiment of the present invention is to provide a face recognition system that can measure a person's temperature at an appropriate position. Another object of the present invention is to provide a temperature measurement method that uses the face recognition system to measure a person's temperature at an appropriate position. [Means for solving the problem]

[0007] A face recognition system according to one embodiment of the present invention includes a marker, a first imaging unit that generates first image data in the visible light region and temperature distribution data in the infrared light region corresponding to the first image data, a second imaging unit that is positioned to include the marker in its angle of view and generates second image data in the visible light region, a marker determination unit that determines whether the marker is detected in the second image data, a face information generation unit that generates face information of a person from the first image data, and a temperature information generation unit that generates temperature information including the person's temperature from the temperature distribution data based on the face information, and when the marker is not detected by the marker determination unit, the face information and temperature information are generated.

[0008] The marker may be placed on the floor surface. The marker may also be projected onto the floor surface. The marker may also be a QR code (registered trademark).

[0009] A facial recognition system according to one embodiment of the present invention includes a marker group including a plurality of markers arranged in a specific array pattern, an imaging unit arranged to include the markers within an angle of view and generating image data in the visible light region and temperature distribution data in the infrared light region corresponding to the image data, a marker determination unit determining a detection pattern produced by the plurality of markers in the image data, a facial information generation unit generating facial information of a person from the image data, and a temperature information generation unit generating temperature information including the person's temperature from the temperature distribution data based on the facial information, and generating the facial information and temperature information when the detection pattern satisfies predetermined conditions.

[0010] The markers may be placed on a wall surface. Also, the markers may be projected onto the wall surface.

[0011] The face authentication system may further include a face matching unit that matches face image data of the person included in the face information with face image data included in the registration information.

[0012] A temperature measurement method according to one embodiment of the present invention photographs a person, generates first image data in the visible light region and temperature distribution data in the infrared light region corresponding to the first image data, photographs a marker, generates second image data in the visible light region, and when the marker is not detected in the second image data, generates facial information of the person from the first image data, and generates temperature information including the person's temperature from the temperature distribution data based on the facial information.

[0013] A temperature measurement method according to one embodiment of the present invention photographs a person and a group of markers including multiple markers arranged in a specific array pattern, generates image data in the visible light region and temperature distribution data in the infrared light region corresponding to the image data, generates facial information of the person when the detection pattern of the multiple markers in the image data satisfies predetermined conditions, and generates temperature information including the person's temperature from the temperature distribution data based on the facial information.

[0014] The specific array pattern may be a pattern in which a plurality of markers are arrayed in a straight line.

[0015] The predetermined condition may be that at least one of the multiple markers is not detected.

[0016] Furthermore, face image data of a person included in the face information may be compared with face image data included in the registration information. Effect of the Invention

[0017] The face recognition system according to one embodiment of the present invention measures a person's temperature in an appropriate position, so that the person's temperature can be detected with little variation and high accuracy. Also, the temperature measurement method according to one embodiment of the present invention uses the face recognition system to measure a person's temperature in an appropriate position, so that the person's temperature can be detected with little variation and high accuracy. [Brief description of the drawings]

[0018] [Figure 1] 1 is a block diagram showing a configuration of a face authentication system according to an embodiment of the present invention. [Diagram 2] 1A and 1B are schematic diagrams illustrating the layout of a face authentication system according to an embodiment of the present invention, and schematic diagrams illustrating images captured by a first imaging device and a second imaging device. [Diagram 3] FIG. 2 is a plan view of a marker of a face authentication system according to an embodiment of the present invention. [Figure 4] FIG. 4 is a flowchart showing a temperature measurement process of the face recognition system according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a plan view of a marker of a face authentication system according to an embodiment of the present invention. [Figure 6] 1A and 1B are schematic diagrams illustrating the arrangement of a face authentication system according to an embodiment of the present invention and schematic diagrams illustrating an image captured by an imaging device. [Figure 7] 1 is a schematic plan view illustrating detection of a marker group and a detection pattern in a face authentication system according to an embodiment of the present invention. FIG. [Figure 8]FIG. 4 is a flowchart showing a temperature measurement process of the face recognition system according to an embodiment of the present invention. [Figure 9] 1 is a layout diagram of an entrance / exit management system according to an embodiment of the present invention. [Figure 10] 1 is a block diagram showing a configuration of an entrance / exit management system according to an embodiment of the present invention; [Figure 11] 1 is a flowchart of an entrance process in an entrance / exit management system according to an embodiment of the present invention; [Figure 12] 1 is a flowchart of an entrance process in an entrance / exit management system according to an embodiment of the present invention; [Figure 13] 1 is a flowchart of an exit process in an entrance / exit management system according to an embodiment of the present invention. FIG. [Figure 14] FIG. 2 is a schematic perspective view of a unit panel according to an embodiment of the present invention. [Figure 15] FIG. 2 is a schematic plan view of a unit panel according to an embodiment of the present invention. [Figure 16] 1 is a schematic perspective view showing the exterior of a modular house according to an embodiment of the present invention; [Figure 17] 1 is a schematic plan view showing an internal configuration of a modular house according to an embodiment of the present invention. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, each embodiment of the present invention will be described with reference to the drawings. Note that the embodiments are merely examples, and those that a person skilled in the art can easily come up with by appropriately modifying the invention while keeping the gist of the invention are naturally included in the scope of the present invention. In addition, in order to make the explanation clearer, the width, thickness, shape, etc. of each part may be shown diagrammatically compared to the actual embodiment. However, the shapes shown in the drawings are merely examples and do not limit the interpretation of the present invention.

[0020] In this specification, for convenience of explanation, the terms "above" or "upper" or "below" or "lower" are used in the explanation, but these terms merely explain the hierarchical relationship of each component. For example, when a structure is installed, the installation surface side on which the structure is usually installed is referred to as "lower" or "lower".

[0021] In this specification, the letters "first," "second," or "third" attached to each component are convenient labels used to distinguish each component, and have no other meaning unless otherwise specified.

[0022] In this specification and drawings, the same reference numerals are used to collectively represent multiple identical or similar components, and lowercase or uppercase alphabets may be added to each of these components to distinguish them from one another. In addition, hyphens and natural numbers may be used to distinguish between multiple parts of one component.

[0023] In this specification, the measurement of a person's body surface temperature is described as temperature measurement.

[0024] In this specification, the term "video" may include not only still images but also moving images.

[0025] In this specification, a "subject" is a person whose entry and exit is controlled, such as a worker at a construction site or a user of an event facility or event venue.

[0026] The following embodiments can be combined with each other as long as no technical contradiction occurs.

[0027] First Embodiment A face authentication system 10 according to an embodiment of the present invention will be described with reference to FIGS.

[0028] [1. Configuration of face recognition system 10] Fig. 1(A) is a schematic diagram for explaining the arrangement of a face authentication system 10 according to an embodiment of the present invention. Fig. 1(B) and Fig. 1(C) are schematic diagrams for explaining images captured by a first imaging device 13 and a second imaging device 14 of the face authentication system 10 according to an embodiment of the present invention, respectively.

[0029] As shown in FIG. 1(A), the face authentication system 10 includes a blackbody furnace 11, a marker 12, a first imaging device 13, a second imaging device 14, and an information processing device 15. As shown in FIG. 1(A), the blackbody furnace 11 is disposed at a certain distance from the first imaging device 13 and at a position facing the first imaging device 13. The position of the blackbody furnace 11 is adjusted so as to be within the angle of view of the first imaging device 13. The height of the blackbody furnace 11 can be adjusted by a support that supports the blackbody furnace 11. The support can be installed not only on the floor surface but also on the wall surface or ceiling surface. It is preferable that the support can adjust the distance between the blackbody furnace 11 and the first imaging device 13. The marker 12 is disposed on the floor surface, but is not limited to this. The marker 12 may be disposed on the wall surface. The position of the marker 12 is adjusted so as to be within the angle of view of the second imaging device 14. The first imaging device 13 and the second imaging device 14 are disposed on the ceiling surface, but are not limited to this. The first imaging device 13 and the second imaging device 14 may be disposed on a wall surface. The information processing device 15 is disposed near the first imaging device 13, but is not limited to this. The information processing device 15 only needs to be connected to the first imaging device 13 by wire or wirelessly, and can also be disposed in a location different from where the first imaging device 13 is disposed.

[0030] As shown in Fig. 1(B), the first imaging device 13 can capture an image of the person as well as the blackbody furnace 11. Also, as shown in Fig. 1(C), the second imaging device 14 can capture an image of the marker 12.

[0031] The configuration of each device in the face authentication system 10 will be described in detail below with reference to FIG.

[0032] The blackbody furnace 11 can emit electromagnetic waves in the infrared wavelength range spectrum according to the set temperature by thermal radiation. Hereinafter, for convenience, the blackbody furnace 11 will be described as emitting infrared rays. Although not shown in detail, the blackbody furnace 11 includes a housing, a blackbody surface, a heater, and a heater control unit. The heater and the control unit are provided in the housing. The blackbody surface is provided on one side of the housing and is maintained at a predetermined temperature by the heater and the heater control unit. For example, a Peltier element can be used as the heater. By using the Peltier element, the predetermined temperature can be easily maintained. Therefore, the blackbody surface can emit infrared rays corresponding to the predetermined temperature. Therefore, the blackbody furnace 11 is arranged so that the blackbody surface is photographed by the first imaging device 13.

[0033] The marker 12 may be any shape that can be identified in an image captured by the second imaging device 14. The marker 12 may be, for example, a circle, an ellipse, a polygon, a cross, or a star, or a graphic or symbol that is a combination of these. The marker 12 may be printed or projected onto the floor surface. Also, a flat plate on which the marker 12 is provided may be placed on the floor surface. The marker 12 is placed at an appropriate position where a person's temperature can be measured and facial authentication can be performed. That is, the facial authentication system 10 performs a temperature measurement process and a facial authentication process on the person on the marker 12, so that the person's temperature can be measured and facial authentication can be performed at an appropriate distance. As a result, the accuracy of the person's temperature measurement and facial authentication is improved.

[0034] The first imaging device 13 can capture images of the person and the blackbody furnace 11. The first imaging device 13 is, for example, a camera including a solid-state imaging element such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor. The first imaging device 13 can capture images in the infrared light region as well as images in the visible light region. The first imaging device 13 may capture images in the visible light region and the infrared light region with one camera, or may include two cameras, one of which captures images in the visible light region and the other of which captures images in the infrared light region. From the captured image in the infrared light region, the temperature distribution of a person or object included in the image can be obtained. In addition, when the first imaging device 13 includes two cameras, it is preferable that the two cameras are arranged so that the positions in the visible light region image and the positions in the infrared light region image correspond to each other.

[0035] The first imaging device 13 includes a first imaging section 13a. The first imaging section 13a can capture an image in the visible light region including a person and the blackbody furnace 11, and generate first image data.

[0036] The second imaging device 14 can capture an image of the marker 12. The second imaging device 14 has the same configuration as the first imaging device 13, but the second imaging device 14 only needs to be able to capture an image in the visible light region that includes at least the marker 12. In other words, the marker 12 only needs to be included in the angle of view of the second imaging device 14. Therefore, the second imaging device 14 can be disposed directly above the marker 12 or diagonally above it.

[0037] The information processing device 15 can execute arithmetic processing based on a program. The information processing device 15 is, for example, a computer. The computer includes, for example, a central processing unit (CPU) as arithmetic means and a storage device as storage means. The storage device is, for example, a random access memory (RAM), a read only memory (ROM), or a hard disk drive (HDD).

[0038] Here, with reference to FIG. 2, a specific description will be given of cases where the marker 12 is detected and where it is not detected in the second image data.

[0039] FIG. 2 is a plan view of the marker 12 of the face authentication system 10 according to an embodiment of the present invention. FIG. 2(A) shows a state where there is nothing above the marker 12. In this case, there is nothing between the second imaging device 14 and the marker 12, and the second imaging device 14 can clearly capture the marker 12. Therefore, the information processing device 15 (specifically, the marker determination unit 15a described later) can detect the marker 12 in the second image data and determine that the marker 12 is present in the second image data. In contrast, FIG. 2(B) shows a state where a walking person is located above the marker 12. In this case, the second imaging device 14 captures the marker 12 hidden by the person, and the marker 12 does not clearly exist in the second image data. Therefore, the information processing device 15 (marker determination unit 15a) cannot detect the marker 12 in the second image data. In other words, the information processing device 15 (marker determination unit 15a) can determine whether a person is not present on the marker 12 (when the marker 12 is detected in the second image data) or whether a person is present on the marker 12 (when the marker 12 is not detected in the second image data).

[0040] 3 is a block diagram showing the configuration of a face authentication system 10 according to an embodiment of the present invention. In the following, the configurations of the first imaging device 13, the second imaging device 14, and the information processing device 15 will be described in detail with reference to FIG.

[0041] The first imaging unit 13a can capture an image in the infrared light region including the person and the blackbody furnace 11, and generate temperature distribution data. Each of the first image data and the temperature distribution data is transmitted to the information processing device 15.

[0042] The second imaging device 14 includes a second imaging section 14a. The second imaging section 14a can capture an image in the visible light region including the marker 12 and generate second image data. The second image data is transmitted to the information processing device 15.

[0043] The information processing device 15 includes a marker determination unit 15a, a face information generation unit 15b, a temperature information generation unit 15c, a registration information storage unit 15d, a face matching unit 15e, and a person information processing unit 15f. These components will be described in detail below.

[0044] The marker determination unit 15a can receive the second image data and determine the presence or absence of the marker 12 in the second image data. Specifically, the marker determination unit 15a can, for example, compare the marker data of the marker 12 registered in advance and detect the marker 12 that matches the marker data from the second image data. The marker determination unit 15a may also determine the presence or absence of the marker 12 in the second image data by using machine learning or deep learning.

[0045] The face information generating unit 15b can receive the first image data and detect a person's face area from the first image data. The face information generating unit 15b can also generate face image data based on the face area detected from the first image data. The face information generating unit 15b can also generate face information including the face image data and position information of the face image data in the image data.

[0046] Here, the face area detection process executed by the face information generating unit 15b will be described. The face information generating unit 15b can detect feature points such as the eyes, nose, and mouth, which are parts that constitute a face, from the first image data, and detect a face area from the relative positions of these feature points. The face information generating unit 15b can also execute edge processing on the first image data, detect an elliptical edge distribution that is similar to the outline of a person's head, and detect an area surrounded by the edge distribution as a face area. The face information generating unit 15b can also calculate a similarity by comparing with a face shape model registered in advance, and detect an area with a predetermined similarity or higher as a face area.

[0047] Furthermore, the face information generating unit 15b can generate rectangular face image data including the face area based on the size of the detected face area. In the matching of face image data described later, a resolution sufficient to detect feature points such as the eyes, nose, or mouth in more detail is required, so the face information generating unit 15b may execute a size (or resolution) determination process on the generated face image data. In the size determination process of the face image data, if the area of ​​the face image data is within a predetermined range, it is determined to be appropriate face image data. Also, if each of the horizontal length and vertical length of the face image data is within a predetermined range, it may be determined to be appropriate face image data. Note that the face image data determined to be appropriate may be converted to a predetermined size to make it suitable for the matching process.

[0048] The temperature information generating unit 15c receives the temperature distribution data and the facial information, obtains the temperature from the temperature distribution data based on the position information of the facial image data included in the facial information, and can generate temperature information including the temperature of the person's face (i.e., the person's body temperature) corrected by the temperature of the blackbody furnace 11.

[0049] The registration information storage unit 15d can store information (registration information) of a specific person as a database. The registration information can be created in advance. The registration information includes, for example, face image data, affiliation, name, age, and the like, which are linked and stored.

[0050] The face matching unit 15e can receive face information, acquire registration information from the registration information storage unit 15d, and match the face image data of the face information with the face image data of the registration information. If the first face matching unit 1060 can identify a person through the matching process (if the similarity with at least one registered person is equal to or greater than a threshold value in the matching process), it can transmit all or part of the registered information of the matched registered person to the person information processing unit 15f. On the other hand, if the first face matching unit 1060 cannot identify a person through the matching process (if the similarity with any registered person is less than a threshold value in the matching process), it can generate matching failure information and transmit the matching failure information to the person information processing unit 15f.

[0051] Here, the process of matching face image data executed by face matching section 15e will be described.

[0052] The face matching unit 15e can detect feature points such as the size, direction, or relative position of the eyes, nose, mouth, and other parts that constitute a face from the image data. The face matching unit 15e can also detect the facial contour as a feature point. The face matching unit 15e compares the detected feature points with the feature points of the face image data of the registration information of the database stored in the registration information storage unit 15d, and calculates the similarity. The face matching unit 15e can identify the registrant of the registration information with the highest similarity as a person.

[0053] The person information processing unit 15f can receive face information, temperature information, and registration information, and generate person information in which these are linked. The person information includes, for example, the shooting date and time, face image data of the face information, temperature of the temperature information, or face image data, affiliation, or name of the registration information. Furthermore, when the person information processing unit 15f receives face information, temperature information, and unmatchable information, it can generate person registration information in which these are linked, and register information of the person for whom matching processing has been performed. Note that missing information of a person may be input separately.

[0054] Although the configuration of the face recognition system 10 has been described above, the configuration of the face recognition system 10 is not limited to this. Although details will be described later, the face recognition system 10 can also include a warning device that is activated when the temperature included in the temperature information of a person exceeds a predetermined temperature.

[0055] [2. Temperature measurement and matching process of face recognition system 10] 4 is a flow chart showing the temperature measurement and matching process of the face authentication system 10 according to an embodiment of the present invention. Specifically, FIG. 4 shows the temperature measurement and matching process executed by the information processing device 15 of the face authentication system 10.

[0056] In step S100, the information processing device 15 can acquire first image data in the visible light region and temperature distribution data in the infrared light region captured by the first imaging device 13, as well as second image data in the visible light region captured by the second imaging device 14. The temperature distribution data in the infrared light region corresponds to the first image data in the visible light region. In other words, position coordinates in the temperature distribution data correspond to position coordinates in the first image data. When the first image data, the temperature distribution data, and the second image data are acquired, step S110 is executed.

[0057] In step S110, the information processing device 15 (marker determination unit 15a) can determine the presence or absence of a marker 12 in the second image data. If the marker 12 is detected in the second image data (step S110: YES), the process returns to step S100, and the information processing device 15 can again acquire the first image data in the visible light region and the temperature distribution data in the infrared light region captured by the first imaging device 13, and the second image data in the visible light region captured by the second imaging device 14. On the other hand, if the marker 12 is not detected in the second image data (step S110: NO), the information processing device 15 (face information generation unit 15b) can execute a process of determining the detection of a face region (step S120).

[0058] In step S120, the information processing device 15 (face information generating unit 15b) can determine the detection of a face area in the first image data. If a face area is detected in the first image data (step S120: YES), step S130 is executed. On the other hand, if a face area is not detected in the first image data (step S120: NO), the process returns to step S100, and the information processing device 15 can again acquire the first image data in the visible light region and the temperature distribution data in the infrared light region captured by the first imaging device 13, and the second image data in the visible light region captured by the second imaging device 14.

[0059] In step S130, the information processing device 15 (face information generating unit 15b) can generate face image data based on the face region. When the face image data is generated, step S140 is executed.

[0060] In step S140, the information processing device 15 (face information generating unit 15b) can acquire position information of face image data in the image data, and generate face information including the face image data and the position information.

[0061] In step S150, the information processing device 15 (temperature information generating unit 15c) can generate temperature information including the temperature of the person corrected by the temperature of the blackbody furnace 11 from the temperature distribution data based on the face information.

[0062] In step S160, the information processing device 15 (face matching unit 15e) can match the face image data of the generated face information with the face image data of the registration information to identify the person. If the person is identified (step S160: YES), the information processing device 15 (person information processing unit 15f) executes step S170. On the other hand, if the person is not identified (step S160: NO), step S175 is executed.

[0063] In step S170, the information processing device 15 (person information processing unit 15f) can generate person information that links the face information, temperature information, and registration information.

[0064] In step S175, the information processing device 15 (person information processing unit 15f) can generate person registration information in which the face information, the temperature information, and the non-matching information are linked together.

[0065] When the personal information or personal registration information is generated, the temperature measurement and matching process ends in the face authentication system 10. The generated personal information or personal registration information can be provided to another device (for example, a display device, etc.).

[0066] Although the temperature measurement and face recognition method of the face recognition system 10 has been described mainly based on the temperature measurement and matching process executed by the information processing device 15, the temperature measurement and face recognition method of the face recognition system 10 is not limited to this.

[0067] <Modification> 5, the configurations of markers 12A and 12B, which are modified versions of marker 12, will be described. However, the modifications of marker 12 are not limited to those described below. In the following, when markers 12A and 12B include a configuration similar to that of marker 12, the description of the configuration may be omitted.

[0068] 5(A) and 5(B) are plan views of markers 12A and 12B, respectively, of a face authentication system 10 according to an embodiment of the present invention.

[0069] The markers 12A and 12B are so-called QR codes (registered trademark) and AR codes, respectively. That is, the markers 12A and 12B are not simply figures, but figures containing information. Therefore, a person passing over the marker 12A or 12B can read the marker 12A or 12B with an information terminal carried by the person, and obtain the information contained in the marker 12A or 12B. The information contained in the marker 12A or 12B is, for example, advertisements, notices, or cautions, but is not limited to these. For example, when the face authentication system 10 is used at a construction site, the marker 12A or 12B can include information on the work process or notices at the construction site, and the worker who reads the marker 12A or 12B can be notified of this information. Furthermore, when the face authentication system 10 is used at an event facility or event venue, the marker 12A or 12B can include information on cautions for use, and the user who reads the marker 12A or 12B can be notified of this information.

[0070] The face authentication system 10 according to the present embodiment, including the modified example, has been described above. The face authentication system 10 can measure a person's temperature and perform face authentication at an appropriate position by arranging the marker 12 at an appropriate distance from the first imaging device 13. In addition, by arranging the marker 12, the person can recognize the position where the temperature measurement and face authentication are performed. In this case, the person often turns his / her face toward the first imaging device 13 to confirm the position of the first imaging device 13 where the temperature measurement and face authentication are performed. Therefore, the face authentication system 10 can measure a person's temperature and perform face authentication with little variation and high accuracy.

[0071] In the above-mentioned face recognition system 10, temperature measurement and face recognition are performed at the same position (the position where the marker 12 is placed), but different markers may be placed at the appropriate positions for temperature measurement and face recognition, respectively, and temperature measurement and face recognition may be performed at different positions. Even in this case, a person's temperature can be measured and face recognition can be performed at the appropriate positions.

[0072] <Second embodiment> A face authentication system 20 according to an embodiment of the present invention will be described with reference to Fig. 6 to Fig. 8. In the following, when the face authentication system 20 includes the same configuration as the face authentication system 10, the description of the configuration may be omitted.

[0073] [1. Configuration of face recognition system 20] Fig. 6(A) is a schematic diagram for explaining the arrangement of a face authentication system 20 according to an embodiment of the present invention, and Fig. 6(B) is a schematic diagram for explaining an image captured by an imaging device 23 of the face authentication system 20 according to an embodiment of the present invention.

[0074] As shown in FIG. 6, the face authentication system 20 includes a blackbody furnace 21, a marker group 22, an imaging device 23, and an information processing device 25. As shown in FIG. 6(A), the blackbody furnace 21 is disposed at a certain distance from the imaging device 23 and at a position facing the imaging device 23. The position of the blackbody furnace 21 is adjusted so as to be within the angle of view of the imaging device 23. The marker group 22 is disposed on a wall surface, but is not limited thereto. The marker group 22 may be disposed on a floor surface. The position of the marker group 22 is also adjusted so as to be within the angle of view of the imaging device 23. Therefore, the imaging device 23 can capture the blackbody furnace 21 and the marker group 22 together with the person.

[0075] The blackbody furnace 21 has a similar configuration to the blackbody furnace 11 of the face recognition system 10, and therefore a description thereof will be omitted here.

[0076] The marker group 22 includes a first marker 22-1 to a fifth marker 22-5. The first marker 22-1 to the fifth marker 22-5 are arranged on the wall surface in order from the black body furnace 21 toward the imaging device 23. For example, the first marker 22-1 to the fifth marker 22-5 have a pattern arranged on a straight line. In this way, the first marker 22-1 to the fifth marker 22-5 are arranged with a specific arrangement pattern. The first marker 22-1 to the fifth marker 22-5 may be printed or projected on the wall surface. Also, a tape on which the first marker 22-1 to the fifth marker 22-5 are provided may be attached to the wall surface. The first marker 22-1 to the fifth marker 22-5 may be spaced at equal intervals or may be spaced at different intervals. Each of the first marker 22-1 to the fifth marker 22-5 may be identifiable in an image captured by the imaging device 23. The number of markers included in the marker group 22 is not particularly limited.

[0077] The imaging device 23 has the same configuration as the first imaging device 13 of the face authentication system 10. The imaging device 23 includes an imaging unit. The imaging unit can capture an image in the visible light region including the person, the black body furnace 21, and the marker group 22, and generate image data. The imaging unit can also capture an image in the infrared light region including the person and the black body furnace 21, and generate temperature distribution data. Each of the image data and the temperature distribution data is transmitted to the information processing device 25.

[0078] The information processing device 25 has the same configuration as the information processing device 15 of the face authentication system 10. The information processing device 25 includes a marker determination unit, a face information generation unit, a temperature information generation unit, a registration information storage unit, a face matching unit, and a person information processing unit. The marker determination unit of the information processing device 25 is different from the marker determination unit 15a of the information processing device 15. The configuration of the marker determination unit of the information processing device 25 will be described in detail below.

[0079] The marker determination unit can receive image data and determine a detection pattern by the first marker 22-1 to the fifth marker 22-5 from the image data. For example, the marker determination unit can determine the detection pattern using machine learning or deep learning. Furthermore, the marker determination unit can generate marker detection information based on the detection pattern.

[0080] Now, with reference to FIG. 7, a process of generating marker detection information by the marker determination unit will be described.

[0081] FIG. 7 is a schematic plan view illustrating detection and a detection pattern of the marker group 22 in the face authentication system 20 according to an embodiment of the present invention.

[0082] As shown in FIG. 7, the angle of view of the imaging device 23 includes the first marker 22-1 to the fifth marker 22-5 of the marker group 22. Therefore, the imaging device 23 can capture the first marker 22-1 to the fifth marker 22-5 of the marker group 22. Here, consider a case where a person passes in front of the imaging device 23. If the person is in area A in front of the first marker 22-1, the first marker 22-1 is hidden by the person. In this case, the first marker 22-1 is not captured by the imaging device 23, but the second marker 22-2 to the fifth marker 22-5 are captured by the imaging device 23. If the person moves from area A to area B, the second marker 22-2 is hidden by the person. In this case, the second marker 22-2 is not captured by the imaging device 23, but the first marker 22-1 and the third marker 22-3 to the fifth marker 22-5 are captured by the imaging device 23. The same applies when the person is in area C in front of the third marker 22-3, area D in front of the fourth marker 22-4, and area E in front of the fifth marker 22-5. Therefore, if there is an undetected marker in the image data captured by the imaging device 23, it is presumed that the person is in the area in front of the undetected marker. Therefore, since the position of the person (areas A to E) can be specified based on the undetected marker, the marker determination unit can generate marker detection information in which the presence or absence of detection of the first marker 22-1 to the fifth marker 22-5 is used as a detection pattern.

[0083] The number of undetected markers in the image data does not have to be 1. For example, when the first marker 22-1 and the second marker 22-2 are not detected in the image data, it is presumed that the person is located at the boundary between areas A and B, close to the imaging device 23. Therefore, based on the detection pattern, it is also possible to specify whether the person is near the wall or far from the wall.

[0084] In this way, the marker determination unit can generate marker detection information according to the position or number of markers that are not detected in the image data, that is, the detection pattern of the markers. As described above, since the position of a person can be specified by the detection pattern of the markers, it can also be said that the marker detection information includes the position information of the person. In addition, the marker determination unit can determine the marker detection information, and when the detection pattern of the markers satisfies a predetermined condition, execute the temperature measurement process and the matching process. For example, when a person is in an appropriate position, the predetermined condition can be that at least one of the multiple markers is not detected.

[0085] Although the configuration of the face authentication system 20 has been described above, the configuration of the face authentication system 20 is not limited to this. Although details will be described later, the face authentication system 20 can also include a warning device that is activated when the temperature included in the temperature information of a person exceeds a predetermined temperature.

[0086] [2. Temperature measurement and matching process of face recognition system 20] 8 is a flowchart showing the temperature measurement process of the face authentication system 20 according to an embodiment of the present invention. Specifically, FIG. 8 shows the temperature measurement process executed by the information processing device 25 of the face authentication system 20.

[0087] In step S200, the information processing device 25 can acquire image data in the visible light region and temperature distribution data in the infrared light region captured by the imaging device 23. The temperature distribution data in the infrared light region corresponds to the image data in the visible light region. In other words, the position coordinates in the temperature distribution data correspond to the position coordinates in the image data. When the image data and the temperature distribution data are acquired, step S210 is executed.

[0088] In step S210, the information processing device 25 (marker determination unit) can detect the first marker 22-1 to the fifth marker 22-5 in the image data. When the first marker 22-1 to the fifth marker 22-5 are detected, step S220 is executed.

[0089] In step S220, the information processing device 25 (marker determination unit) can generate marker detection information based on the detection pattern of the marker. When the marker detection information is generated, step S230 is executed.

[0090] In step S230, the information processing device 25 (marker determination unit) can determine whether or not the person is in the appropriate position based on the marker detection information. If the person is in the appropriate position (step S230: YES), step S240 is executed. On the other hand, if the person is not in the appropriate position (step S230: NO), the process returns to step S200, and the information processing device 25 can again acquire image data in the visible light region and temperature distribution data in the infrared light region captured by the imaging device 23.

[0091] Steps S240 to S295 are similar to steps S120 to S175, respectively, and therefore will not be described here.

[0092] When the personal information or personal registration information is generated, the temperature measurement and matching process ends in the face authentication system 20. The generated personal information or personal registration information can be provided to another device (for example, a display device, etc.).

[0093] Although the temperature measurement and face recognition method of the face recognition system 20 has been described mainly based on the temperature measurement and matching process executed by the information processing device 25, the temperature measurement and face recognition method of the face recognition system 20 is not limited to this.

[0094] The face authentication system 20 according to the present embodiment has been described above. The face authentication system 20 is arranged with a marker group 22 including a plurality of markers, and can identify the position of a person based on the detection pattern of the markers in image data obtained by capturing the marker group 22. Therefore, the face authentication system 20 can determine whether a person is in an appropriate position, and when the person is in an appropriate position, can perform temperature measurement and face authentication of the person. Therefore, the face authentication system 20 can perform temperature measurement and face authentication of a person with little variance and high accuracy.

[0095] In the above-mentioned face authentication system 20, the position of a person is specified by the detection pattern of the markers. However, in addition to the position of the person, the height of the marker group 22 from the floor surface may be compared with the height of the person's face to calculate the height of the person. In this case, the matching process may be performed based on the calculated height. The detection pattern of the markers between frames may also be determined to specify the direction of movement of the person. For example, even if the person is in the correct position, if the person turns back, the temperature measurement and matching process may not be performed.

[0096] <Third embodiment> An entrance / exit management system 30 according to one embodiment of the present invention will be described with reference to Fig. 9 to Fig. 13. The entrance / exit management system 30 includes a face authentication system 10. In the following, as an example, it is assumed that the entrance / exit management system 30 is installed at a construction site, and entrance / exit management of workers (subjects) at the construction site using the entrance / exit management system 30 will be described.

[0097] [1. Configuration of the entrance / exit management system 30] FIG. 9 is a layout diagram of the entrance / exit management system 30 according to an embodiment of the present invention. The entrance / exit management system 30 is installed and used in a passage 120 connecting a first gate 100 and a second gate 110 facing the first gate 100. The construction site is beyond the second gate 110, and the subject can enter the construction site by passing through the second gate 110. That is, the entrance / exit management system 30 can be installed at the entrance / exit of the construction site. FIG. 9(A) and FIG. 9(B) show the same layout of the entrance / exit management system 30, but respectively show the subject's entry and exit. When the subject enters the construction site, the subject enters through the first gate 100, undergoes entrance processing using the entrance / exit management system 30, and exits through the second gate 110. Furthermore, when the subject leaves the construction site, the subject enters through the second gate 110, is processed for exit using the entrance / exit management system 30, and exits through the first gate 100. Therefore, entrance / exit management (entry processing and exit processing) is performed for the subject not only when he / she enters the construction site but also when he / she leaves using the entrance / exit management system 30.

[0098] 9 shows the first gate 100 and the second gate 110, the first gate 100 and the second gate 110 do not have to be clearly installed. For example, the entrance / exit management system 30 may be installed in the middle of the passage 120, and one end of the passage 120 where the entrance / exit management system 30 is installed may be the first gate 100, and the other end may be the second gate 110. Even in this case, the entrance / exit management system 30 is used when the subject passes through the passage 120, so that the subject's entrance / exit management can be performed.

[0099] As shown in FIG. 9(A) and FIG. 9(B), the entrance / exit management system 30 includes a first information processing device 200, a first imaging device 210, a first display device 220, a warning device 230, a black body furnace 240, a second information processing device 300, a second imaging device 310, a second display device 320, a third information processing device 400, a marker 250, and a third imaging device 260. The first information processing device 200, the first imaging device 210, the first display device 220, the warning device 230, the black body furnace 240, the marker 250, and the third imaging device 260 are used in the entrance process of the subject. The second information processing device 300, the second imaging device 310, and the second display device 320 are used in the exit process of the subject. The third information processing device 400 is used in the entrance / exit management process of the subject.

[0100] Although not shown in detail, the first imaging device 210, the first display device 220, the warning device 230, and the third imaging device 260 are connected to the first information processing device 200. The second imaging device 310 and the second display device 320 are connected to the second information processing device 300. Furthermore, the first information processing device 200 and the second information processing device 300 are connected to the third information processing device 400. These connections may be wired or wireless.

[0101] The first imaging device 210, the first display device 220, and the warning device 230 are disposed near the second gate 110. The first imaging device 210 is disposed, for example, on the ceiling surface or wall surface of the passage 120. The first imaging device 210 can photograph a subject who enters through the first gate 100 and passes through the passage 120. The first imaging device 210 can photograph a walking subject and the black body furnace 240, and the subject does not necessarily have to stop in front of the first imaging device 210. The black body furnace 240 is installed within the angle of view of the first imaging device 210 and at an appropriate distance from the first imaging device 210. The marker 250 is disposed on the floor surface. The third imaging device 260 is disposed on the ceiling surface and can photograph the marker 250. The first information processing device 200 can match the photographed subject or determine the subject's temperature (body temperature). The first information processing device 200 may be installed inside the passage 120 or may be arranged outside the passage 120. The first display device 220 can display the matching result of the subject. The subject can check the matching result displayed on the screen of the first display device 220 and exit through the second gate 110. The warning device 230 is activated when the subject's temperature exceeds a threshold value, and notifies the subject that an abnormality in body temperature has been detected.

[0102] Similarly, the second imaging device 310 and the second display device 320 are disposed near the first gate 100. The second imaging device 310 disposed on the ceiling or wall surface of the passage 120 can capture an image of a subject who enters through the second gate 110 and passes through the passage 120. The second information processing device 300 disposed inside or outside the passage 120 can verify the image of the subject. The subject can check the verification result displayed on the screen of the second display device 320 and exit from the first gate 100.

[0103] The entrance / exit management system 30 detects the subject's temperature when the subject enters the construction site, but does not detect the subject's temperature when the subject leaves the construction site. However, the entrance / exit management system 30 may detect the subject's temperature when the subject leaves the construction site. In that case, the entrance / exit management system 30 can compare the subject's temperature when he or she enters and when he or she leaves, and if there is a predetermined temperature difference, it can activate a warning device to notify the subject that an abnormality in body temperature has been detected.

[0104] The above-mentioned arrangement of the devices is merely an example, and the arrangement of the devices in the entrance / exit management system 30 according to this embodiment is not limited to this.

[0105] The following describes the configuration of each device in the entrance / exit management system 30. In the following, if the entrance / exit management system 30 includes the same configuration as the face authentication system 10, the description of that configuration may be omitted.

[0106] Each of the first information processing device 200, the second information processing device 300, and the third information processing device 400 can execute arithmetic processing based on a program. The first information processing device 200, the second information processing device 300, and the third information processing device 400 may be one computer or multiple computers each capable of processing.

[0107] The first imaging device 210 has the same configuration as the first imaging device 13 of the face authentication system 10, and therefore the description thereof will be omitted here. Note that the second imaging device 310 may be a camera similar to the first imaging device 210 as long as it can capture an image at least in the visible light region.

[0108] Each of the first display device 220 and the second display device 320 is a device capable of displaying an image, and is, for example, a liquid crystal display device or an OLED (Organic Light-Emitting Diode) display device. Each of the first display device 220 and the second display device 320 preferably includes an input device, and may include, for example, a touch panel that allows an operation to be performed by touching the display on the screen.

[0109] The warning device 230 is a device capable of notifying a target person that an abnormality has occurred, and is, for example, a warning light or a speaker that emits a warning sound, etc. The warning device 230 may also be an electronic bulletin board.

[0110] The blackbody furnace 240 has the same configuration as the blackbody furnace 11 of the face recognition system 10, and therefore a description thereof will be omitted here.

[0111] The marker 250 has a similar configuration to the marker 12 of the face recognition system 10, and therefore a description thereof will be omitted here.

[0112] The third imaging device 260 has the same configuration as the second imaging device 14 of the face authentication system 10, and therefore a description thereof will be omitted here.

[0113] The configuration of each device in the entrance / exit management system 30 will be described in further detail below with reference to FIG.

[0114] FIG. 10 is a block diagram showing the configuration of an entrance / exit management system 30 according to an embodiment of the present invention.

[0115] As shown in FIG. 10, the entrance / exit management system 30 includes a first imaging unit 1010, a marker determination unit 1020, a first face information generation unit 1030, a temperature information generation unit 1040, a first registration information memory unit 1050, a first face matching unit 1060, an entrance person information processing unit 1070, a first display unit 1080, a warning unit 1090, a second imaging unit 1110, a second face information generation unit 1130, a second face matching unit 1160, an exit person information processing unit 1170, a second display unit 1180, an entrance / exit management information processing unit 1210, and an entrance / exit management information memory unit 1220.

[0116] The first information processing device 200 includes a marker determination unit 1020, a first face information generation unit 1030, a temperature information generation unit 1040, a first registration information storage unit 1050, a first face matching unit 1060, and an entrance person information processing unit 1070. The first imaging device 210 includes a first imaging unit 1010. The first display device 220 includes a first display unit 1080. The warning device 230 includes a warning unit 1090. The second information processing device 300 includes a second face information generation unit 1130, a second registration information storage unit 1150, a second face matching unit 1160, and an exit person information processing unit 1170. The second imaging device 310 includes a second imaging unit 1110. The second display device 320 includes a second display unit 1180. The third information processing device 400 includes an entrance / exit management information processing unit 1210 and an entrance / exit management information storage unit 1220. The third imaging device 260 includes a third imaging unit 1310.

[0117] The configuration of each device is not limited to that shown in Fig. 10. For example, the first imaging device 210 may include a first imaging section 1010, a first face information generation section 1030, and a temperature information generation section 1040, and the first information processing device 200 may include a first face matching section 1060 and an attendee information processing section 1070.

[0118] The first imaging unit 1010 has the same configuration as the first imaging unit 13a of the face authentication system 10. That is, the first imaging unit 1010 can generate first image data obtained by capturing an image in the visible light region including a person and the black body furnace 240, and temperature distribution data obtained by capturing an image in the infrared light region. The first image data is transmitted to the first face information generating unit 1030. In addition, the temperature distribution data is transmitted to the temperature information generating unit 1040.

[0119] The third imaging unit 1310 has the same configuration as the second imaging unit 14a of the face authentication system 10. That is, the third imaging unit 1310 can generate third image data by capturing an image in the visible light region including the marker 250. The third image data is transmitted to the marker determination unit 1020.

[0120] The marker determination unit 1020 has the same configuration as the marker determination unit 15a of the face authentication system 10. That is, the marker determination unit 1020 can determine the presence or absence of the marker 250 in the third image data.

[0121] The first face information generating unit 1030 has the same configuration as the face information generating unit 15b of the face authentication system 10. That is, the first face information generating unit 1030 can detect the face area of ​​the subject from the first image data and generate face image data based on the detected face area. In addition, the first face information generating unit 1030 can generate face information including face image data and position information of the face image data. All or a part of the generated face information is transmitted to the temperature information generating unit 1040, the first face matching unit 1060, and the visitor information processing unit 1070.

[0122] The temperature information generating unit 1040 has the same configuration as the temperature information generating unit 15c of the face authentication system 10. That is, the temperature information generating unit 1040 can generate temperature information including the temperature of the target person. The generated temperature information is transmitted to the visitor information processing unit 1070.

[0123] The first registration information storage unit 1050 can store information (registration information) of workers working at a construction site as a database. The registration information can be created in advance. The registration information includes, for example, face image data, affiliation, or name of a worker, which are linked and stored.

[0124] The first face matching unit 1060 has the same configuration as the face matching unit 15e of the face authentication system 10. That is, the first face matching unit 1060 can transmit all or part of the registration information of the matched registrant through the matching process to the visitor information processing unit 1070. Also, if the target person cannot be identified through the matching process, the first face matching unit 1060 can generate match failure information and transmit the match failure information to the visitor information processing unit 1070.

[0125] When the entrance / exit management system 30 is used at a construction site, the subject may be wearing a helmet and a mask. In particular, when the subject is wearing a mask, the nose and mouth are covered by the mask, so that the number of detected feature points is reduced. Therefore, the first face matching unit 1060 performs a process of determining whether a mask is being worn on the face image data, and when it is determined that a mask is being worn, it can also perform weighting so as to give a higher priority to the eyes as a feature point and calculate the similarity.

[0126] The visitor information processing unit 1070 can receive face information, temperature information, and registration information, and generate visitor information in which these are linked. The visitor information includes, for example, the entry date and time, face image data of the face information, temperature of the temperature information, or face image data, affiliation, or name of the registration information. The visitor information is transmitted to the entrance and exit management information processing unit 1210. In addition, the visitor information processing unit 1070 can convert the visitor information into a display image signal and transmit the display image signal to the first display unit 1080. In response to this, when the visitor information processing unit 1070 receives the non-matching information, it can convert the face image data of the face information into a display image signal and transmit the display image signal to the first display unit 1080. In addition, when the temperature of the target person included in the temperature information exceeds a predetermined temperature, the visitor information processing unit 1070 can generate a control signal and transmit the control signal to the warning unit 1090.

[0127] The first display unit 1080 can receive a display image signal and display an image based on the display image signal on the screen of the first display device 220. The first display unit 1080 can display, for example, face image data of face information, temperature of temperature information, or face image data, affiliation, or name of registered information on the screen of the first display device 220. The first display unit 1080 can also display, on the screen, an icon for checking whether the face information matches the registered information, for example, an icon that can be touched when the matching of the subject is a false positive. When the subject touches the icon, the first display unit 1080 generates operation information and transmits the operation information to the visitor information processing unit 1070.

[0128] The alarm unit 1090 can receive the control signal and activate the alarm device 230 based on the control signal.

[0129] The second imaging unit 1110 can capture at least an image in the visible light region and generate second image data, and may have the same configuration as the first imaging unit 1010. The second image data generated by the second imaging unit 1110 is transmitted to a second face information generation unit.

[0130] The second face information generating unit 1130 has the same configuration as the first face information generating unit 1030, and therefore the description thereof will be omitted here. All or a part of the face information generated by the second face information generating unit 1130 is transmitted to the second face matching unit 1160 and the exiting person information processing unit 1170.

[0131] The second registered information storage unit 1150 has the same configuration as the first registered information storage unit 1050, and therefore a description thereof will be omitted here.

[0132] The second face matching unit 1160 has the same configuration as the first face matching unit 1060, and therefore a description thereof will be omitted here. When the second face matching unit 1160 is able to identify the target person through the matching process, it can transmit all or part of the identified registrant information to the leaving person information processing unit 1170. Furthermore, when the second face matching unit 1160 is unable to identify the target person through the matching process, it can generate matching failure information and transmit the matching failure information to the leaving person information processing unit 1170.

[0133] The exiting person information processing unit 1170 can receive face information and registration information, and generate exiting person information in which these are linked. The exiting person information includes, for example, the exit date and time, face image data of the face information, or face image data, affiliation, or name of the registration information. The exiting person information is transmitted to the entrance and exit management information processing unit 1210. In addition, the exiting person information processing unit 1170 can convert the exiting person information into a display image signal and transmit the display image signal to the second display unit 1180. In response to this, when the exiting person information processing unit 1170 receives matching impossible information, it can convert the face image data of the face information into a display image signal and transmit the display image signal to the second display unit 1180.

[0134] The second display unit 1180 has the same configuration as the first display unit 1080, and therefore a description thereof will be omitted here. The operation information generated by the second display unit 1180 is transmitted to the exiting person information processing unit 1170.

[0135] The entrance / exit management information processing unit 1210 can receive the entrance information and the exit information, and generate the entrance / exit management information in which the entrance information and the exit information are linked. That is, the entrance / exit management information processing unit 1210 can identify the entrance information and the exit information, respectively, and generate the entrance / exit management information stored in a database by treating the entrance information and the exit information as items. Specifically, the entrance / exit management information processing unit 1210 can generate the entrance / exit management information stored in a database using the entrance information, and update the entrance / exit management information using the exit information. When linking the exit information with the entrance information, the entrance / exit management information processing unit 1210 can obtain the entrance / exit management information stored in the entrance / exit management information storage unit 1220, and update the entrance / exit management information. The entrance / exit management information includes, for example, the entrance date and time, temperature, affiliation, or name of the entrance information, or the exit date and time, affiliation, or name of the exit information. Furthermore, the entrance / exit management information may include face data of face information included in the entrance person information or face data of face information included in the exit person information.

[0136] The entrance / exit management information storage unit 1220 can store the entrance / exit management information generated by the entrance / exit management information processing unit 1210 as a database.

[0137] The above-mentioned devices and the configuration of each device are merely examples, and the configuration of the entrance / exit management system 30 according to the present embodiment is not limited to these. For example, when each component transmits and receives data or information wirelessly, each device may include a communication unit.

[0138] Furthermore, the use of the entrance / exit management system 30 is not limited to entrance / exit management at construction sites. For example, the entrance / exit management system 30 can be installed at the entrance / exit of an event facility or event venue to manage the entrance / exit of users. One example of installing the entrance / exit management system 30 at an event facility is when users' facial image data is registered and tickets are sold. In this case, users can enter and exit the event facility by walking through, and even if it is later discovered that one of the users is infected with influenza virus or coronavirus, the entrance / exit management system 30 can be used to confirm that the user entered and exited the event facility.

[0139] The entrance process and the exit process by the entrance / exit management system 30 will be described below with reference to Figs.

[0140] [2. Entry processing by the entrance / exit management system 30] Fig. 11 and Fig. 12 are flow charts showing the entrance process of the entrance / exit management system 30 according to one embodiment of the present invention. Specifically, Fig. 11 shows the process executed by the first information processing device 200 and the third information processing device, Fig. 12(A) shows the process executed by the first display device 220, and Fig. 12(B) shows the process executed by the warning device 230.

[0141] In step S1000, the first information processing device 200 can acquire first image data in the visible light region and temperature distribution data in the infrared light region captured by the first imaging device 210, and third image data in the visible light region captured by the third imaging device 260. The temperature distribution data in the infrared light region corresponds to the first image data in the visible light region. In other words, the position coordinates in the temperature distribution data correspond to the position coordinates in the first image data. When the first image data, the temperature distribution data, and the second image data are acquired, step S1010 is executed.

[0142] In step S1010, the first information processing device 200 (marker determination unit 1020) can determine the presence or absence of the marker 250 in the third image data. If the marker 250 is detected in the third image data (step S1010: YES), the process returns to step S1000, and the first information processing device 200 can again acquire the first image data in the visible light region and the temperature distribution data in the infrared light region captured by the first imaging device 210, and the third image data in the visible light region captured by the third imaging device 260. On the other hand, if the marker 250 is not detected in the third image data (step S1010: NO), the first information processing device 200 (first face information generation unit 1030) can execute a determination process (step S1020) for the detection of a face region.

[0143] In step S1020, the first information processing device (first face information generating unit 1030) can determine the detection of a face area in the first image data. If a face area is detected in the first image data (step S1020: YES), step S1030 is executed. On the other hand, if a face area is not detected (step S1020: NO), the process returns to step S1000, and the first information processing device 200 can again obtain the first image data in the visible light region and the temperature distribution data in the infrared light region captured by the first imaging device 210, and the third image data in the visible light region captured by the third imaging device 260 (step S1000).

[0144] In step S1030, the first information processing apparatus 200 (first face information generating unit 1030) can generate face image data based on the face region. When the face image data is generated, step S1040 is executed.

[0145] In step S1040, the first information processing apparatus 200 (first face information generating unit 1030) can acquire position information of face image data in the first image data, and generate face information including the face image data and the position information.

[0146] In step S1050, the first information processing apparatus 200 (temperature information generating unit 1040) can generate temperature information of the subject corrected by the temperature of the blackbody furnace 240 from the temperature distribution data based on the face information.

[0147] In step S1060, the first information processing device 200 (first face matching unit 1060) can match the face image data of the generated face information with the face image data of the registration information to identify the target person. If the target person is identified (step S1060: YES), the first information processing device 200 (attendee information processing unit 1070) executes step S1070. On the other hand, if the target person is not identified (step S1060: NO), step S1080 is executed.

[0148] In step S1070, the first information processing apparatus 200 (attendee information processing section 1070) can generate attendee information that links the face information, the temperature information, and the registration information. When the attendee information is generated, step S1080 is executed.

[0149] In step S1080, the first information processing device 200 (first face matching unit 1060) can generate match impossible information. When the match impossible information is generated, step S1070 is executed. In this case, in step S1070, the first information processing device 200 (attendee information processing unit 1070) can generate attendee information that links the face information, temperature information, registration information, and match impossible information.

[0150] In step S1090, the first information processing device 200 (attendee information processing unit 1070) can determine whether or not the temperature included in the temperature information of the subject is equal to or lower than a predetermined temperature. If the temperature of the subject is equal to or lower than the predetermined temperature (step S1090: YES), the first information processing device 200 can convert the generated attendee information into a display image signal. The display image signal is transmitted to the first display device 220, and display processing (step S1100) is executed. On the other hand, if the temperature of the subject exceeds the predetermined temperature (step S1090: NO), step S1110 is executed.

[0151] Details of step S1100 (display processing) will be described later, but after step S1100 ends, step S1030 is executed.

[0152] In step S1110, the first information processing device 200 can generate a control signal. The generated control signal is transmitted to the warning device 230, and a warning process (step S1120) is executed.

[0153] Details of step S1120 (warning processing) will be described later, but after completing step S1120, the process returns to step S1000, and the first image data in the visible light region and temperature distribution data in the infrared light region captured by the first imaging device 210, as well as the third image data in the visible light region captured by the third imaging device 260, can be acquired again.

[0154] In step S1130, the first information processing device 200 (visitor information processing unit 1070) can determine whether or not operation information has been received. For example, the first information processing device 200 can be determined to receive operation information within a certain time period as a condition for determination. If the first information processing device 200 receives operation information (step S1130: YES), the process returns to step S1000, and the first image data in the visible light region and the temperature distribution data in the infrared light region captured by the first imaging device 210, as well as the third image data in the visible light region captured by the third imaging device 260, can be acquired again. On the other hand, if the first information processing device 200 does not receive operation information (step S1130: NO), the visitor information is transmitted to the third information processing device 400, and step S1140 is executed.

[0155] In step S1140, the third information processing apparatus 400 (entrance / exit management information processing unit 1210) can generate entrance / exit management information by converting visitor information into a database.

[0156] When the entrance / exit management information is generated, the entrance process ends.

[0157] The display process (step S1100) will be described in detail with reference to FIG.

[0158] In step S1101, the first display device 220 can acquire a display image signal. When the display image signal is acquired, step S1102 is executed.

[0159] In step S1102, the first display device 220 can display an image on the screen of the first display device 220 based on the display image signal. At this time, the matching result of the subject is displayed on the screen of the first display device 220. Therefore, the subject can check whether the matching result is correct by looking at the screen.

[0160] In step S1103, the first display device 220 can determine whether or not the matching result displayed on the screen is a false positive. Specifically, the first display device 220 determines whether or not the subject has performed an input operation that is falsely detected. If an input operation that is falsely detected has been performed (step S1103: YES), step S1104 is executed. If an input operation that is falsely detected has not been performed (step S1103: NO), the display process (step S1100) ends.

[0161] In step S1104, the first display device 220 can generate operation information. The generated operation information is transmitted to the first information processing device 200. When the operation information is generated, the display process (step S1100) ends.

[0162] Next, the warning process (step S1120) will be described in detail with reference to FIG.

[0163] In step S1121, the warning device 230 can obtain a control signal.

[0164] In step S1122, the warning device 230 can be activated based on the control signal. The subject can confirm that his / her own body temperature is high by the activation of the warning device 230. When the warning device 230 is activated, the warning process (step S1120) ends.

[0165] [3. Exit processing of the entrance / exit management system 30] Fig. 13 is a flow chart showing the exit process of the entrance / exit management system 30 according to one embodiment of the present invention. Specifically, Fig. 13 shows the process executed by the second information processing device 300 and the third information processing device.

[0166] Steps S2010 to S2040 and steps S2060 to S2080 of the exit process are similar to steps S1020 to S1040, S1060, S1080, S1100, and S1130 of the entrance process, and therefore may not be described here.

[0167] In step S2000, the second information processing device 300 can acquire second image data in the visible light region captured by the second imaging device 310. When the second image data is acquired, step S2010 is executed.

[0168] In step S2010, the second information processing device 300 (second face information generating unit 1130) can determine the detection of a face area in the second image data. If a face area is detected in the second image data (step S2010: YES), step S2020 is executed. On the other hand, if a face area is not detected in the second image data (step S2010: NO), the process returns to step S2000, and the second information processing device 300 can again acquire second image data in the visible light region captured by the second imaging device 310.

[0169] In step S2020, the second information processing apparatus 300 can generate face image data based on the face region. When the face image data is generated, step S2030 is executed.

[0170] In step S2030, the second information processing apparatus 300 (second face information generating unit 1130) can acquire position information of face image data in the second image data, and generate face information including the face image data and the position information.

[0171] In step S2040, the second information processing device 300 (second face matching unit 1160) can match the face image data of the generated face information with the face image data of the registration information to identify the target person. If the target person is identified (step S2040: YES), step S2050 is executed. On the other hand, if the target person is not identified (step S2040: NO), step S2060 is executed. In this case, the second information processing device 300 (exiting person information processing unit 1170) can generate exiting person information that links the face information and the non-matching information (step S2050).

[0172] In step S2050, the second information processing apparatus 300 (the exiting person information processing unit 1170) can generate exiting person information that links the face information and the registration information. When the exiting person information is generated, a display process (step S2070) is executed.

[0173] In step S2060, the second information processing device 300 (the second face matching unit 1160) can generate match impossible information. When the match impossible information is generated, step S2050 is executed. In this case, the second information processing device 300 (the exiting person information processing unit 1170) can generate exiting person information that links the face information, the registration information, and the match impossible information.

[0174] Step S2070 (display processing) is similar to step S1100, and therefore description thereof will be omitted here. After step S2070 ends, step S2080 is executed.

[0175] In step S2080, the second information processing device 300 (exiting person information processing unit 1170) can determine whether or not operation information has been received (step S2080). If the second information processing device 300 has received operation information (step S2080: YES), the process returns to step S2000, and the second image data in the visible light region captured by the second imaging device 310 can be obtained again. On the other hand, if the second information processing device 300 has not received operation information (step S2080: NO), exiting person information is transmitted to the third information processing device 400, and step S2090 is executed.

[0176] In step S2090, the third information processing device 400 (entrance / exit management information processing unit 1210) can obtain the entrance / exit management information from the entrance / exit management information storage unit 1220 and update the entrance / exit management information.

[0177] When the entrance / exit management information is updated, the exit process ends.

[0178] The entrance / exit management system 30 according to this embodiment has been described above. Since the marker 250 is disposed at an appropriate distance from the first imaging device 210, the entrance / exit management system 30 can perform entrance processing including temperature measurement and face authentication at an appropriate position. Therefore, in the entrance processing of the entrance / exit management system 30, highly accurate temperature measurement and face authentication of the subject are possible. In addition, since the entrance / exit management system 30 also performs exit processing, it is possible to manage the entrance processing and exit processing of the subject as a series. Therefore, it is possible to easily grasp the stay time of the subject, etc. <Fourth embodiment> A unit panel 40 including an entrance / exit management system according to one embodiment of the present invention will be described with reference to Figures 14 and 15. When the entrance / exit management system included in the unit panel 40 includes a configuration similar to that of the entrance / exit management system 30, a description of the configuration may be omitted.

[0179] 14 and 15 are respectively a schematic perspective view and a schematic plan view of a unit panel 40 according to an embodiment of the present invention. The unit panel 40 includes a panel material 500A, and the panel material 500A is provided with all or part of the configuration of an entrance / exit management system. The entrance / exit management system provided on the panel material 500A is, for example, a first information processing device 200A, a first imaging device 210A, a first display device 220A, a warning device 230A, a third imaging device 260A, a second information processing device 300A, a second imaging device 310A, or a second display device 320A. In addition, a black body furnace 240A is arranged so as to be within the angle of view of the first imaging device 210A, and a marker 250A is arranged on the floor surface so as to be within the angle of view of the third imaging device 260A. Therefore, by installing the unit panel 40 at the entrance and exit of a construction site, the entrance and exit management system provided in the unit panel 40 can be used to manage the entrance and exit of workers to the construction site.

[0180] The material of the panel material 500A is not particularly limited. For example, wood or resin material can be used as the panel material 500A. The panel material 500A is provided with an opening 510A for the subject to pass through.

[0181] The first imaging device 210A, the first display device 220A, the warning device 230A, and the third imaging device 260A are provided on one side of the first surface 501A of the panel material 500A. The first information processing device 200A is provided on one side of the second surface 502A, which is the back surface of the panel material 500A on which these devices are provided. The first imaging device 210A, the first display device 220A, the warning device 230A, and the third imaging device 260A are connected to the first information processing device 200A. When the first information processing device 200A is connected wirelessly, the first information processing device 200A does not need to be located near the panel material 500A.

[0182] A second imaging device 310A and a second display device 320A are provided on the other side of the second surface 502A of the panel material 500A. A second information processing device 300A is provided on the other side of the first surface 501A, which is the back surface of the panel material 500A on which these devices are provided. The second imaging device 310A and the second display device 320A are connected to the second information processing device 300A. Note that, when the second information processing device 300A is connected wirelessly, the second information processing device 300A does not need to be located near the panel material 500A.

[0183] 15(A) and 15(B), the third information processing device 400A is installed away from the panel material 500A, but the third information processing device 400A may also be provided on the panel material 500A. The third information processing device 400A is connected to the first information processing device 200A and the second information processing device 300A. When the third information processing device 400A is connected wirelessly, the third information processing device 400A does not need to be located near the panel material 500A.

[0184] The opening 510A corresponds to the first gate or the second gate. The unit panel 40 is installed so that the second surface 502A of the panel material 500A is connected to the entrance and exit of the construction site. As shown in FIG. 15(A), when entering, the subject undergoes an entrance process using an entrance and exit management system on the first surface 501A side of the panel material 500A, and passes through the opening 510A to head toward the second surface 502A side. On the other hand, as shown in FIG. 15(B), when leaving, the subject undergoes an exit process using an entrance and exit management system on the second surface 502A side of the panel material 500A, and passes through the opening 510A to head toward the first surface 501A side.

[0185] The unit panel 40 according to this embodiment can be easily installed or removed anywhere. Therefore, during the construction period at a construction site, or during the period when an event facility or event venue is held, the unit panel 40 can be temporarily installed and an entrance / exit management system can be used to manage the entrance and exit of target persons.

[0186] <Fifth embodiment> A unit house 50 including an entrance / exit management system according to one embodiment of the present invention will be described with reference to Fig. 16 and Fig. 17. When the entrance / exit management system included in the unit house 50 includes a configuration similar to that of the entrance / exit management system 30, the description of the configuration may be omitted.

[0187] 16 and 17 are respectively a schematic perspective view showing the exterior and a schematic plan view showing the internal configuration of a unit house 50 according to an embodiment of the present invention. The unit house 50 includes a box-shaped body 600B consisting of four side walls, a ceiling surface covering the upper part of the space surrounded by the four side walls, and a floor surface covering the lower part of the space surrounded by the four side walls, and the box-shaped body 600B is provided with all or part of the configuration of the entrance and exit management system. The entrance and exit management system provided in the box-shaped body 600B is, for example, a first information processing device 200B, a first imaging device 210B, a first display device 220B, a warning device 230B, a black body furnace 240B, a marker 250B, a third imaging device 260B, a second information processing device 300B, a second imaging device 310B, a second display device 320B, or a third information processing device 400B. Therefore, if the modular house 50 is installed at the entrance and exit of a construction site, the entrance and exit management system provided in the modular house 50 can be used to manage the entrance and exit of workers to the construction site.

[0188] Each of the side wall surface, ceiling surface, and floor surface of the box-shaped body 600B may be composed of one material or multiple materials. Also, the box-shaped body 600B may be composed of a frame body formed by using pillar materials or beam materials, and a panel material may be fixed to the frame body. The box-shaped body 600B may be a so-called container, a prefabricated house, or a storage room, or may be a simple building used for a house, an office, a warehouse, a store, or the like.

[0189] The modular house 50 may be capable of being moved as is and installed at the construction site, or may be capable of being divided into several components and installed by assembling them at the construction site.

[0190] Of the four side walls of the box-shaped body 600B, a first door 610B and a second door 620B are provided on two opposing side walls. The first door 610B and the second door 620B correspond to a first gate and a second gate, respectively, and the modular house 50 is installed so that the second door 620B is connected to the entrance and exit of the construction site. When a subject enters the construction site, the subject enters through the first door 610B, an entrance process using an entrance and exit management system is performed, and the subject exits through the second door 620B. When a subject exits the construction site, the subject enters through the second door 620B, an exit process using an entrance and exit management system is performed, and the subject exits through the first door 610B.

[0191] When a window is provided on the side wall surface, the first door 610B, or the second door 620B of the box-shaped body 600B, it is preferable that a light-shielding member such as a curtain, blind, or smoke film is provided on the window in order to block light entering the unit house 50 through the window. By blocking the light from the window, the illuminance inside the box-shaped body 600B can be kept constant. Therefore, the subject can always be photographed under the same illuminance conditions, improving the accuracy of the subject matching process.

[0192] An air conditioner 650B including an indoor unit 651B, an outdoor unit 652B, and a piping 653B is provided on the side wall surface of the box-shaped body 600B. The air conditioner 650B is provided in the unit house 50, so that the temperature inside the box-shaped body 600B can be kept constant. Therefore, the subject can always be photographed under the same temperature conditions, improving the accuracy of the subject's body temperature measurement. In addition, a ventilation port or a ventilation fan may be provided on the side wall surface to circulate the air inside the box-shaped body 600B. The indoor unit 651B, the ventilation port, and the ventilation fan may be installed not only on the side wall surface but also on the ceiling surface.

[0193] Moreover, the unit house 50 is preferably equipped with a rechargeable battery unit 660B. By providing the unit house 50 with the battery unit 660B, even if it is difficult to supply power from the outside at the construction site, power can be supplied from the battery unit 660B to each device of the unit house 50. The unit house 50 may be equipped with a power generation device (for example, a solar power generation device or a wind power generation device provided on the ceiling or wall, or a self-power generation device provided under the floor, etc.).

[0194] Furthermore, the unit house 50 may be provided with a sensor that detects the opening and closing of the first door 610B or the second door 620B. By providing the sensor in the unit house 50, for example, when the first door 610B or the second door 620B is opened, the power supply of the entrance and exit management system of the unit house 50 can be turned on.

[0195] The unit house 50 according to this embodiment can be installed by moving the box-shaped body 600B and attaching some components, so it can be easily installed or removed anywhere. Therefore, during the construction period at a construction site, or during the period when an event facility or event venue is held, the unit house 50 can be temporarily installed and the entrance and exit management system can be used to manage the entrance and exit of the target person.

[0196] The above-described embodiments of the present invention may be combined as appropriate as long as they are not mutually inconsistent. Furthermore, those in which a person skilled in the art appropriately adds or removes components or modifies designs, or adds or omits steps or modifies conditions, based on the embodiments, are also included in the scope of the present invention as long as they include the gist of the present invention.

[0197] Even if there are other effects and advantages different from those brought about by the respective embodiments described above, those which are clear from the description in this specification or which can be easily predicted by a person skilled in the art are naturally understood to be brought about by the present invention. [Explanation of symbols]

[0198] 10: face recognition system, 11: blackbody furnace, 12, 12A, 12B: marker, 13: first imaging device, 13a: first imaging section, 14: second imaging device, 14a: second imaging section, 15: information processing device, 15a: marker determination section, 15b: face information generation section, 15c: temperature information generation section, 15d: registration information storage section, 15e: face matching section, 15f: person information processing section, 20: face recognition system, 21: black body furnace, 22: marker group, 22-1: first marker, 22-2: second marker, 22-3: third marker, 22-4: fourth marker, 22-5: fifth marker, 23: imaging device, 25: information processing device, 30: entrance / exit management system, 40: unit panel, 50: unit house, 100: first gate, 110: second gate, 120: passage, 200, 200A, 200B: first information processing device; 210, 210A, 210B: first imaging device; 220, 220A, 220B: first display device; 230, 230A, 230B: warning device; 240, 240A, 240B: black body furnace; 250, 250A, 250B: marker; 260, 260A, 260B: third imaging device; 300, 300A, 300B: second information processing device; 310, 310A, 310B: second imaging device; 320, 320A, 320B: second display device; 400, 400A, 400B: third information processing device, 500A: panel material; 501A: first surface; 502A: second surface; 510A: opening; 600B: box-shaped body, 610B: first door, 620B: second door, 650B: air conditioner, 651B: indoor unit, 652B: outdoor unit, 653B: piping, 660B: battery section, 1010: first imaging unit, 1020: marker determination unit, 1030: first face information generation unit, 1040: temperature information generation unit, 1050: first registration information storage unit, 1060: first face matching unit, 1070: entrance person information processing unit, 1080: first display unit, 1090: warning unit, 1110: second imaging unit, 1130: second face information generation unit, 1150: second registration information storage unit, 1160: second face matching unit, 1170: exit person information processing unit, 1180: second display unit, 1210: entrance / exit management information processing unit, 1220: entrance / exit management information storage unit, 1310: third imaging unit

Claims

1. A marker and a first imaging unit that generates first image data in a visible light region and temperature distribution data in an infrared light region corresponding to the first image data; a second imaging unit that is disposed at a position different from that of the first imaging unit so as to include the marker in an angle of view and that generates second image data in a visible light region; a marker determination unit that determines the presence or absence of the marker in the second image data and a detection pattern of the marker between frames of the second image data; a face information generating unit that generates face information of a person from the first image data; a temperature information generating unit that generates temperature information including a temperature of the person from the temperature distribution data based on the face information, A face recognition system that generates the face information and the temperature information when the marker determination unit determines that the marker is not detected and the movement direction of the person determined based on the detection pattern of the marker is a predetermined direction.

2. The facial recognition system according to claim 1 , wherein the marker is disposed on a floor surface.

3. The facial recognition system according to claim 1 , wherein the marker is projected onto a floor surface.

4. The face authentication system according to claim 1 , wherein the marker is a QR code.

5. The face authentication system according to claim 1 , further comprising a face matching unit that matches face image data of the person included in the face information with face image data included in registration information.

6. Taking an image of a person and generating first image data in a visible light region and temperature distribution data in an infrared light region corresponding to the first image data; Photographing the marker to generate second image data in the visible light region; generating face information of the person from the first image data when the marker is not detected in the second image data and the moving direction of the person determined based on the detection pattern of the marker is a predetermined direction; A temperature measuring method, comprising: generating temperature information including the temperature of the person from the temperature distribution data based on the face information.

7. The temperature measuring method according to claim 6 , further comprising: comparing face image data of the person included in the face information with face image data included in registration information.

Images