Management system, management method, and program

Abstract

To simplify identification of a person.SOLUTION: A management system 1 comprises a first imaging unit 4, an image generation unit 231, and a behavior management unit 233. The first imaging unit 4 is provided in a facility 100. The first imaging unit 4 captures an image of a person attempting to enter a managed area A1 from an entrance of the managed area A1 in the facility 100 and generates a plurality of first captured images. The image generation unit 231 generates a three-dimensional image of an entire body of the person based on the plurality of first captured images. The behavior management unit 233 manages behavior of people present in the managed area A1 by comparing the three-dimensional image with a second captured image captured by a second imaging unit 5 provided in the managed area A1.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates generally to a management system, a management method, and a program, and more particularly to a management system, a management method, and a program for managing the actions of people in a controlled area. [Background technology]

[0002] Patent Document 1 discloses a non-health condition monitoring device. The non-health condition monitoring device of Patent Document 1 includes an image sensor that captures images in an office, a behavior identification unit that identifies a person's position and the orientation of their body or face from the images as their behavior, and a condition determination unit that determines whether or not the person is in an unhealthy condition based on the identified behavior. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-101952 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, the image sensor in Patent Document 1 is an image sensor installed on, for example, the ceiling or wall of an office. With an image sensor installed on the ceiling or wall of an office, for example, if a person's face is not facing the image sensor, it is difficult to identify who is included in the imaging range of the image sensor.

[0005] The present disclosure has been made in consideration of the above-mentioned circumstances, and aims to provide a management system, a management method, and a program that can facilitate the identification of people. [Means for solving the problem]

[0006] A management system according to an embodiment of the present disclosure includes a first imaging unit, an image generation unit, and a behavior management unit. The first imaging unit is provided in a facility. The first imaging unit captures an image of a person attempting to enter a managed area of ​​the facility through an entrance of the managed area to generate a plurality of first captured images. The image generation unit generates a three-dimensional image of the person's entire body based on the plurality of first captured images. The behavior management unit manages the behavior of the person present in the managed area by comparing a second captured image captured by a second imaging unit provided in the managed area with the three-dimensional image.

[0007] A management method according to one aspect of the present disclosure is a method used in the management system. The management system generates a plurality of first captured images by capturing an image of a person attempting to enter a managed area of ​​the facility through an entrance of the managed area using a first imaging unit provided in the facility. The management method includes an image generating step and a motion management step. In the image generating step, a three-dimensional image of the person's entire body is generated based on the plurality of first captured images. In the management step, a second captured image captured by a second imaging unit provided in the managed area is compared with the three-dimensional image to manage the motion of the person present in the managed area.

[0008] A program according to one aspect of the present disclosure is a program for causing one or more processors to execute the management method. Effect of the Invention

[0009] According to the management system, management method, and program according to the above aspects of the present disclosure, it is possible to facilitate the identification of people. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of a management system according to an embodiment. [Diagram 2] FIG. 2 is an explanatory diagram for explaining the operation of the management system. [Diagram 3]FIG. 3 is an explanatory diagram for explaining another operation of the management system. [Figure 4] FIG. 4 is an explanatory diagram for explaining still another operation of the management system. [Diagram 5] FIG. 5 is a schematic diagram showing an example of a reception screen in the management system. [Figure 6] FIG. 6 is a schematic diagram showing another example of the reception screen in the management system. [Figure 7] FIG. 7 is a flowchart showing the operation of the management system. [Figure 8] FIG. 8 is a flowchart showing another operation of the management system. [Figure 9] FIG. 9 is a flowchart showing still another operation of the management system. [Figure 10] FIG. 10 is a schematic diagram showing a configuration of a management system according to the first modification. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the drawings. In addition, elements common to the embodiments described below are given the same reference numerals, and duplicated descriptions of the common elements may be omitted. The following embodiment is merely one of various embodiments of the present disclosure. Various modifications of the embodiment may be made depending on the design, etc., as long as the object of the present disclosure can be achieved. In addition, the following embodiments and modified examples may be made depending on the design, etc., as long as the object of the present disclosure can be achieved. In addition, the configurations of the modified examples may be appropriately combined.

[0012] Each drawing described in this disclosure is a schematic drawing, and the ratio of the size and thickness of each component in each drawing does not necessarily reflect the actual dimensional ratio.

[0013] (1) Overview First, an overview of a management system 1 according to the present embodiment will be described with reference to FIGS.

[0014] As shown in FIG. 1, the management system 1 of this embodiment is provided in a facility 100. The management system 1 is a system that estimates the movement of a person H1 (see FIG. 3) in a management area A1 of the facility 100. In the first embodiment, it is assumed that the facility 100 is an office. In the present disclosure, the term "facility" includes residential facilities used for residential purposes, as well as non-residential facilities such as stores, offices, welfare facilities, educational facilities, hospitals, and factories. Non-residential facilities also include restaurants, amusement parks, hotels, inns, kindergartens, nurseries, and community centers. In other words, the facility 100 may be a residential facility such as an apartment building, or a non-residential facility such as an office. Furthermore, the facility 100 also includes a facility in which residential facilities and non-residential facilities are mixed, for example, where the lower floors are stores and the upper floors are residences.

[0015] As shown in FIG. 1, the management system 1 of this embodiment includes a plurality of first imaging units 4 (three in the example of FIG. 1), an image generating unit 231, and an operation management unit 233.

[0016] The first imaging unit 4 is provided in the facility 100. The first imaging unit 4 captures an image of a person H1 (see FIG. 2) attempting to enter the managed area A1 from an entrance of the managed area A1 of the facility 100, and generates a plurality of first captured images. In this embodiment, a door 102 (see FIG. 2) is provided at the entrance of the managed area A1.

[0017] The image generating section 231 generates a three-dimensional image (or a three-dimensional model) of the entire body of the person H1 based on the multiple first captured images.

[0018] The movement management unit 233 manages the movement of the person H1 present in the management area A1 by comparing the second captured image captured by the second imaging unit 5 provided within the management area A1 with the above-mentioned three-dimensional image.

[0019] According to the management system 1 of the present embodiment, since a 3D image of the whole body of the person H1 is used to identify the person H1, for example, in the management area A1, it is possible to identify the person H1 even if the face of the person H1 is not facing the second imaging unit 5. In other words, according to the management system 1 of the present embodiment, it is possible to easily identify the person H1.

[0020] (2)Details Hereinafter, a detailed configuration of the management system 1 according to the present embodiment will be described with reference to FIGS.

[0021] (2.1) Management System Configuration As shown in FIG. 1, the management system 1 includes a management device 2, an entrance device 3, multiple (three in the example of FIG. 1) first imaging units 4, multiple (three in the example of FIG. 1) second imaging units 5, a desk 6, a seat 7, and an information terminal 8.

[0022] (2.2) Configuration of the first imaging unit 1 and 2, the three first imaging units 4 include a first imaging unit 4a, a first imaging unit 4b, and a first imaging unit 4c. In the following description, when the first imaging unit 4a, the first imaging unit 4b, and the first imaging unit 4c are not particularly distinguished from each other, the first imaging unit 4a, the first imaging unit 4b, and the first imaging unit 4c may be simply referred to as the "first imaging unit 4." The three first imaging units 4 are provided in a non-managed area A2, which is an area different from the managed area A1 in the facility 100.

[0023] The first imaging unit 4a in this embodiment is built into the entrance device 3. The first imaging unit 4a is a front camera that captures an image of the entire body of a person H1 standing facing the entrance device 3 at a predetermined position in the non-managed area A2 from the front (i.e., in front). The first imaging unit 4a transmits the captured image to the management device 2. In the following description, the image captured by the first imaging unit 4a of the person H1 may be referred to as a "front image." In addition, the "image" in this disclosure includes still images, videos, and frame-by-frame images. "Generating an image" includes generating image data, and "transmitting an image" includes transmitting image data.

[0024] The first imaging unit 4b in this embodiment is provided above a predetermined position. More specifically, the first imaging unit 4b in this embodiment is provided on the ceiling 101 facing the non-managed area A2. The first imaging unit 4b is a camera that captures an image of the entire body of a person H1 standing facing the entrance device 3 at a predetermined position from above. The first imaging unit 4b transmits the captured image to the management device 2.

[0025] The first imaging unit 4c in this embodiment is provided next to a predetermined position. The first imaging unit 4c is a camera that captures an image of the entire body of a person H1 standing at the predetermined position facing the entrance device 3 from the side. The first imaging unit 4c transmits the captured image to the management device 2.

[0026] As described above, the three first imaging units 4 capture images of the person H1 attempting to enter the managed area A1 from the entrance from different angles.

[0027] (2.3) Configuration of the entrance device The entrance device 3 is a device that receives a person H1 who wishes to enter the controlled area A1. The entrance device 3 is provided facing a predetermined position in the uncontrolled area A2.

[0028] 1 and 2, the entrance device 3 includes a touch panel 31 (see FIG. 2) and a speaker 32 (see FIG. 2). As described above, the entrance device 3 of this embodiment includes the first imaging unit 4a.

[0029] The touch panel 31 functions as a display unit and an operation unit. The touch panel 31 displays various types of notification information for the person H1. The touch panel 31 also accepts operations by the person H1.

[0030] The speaker 32 outputs various notification information to the person H1 by sound or voice.

[0031] The entrance device 3 of this embodiment includes an interface configured to be capable of communicating with the three first imaging units 4. Note that "capable of communication" in this disclosure means that information can be exchanged directly or indirectly via a network or a repeater, etc., by an appropriate communication method such as wired communication or wireless communication.

[0032] The entrance device 3 controls the three first imaging units 4. The entrance device 3 controls the three first imaging units 4 in response to the operation of the person H1 on the touch panel 31. When the operation performed by the person H1 on the touch panel 31 is an operation for obtaining new entrance qualification, the entrance device 3 activates all three first imaging units 4. Then, the entrance device 3 notifies the person H1 to stand at a predetermined position using at least one of the touch panel 31 and the speaker 32. When the entrance device 3 detects that the person H1 has stood at a predetermined position, it causes each of the three first imaging units 4 to capture an image of the entire body of the person H1. The entrance device 3 transmits the captured images generated by each of the three first imaging units 4 to the management device 2.

[0033] Furthermore, if the operation performed by the person H1 on the touch panel 31 is an operation for the person H1, who has already obtained entry qualification, to enter the managed area A1, the entrance device 3 activates the first imaging unit 4a of the three first imaging units 4. Then, the entrance device 3 notifies the person H1 to stand at a predetermined position using at least one of the touch panel 31 and the speaker 32. When the entrance device 3 detects that the person H1 has stood at the predetermined position, it causes the first imaging unit 4a to capture an image of the entire body of the person H1. The entrance device 3 transmits the front image generated by the first imaging unit 4a to the management device 2.

[0034] (2.4) Configuration of the second imaging unit As shown in FIG. 3, the three second imaging units 5 include a second imaging unit 5a, a second imaging unit 5b, and a second imaging unit 5c. In the following description, when the second imaging unit 5a, the second imaging unit 5b, and the second imaging unit 5c are not particularly distinguished from each other, the second imaging unit 5a, the second imaging unit 5b, and the second imaging unit 5c may be simply referred to as the "second imaging unit 5". The three second imaging units 5 are provided on the ceiling 103 facing the managed area A1 in the facility 100. The number of the second imaging units 5 provided in the managed area A1 may be four or more, or two or less. In other words, the number of the second imaging units 5 provided in the managed area A1 may be one or more, but it is preferable that the management system 1 can generate an image that can identify the person H1 in the entire managed area A1. The second imaging unit 5 of this embodiment is provided integrally with a lighting device that irradiates light to the managed area A1.

[0035] The second imaging unit 5 of this embodiment is basically always in operation. The imaging range A11 of the second imaging unit 5a includes the first region in the imaging range. In other words, the second imaging unit 5a is a first region imaging unit that images the first region and generates a first region image. The first region of this embodiment includes the region in which the seat 7 where the person H1 is sitting is located in FIG. 3. The imaging range A12 of the second imaging unit 5b includes the second region in the imaging range. In other words, the second imaging unit 5b is a second region imaging unit that images the second region and generates a second region image. The second region of this embodiment does not include the region in which the seat 7 where the person H1 is sitting is located in FIG. 3. The imaging range A13 of the second imaging unit 5c includes the third region in the imaging range. In other words, the second imaging unit 5c is a third region imaging unit that images the third region and generates a third region image. The third area in this embodiment is an area that does not include the area where the seat 7 where the person H1 is sitting is located in Fig. 3, and is an area that is farther from the first area than the second area is. The three second imaging units 5 transmit captured images to the management device 2 in real time.

[0036] (2.5) Seat and desk configuration The seat 7 is located in the controlled area A1 of the facility 100. More specifically, the seat 7 is located in a first region of the controlled area A1.

[0037] The desk 6 is placed in the management area A1 of the facility 100. The desk 6 corresponds to the seat 7 where the person H1 is sitting in FIG. 3. That is, the desk 6 is included in the first area. As shown in FIG. 1, the desk 6 of this embodiment includes a communication unit 61 and a lifting mechanism 62.

[0038] The communication unit 61 includes an interface configured to be able to communicate with the management device 2 .

[0039] The lifting mechanism 62 is electrically powered and configured to be capable of increasing and decreasing the height of the desk 6. Note that "increasing the height of the desk 6" includes increasing the height of the top of the desk 6. The lifting mechanism 62 of this embodiment changes the height of the desk 6 based on an instruction from the management device 2. Note that the lifting mechanism 62 may be configured to be able to change the height of the desk 6, for example, by operating an operation unit provided on the desk 6.

[0040] (2.6) Management Device Configuration As shown in FIG. 1, the management device 2 of this embodiment includes a communication unit 21, a storage unit 22, and a processing unit .

[0041] The communication unit 21 includes an interface configured to communicate with the entrance device 3, an interface configured to communicate with the three first imaging units 4, an interface configured to communicate with the three second imaging units 5, an interface configured to communicate with the desk 6, and an interface configured to communicate with the information terminal 8.

[0042] The storage unit 22 includes an electrically readable and writable non-volatile memory. More specifically, the storage unit 22 of this embodiment includes an EEPROM (Electrically Erasable Programmable Read Only Memory). The storage unit 22 may include a rewritable ROM (Read Only Memory) other than the EEPROM. The storage unit 22 may be a hard disk drive or the like.

[0043] The memory unit 22 in this embodiment stores a three-dimensional image, an authentication image, identification information, etc. for each person H1 who is permitted to enter the managed area A1. The memory unit 22 also stores participation information for each person H1 who is participating in the health promotion system (or health promotion program). The memory unit 22 also stores layout information for the managed area A1. The layout information includes position information of the desks 6 and seats 7 in the managed area A1. The layout information in this embodiment also includes information on the combination (or correspondence) of the seats 7 and the desks 6.

[0044] The processing unit 23 mainly comprises, for example, a computer system having one or more processors and one or more memories. In the management device 2, the one or more processors execute a program recorded in the memory, thereby realizing the function of the processing unit 23. The program may be pre-recorded in the memory, may be provided via a telecommunication line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

[0045] As shown in FIG. 1, the processing unit 23 includes an image generating unit 231, an entrance management unit 232, an operation management unit 233, and a reception unit 234.

[0046] The image generating section 231 generates a 3D image of the whole body of the person H1 based on the plurality of first captured images. The image generating section 231 of this embodiment generates a 3D image of the whole body of the person H1 based on the first captured image captured by the first imaging section 4a, the first captured image captured by the first imaging section 4b, and the first captured image captured by the first imaging section 4c. That is, the image generating section 231 of this embodiment generates a 3D image based on the plurality of first captured images generated by the plurality of first imaging sections 4. Since the first imaging section 4a, the first imaging section 4b, and the first imaging section 4c capture the image of the person H1 from different angles, it is possible to generate a 3D image of the person H1 more accurately.

[0047] Furthermore, in the 3D image of person H1 generated by the image generating unit 231 of this embodiment, the amount of information of the head of person H1 in the 3D image is greater than the amount of information of the part below the head of person H1 in the 3D image. The head includes many parts that tend to be characteristic of each person, such as eyes, nose, mouth, ears, and hair. According to the management system 1 of this embodiment, by making the amount of information of the head of person H1 in the 3D image greater than the amount of information of the part below the head, it is possible to generate a 3D image that makes it easy to identify person H1 while preventing the amount of information of the 3D image from becoming too large.

[0048] The entrance management unit 232 permits or restricts the entrance of person H1 who is attempting to enter the managed area A1 into the managed area A1. The entrance management unit 232 authenticates person H1 who is attempting to enter the managed area A1. If the entrance management unit 232 succeeds in authenticating person H1, it opens (or unlocks) the door 102. On the other hand, if the entrance management unit 232 fails to authenticate person H1, it does not open the door 102. Note that the door 102 in this embodiment is an automatic door. According to the management system 1 of this embodiment, it is possible to not only manage the behavior of person H1 who is present in the managed area A1, but also to manage entrance into the managed area A1.

[0049] More specifically, the entrance management unit 232 of this embodiment performs authentication by comparing a first captured image (front image) captured by the first imaging unit 4a of the person H1 with an authentication image registered in advance in the storage unit 22. That is, the entrance management unit 232 of this embodiment performs authentication by comparing one first captured image included in the plurality of first captured images with an authentication image registered in advance in the storage unit 22. The entrance management unit 232 performs a pattern matching process or a process of recognizing an object reflected in an image using a trained model created by machine learning, and the like, to determine whether or not an authentication image having a similarity to one first captured image that is equal to or greater than a threshold is stored in the storage unit 22. The entrance management unit 232 determines that authentication of the person H1 has been successful when there is an authentication image having a similarity to one first captured image that is equal to or greater than a threshold among the authentication images stored in the storage unit 22. On the other hand, if there is no authentication image stored in the memory unit 22 whose similarity to a first captured image is equal to or greater than a threshold value, the entrance management unit 232 determines that authentication of person H1 has failed and restricts entry of person H1 into the managed area A1.

[0050] Then, when the authentication of the person H1 is successful, the entrance management unit 232 judges whether or not a three-dimensional image of the person H1 has been generated in the image generation unit 231. When the authentication of the person H1 is successful and the three-dimensional image of the person H1 has been generated in the image generation unit 231, the entrance management unit 232 permits the person H1 who is attempting to enter the managed area A1 to enter the managed area A1. On the other hand, when the image generation unit 231 has not been able to generate a three-dimensional image of the person H1, the entrance management unit 232 restricts the person H1 who is attempting to enter the managed area A1 from entering the managed area A1. According to the management system 1 of this embodiment, the person H1 is authenticated by comparing the first captured image for generating a three-dimensional image with the authentication image, so that the first captured image for generating a three-dimensional image can be utilized for entrance management of the managed area A1.

[0051] The operation management unit 233 manages the operation of the person H1 present in the management area A1 by comparing the second captured image captured by the second imaging unit 5 provided in the management area A1 with the three-dimensional image stored in the storage unit 22. More specifically, the operation management unit 233 identifies the person H1 included in the imaging range of the second imaging unit 5 by comparing the second captured image with the three-dimensional image, and manages the operation of the identified person H1. According to the management system 1 of this embodiment, since the comparison target of the second captured image is a three-dimensional image, it is possible to identify the person H1 included in the imaging range of the second imaging unit 5 with higher accuracy than when the comparison target of the second captured image is a two-dimensional reference image.

[0052] The operation management unit 233 of this embodiment judges whether the specified person H1 is sitting on the seat 7 based on the first region image. The operation management unit 233 starts measuring the sitting time when it judges that the specified person H1 is sitting on the seat 7. Then, when the specified person H1 leaves the seat 7 after judging that the specified person H1 has been sitting continuously for a predetermined time or more, the operation management unit 233 raises the height of the desk 6 corresponding to the seat 7. The predetermined time is a time that can be set for each person H1. The predetermined time is, for example, 2 hours. It is not good for the health of the person H1 to remain in a sitting state for a long time. According to the management system 1 of this embodiment, by raising the height of the desk 6 used by the person H1 who has been sitting on the seat 7 for a predetermined time or more, it is possible to encourage the person H1 to stand (or work standing up), and the health of the person H1 can be improved. Furthermore, according to the management system 1 of this embodiment, the height of the desk 6 is not raised until the person H1 leaves the seat 7, so that it is possible to reduce the possibility that the person H1 will be surprised or that the person H1's work will be interrupted midway.

[0053] Further, the operation management unit 233 of this embodiment judges whether the identified person H1 is sitting on the seat 7 based on the first area image. The operation management unit 233 starts measuring the sitting time when it is judged that the person H1 is sitting on the seat 7, and continues measuring the sitting time when the person H1 is present in the first area based on the first area image. According to the operation management unit 233 of this embodiment, the measurement of the sitting time is continued not only based on whether the person H1 has stood up from the seat 7, but also based on whether the person H1 is present in the first area where the seat 7 is arranged. Therefore, according to the management system 1 of this embodiment, the measurement of the sitting time is not interrupted by the movement of the person H1 that can be regarded as being substantially in a sitting state, such as when the person H1 stands up to pick up luggage, so that the health of the person H1 can be further promoted.

[0054] Furthermore, the action management unit 233 of this embodiment manages the actions of the person H1 present in the managed area A1 by determining whether the person H1 has performed a healthy action based on the actions of the person H1 present in the managed area A1, and managing the healthy action performed by the person H1. The action management unit 233 then records the healthy action performed by the person H1. According to the management system 1 of this embodiment, the health action performed by the person H1, such as bending and stretching exercises, walking around the managed area A1, or doing gymnastics, is managed, so that the person H1 can look back on the healthy action he or she has performed, for example.

[0055] Furthermore, the operation management unit 233 of this embodiment determines that the person H1 in the management area A1 has performed a healthy behavior when the person H1 in the management area A1 during a specific time period raises his / her hand higher than above his / her head. According to the management system 1 of this embodiment, for example, when a health promotion program that involves doing exercises during a specific time period is implemented in the workplace, it is possible to manage whether or not the person H1 has performed exercises as a healthy behavior.

[0056] The operation management unit 233 of this embodiment manages health behavior only for the person H1 who intends to participate in the health promotion program. According to the management system 1 of this embodiment, for example, when the person H1 sits on the seat 7 for a long time and then leaves the seat, each person decides whether to raise the height of the desk 6 or to have the management system 1 manage the exercises.

[0057] The reception unit 234 accepts the person H1's participation in the health promotion program. For example, the reception unit 234 causes the management device 2 to function as a Web server. The reception unit 234 displays a reception screen such as screen D1 (see FIG. 5) or screen D2 (see FIG. 6) on the display unit 81 of the information terminal 8 held by the person H1, and accepts an operation on the reception screen, thereby accepting the person H1's participation in the health promotion program.

[0058] The reception unit 234 receives input on a reception screen, such as whether or not person H1 will participate in a health promotion program, whether or not to raise the height of desk 6 if person H1 continues to sit in seat 7 for a long period of time, the setting of height X1 (see Figure 4) to which desk 6 will be raised, person H1's height, weight, whether or not he / she has a chronic illness, etc.

[0059] (2.7) Information terminal configuration The information terminal 8 is a terminal held by the person H1. The information terminal 8 is, for example, a smartphone. The information terminal 8 of this embodiment has a browser function. The information terminal 8 can access the management device 2 by using the browser function, and display a reception screen for the health promotion program on a display unit 81 such as a touch panel of the information terminal 8.

[0060] (3) Operation of the management system Next, the operation of the management system 1 will be described with reference to FIGS.

[0061] FIG. 7 is a flowchart showing the operation of the management system 1 when a person H1 performs an operation on the entrance device 3 to obtain new entrance qualification.

[0062] First, the management system 1 accepts the operation of the person H1 on the entrance device 3 (step S1). Next, the management system 1 performs a process of capturing an image of the person H1 using the three first imaging units 4 and generating a three-dimensional image. Next, the management system 1 judges whether or not the three-dimensional image has been generated (step S3). If the generation of the three-dimensional image fails (step S3: No), the management system 1 performs the image generation process again (step S2). Note that when performing the image generation process again (step S2), the management system 1 may notify the entrance device 3 of points to note, such as the standing position or the direction of the face. On the other hand, if the generation of the three-dimensional image is successful (step S3: Yes), the management system 1 performs an authentication process by comparing the first captured image captured by the first imaging unit 4a with the authentication image stored in the storage unit 22 (step S4). If the authentication is successful (step S5: Yes), the management system 1 unlocks (or opens) the door 102 (step S6). On the other hand, if the authentication fails (step S5: No), the management system 1, for example, notifies the person H1 that the authentication has failed, and ends the process.

[0063] FIG. 8 is a flowchart showing the operation of the management system 1 when managing the movements of a person H1 who is a participant in a health promotion program.

[0064] First, the management system 1 determines whether the target person H1 is sitting or not based on the second captured image and the three-dimensional image (step S11). The management system 1 repeats the process of step S11 until it determines that the person H1 is sitting. When the management system 1 determines that the person H1 is sitting (step S11: Yes), it starts measuring the sitting time (step S12).

[0065] Next, the management system 1 determines whether the person H1 has stood up from the seat 7 (step S13). The management system 1 repeats the process of step S13 until it determines that the person H1 has stood up. When the management system 1 determines that the person H1 has stood up (step S13: Yes), it ends the measurement of the seated time (step S14).

[0066] Next, the management system 1 determines whether the person H1 has been sitting on the seat 7 for a predetermined time or more (step S15). If the person H1 has not been sitting on the seat 7 for a predetermined time or more (step S15: No), the management system 1 performs a storage process to store the sitting time of the person H1 in the storage unit 22 (step S17). On the other hand, if the person H1 has been sitting on the seat 7 for a predetermined time or more (step S15: Yes), the management system 1 raises the height of the desk 6 (step S16) and performs a storage process to store the history of raising the height of the desk 6 and the sitting time of the person H1 in the storage unit 22 (step S17).

[0067] 9 is a flowchart showing the operation of the management system 1 when managing the health behavior of person H1 who is a participant in a health promotion program. Note that the series of processes shown in FIG. 9 are processes performed in a predetermined time period.

[0068] The management system 1 determines whether the target person H1 is performing exercises or not based on the second captured image and the three-dimensional image (step S21). The "target person H1" is the person H1 participating in the health promotion program. If the person H1 is not performing exercises (step S21: No), the management system 1 performs a storage process to store in the storage unit 22 a history indicating that the person H1 did not perform exercises (step S22). On the other hand, if the person H1 is performing exercises (step S21: Yes), the management system 1 performs a storage process to store in the storage unit 22 a history indicating that the person H1 performed exercises (step S22).

[0069] It should be noted that the flowcharts shown in FIGS. 7 to 9 are merely examples, and the order of the processes may be changed as appropriate, and processes may be added or deleted as appropriate.

[0070] (4) Variations Modifications of the above embodiment are listed below.

[0071] (4.1) Variation 1 10, the management system 1 of the first modification further includes an authentication device 9. The authentication device 9 of the first modification is a device such as an ID card carried by a person H1 who has registered to enter the managed area A1.

[0072] The entrance management unit 232 of the first modification performs authentication by reading information from an authentication device 9 for authenticating person H1, which is carried by person H1 attempting to enter the managed area A1. If the authentication is successful and a three-dimensional image can be generated in the image generation unit 231, the entrance management unit 232 permits entry of person H1 attempting to enter the managed area A1 into the managed area A1. According to the management system 1 of the first modification, entrance management to the managed area A1 can be performed using the authentication device 9.

[0073] The information terminal 8 carried by the person H1 may function as the authentication device 9.

[0074] (4.2) Other Modifications The functions equivalent to the management system 1 according to the above embodiment may be embodied in a management method, a (computer) program, or a non-transitory recording medium on which a program is recorded. The management method according to one embodiment is a method used in the management system 1. The management system 1 generates a plurality of first captured images by capturing an image of a person H1 attempting to enter the managed area A1 of the facility 100 from an entrance of the managed area A1 of the facility 100 using a first imaging unit 4 provided in the facility 100. The management method includes an image generating step and a motion management step. In the image generating step, a three-dimensional image of the whole body of the person H1 is generated based on the plurality of first captured images. In the motion management step, the motion of the person H1 present in the managed area A1 is managed by comparing a second captured image captured by a second imaging unit 5 provided in the managed area A1 with the three-dimensional image. The program according to one embodiment is a program for causing one or more processors to execute the above management method.

[0075] The executing entity of the management system 1 or the management method in the present disclosure includes a computer system. The computer system is mainly composed of a processor and a memory as hardware. The processor executes a program recorded in the memory of the computer system to realize the function of the executing entity of the management system 1 or the management method in the present disclosure. The program may be pre-recorded in the memory of the computer system, provided through an electric communication line, or provided by recording it in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits such as IC or LSI referred to here are called by different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the manufacture of the LSI, or a logic device that can reconfigure the connection relationship inside the LSI or reconfigure the circuit partition inside the LSI, can also be adopted as a processor. The electronic circuits may be integrated in one chip or distributed among multiple chips. The chips may be integrated in one device or distributed among multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Thus, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

[0076] Furthermore, it is not essential for the management system 1 that multiple functions in the management system 1 are concentrated in one housing, and the components of the management system 1 may be distributed across multiple housings. Furthermore, at least some of the functions of the management system 1, for example, some of the functions of the management device 2, may be realized by the cloud (cloud computing) or the like.

[0077] In the above embodiment, at least some of the functions of the management system 1 that are distributed among multiple devices may be integrated into one housing. For example, some of the functions of the management system 1 that are distributed between the management device 2 and the entrance device 3 may be integrated into one housing.

[0078] The operation management unit 233 may increase the height of the desk 6 corresponding to the seat 7 when the person H1 leaves the seat 7 after determining that the specified person H1 has been sitting continuously for a predetermined time or more, and when the operation management unit 233 determines that the person H1 who sat on the seat 7 is present in the second area based on the second area image. The operation management unit 233 may increase the height of the desk 6 corresponding to the seat 7 when the person H1 leaves the seat 7 after determining that the specified person H1 has been sitting continuously for a predetermined time or more, and when the operation management unit 233 determines that the person H1 who sat on the seat 7 is present in the third area based on the third area image. FIG. 4 shows a case where the height of the desk 6 corresponding to the seat 7 is increased by a height X1 when the person H1 who sat on the seat 7 is determined to be present in the third area. According to the management system 1 of the modified example, the measurement of the sitting time is not interrupted for the movement of the person H1 that can be regarded as being substantially in a sitting state, such as when the person H1 leaves the first area slightly to get something, so that the health of the person H1 can be further promoted.

[0079] A two-dimensional code or the like indicating identification information of the desk 6 may be attached to, for example, the top surface of the desk 6. The second imaging unit 5 captures an image of the two-dimensional code, and the management device 2 can acquire the identification information of the desk 6 used by the person H1. Therefore, for example, even if the layout information has not been updated when a layout change or the like has been made in the management area A1, the management device 2 can identify the desk 6 used by the person H1.

[0080] The management system 1 may manage the behavior of the person H1 present in the management area A1 using position information of the person H1 obtained by a positioning system, such as a local positioning system (LPS), in addition to the second captured image and the three-dimensional image. For example, the local positioning system includes a plurality of beacon transmitters. Each of the plurality of beacon transmitters periodically transmits a beacon signal including the position information of the transmitter. The person H1 carries a beacon receiver. The information terminal 8 or the authentication device 9 may function as the beacon receiver. The beacon receiver detects its own terminal position by receiving a beacon signal periodically transmitted from each of the plurality of beacon transmitters. That is, the beacon receiver communicates with the plurality of beacon transmitters to obtain position information indicating its own position within the management area A1. Then, the beacon receiver transmits the obtained position information to the management device 2. The management system 1 can more accurately manage the behavior of the person H1 present in the management area A1 by using the position information of the person H1 obtained by the positioning system.

[0081] In the above embodiment, the management system 1 includes three first imaging units 4. However, the number of first imaging units 4 included in the management system 1 may be one or two, or may be four or more. When the management system 1 includes one first imaging unit 4, for example, the first imaging unit 4 is provided on a moving mechanism, and the first imaging unit captures images of the person H1 from multiple angles to generate multiple first captured images. In addition, the management system 1 may rotate the person H1 by issuing a notification to the person H1 at a predetermined position to prompt him or her to rotate. For example, a fixed first imaging unit captures an image of the rotating person H1 to generate multiple first captured images.

[0082] (summary) As is clear from the above-described embodiment, the management system (1) according to the first aspect includes a first imaging unit (4), an image generation unit (231), and an action management unit (233). The first imaging unit (4) is provided in a facility (100). The first imaging unit (4) captures an image of a person (H1) attempting to enter a managed area (A1) from an entrance of the managed area (A1) of the facility (100) to generate a plurality of first captured images. The image generation unit (231) generates a three-dimensional image of the whole body of the person (H1) based on the plurality of first captured images. The action management unit (233) manages the actions of the person (H1) present in the managed area (A1) by comparing a second captured image captured by a second imaging unit (5) provided in the managed area (A1) with the three-dimensional image.

[0083] According to this embodiment, since a three-dimensional image of the whole body of the person (H1) is used to identify the person (H1), it is possible to facilitate identification of the person (H1).

[0084] The management system (1) according to the second aspect is the same as the management system (1) according to the first aspect, and further includes an entrance management unit (232). The entrance management unit (232) permits or restricts the entrance of a person (H1) who is attempting to enter the managed area (A1) to the managed area (A1).

[0085] According to this embodiment, not only can the movement of the person (H1) present in the controlled area (A1) be controlled, but also entry to the controlled area (A1) can be controlled.

[0086] In the management system (1) according to the third aspect, in the second aspect, the entrance management unit (232) performs the authentication by comparing one of the first captured images included in the plurality of first captured images with a preregistered authentication image. If the authentication is successful and the image generation unit (231) is able to generate a three-dimensional image, the entrance management unit (232) permits the person (H1) who is attempting to enter the managed area (A1) to enter the managed area (A1).

[0087] According to this embodiment, the first captured image for generating a three-dimensional image can be utilized for entrance control of the controlled area (A1).

[0088] In the management system (1) according to the fourth aspect, in the second aspect, the entrance management unit (232) performs authentication by reading information from an authentication device (9) for authenticating a person (H1) who is attempting to enter the managed area (A1) and which is carried by the person (H1). If the authentication is successful and a three-dimensional image can be generated in the image generation unit (231), the entrance management unit (232) permits entry of the person (H1) who is attempting to enter the managed area (A1) into the managed area (A1).

[0089] According to this embodiment, it is possible to control entry to the controlled area (A1) using the authentication device (9).

[0090] The management system (1) according to the fifth aspect is any one of the first to fourth aspects and includes a plurality of first imaging units (4). The plurality of first imaging units (4) capture images of a person (H1) attempting to enter the management area (A1) from an entrance from different angles. The image generating unit (231) generates a three-dimensional image based on the plurality of first captured images generated by the plurality of first imaging units (4).

[0091] According to this embodiment, a three-dimensional image of the person (H1) can be generated more accurately.

[0092] In the management system (1) of the sixth aspect, in any one of the first to fifth aspects, the amount of information of the head of the person (H1) in the three-dimensional image is greater than the amount of information of the part below the head of the person (H1) in the three-dimensional image.

[0093] According to this embodiment, it is possible to generate a three-dimensional image in which the person (H1) can be easily identified while preventing the amount of information in the three-dimensional image from increasing.

[0094] In the management system (1) according to the seventh aspect, in any one of the first to sixth aspects, the operation management unit (233) performs management by determining whether or not a person (H1) present in the management area (A1) has performed health behavior based on the operation of the person (H1) and managing the health behavior performed by the person (H1).

[0095] According to this embodiment, for example, a person (H1) can reflect on the health behaviors he or she has taken.

[0096] In the management system (1) according to the eighth aspect, in the seventh aspect, the operation management unit (233) determines that a person (H1) present in the management area (A1) has performed a health behavior when the person (H1) present in the management area (A1) raises his / her hand higher than above his / her head during a specified time period.

[0097] According to this embodiment, it is possible to manage whether or not the person (H1) has performed exercises as a health behavior.

[0098] In the management system (1) according to the ninth aspect, in any one of the first to eighth aspects, a seat (7) and a desk (6) corresponding to the seat (7) and having an electric lifting mechanism (62) are arranged in the management area (A1). As part of the management, the operation management unit (233) determines whether a person (H1) present in the management area (A1) is sitting on the seat (7). When the person (H1) leaves the seat (7) after determining that the person (H1) has been sitting there for a predetermined period of time or more, the operation management unit (233) increases the height of the desk (6) corresponding to the seat (7).

[0099] According to this embodiment, the person (H1) can be encouraged to stand, and the health of the person (H1) can be improved.

[0100] The management system (1) according to the tenth aspect is the ninth aspect, and includes a plurality of second imaging units (5). The plurality of second imaging units (5) include a first area imaging unit (second imaging unit 5a) and a second area imaging unit (second imaging unit 5b; second imaging unit 5c). The first area imaging unit images a first area including the seat (7) to generate a first area image. The second area imaging unit images a second area not including the seat (7) to generate a second area image. The operation management unit (233) determines whether or not a person (H1) present in the management area (A1) is sitting on the seat (7) based on the first area image. When the operation management unit (233) determines that the person (H1) has been sitting continuously for a predetermined time or more and then leaves the seat (7), and determines that the person (H1) who sat on the seat (7) is present in the second area based on the second area image, the operation management unit (233) increases the height of the desk (6) corresponding to the seat (7).

[0101] According to this embodiment, the health of the person (H1) can be further improved.

[0102] The management system (1) according to an eleventh aspect is the ninth or tenth aspect, and includes a plurality of second imaging units (5). The plurality of second imaging units (5) include a first area imaging unit (second imaging unit 5a) and a second area imaging unit (second imaging unit 5b; second imaging unit 5c). The first area imaging unit images a first area including a seat (7) to generate a first area image. The second area imaging unit images a second area not including a seat (7) to generate a second area image. The operation management unit (233) determines whether or not a person (H1) present in the management area (A1) is sitting in the seat (7) based on the first area image. The operation management unit (233) starts measuring the sitting time when it is determined that the person (H1) is sitting in the seat (7), and continues measuring the sitting time when the person (H1) is present in the first area based on the first area image.

[0103] According to this embodiment, the health of the person (H1) can be further improved.

[0104] The configurations other than those of the first embodiment are not essential to the management system (1) and may be omitted as appropriate.

[0105] A management method according to a twelfth aspect is a method used in a management system (1). The management system (1) uses a first imaging unit (4) provided in a facility (100) to capture an image of a person (H1) attempting to enter a managed area (A1) of the facility (100) through an entrance of the managed area (A1) to generate a plurality of first captured images. The management method includes an image generation step and a movement management step. In the image generation step, a three-dimensional image of the entire body of the person (H1) is generated based on the plurality of first captured images. In the movement management step, a second captured image captured by a second imaging unit (5) provided in the managed area (A1) is compared with the three-dimensional image to manage the movement of the person (H1) present in the managed area (A1).

[0106] According to this embodiment, since a three-dimensional image of the whole body of the person (H1) is used to identify the person (H1), it is possible to facilitate identification of the person (H1).

[0107] A program according to a thirteenth aspect is a program for causing one or more processors to execute the management method according to the twelfth aspect.

[0108] According to this embodiment, since a three-dimensional image of the whole body of the person (H1) is used to identify the person (H1), it is possible to facilitate identification of the person (H1). [Explanation of symbols]

[0109] 1 Management System 100 Facilities 231 Image Generation Unit 232 Admission Management Department 233 Operation management section 4 First imaging unit 5 Second imaging section 5a Second imaging section (first area imaging section) 5b Second imaging section (second area imaging section) 5c Second imaging unit (second area imaging unit) 6 desk 62 Lifting mechanism 7 seats 9 Authentication Devices A1 Management Domain H1 People

Claims

1. a first imaging unit that is provided in a facility and captures an image of a person attempting to enter a controlled area of ​​the facility through an entrance of the controlled area to generate a plurality of first captured images; an image generating unit that generates a three-dimensional image of the entire body of the person based on the plurality of first captured images; a motion management unit that manages motions of the person present in the management area by comparing a second captured image captured by a second imaging unit provided within the management area with the three-dimensional image; Equipped with Management system.

2. Further comprising an entrance management unit that permits or restricts the entrance of the person who is attempting to enter the controlled area to the controlled area, The management system according to claim 1 .

3. the entry management unit performs authentication by comparing one of the first captured images included in the plurality of first captured images with a pre-registered authentication image, and when the authentication is successful and the image generation unit is able to generate the three-dimensional image, permits the person who is attempting to enter the controlled area to enter the controlled area. The management system according to claim 2.

4. the entrance management unit performs authentication by reading information from an authentication device for authenticating the person carried by the person attempting to enter the controlled area, and when the authentication is successful and the image generation unit is able to generate the three-dimensional image, permits the person attempting to enter the controlled area. The management system according to claim 2.

5. A plurality of the first imaging units are provided, The plurality of first imaging units image the person attempting to enter the controlled area from the entrance from different angles, The image generating unit generates the three-dimensional image based on the first captured images generated by the first imaging units. The management system according to claim 1 .

6. an amount of information about the person's head in the three-dimensional image is greater than an amount of information about a portion of the person below the head in the three-dimensional image; The management system according to claim 1 .

7. The operation management unit, as the management, determines whether the person has performed a health behavior based on the operation of the person present in the management area, and manages the health behavior performed by the person. The management system according to claim 1 .

8. the operation management unit determines that the person in the management area has performed the health behavior when the person in the management area raises his / her hand higher than above his / her head during a predetermined time period. The management system according to claim 7.

9. In the management area, seats and desks each having an electric lift mechanism corresponding to the seats are arranged, The operation management unit As the management, determining whether the person present in the management area is sitting in the seat; When the person leaves the seat after it is determined that the person has been sitting continuously for a predetermined period of time or more, the height of the desk corresponding to the seat is increased. The management system according to claim 1 .

10. A plurality of the second imaging units are provided, The plurality of second imaging units include a first area imaging unit that captures an image of a first area including the seat and generates a first area image; a second area imaging unit that captures an image of a second area not including the seat and generates a second area image; Including, The operation management unit determining whether the person present in the control area is sitting in the seat based on the first area image; when it is determined that the person has been sitting continuously for a predetermined time or more and then the person leaves the seat and it is determined based on the second area image that the person who was sitting on the seat is now in the second area, the height of the desk corresponding to the seat is increased. The management system according to claim 9.

11. A plurality of the second imaging units are provided, The plurality of second imaging units include a first area imaging unit that captures an image of a first area including the seat and generates a first area image; a second area imaging unit that captures an image of a second area not including the seat and generates a second area image; Including, The operation management unit determining whether the person present in the control area is sitting in the seat based on the first area image; starting measurement of a sitting time when it is determined that the person is sitting in the seat, and continuing measurement of the sitting time when the person is present in the first area based on the first area image; The management system according to claim 9.

12. A management method used in a management system, in which a first imaging unit provided in a facility images a person attempting to enter a managed area of ​​the facility through an entrance of the managed area to generate a plurality of first captured images, an image generating step of generating a three-dimensional image of the whole body of the person based on the plurality of first captured images; a movement management step of managing the movement of the person present in the management area by comparing a second captured image captured by a second imaging unit provided in the management area with the three-dimensional image; having Management method.

13. 13. The method of claim 12, further comprising the steps of: program.

Images