Attendance information management system and attendance information management method

Abstract

To provide an attendance information management system configured to check stress of each person timely using a robot, effectively present a result of the stress check, and practice mental healthcare of each person in the entire office, thereby providing employees with a comfortable work environment, and an attendance information management method.SOLUTION: In an attendance information management system, an information collection robot 1 autonomously travels in a work area and collects information on a person who is present in the work area. An attendance management server 4 accumulates attendance information on an attendance status of a person in the work area collected by the information collection robot 1, performs stress check to determine a stress condition of a target person on the basis of the collected attendance information, and causes a user terminal 6 to display a screen that presents a result of the stress check regarding the target person together with attendance status of persons in the work area.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an office presence information management system and an office presence information management method for managing office presence information relating to the presence status of people in an office area. [Background technology]

[0002] In recent years, interest in and awareness of mental health has increased dramatically. Specifically, stress checks are now mandatory for employees, and measures to address employee mental health are expanding, such as encouraging those found to be in a problematic state through these checks to see an industrial physician.

[0003] As a technology relating to such employee mental health measures, a technology has been known in the past in which a humanoid robot provides counseling to employees and encourages them to implement effective mental health care and training (see Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6724279 Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional technology only performs stress checks to assess a person's stress state, which is insufficient from the perspective of mental health care. In other words, it is important to conduct stress checks for each person in a timely manner and effectively present the results of the stress checks to ensure the mental health care of each person throughout the workplace, in order to create an environment in which employees can work with peace of mind. Furthermore, it is desirable to enhance each person's mental health care by reporting to relevant parties, such as supervisors and health management staff, and by receiving support from people around them in the workplace.

[0006] Therefore, the main object of the present invention is to provide an attendance information management system and an attendance information management method that utilizes a robot to conduct timely stress checks on each person and effectively present the results of the stress checks, thereby promoting mental health care for each person throughout the workplace and creating an environment in which employees can work with peace of mind. Another object of the present invention is to enhance each person's mental health care by reporting to relevant parties such as superiors and health management office staff, and by receiving support from people around them in the workplace. [Means for solving the problem]

[0007] The attendance information management system of the present invention comprises: Based on the detection results of the occupancy detection area where a seat has changed from vacant to occupied in the office area, An information management system for managing presence information relating to the presence status of a person, the information management system comprising: an presence management unit for storing the presence information; A person present in the presence detection area Collect information about Had a camera An information gathering robot and a robot control unit that controls the operation of the information gathering robot, wherein the robot control unit When receiving an instruction to collect information about a target person present in the presence detection area, the information collection robot controls movement of the information collection robot to the presence detection area, identifies the target person based on the captured image acquired by the camera, and performs facial expression detection processing to detect the target person's facial expression, A stress check is conducted to assess the subject's stress level. Furthermore, a result display confirmation is performed to confirm with the subject whether or not the results of the stress check regarding the subject will be displayed on a screen to be shared with other people, and setting information regarding whether or not the results of the stress check can be displayed on the screen is acquired; The presence management unit If the setting information is set to screen displayable, The results of the stress check for the subject are presented together with the presence status of each person in the work area.

[0008] The attendance information management method of the present invention further comprises: Based on the detection results of the occupancy detection area where a seat has changed from vacant to occupied in the office area, A method for managing presence information relating to the presence status of a person, comprising: Had a camera The information gathering robot autonomously navigates within the work area. A person present in the presence detection area a robot control unit that collects information about and controls the operation of the information collecting robot, When receiving an instruction to collect information about a target person present in the presence detection area, the information collection robot controls movement of the information collection robot to the presence detection area, identifies the target person based on the captured image acquired by the camera, and performs facial expression detection processing to detect the target person's facial expression, A stress check is conducted to assess the subject's stress level. Furthermore, a result display confirmation is performed to confirm with the subject whether or not the results of the stress check regarding the subject will be displayed on a screen to be shared with other people, and setting information regarding whether or not the results of the stress check can be displayed on the screen is acquired; an attendance management unit that accumulates the attendance information, If the setting information is set to screen displayable, The results of the stress check for the subject are presented together with the presence status of each person in the work area. [Effects of the Invention]

[0009] According to the present invention, a robot is used to carry out stress checks on each person in a timely manner, Depending on the subject's wishes, By effectively presenting the results of stress checks, it is possible to promote the mental health care of each individual throughout the workplace and create an environment where employees can work with peace of mind. [Brief explanation of the drawings]

[0010] [Figure 1] Overall configuration diagram of the attendance information management system according to the first embodiment [Figure 2] FIG. 1 is an explanatory diagram showing the layout of an office according to the first embodiment, the installation status of fixed cameras, and the setting status of occupancy detection areas. [Figure 3] FIG. 1 is an explanatory diagram showing a schematic configuration of an information collection robot according to a first embodiment; [Figure 4] FIG. 1 is a block diagram showing an overview of the processing performed by the attendance management server and the robot control server according to the first embodiment. [Figure 5] FIG. 1 is a block diagram showing the schematic configuration of an information collection robot, a robot control server, and a presence management server according to a first embodiment. [Figure 6] FIG. 10 is an explanatory diagram showing a screen displayed on a display of an information collecting robot according to the first embodiment; [Figure 7] FIG. 10 is an explanatory diagram showing a seat presence status confirmation screen in map display mode displayed on a user terminal according to the first embodiment; [Figure 8] FIG. 10 is an explanatory diagram showing an attendance status confirmation screen in a department display mode displayed on a user terminal according to the first embodiment; [Figure 9] FIG. 1 is a flowchart showing the operation procedure of the seating management server according to the first embodiment; [Figure 10] FIG. 1 is a flowchart showing the operation procedure of the robot control server according to the first embodiment. [Figure 11] FIG. 10 is a block diagram showing the schematic configuration of an information collection robot, a robot control server, and a presence management server according to a second embodiment. [Figure 12]FIG. 10 is an explanatory diagram showing a screen displayed on a display of an information collecting robot according to a second embodiment. [Figure 13] FIG. 11 is an explanatory diagram showing a stress check result report screen displayed on a user terminal of a related person according to the second embodiment; [Figure 14] FIG. 10 is an explanatory diagram showing a call request screen displayed on the display of the robot and on the user terminal of the seated person according to the second embodiment; [Figure 15] FIG. 11 is an explanatory diagram showing a setting screen displayed on an administrator terminal according to the second embodiment; [Figure 16] FIG. 11 is an explanatory diagram showing a setting screen displayed on an administrator terminal according to the second embodiment; [Figure 17] FIG. 10 is a flowchart showing the operation procedure of the robot control server according to the second embodiment. [Figure 18] FIG. 10 is a flowchart showing the operation procedure of the robot control server according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] The first invention made to solve the above problem is: Based on the detection results of the occupancy detection area where a seat has changed from vacant to occupied in the office area, An information management system for managing presence information relating to the presence status of a person, the information management system comprising: an presence management unit for storing the presence information; A person present in the presence detection area Collect information about Had a camera An information gathering robot and a robot control unit that controls the operation of the information gathering robot, wherein the robot control unit When receiving an instruction to collect information about a target person present in the presence detection area, the information collection robot controls movement of the information collection robot to the presence detection area, identifies the target person based on the captured image acquired by the camera, and performs facial expression detection processing to detect the target person's facial expression, A stress check is conducted to assess the subject's stress level. Furthermore, a result display confirmation is performed to confirm with the subject whether or not the results of the stress check regarding the subject will be displayed on a screen to be shared with other people, and setting information regarding whether or not the results of the stress check can be displayed on the screen is acquired; The presence management unit If the setting information is set to screen displayable, The results of the stress check for the subject are presented together with the presence status of each person in the work area.

[0012] According to this, the robot will be used to conduct timely stress checks on each employee, Depending on the subject's wishes,By effectively presenting the results of the stress check, it is possible to promote the mental health care of each individual throughout the workplace and create an environment in which employees can work with peace of mind. In addition, in the stress check, for example, the facial expression of the subject can be detected from an image of the subject's face, and the subject's tone of voice can be detected from the subject's speech, and the subject's stress level can be determined based on the detection results of the facial expression and tone of voice.

[0013] In addition, in a second aspect of the present invention, the robot control unit An image area of ​​the subject's face is cut out from the image captured by the camera to obtain a facial image, and facial feature information of the subject is extracted from the facial image. The facial feature information of each registered person is compared with the facial feature information of the subject to identify the subject. The composition is as follows.

[0014] This allows the subject to be identified with high accuracy through facial matching. It is also advisable to capture the subject's face and obtain information on the subject's condition, such as body temperature, as a measure to prevent the spread of infectious diseases. It is also possible to detect whether the subject is wearing a mask from the image of the subject's face as a measure to prevent the spread of infectious diseases.

[0015] In addition, in a third invention, the robot control unit is configured to perform processing to guide the subject regarding the implementation of a predetermined refresh menu if the result of the stress check indicates that the subject is in an undesirable state.

[0016] This allows the subject's undesirable condition to be quickly improved.

[0017] In a fourth aspect of the present invention, the robot control unit performs a process of guiding the subject to perform at least one of smiling, stretching, and vocalizing as the refreshment menu.

[0018] This allows the subject's undesirable condition to be appropriately improved.

[0019] In addition, in a fifth invention, the robot control unit is configured to perform processing to report the stress check result to persons related to the subject if the stress check result indicates that the subject is in an undesirable state.

[0020] This allows the relevant parties to quickly understand the subject's undesirable state. In this case, a notification for reporting the stress check results may be sent to a user device operated by the relevant parties via SNS. This allows the stress check results to be reported quickly.

[0021] In addition, in a sixth invention, if the stress check results in the subject being in an undesirable state, the robot control unit is configured to select a person from among those present around the subject who will speak to the subject to improve the subject's condition, and to request that person to speak to the subject.

[0022] This allows the subject's undesirable condition to be quickly improved.

[0023] In addition, the seventh invention is configured such that the robot control unit controls the information gathering robot to move near the person to whom the request is made and perform an action to request the person to speak to the target person.

[0024] This allows the request to the requested person to be made face-to-face with confidence. Note that a notification requesting the requested person to make a call to the target person may be sent to a user device operated by the requested person via SNS. This allows the request to the requested person to be made quickly.

[0027] Also, 8th The invention is configured such that the robot control unit controls the information collection robot to perform an operation related to the result display confirmation when collecting information required for the stress check.

[0028] This allows the subject to be asked at an appropriate time whether or not the stress check results should be displayed on the screen.

[0029] Also, 9th The invention Based on the detection results of the occupancy detection area where a seat has changed from vacant to occupied in the office area,A method for managing presence information relating to the presence status of a person, comprising: Had a camera The information gathering robot autonomously navigates within the work area. A person present in the presence detection area a robot control unit that collects information about and controls the operation of the information collecting robot, When receiving an instruction to collect information about a target person present in the presence detection area, the information collection robot controls movement of the information collection robot to the presence detection area, identifies the target person based on the captured image acquired by the camera, and performs facial expression detection processing to detect the target person's facial expression, A stress check is conducted to assess the subject's stress level. Furthermore, a result display confirmation is performed to confirm with the subject whether or not the results of the stress check regarding the subject will be displayed on a screen to be shared with other people, and setting information regarding whether or not the results of the stress check can be displayed on the screen is acquired; an attendance management unit that accumulates the attendance information, If the setting information is set to screen displayable, The results of the stress check for the subject are presented together with the presence status of each person in the work area.

[0030] According to this, as with the first invention, a robot is used to conduct stress checks on each person in a timely manner, Depending on the subject's wishes, By effectively presenting the results of stress checks, it is possible to promote the mental health care of each individual throughout the workplace and create an environment where employees can work with peace of mind.

[0031] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0032] (First embodiment) FIG. 1 is a diagram showing the overall configuration of a seating information management system according to the first embodiment.

[0033] This system manages presence information regarding the presence status of people in a free-address office (work area). The system includes an information collection robot 1, a robot control server 2 (robot control unit), a fixed camera 3, a presence management server 4 (presence management unit), a cloud server 5, a user terminal 6 (user device), and an administrator terminal 7 (administrator device). The robot control server 2, fixed camera 3, presence management server 4, cloud server 5, user terminal 6, and administrator terminal 7 are connected via a network.

[0034] The information collection robot 1 is configured to be capable of autonomous travel. In response to instructions from the robot control server 2, the information collection robot 1 moves to the vicinity of a person (target person) sitting at a desk in an office and collects information about that person.

[0035] The robot control server 2 controls the operation of the information collecting robot 1. When the presence management server 4 detects the presence of a person, the robot control server 2 instructs the information collecting robot 1 to collect information about the person (target person) present at the seat.

[0036] The fixed camera 3 is installed in an appropriate location in the office (for example, at the entrance or on the ceiling) and captures images of people staying in the office.

[0037] The presence management server 4 performs processing to manage people who are seated at desks in the office based on images captured by the fixed camera 3 and information collected by the information collection robot 1. The presence management server 4 also has the function of a distribution server, and distributes presence information regarding the presence status of people in the office to the user terminal 6 based on management information registered in a database.

[0038] The cloud server 5 provides an SNS. Users can participate in the SNS using user terminals 6. An SNS application is installed on the user terminals 6. The cloud server 5, together with the user terminals 6, constitutes an SNS system. Specifically, the cloud server 5 controls a chat service that uses the user terminals 6.

[0039] The user terminal 6 is operated by a person (user) sitting at a desk in the office. The user terminal 6 is configured with a PC, tablet terminal, etc. The user terminal 6 presents presence information regarding the presence status of a person in the office to the user based on information distributed from the presence management server 4. The user terminal 6 can also use the chat service provided by the cloud server 5.

[0040] In this embodiment, a robot control server 2 is provided as a robot control unit that controls the information collection robot 1, but the information collection robot 1 itself may be configured to have a robot control unit that controls its own device, i.e., to have the functions of the robot control server 2.

[0041] In addition, in this embodiment, the robot control server 2 performs face matching, but a face matching server may be provided separately.

[0042] In addition, in this embodiment, the presence management server 4 is provided as a presence management unit that manages the presence information, but the presence management server 4 may be configured to be integrated with the robot control server 2. Also, the function of managing the database in the presence management server 4 and the function of distributing the presence information may be separated from the presence management server 4, and each function may be realized by an independent database server and distribution server.

[0043] Furthermore, in this embodiment, a system for an office with a free address system will be described, but the system may also be for an office with fixed seats.

[0044] Next, the layout of the office according to the first embodiment, the installation status of the fixed cameras 3, and the setting status of the occupancy detection area will be described. Fig. 2 is an explanatory diagram showing the layout of the office, the installation status of the fixed cameras 3, and the setting status of the occupancy detection area.

[0045] The office has desks and chairs arranged in a row. This office has a free address system, so when a person enters the office, they find an empty seat and sit down.

[0046] A fixed camera 3 is installed on the ceiling of the office and captures images of people staying in the office. The fixed camera 3 is an omnidirectional camera that uses a fisheye lens to capture images in a 360-degree range. Alternatively, a box camera that captures images within a predetermined angle of view may be used as the fixed camera 3. Alternatively, a simple camera (for example, a USB camera) connected to a PC in the office may be used as the fixed camera 3.

[0047] In this embodiment, an occupancy detection area for each office seat is set in advance on the image captured by the fixed camera 3, and whether or not a person is sitting at the office seat is detected based on the image of this detection area. Note that in the example shown in Fig. 2, the occupancy detection area (dotted line area) is represented by a rectangle on the floor plan of the office, but in reality, the occupancy detection area is set as a polygon on the omnidirectional image (fisheye image) captured by the fixed camera 3.

[0048] An information collection robot 1 is also placed in the office. This information collection robot 1 waits at a predetermined standby position in the office and, in response to instructions from the robot control server 2, moves to the vicinity of a person sitting at a desk in the office to collect information about that person. In this embodiment, when the presence management server 4 detects the presence of a person in a presence detection area, it instructs the robot control server 2 to move to the vicinity of the presence detection area of ​​the target person in order to collect information about that target person (subject).

[0049] Next, a description will be given of the general configuration of the information collecting robot 1 according to the first embodiment. FIG.

[0050] The information gathering robot 1 includes a camera 11 , a body temperature sensor 12 , a speaker 13 , a microphone 14 , a display 15 , a running unit 16 , and a controller 17 .

[0051] Camera 11 captures the face of a subject sitting at a desk. A facial image for face matching is obtained from the image captured by camera 11. Camera 11 can capture the face of a person sitting at a desk from the front at a close distance. This makes it possible to obtain a facial image suitable for face matching.

[0052] Body temperature sensor 12 measures the body temperature of the subject without contact. Body temperature sensor 12 is, for example, a thermo camera (infrared camera). Note that a thermo camera capable of outputting temperature images and color images may be used as camera 11, so that camera 11 also serves as body temperature sensor 12. Furthermore, a vital sensor that measures vital information other than body temperature, such as heart rate (pulse), without contact may be installed.

[0053] The speaker 13 outputs voices such as various requests, guidance, and notifications under the control of the robot control server 2.

[0054] The microphone 14, under the control of the robot control server 2, picks up the voice of the subject.

[0055] The display 15 displays various screens such as guidance and notifications under the control of the robot control server 2.

[0056] The traveling unit 16 includes wheels, a motor, etc. The traveling unit 16 performs autonomous traveling under the control of the controller 17 to move to a destination.

[0057] The controller 17 controls each part of the information collecting robot 1 based on operation instructions from the robot control server 2.

[0058] Next, an overview of the processing performed by the seating management server 4 and the robot control server 2 according to the first embodiment will be described. Fig. 4 is a block diagram showing an overview of the processing performed by the seating management server 4 and the robot control server 2.

[0059] The seat presence management server 4 extracts the image region of the seat presence detection area (office seat) from the image captured by the fixed camera 3 to obtain the seat presence detection area image, determines from the seat presence detection area image whether or not a person is present in the seat presence detection area, and sets the state of the seat presence detection area to either occupied or vacant (absent) depending on the determination result (seat presence detection process). This seat presence detection process is performed periodically. The detection results of the seat presence detection process are registered in the seat presence database.

[0060] In addition, when the presence management server 4 detects the presence of a person in the presence detection area, it instructs the robot control server 2 to have the information collection robot 1 collect information about the person (target person) present in the presence detection area.

[0061] The robot control server 2 controls the operation of the information collection robot 1 in response to an instruction to collect information from the presence management server 4. Specifically, it controls the information collection robot 1 to move to the vicinity of a target presence detection area. It also controls the information collection robot 1 to take a picture of the face of a person sitting in the target presence detection area with the camera 11.

[0062] The robot control server 2 also extracts the image area of ​​a person's face from the image captured by the camera 11 to obtain a facial image, and extracts facial feature information of the target person from the facial image. The robot control server 2 then compares the facial feature information of each registered person with the facial feature information of the target person to identify the target person (face matching process). This face matching process links the target person with the registered person, and identifies the target person. In other words, the information collection robot 1 constitutes a mobile authentication device, and the robot control server 2 constitutes a face matching server that executes the face matching process, thereby constructing a face authentication system.

[0063] The robot control server 2 also determines whether the subject is wearing a mask based on the image captured by the camera 11 (mask wearing determination process). The robot control server 2 also controls the information collection robot 1 to measure the subject's body temperature with the body temperature sensor 12, and acquires the body temperature measurement result (body temperature measurement process).

[0064] The robot control server 2 also detects the facial expression of the subject based on the image captured by the camera 11 (facial expression detection process). The robot control server 2 also detects the subject's tone of voice based on the sound picked up by the microphone 14 (speech tone detection process). The robot control server 2 then determines the subject's stress state based on the detection results of the facial expression detection process and the speech tone detection process (stress check process).

[0065] The facial matching results, mask wearing determination results, body temperature measurement results, and stress check results obtained by the robot control server 2 are sent to the presence management server 4 as seated person information and registered in the seated person database. The seated person information also includes the collection time, etc.

[0066] Based on the detection results of the presence detection process and the occupancy person information registered in the presence database, the presence management server 4 generates an occupancy status confirmation screen (see FIGS. 7 and 8) that presents the stress check results for the subject along with the occupancy status of each person in the office, and displays it on the user terminal 6. This allows the user to simultaneously check the occupancy status and stress state of each person in the office.

[0067] Next, a description will be given of the schematic configuration of the information collecting robot 1, the robot control server 2, and the presence management server 4 according to the first embodiment. Fig. 5 is a block diagram showing the schematic configuration of the information collecting robot 1, the robot control server 2, and the presence management server 4.

[0068] As described above, the information gathering robot 1 includes the camera 11, the body temperature sensor 12, the speaker 13, the microphone 14, the display 15, the running unit 16, and the controller 17 (see FIG. 2). The controller 17 includes a communication unit 51, a memory unit 52, and a processor 53.

[0069] The communication unit 51 communicates with the robot control server 2 .

[0070] The storage unit 52 stores programs executed by the processor 53 and the like.

[0071] The processor 53 performs various processes by executing programs stored in the storage unit 52. In this embodiment, the processor 53 performs autonomous driving control processing and the like.

[0072] In the autonomous driving control process, the processor 53 controls the driving unit 16 to proceed toward the destination instructed by the robot control server 2 while determining a course to avoid obstacles based on images captured by the camera 11 and detection results from a distance sensor (not shown).

[0073] In addition, the processor 53 controls each device, the camera 11, the body temperature sensor 12, the speaker 13, the microphone 14, and the display 15, causing each device to perform the required operation.

[0074] The robot control server 2 includes a communication unit 21, a storage unit 22, and a processor 23.

[0075] The communication unit 21 communicates with the information collecting robot 1, the presence management server 4, the cloud server 5, and the manager terminal 7.

[0076] The storage unit 42 stores programs executed by the processor 23, etc. The storage unit 42 also stores registration information for an area management database and a face database. The area management database stores management information for presence detection areas, specifically, area IDs and position information for presence detection areas, etc. The face database stores face matching information for each person registered in advance, specifically, information such as person IDs and facial feature information.

[0077] The processor 43 performs various processes by executing programs stored in the storage unit 42. In this embodiment, the processor 43 performs driving control process, mask wearing determination process, face matching process, body temperature measurement process, facial expression detection process, speech tone detection process, stress check process, and the like.

[0078] In the travel control process, the processor 23 controls the travel of the information gathering robot 1. Specifically, the processor 23 sets a target position near a person (target person) whose presence is detected, and controls the information gathering robot 1 to move from a standby position to the target position. The processor 23 also controls the information gathering robot 1 to return to the standby position.

[0079] In the mask wearing determination process, the processor 23 determines whether or not the subject is wearing a mask based on the image captured by the camera 11 of the information collecting robot 1.

[0080] In the face matching process, the processor 23 controls the information collection robot 1 to capture an image of the target person's face with the camera 11. Next, facial feature information of the target person is extracted from the image captured by the camera 11 received from the information collection robot 1. Then, facial feature information for each registered person is obtained from the storage unit 42, and the target person is identified by matching the facial feature information for that registered person with the facial feature information of the target person. Note that if the target person is wearing a mask, matching may be performed by excluding the masked area from the facial image, but guidance to temporarily remove the mask may be displayed on the display 15 or output as audio from the speaker 13 to prompt the target person to remove the mask, and matching may be performed once the entire facial image has been recognized.

[0081] In the body temperature measurement process, the processor 23 acquires the body temperature measurement result based on the detection result of the body temperature sensor 12 of the information collection robot 1. Note that vital information other than body temperature, such as heart rate (pulse), may also be measured.

[0082] In the facial expression detection process (facial expression estimation process), the processor 23 detects the facial expression of the target person based on the image captured by the camera 11 of the information collecting robot 1.

[0083] In the speech tone detection process, the processor 23 detects the speech tone of the target person based on the voice picked up by the microphone 14 of the information collecting robot 1. The speech tone is determined based on, for example, the force and tone of speech.

[0084] In the stress check process, the processor 23 determines the stress state of the subject based on the detection results of the facial expression detection process and the detection results of the tone detection process. In this embodiment, the stress state is determined to be positive, negative, or neutral. Here, positive represents a desirable state, negative represents an undesirable state, and neutral represents a normal state.

[0085] The seating management server 4 includes a communication unit 41, a storage unit 42, and a processor 43.

[0086] The communication unit 41 communicates with the robot control server 2, the fixed camera 3, and the user terminal 6.

[0087] The storage unit 42 stores programs executed by the processor 43, etc. The storage unit 42 also stores registration information for an area management database, an occupancy database, and a person database. The area management database registers management information for occupancy detection areas, specifically, the area ID and location information of the occupancy detection areas. The occupancy database registers information such as the area ID, the occupancy detection time, and person matching result information, specifically, the person ID and the person matching score. The person database registers person management information, specifically, information such as the person ID, the person's name, affiliation, and position. The storage unit 42 also temporarily stores images captured by the fixed camera 3.

[0088] The processor 43 performs various processes by executing programs stored in the storage unit 42. In this embodiment, the processor 43 performs an presence detection process, an presence information distribution process, and the like.

[0089] In the presence detection process, the processor 43 performs person detection on the image region of the presence detection area in the image captured by the fixed camera 3, and determines whether or not a person is present in the target presence detection area. If a person is present in the presence detection area, the state of the presence detection area is set to "occupied." On the other hand, if no person is present in the presence detection area, the state of the presence detection area is set to "vacant (absent)." Then, the presence detection result information (presence detection time, number of areas) and presence detection result detailed information (presence detection time, area ID, detection state) are stored in the memory unit 42.

[0090] In the presence information distribution process, the processor 43 generates information about the presence status of people in the office (such as the seat location) based on the information registered in the presence database and the person database, and distributes the information to the user terminal 6. In this embodiment, display information for the presence status confirmation screen (see FIGS. 7 and 8) is distributed to the user terminal 6. The presence status confirmation screen also includes information about the body temperature measurement result, the mask wearing determination result, and the stress check result.

[0091] Next, a description will be given of a screen displayed on the display 15 of the information collecting robot 1 according to the first embodiment. Fig. 6 is an explanatory diagram showing a screen displayed on the display 15 of the information collecting robot 1.

[0092] When the information collecting robot 1 arrives at the location of the target person, first, a screen 101 (initial screen) shown in Fig. 6(A) is displayed on the display 15. An image 102 captured by the camera 11 and text 103 urging the target person to turn their face toward the information collecting robot 1 and speak may be displayed on the screen 101. Simultaneously with the screen display, a voice may be output from the speaker 13 urging the target person to turn their face toward the information collecting robot 1 and speak.

[0093] At this time, the robot control server 2 acquires from the information collection robot 1 the image captured by the camera 11, the detection results of the body temperature sensor 12, and the audio picked up by the microphone 14. Then, based on the image captured by the camera 11, the robot control server 2 performs facial matching of the subject, determines whether the subject is wearing a mask, and detects the subject's facial expression. The robot control server 2 also detects the subject's tone of voice from the audio picked up by the microphone 14. The robot control server 2 also acquires the body temperature measurement result from the detection results of the body temperature sensor 12. Next, the robot control server 2 performs a stress check based on the detection results of the facial expression detection and the tone of voice detection. The robot control server 2 then displays a screen on the display 15 of the information collection robot 1 that presents the stress check result, mask-wearing determination result, and body temperature measurement result to the subject. At this time, a different screen is displayed as the stress check result depending on whether the stress state is positive, negative, or neutral.

[0094] Specifically, if the stress check result is positive, screen 111 shown in Fig. 6(B) is displayed. If the stress check result is neutral, screen 121 shown in Fig. 6(C) is displayed. If the stress check result is negative, screen 131 shown in Fig. 6(D) is displayed. Screens 111, 121, and 131 display text 112 indicating the stress check result, image 113 indicating the mask wearing determination result, and image 114 indicating the body temperature measurement result.

[0095] Furthermore, on the display 15, the screens 111, 121, and 131 shown in FIGS. 6(B), (C), and (D), which are the stress check results, are switched to a screen 141 shown in FIG. 6(E).

[0096] Screen 141 shown in Fig. 6(E) is used to confirm with the subject whether or not they wish to display the stress check results for that person on the presence status confirmation screen (see Figs. 7 and 8). Screen 141 has text 142 asking the subject whether or not they wish to display the stress check results, as well as a "Yes" button 143 and a "No" button 144. The subject operates either "Yes" button 143 or "No" button 144 depending on whether or not they wish to display the stress check results. This allows the robot control server 2 to obtain setting information for each person regarding whether or not the stress check results can be displayed.

[0097] Next, a description will be given of the presence status check screen displayed on the user terminal 6 according to the first embodiment. Fig. 7 is an explanatory diagram showing the presence status check screen in map display mode displayed on the user terminal 6. Fig. 8 is an explanatory diagram showing the presence status check screen in department display mode displayed on the user terminal 6.

[0098] The presence management server 4 generates display information for a screen that shows the presence status of people in the office based on the information registered in the database, and distributes the display information to the user terminal 6. On the user terminal 6, an presence status confirmation screen 201 in map display mode shown in Fig. 7 and an presence status confirmation screen 211 in department display mode (list display mode) shown in Fig. 8 are displayed. Note that the map display mode and department display mode can be switched by a predetermined screen operation. Furthermore, the confirmation screens for these two modes may be integrated and displayed.

[0099] As shown in Fig. 7, the presence status confirmation screen 201 (presence map) in map display mode displays an office layout diagram 202 (area map) in which each office seat is drawn, and a person icon 203 (an image showing the person's seating position) representing the person sitting at the office seat is displayed at the position of each office seat on the layout diagram 202. The person icon 203 displays an image of the person's face. Note that the person icon 203 may display a portrait of the person or letters showing the person's name in addition to an image of the person's face cut out from a photographed image of the person.

[0100] On the presence status confirmation screen 201, when the user operates the person icon 203, a speech bubble 204 (person information display section) is displayed. Detailed information about the person is displayed in this speech bubble 204. In the example shown in FIG. 7, the speech bubble 204 displays the detailed information about the person, including the person's name, identification information (area number) of the presence detection area (work seat), the measured body temperature, a mask icon 205 indicating whether or not the person is wearing a mask, and a stress icon 206 indicating the results of a stress check. Links to emails and social media may also be displayed.

[0101] The mask icon 205 changes form depending on whether or not a mask is being worn. Specifically, if a mask is being worn, the first form includes a "circle" symbol. If a mask is not being worn, the second form includes a "cross" symbol.

[0102] The form of the stress icon 206 changes depending on the stress check result and whether or not the person wishes for the stress check result to be displayed. Specifically, if the person wishes for the stress check result to be displayed (results can be displayed) and the stress state is good, the stress icon will take on a first form in which a smiling face icon is drawn. If the person wishes for the stress check result to be displayed (results can be displayed) and the stress state is normal, the stress icon will take on a second form in which a normal face icon is drawn. If the person does not wish for the stress check result to be displayed (results cannot be displayed), the stress icon will take on a third form in which no face icon is drawn.

[0103] Here, if the stress check result is positive, the stress state is deemed to be good, and the first form is selected. If the stress check result is negative or neutral, the stress state is deemed to be normal, and the second form is selected. Note that if the stress check result is neutral, the stress state may also be deemed to be good, and the first form is selected.

[0104] If the person seated at the desk is unknown, that is, if the person cannot be identified by face matching, a person icon 207 indicating that the person is unknown is displayed.

[0105] As shown in Fig. 8, on the presence status confirmation screen 211 in the department display mode, information about the people who are present is displayed for each department (first to third development groups). Specifically, a department display field 212 is provided, and the department display field 212 is provided with a person display field 213. The person display field 213 displays the person's face image, the person's name, identification information (area number) of the presence detection area (work seat), the measured body temperature value, a mask icon 205, and a stress icon 206. In the example shown in Fig. 8, for an absent person, only the person's face image and the person's name are displayed.

[0106] Furthermore, if the body temperature is within the fever range (for example, 37.5°C or higher) or if the person is not wearing a mask, the corresponding person display column 213 may be highlighted. In the example shown in Fig. 8, the measured body temperature is displayed in bold red. If the body temperature is within the fever range or if the person is not wearing a mask, an alert may be issued using a pop-up screen or sound.

[0107] Next, an operation procedure of the seating management server 4 according to the first embodiment will be described.

[0108] The seating management server 4 first performs seating detection processing (ST101). In this seating detection processing, the processor 43 acquires an image captured by the fixed camera 3, performs person detection on the image region of the seating detection area in the captured image, and determines whether or not a person is present in the target seating detection area. If the processor 43 determines that a person is present in the target seating detection area, the processor 43 determines that the state of the target seating detection area is "present." If the processor 43 determines that no person is present in the target seating detection area, the processor 43 determines that the state of the target seating detection area is "vacant (not present)," and stores the presence detection result in the storage unit 42. Note that even if no person is present in the target seating detection area, if the person's belongings are detected due to temporary absence from the seat, for example, the processor 43 may treat the state of the seating detection area as "present."

[0109] Next, processor 43 determines whether the state of the seat occupancy detection area has changed (ST102).

[0110] Here, if the state of the occupancy detection area has changed (Yes in ST102), the processor 43 then performs information collection processing (information collection loop) using the information collection robot 1 for all occupancy detection areas whose state has changed (ST103 to ST112).

[0111] In this information collection process, first, processor 43 determines whether the state of the seat occupancy detection area has changed from vacant (absent) to occupied (ST104).

[0112] Here, if the state of the occupancy detection area changes from vacant to occupied, i.e., if a person takes a seat (Yes in ST104), then processor 43 determines whether the target occupancy detection area has not been checked, i.e., whether an instruction to collect information has not yet been given by information collecting robot 1 (ST105).

[0113] Here, if the target presence detection area is unchecked (Yes in ST105), the processor 43 then sends an information collection instruction from the communication unit 41 to the robot control server 2 to cause the information collection robot 1 to collect information about people present in the target presence detection area (ST106).

[0114] Next, the processor 43 acquires the information on the person present at the desk received from the robot control server 2 via the communication unit 41, that is, the face matching result, the mask wearing determination result, the body temperature measurement result, and the stress check result (ST107).

[0115] Next, processor 43 updates the registration information related to the person in the seating detection database (ST108). That is, the person ID as the face matching result for the person associated with the target seating detection area, the mask wearing determination result, the body temperature measurement result, and the stress check result are registered in the seating database. Processor 43 also updates the registration information related to the state of the target area in the seating detection database to "occupied" (ST109). Then, the process proceeds to processing the next seating detection area.

[0116] On the other hand, if the target occupancy detection area is not unchecked, i.e., if an instruction to collect information has already been given by the information gathering robot 1 (No in ST105), the processor 43 then determines whether or not a predetermined time has passed since the instruction to collect information was given by the information gathering robot 1 (ST110).

[0117] If a predetermined time or more has passed since the information collecting robot 1 was instructed to collect information (Yes in ST110), the process proceeds to ST106, where the information collecting robot 1 is instructed to collect information again. On the other hand, if a predetermined time or more has not passed since the information collecting robot 1 was instructed to collect information (No in ST110), the process proceeds to ST109.

[0118] If the state of the seating detection area changes from occupied to vacant (No in ST104), processor 43 updates the registration information regarding the state of the target seating detection area in the seating database to vacant (ST111), and then proceeds to processing the next seating detection area.

[0119] Next, an explanation will be given of the operation procedure of the robot control server 2 according to the first embodiment. FIG.

[0120] In the robot control server 2, first, the communication unit 21 receives an instruction for the information collecting robot 1 to collect information from the seating management server 4 (ST201).

[0121] Next, the processor 23 sets a target position near the target person, i.e., a person present in the presence detection area where presence is detected, and controls the information gathering robot 1 to move from the waiting position to the target position (ST202).

[0122] Next, when the information collecting robot 1 arrives at the target location, the processor 23 controls the information collecting robot 1 to perform a guidance action for information collection (ST203). Specifically, a guidance screen (see FIG. 6(A)) is displayed encouraging the target person to turn their face toward the information collecting robot 1 and speak, and a guidance voice with the same content is output from the speaker 13. At this time, the processor 23 controls the information collecting robot 1 to photograph the target person's face with the camera 11 and to collect the target person's speaking voice with the microphone 14.

[0123] Next, the processor 23 performs a mask wearing determination process (ST204). At this time, the processor 23 determines whether or not the subject is wearing a mask based on the image captured by the camera 11 received from the information collecting robot 1.

[0124] Next, processor 23 performs face matching processing (ST205). At this time, facial feature information of the target person is extracted from the image captured by camera 11. Then, facial feature information for each registered person is obtained from storage unit 42, and the facial feature information for each registered person is compared with the facial feature information of the target person to obtain a face matching score.

[0125] Next, processor 23 determines whether or not face matching is successful, that is, whether or not the subject person matches a registered person, based on the face matching score (ST206).

[0126] If face matching is successful (Yes in ST206), processor 23 performs body temperature detection processing (ST207). At this time, processor 23 controls information collection robot 1 to measure the body temperature of the subject with body temperature sensor 12, and acquires the body temperature measurement result received from information collection robot 1.

[0127] Next, the processor 23 receives from the information collecting robot 1 a photographed image of the target person's face taken by the camera 11 of the information collecting robot 1, and detects the target person's facial expression from the photographed image (facial expression detection process) (ST208).

[0128] Furthermore, the processor 23 receives the target person's voice collected by the microphone 14 of the information collecting robot 1 from the information collecting robot 1, and detects the target person's tone of voice from the voice (tone of voice detection process) (ST209).

[0129] Next, the processor 23 determines the stress state of the subject based on the detection results of the facial expression detection process and the detection results of the tone detection process (stress check) (ST210).

[0130] Next, the processor 23 displays screens 111, 121, and 131 (see Figures 6(B), (C), and (D)) on the display 15 of the information gathering robot 1 to present the subject with the body temperature measurement results, mask wearing determination results, and stress check results (ST211).

[0131] Next, the processor 23 displays a screen 141 (see FIG. 6(E)) on the display 15 of the information collecting robot 1, which asks the subject whether or not they wish to display their stress check results, on a screen shared with other people (presence status confirmation screen, see FIGS. 7 and 8) (ST212). At this time, in response to the subject's screen operation, setting information regarding whether or not the stress check results should be displayed on the screen is acquired.

[0132] Next, the processor 23 transmits the seating person information, that is, the face matching result, the mask wearing determination result, the body temperature measurement result, and the stress check result, from the communication unit 21 to the seating management server 4 (ST213).

[0133] Next, the processor 23 controls the information collecting robot 1 to return to a predetermined standby position (ST214).

[0134] (Second embodiment) Next, a second embodiment will be described. Note that the points not specifically mentioned here are the same as those in the previous embodiment.

[0135] In the first embodiment, a stress check is conducted to determine the stress state of a person sitting in an office, and the results of the stress check are displayed on a screen. On the other hand, in this embodiment, if the stress check result is negative, the subject is asked to perform a refreshment menu to improve the subject's negative state (undesirable state). In this embodiment, the subject is asked to perform one of the refreshment menus: smiling, stretching, and speaking.

[0136] In this embodiment, if the stress check result is negative, the stress check result is reported to the relevant parties (such as the superior or the person in charge of the health management office). This reporting of the stress check result is performed using the SNS provided by the cloud server 5, specifically, a chat service.

[0137] Furthermore, in this embodiment, if the stress check result of the subject is negative, the subject is spoken to in order to improve the subject's negative state. The person who speaks to the subject is a person who is present in the subject's vicinity and is selected by the robot control server 2. The information collecting robot 1 makes a request to speak to the subject in person to the requested person. Alternatively, the request to speak to the requested person is made using SNS. Note that the information collecting robot 1 itself may speak to the subject.

[0138] Incidentally, such actions as measures to improve the mental health of subjects (refreshment menu guidance, stress check result reporting, and speaking to the subject) may be taken when a negative state is evident. In this case, the stress check will determine the negative state at multiple levels.

[0139] Furthermore, mental health measures may be implemented when there is a significant change in the stress check results, i.e., when the stress state has significantly worsened compared to before. Specifically, stress check results (scores) for each person are accumulated, and the subject's normal stress state is obtained from the subject's past stress check results. The current stress check result is then compared with the subject's normal stress state, and if the degree of change in the state exceeds a reference range, mental health measures may be implemented. Furthermore, mental health measures may be implemented if the degree of change in the state exceeds the reference range for a predetermined number of consecutive times (a predetermined period of time).

[0140] Next, a description will be given of the schematic configuration of the information collecting robot 1, the robot control server 2, and the presence management server 4 according to the second embodiment. Fig. 11 is a block diagram showing the schematic configuration of the information collecting robot 1, the robot control server 2, and the presence management server 4.

[0141] The configurations of the information collecting robot 1 and the seating management server 4 are the same as those in the first embodiment (see FIG. 5).

[0142] The configuration of the robot control server 2 is substantially the same as in the first embodiment, but differs in the processing executed by the processor 23. Specifically, the processor 23 performs driving control processing, mask wearing determination processing, face matching processing, body temperature measurement processing, facial expression detection processing, speech tone detection processing, and stress check processing, just like in the first embodiment, but also refreshment guidance processing, movement detection processing, stress check result reporting processing, and call request processing.

[0143] In the refreshment guidance process, the processor 23 guides the subject to perform a predetermined refreshment menu. In this embodiment, the subject is made to perform one of the refreshment menus, which are smiling, stretching, and vocalizing. Also, in this embodiment, the information collecting robot 1 is made to perform an operation (screen display, voice output) to guide the subject to perform the refreshment menu.

[0144] In the movement detection process, while the subject is performing a stretching (stretching exercise) refresh menu, the processor 23 detects the subject's movement from the image captured by the camera 11 of the information collecting robot 1. In particular, in this embodiment, it is determined whether the subject has performed stretching (stretching exercise) to a standard degree or more.

[0145] In the facial expression detection process, like the first embodiment, the processor 23 detects the facial expression of the target person from the image captured by the camera 11 of the information gathering robot 1, but in this embodiment, it is determined whether or not the target person smiled at a level above a reference level. In the speech tone detection process, like the first embodiment, the processor 23 detects the speech tone of the target person from the voice picked up by the microphone 14 of the information gathering robot 1, but in this embodiment, it is determined whether or not the target person uttered a voice above a reference level.

[0146] In the stress check result reporting process, if the stress check result is negative and there is a significant change in the stress check result, the processor 23 issues a notification to report the stress check result to the relevant person (supervisor or health management office staff). Specifically, the notification of the stress check result report is sent from the robot control server 2 via the cloud server 5 to the relevant person's user terminal 6. On the relevant person's user terminal 6, a stress check result report screen 301 (see FIG. 13) presenting the stress check result is displayed as a screen for the chat service using an SNS application. Note that the stress check result is reported when a setting is made to allow reporting for the subject.

[0147] In the call request process, if the stress check result of the subject is negative, the processor 23 selects a person from those present around the subject to call out to the subject to improve the subject's stress check state, and requests the selected person to call out to the subject. Note that the call to the subject is performed if there is a setting for the subject that allows calls to be made.

[0148] In this embodiment, the information collecting robot 1 is controlled so that the information collecting robot 1 moves to the vicinity of the requested person and performs an action of requesting the requested person to call out to the target person face-to-face. Specifically, as the action of requesting the person to call out to the target person, a call request screen 171 (see FIG. 14(A)) requesting the person to call out to the target person is displayed on the display 15 of the information collecting robot 1.

[0149] In this embodiment, a notification of the call request is sent from the robot control server 2 to the user terminal 6 of the requested person via the cloud server 5. On the user terminal 6 of the requested person, a call request screen 311 (see FIG. 14(B)) for requesting the person to call out to the target person is displayed as a screen for a chat service using an SNS application.

[0150] Next, a screen displayed on the display 15 of the information collecting robot 1 according to the second embodiment will be described. Fig. 12 is an explanatory diagram showing a screen displayed on the display 15 of the information collecting robot 1.

[0151] If the stress check result is negative and the refresh menu is a smile, first, the screen 131 shown in FIG. 6(D) is displayed on the display 15, and then the screen transitions to a screen 141 shown in FIG. 12(A-1). The screen 141 shown in FIG. 12(A-1) displays the image 102 captured by the camera 11 and text 143 urging the subject to smile. At this time, the robot control server 2 determines, in a facial expression detection process, based on the image captured by the camera 11, whether the subject has smiled at a level equal to or greater than a reference level. If it is determined that the subject has smiled at a level equal to or greater than the reference level, the screen transitions to a screen 142 shown in FIG. 12(A-2). The screen 142 shown in FIG. 12(A-2) displays the image 102 captured by the camera 11 and text 144 indicating that the refresh menu has ended.

[0152] If the stress check result is negative and the refresh menu is stretching, first, the screen 131 shown in FIG. 6(D) is displayed on the display 15, and then the screen transitions to the screen 151 shown in FIG. 12(B-1). The screen 151 shown in FIG. 12(B-1) displays the image 102 captured by the camera 11 and text 153 urging the subject to stretch (stretching exercises). At this time, the robot control server 2 determines whether the subject has stretched to a standard degree or more based on the image captured by the camera 11 in the motion detection process or the skeleton detection process. If it is determined that the subject has stretched to a standard degree or more, the screen transitions to the screen 152 shown in FIG. 12(B-2). The screen 152 shown in FIG. 12(B-2) displays the image 102 captured by the camera 11 and text 154 indicating that the refresh menu has ended.

[0153] If the stress check result is negative and the refresh menu item is vocalization, first, the screen 131 shown in FIG. 6(D) is displayed on the display 15, and then the screen transitions to a screen 161 shown in FIG. 12(C-1). The screen 161 shown in FIG. 12(C-1) displays the image 102 captured by the camera 11 and text 163 urging the subject to vocalize. At this time, the robot control server 2 determines, in a speech tone detection process, based on the voice picked up by the microphone 14, whether the subject has vocalized at a level equal to or higher than the standard. If it is determined that the subject has vocalized at a level equal to or higher than the standard, the screen transitions to a screen 162 shown in FIG. 12(C-2). The screen shown in FIG. 12(C-2) displays the image 102 captured by the camera 11 and text 164 indicating that the refresh menu has ended.

[0154] After the screens shown in FIGS. 12(A-2), (B-2), and (C-2) are displayed on the display 15, the screen changes to the screen shown in FIG. 6(E).

[0155] Next, a description will be given of the stress check result report screen displayed on the user terminal 6 of the person involved according to the second embodiment. Fig. 13 is an explanatory diagram showing the stress check report screen.

[0156] If the stress check result is negative and there is a significant change in the stress check result, a notification to report the stress check result to relevant parties (supervisors or health management office staff) is sent from the robot control server 2 to the relevant parties' user terminal 6 via the cloud server 5.

[0157] A stress check result report screen 301 (chat service screen) using an SNS application is displayed on the user terminal 6 of the person concerned. The stress check result report screen 301 displays the stress check result. This allows the person concerned to understand the stress check result of the subject.

[0158] In addition, the stress check report using SNS may be made using a chat service or another service such as email.

[0159] Next, a description will be given of a call request screen displayed on the display 15 of the information collecting robot 1 according to the second embodiment and on the user terminal 6 of the seated person. Fig. 14 is an explanatory diagram showing the call request screen.

[0160] If the stress check result of the subject is negative, the robot control server 2 selects a person to talk to the subject from among the people around the subject and requests the selected person to talk to the subject. Note that the person is talked to if there is a setting for talking to the subject.

[0161] In this embodiment, the robot control server 2 controls the information collection robot 1 so that the information collection robot 1 moves to the location of the requested person and performs an action of requesting the requested person to speak to the target person.

[0162] Specifically, a call request screen 171 shown in Fig. 14(A) is displayed on the display 15 of the information collecting robot 1. The call request screen 171 displays text 172 requesting that the target person be called out to, and an image 102 captured by the camera 11 showing the target person. This allows the person to understand the content of the call request. Simultaneously with the screen display, a voice requesting that the target person be called out to may be output from the speaker 13.

[0163] In this embodiment, a notification for requesting the person to speak to the robot is transmitted from the robot control server 2 via the cloud server 5 to the user terminal 6 of the person to whom the request is made.

[0164] A call request screen 311 (chat service screen) shown in Fig. 14(B) is displayed on the user terminal 6 of the requested person by the SNS application. A message requesting a call is displayed on the call request screen 311. This allows the requested person to understand the content of the call request.

[0165] In addition, requests to make contact using SNS may be made using a chat service or another service such as email.

[0166] Next, a description will be given of a setting screen displayed on the administrator terminal 7 according to the second embodiment.

[0167] When the administrator terminal 7 accesses the robot control server 2, an administrator menu screen 401 (initial screen) shown in FIG. 15(A) is displayed.

[0168] An administrator menu screen 401 shown in Fig. 15(A) is provided with a refresh button 402 and a notification button 403. When the administrator operates the refresh button 402, the screen transitions to the refresh menu screen shown in Fig. 15(B). When the administrator operates the notification button 403, the screen transitions to the notification setting screen shown in Fig. 16(A).

[0169] 15(B) is provided with a smile button 412, a stretch button 413, and a vocalization button 414. The refresh menu screen 411 is also provided with a confirm button 415 and a cancel button 416. When the administrator operates the confirm button 415 after operating one of the smile button 412, stretch button 413, and vocalization button 414, a refresh menu is set according to the operation. Note that the refresh menu screen 411 may be configured so that multiple buttons can be selected from the smile button 412, stretch button 413, and vocalization button 414.

[0170] 16(A) displays a member list 422 and a search box 423. For each member, the member list 422 displays the name, whether the stress check results can be reported to relevant parties, the person to report to, and whether the target person can be contacted to improve a negative state. When the administrator inputs a keyword (such as a person's name) in the search box 423 and instructs a search, information about the corresponding member is displayed in the member list 422.

[0171] The notification setting screen 421 is also provided with a confirm button 424 and a cancel button 425. When the administrator operates the confirm button 424, the contents of the member list 422 are registered. When the administrator operates the cancel button 425, the screen returns to the administrator menu screen 401 (see FIG. 15(A)). When the administrator operates the cell of a member (number or name) in the member list 422, the screen transitions to a member registration screen 431 shown in FIG. 16(B).

[0172] 16(B) is provided with an input section 432 for a name, an input section 433 for whether to report, an input section 434 for the person to report to, an input section 435 for whether to call out, and a confirm button 436. When the administrator operates confirm button 436 after performing input operations in input sections 432 to 435, the member registration information is updated based on the input contents, and the member registration information is reflected in member list 422 on notification setting screen 421 shown in FIG.

[0173] Although Figures 15 and 16 show the setting screen displayed on the administrator terminal 7, each person may be able to set on their own user terminal 6 whether or not to report about themselves, who to report to, and whether or not to call out to others.

[0174] In the examples shown in FIGS. 15 and 16, whether or not to report or call out is set for each person, but whether or not to report or call out may be set collectively for all people.

[0175] Next, an explanation will be given of the operation procedure of the robot control server 2 according to the second embodiment. Figures 17 and 18 are flow charts showing the operation procedure of the robot control server 2.

[0176] As shown in Figure 17, the process (ST201 to ST211) up to the display 15 of the information collecting robot 1 displays screens 111, 121, and 131 (see Figures 6(B), (C), and (D)) that present the body temperature measurement results, mask wear determination results, and stress check results to the subject is the same as in the first embodiment (see Figure 10).

[0177] Next, as shown in FIG. 18, the processor 23 determines whether the refresh menu set in advance by the administrator is a smile, a voice, or a stretch (ST221).

[0178] Here, if the refresh menu is a smile ("Smile" in ST221), processor 23 displays a smile refresh guide screen (see FIG. 12(A-1)) on display 15 of information collecting robot 1 (ST222). Next, processor 23 determines whether the subject has smiled to a level equal to or greater than a reference level based on the image captured by camera 11 (facial expression detection process) (ST223). Here, if it is determined that the subject has smiled to a level equal to or greater than the reference level, processor 23 displays a smile refresh result screen (see FIG. 12(A-2)) on display 15 of information collecting robot 1 (ST224).

[0179] Furthermore, if the refresh menu is stretching ("Stretching" in ST221), the processor 23 displays a stretching refreshment guide screen (see FIG. 12(B-1)) on the display 15 of the information-collection robot 1 (ST225). Next, the processor 23 determines whether the subject has performed stretching to a standard degree or more, based on the image captured by the camera 11 (motion detection process or skeleton detection process) (ST226). Here, if it is determined that the subject has performed stretching to a standard degree or more, the processor 23 displays a stretching refreshment result screen (see FIG. 12(B-2)) on the display 15 of the information-collection robot 1 (ST227).

[0180] Furthermore, if the refresh menu is vocalization ("vocalization" in ST221), the processor 23 displays a vocalization refresh guide screen (see FIG. 12(C-1)) on the display 15 of the information collecting robot 1 (ST228). Next, the processor 23 determines whether the subject has vocalized at or above a reference level based on the sound picked up by the microphone 14 (speech tone detection process) (ST229). Here, if it is determined that the subject has vocalized at or above the reference level, the processor 23 displays a vocalization refresh result screen (see FIG. 12(C-2)) on the display 15 of the information collecting robot 1 (ST230).

[0181] Next, the processor 23 determines whether or not the setting allows reporting of the stress check result (ST231). If the setting allows reporting of the stress check result (Yes in ST231), the processor 23 reports the stress check result to relevant parties (such as the supervisor or the person in charge of the health management office) (ST232).

[0182] Processor 23 also determines whether the setting allows calling out to the target person (ST233). If the setting allows calling out to the target person (Yes in ST233), a person who will call out to the target person is selected from people present around the target person, and the requested person is requested to call out to the target person (ST234).

[0183] The subsequent processes (ST212 to ST214) are the same as those in the first embodiment (see FIG. 10).

[0184] In this embodiment, the stress check and refreshment menu are carried out when the presence of a person is detected, i.e., when the person arrives at work, but the stress check and refreshment menu may also be carried out during working hours. For example, the stress check and refreshment menu may be carried out during a time period when fatigue is accumulating. The timing of carrying out the stress check and refreshment menu may be set in advance by an administrator.

[0185] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0186] The presence information management system and presence information management method of the present invention use a robot to conduct stress checks on each person in a timely manner and effectively present the stress check results, thereby promoting the mental health care of each person throughout the workplace and creating an environment in which employees can work with peace of mind.They are useful as presence information management systems and presence information management methods that manage presence information regarding the presence status of people in work areas. [Explanation of symbols]

[0187] 1. Information gathering robot 2. Robot control server (robot control unit) 4 Attendance management server (Attendance management department) 6 User terminal (user device) 11 Camera 12 Body temperature sensor 13 speakers 14. Mike 15 Display 16 Running part 17 Controller

Claims

1. An occupancy information management system that manages occupancy information regarding a person's occupancy status based on the detection result of an occupancy detection area that has changed from vacant to occupied in an office area, comprising: an attendance management unit that accumulates the attendance information; an information gathering robot having a camera that autonomously travels within the office area and gathers information about a target person present in the presence detection area; a robot control unit that controls the operation of the information collecting robot, The robot control unit When an instruction to collect information about a subject present in the presence detection area is received, the information collection robot is controlled to move to the presence detection area, the subject is identified based on the captured image acquired by the camera, and a facial expression detection process is performed to detect the facial expression of the subject, thereby conducting a stress check to determine the subject's stress state; Furthermore, a result display confirmation is performed to confirm with the subject whether or not the results of the stress check regarding the subject will be displayed on a screen to be shared with other people, and setting information regarding whether or not the results of the stress check can be displayed on the screen is acquired; The presence management unit An attendance information management system characterized in that, when the setting information is set to be displayable on the screen, the results of the stress check for the subject are presented along with the presence status of each person in the work area.

2. The robot control unit The presence information management system according to claim 1, characterized in that an image area of ​​the target person's face is cut out from the image captured by the camera to obtain a facial image, facial feature information of the target person is extracted from the facial image, and the target person is identified by comparing the facial feature information of each registered person with the facial feature information of the target person.

3. The robot control unit 2. The presence information management system according to claim 1, wherein, if the result of the stress check indicates that the subject is in an undesirable state, the system performs a process of instructing the subject to implement a predetermined refresh menu.

4. The robot control unit 4. The presence information management system according to claim 3, wherein the refresh menu includes a process of instructing the subject to perform at least one of smiling, stretching, and speaking.

5. The robot control unit 2. The attendance information management system according to claim 1, wherein if the result of the stress check indicates that the subject is in an undesirable state, the system performs a process of reporting the stress check result to the subject's relatives.

6. The robot control unit The presence information management system described in claim 1, characterized in that if the result of the stress check shows that the subject is in an undesirable state, a person who will speak to the subject to improve the subject's condition is selected from among the people present around the subject, and that person is asked to speak to the person.

7. The robot control unit 7. The presence information management system according to claim 6, wherein the information gathering robot is controlled so as to move to the vicinity of the requested person and request the requested person to speak to the target person.

8. The robot control unit 2. The attendance information management system according to claim 1, wherein the information collecting robot is controlled so as to perform an operation related to the display and confirmation of the results when collecting information required for the stress check.

9. A method for managing presence information relating to the presence status of a person based on a detection result of an occupancy detection area in a work area that has changed from an empty seat to an occupied seat, comprising: An information gathering robot equipped with a camera autonomously traveling within the office area to collect information about subjects present in the presence detection area; a robot control unit that controls the operation of the information collecting robot, When an instruction to collect information about a subject present in the presence detection area is received, the information collection robot is controlled to move to the presence detection area, the subject is identified based on the captured image acquired by the camera, and a facial expression detection process is performed to detect the facial expression of the subject, thereby conducting a stress check to determine the subject's stress state; Furthermore, a result display confirmation is performed to confirm with the subject whether or not the results of the stress check regarding the subject will be displayed on a screen to be shared with other people, and setting information regarding whether or not the results of the stress check can be displayed on the screen is acquired; an attendance management unit that accumulates the attendance information, A method for managing presence information, characterized in that, when the setting information is set to be displayable on the screen, the results of the stress check for the subject are presented along with the presence status of each person in the work area.

Images