Seated status presentation method and seated status presentation system
Patent Information
- Application Number
- JP2023531898
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-06-24
- Filing Date
- 2022-06-24
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2042-06-24
AI Technical Summary
In free-address offices, it is difficult for users to locate colleagues quickly and easily contact them, as existing methods struggle to effectively present the presence status of individuals across a large area, leading to inefficiencies in communication and collaboration.
A presence status presentation method and system that uses computers to display presence information, including person icons and personal cards, superimposed on a map of the office area, allowing users to easily identify and contact individuals based on their location and attributes.
Enables users to quickly check the presence status of individuals and initiate communication, enhancing collaboration and reducing the time spent searching for colleagues in large or busy office environments.
Abstract
Description
Occupancy status presentation method and occupation status presentation system
[0001] The present disclosure relates to a presence status presentation method and a presence status presentation system that use one or more computers to execute a process for presenting to a user the presence status of people in an office area having a plurality of seats.
[0002] In recent years, the number of offices with free address systems, where users can freely choose their own desks, has been increasing, with the aim of stimulating communication and collaboration across departments and divisions.In such offices with free address systems, it is difficult to know where the person you are contacting for business is sitting, and it takes time to find that person.Therefore, there is a need for technology that can show who is sitting where.
[0003] In response to such demands, a technology has been known that uses wireless signals or the like to obtain location information of the devices used by people, identifies the seating location of each person present based on the location information of the devices, and generates a map showing the seating location of each person in the office based on the seating location of each person (see Patent Document 1).
[0004] JP 2016-126373 A JP 2018-32294 A
[0005] However, when an office is large or has many users, simply displaying a map showing the locations of each person can make it difficult to find the person you need to contact. There are also cases where you want to get in touch with someone quickly, but even if you know that the person is in the office, you have to go to that person's location or launch a separate chat application to get in touch with them, which is inconvenient as it makes it difficult to contact someone whose presence you have confirmed.
[0006] Therefore, the main purpose of the present disclosure is to provide a presence status presentation method and presence status presentation system that allows a user in a free address office to easily check the presence status of a person and to easily contact that person.
[0007] The presence status presentation method disclosed herein is a presence status presentation method in which one or more computers execute a process for presenting to a user the presence status of people in an office area having a plurality of seats, wherein the computer acquires presence status information regarding the presence status of people at each seat in the office area, acquires person identification information including attribute information and personal information regarding the people currently seated, and generates display information representing the presence status of people in the office area based on the presence status information and the person identification information, wherein the display information includes a map display area in which an presence map is displayed in which person icons representing people currently seated are superimposed on an area image representing the office area, and a card display area arranged alongside this map display area in which a list of personal cards for each currently seated person is displayed, wherein each of the person icons is displayed including the personal information, and each of the personal cards is displayed including the personal information and the attribute information.
[0008] The presence status presentation system of the present disclosure is a presence status presentation system that is configured to include one or more computers that execute a process for presenting to a user the presence status of people in an office area having a plurality of seats, wherein the computer acquires presence status information regarding the presence status of people at each seat in the office area, acquires person identification information including attribute information and personal information regarding the people currently seated, and generates display information representing the presence status of people in the office area based on the presence status information and the person identification information, wherein the display information includes a map display area in which an presence map is displayed in which person icons representing people currently seated are superimposed on an area image representing the office area, and a card display area that is arranged alongside this map display area and displays a list of personal cards for each person currently seated, wherein each person icon is displayed including the personal information, and each personal card is displayed including the personal information and the attribute information.
[0009] According to the present disclosure, an attendance map with person icons containing personal information and a list of personal cards containing personal information and attribute information are simultaneously displayed, making it easy to check the attendance status of people in a free address office.
[0010] FIG. 1 is a block diagram showing the general configuration of an presence detection system according to a first embodiment; FIG. 2 is a block diagram showing the general configuration of a presence detection server, a user terminal, a robot, and a robot control server; FIG. 3 is an explanatory diagram showing an example of the registered contents of an presence status database managed by the presence detection server; FIG. 4 is a flow diagram showing the procedure for presence detection processing performed by the presence detection server; FIG. 5 is a flow diagram showing the procedure for processing performed by the robot control server; FIG. 6 is a flow diagram showing the procedure for presence status display processing performed by the user terminal; 1 is an explanatory diagram showing a state in which the display range of a personal card has been changed by using a group tab on the presence status confirmation screen; 2 is an explanatory diagram showing a state in which the display information has been narrowed down by using a group tab on the presence status confirmation screen; 3 is an explanatory diagram showing the overall configuration of a presence detection system according to a second embodiment; 4 is an explanatory diagram showing a personal card in a normal state and a personal card in a communication tool display state; 5 is a sequence diagram showing the operation procedure of a user terminal and a communication server when sending a message using a communication application on the user terminal; 6 is a sequence diagram showing the operation procedure of a user terminal and a communication server when sending a message without using a communication application on the user terminal; 7 is an explanatory diagram showing a chat screen displayed on a user terminal for sending messages simultaneously using a communication application on the user terminal;
[0011] A first invention made to solve the above problem is a presence status presentation method in which one or more computers execute a process to present to a user the presence status of people in an office area having a plurality of seats, wherein the computer acquires presence status information regarding the presence status of people at each seat in the office area, acquires person identification information including attribute information and personal information regarding the people currently seated, and generates display information representing the presence status of people in the office area based on the presence status information and the person identification information, wherein the display information includes a map display area in which an presence map is displayed in which person icons representing people currently seated are superimposed on an area image representing the office area, and a card display area arranged alongside this map display area in which a list of personal cards for each currently seated person is displayed, wherein each of the person icons is displayed including the personal information, and each of the personal cards is displayed including the personal information and the attribute information.
[0012] This simultaneously displays an attendance map with person icons containing personal information and a list of personal cards containing personal information and attribute information. This makes it easy to check the presence status of people in a free-address office. Attribute information may be, for example, the group (department) to which the person belongs, and personal information may be, for example, name, email address, face image (photograph), etc.
[0013] In addition, the second invention is configured such that the personal information includes first personal information expressed non-verbally and second personal information expressed verbally, the person icons are each displayed including the first personal information, and the personal cards are each displayed including the first personal information and the second personal information.
[0014] This allows users to easily identify the people present at the meeting by the person icons, and to grasp the details of the people present at the meeting by the personal cards. The first personal information is, for example, a facial image, and the second personal information is, for example, a name, an email address, and the like.
[0015] In addition, in a third invention, the first personal information includes either a facial image of a person captured when entering the office area or a facial image of a person captured when their presence is detected.
[0016] This allows the user to understand the current state of the people present at the table from the face images captured on the day.
[0017] In addition, a fourth invention is configured such that the first personal information includes characteristic information on at least one of the person's appearance and clothing extracted from either an image of the person taken when entering the office area or an image of the person taken when their presence is detected.
[0018] This allows the user to easily understand the current state of the person in attendance based on the person's characteristic information based on the image captured on the day. In this case, for example, the person icon may include an avatar image (portrait) created from the person's characteristic information.
[0019] In addition, a fifth invention is configured such that the attribute information includes first attribute information expressed non-verbally and second attribute information expressed verbally, the person icons are each displayed including the first attribute information, and the personal cards are each displayed including the first attribute information and the second attribute information.
[0020] This allows the user to instantly grasp the attributes of the person currently at the desk from the person icon, and to grasp the attributes of the person currently at the desk in detail from the personal card. The first attribute information is, for example, a group color assigned to the group to which the person belongs, and the second attribute information is, for example, characters representing the group to which the person belongs (department, etc.).
[0021] In addition, a sixth invention is configured such that the attribute information includes information regarding a group to which the person belongs, the display information includes an operation unit for the user to select a group, and the computer determines whether each person present belongs to a selected group based on the attribute information for each person, and changes the display state or display content of the personal card and person icon for each person present depending on the determination result.
[0022] This allows the user to check the presence status by narrowing down to a specific group.
[0023] In addition, the seventh invention is configured such that the person icon relating to a person who belongs to the selected group is displayed in a form including the personal information and the attribute information, and the person icon relating to a person who does not belong to the selected group is displayed in a form including the attribute information but not the personal information.
[0024] This allows the user to easily distinguish between people who belong to the selected group and people who do not belong to the group, and further allows the user to know the presence status and attributes of people who do not belong to the selected group.
[0025] In an eighth aspect of the present invention, the personal cards relating to people who do not belong to the selected group are hidden.
[0026] This allows the user to check the details of people in a state where the search is narrowed down to the selected group.
[0027] In addition, in a ninth aspect of the present invention, when the personal identification information cannot be acquired for a person currently seated, the person icon for that person is displayed in a form that does not include the personal information and the attribute information.
[0028] This allows the user to know that a person who cannot be personally identified is present.
[0029] In addition, a tenth invention is configured such that the computer acquires status information regarding at least one of body temperature and whether or not a mask is being worn for each person present, and the status information is displayed on the personal card together with the person identification information.
[0030] This allows users to check the body temperature of people present and whether they are wearing masks.
[0031] In addition, an eleventh invention is configured such that when a user performs an operation to select either the person icon or the personal card, both the selected one and the corresponding other one are highlighted.
[0032] This allows the user to simultaneously check the person's current location and detailed information on both the person icon and the personal card.
[0033] In addition, the twelfth invention is configured such that the card display area has an upper limit on the number of personal cards that can be displayed, and when the total number of personal cards to be displayed exceeds the upper limit, some of the personal cards are hidden, and the hidden personal cards are changed to a displayed state in response to a user operation.
[0034] This prevents the personal cards of all the people present from being displayed in the card display area, making the personal cards difficult to see. In this case, for example, a scroll operation may be performed to display the hidden personal cards in the card display area.
[0035] In addition, a thirteenth invention is configured such that, in response to a user's operation of selecting the person icon, the personal card corresponding to the selected person icon changes from a hidden state to a displayed state in the card display area.
[0036] According to this, when a person icon on the presence map is selected, the personal card corresponding to the selected person icon is always displayed in the card display area. This allows the user to immediately check the person's details using the personal card corresponding to the selected person icon. In this case, for example, the personal card corresponding to the selected person icon may be displayed by shifting the display range of the personal card arrangement list without changing the arrangement order of the personal cards. Alternatively, the arrangement order of the personal cards may be changed so that the personal card corresponding to the selected person icon is displayed first.
[0037] In addition, the 14th invention is configured such that, in response to a user operation to instruct an enlarged display, the presence map is displayed in the map display area with a portion of the presence map as the display range, and in response to a user operation to select a personal card, if the person icon corresponding to the selected personal card is outside the display range, the display range of the presence map is changed so that the person icon corresponding to the selected personal card is displayed.
[0038] According to this, when a portion of the seating map is enlarged, some seats may be outside the display range, and therefore the person icon corresponding to the personal card selected by the user may not be displayed. However, even in such cases, the display range of the seating map can be changed so that the person icon corresponding to the selected personal card is displayed. In this case, the display range of the seating map can be changed to the entire seating map, i.e., the enlarged display can be canceled so that the entire seating map is displayed, or the display range can be shifted so that the person icon corresponding to the selected personal card is displayed.
[0039] In addition, the fifteenth invention is configured such that the personal card includes an operation unit of a communication tool for using the communication system, and when a user selects the personal card and operates the operation unit, a communication application associated with the operation unit is launched and the screen of the communication application is displayed.
[0040] This allows users to easily use the services provided by the communication system to easily communicate with people who are present.
[0041] In addition, the 16th invention is configured such that the personal card includes an operation unit of a communication tool for using the communication system, and the personal card changes from a form that does not include the operation unit of the communication tool to a form that includes the operation unit of the communication tool depending on the operation of the user who selects the personal card.
[0042] With this, the operation unit of the communication tool is not always displayed on the personal card, so that each person's personal card can be made smaller, allowing more personal cards to be displayed in the card display area.
[0043] In addition, the seventeenth invention is configured such that the personal card includes an input field for entering a message and an operation unit for instructing the sending of the message, and when a user selects the personal card and operates the operation unit, a message is sent to the person on the selected personal card via the communication system.
[0044] This allows the user to easily instruct the sending of a message to the person on the personal card.
[0045] In an eighteenth aspect of the present invention, the computer provides the personal information relating to a person staying in the office area or a person sitting in a specific seat in the office area to a communication system.
[0046] This allows the communication system to set a person to whom a message is to be sent based on the presence status of the person in the work area.
[0047] A nineteenth invention is a presence status presentation system comprising one or more computers that executes a process for presenting to a user the presence status of people in an office area having a plurality of seats, wherein the computer acquires presence status information regarding the presence status of people at each seat in the office area, acquires person identification information including attribute information and personal information regarding the people currently seated, and generates display information representing the presence status of people in the office area based on the presence status information and the person identification information, wherein the display information includes a map display area in which an presence map is displayed in which person icons representing people currently seated are superimposed on an area image representing the office area, and a card display area arranged alongside this map display area in which a list of personal cards for each currently seated person is displayed, wherein each of the person icons is displayed including the personal information, and each of the personal cards is displayed including the personal information and the attribute information.
[0048] According to this, as in the first invention, an occupancy map on which person icons containing personal information are arranged and a list of personal cards containing personal information and attribute information are simultaneously displayed, making it easy to check the occupancy status of people in a free address office.
[0049] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
[0050] First Embodiment FIG. 1 is a diagram showing the overall configuration of an occupancy detection system according to a first embodiment.
[0051] The presence detection system presents to a user the presence status of people in an office (work area) having multiple seats. The presence detection system includes a presence detection server 1, a person management server 2, a user terminal 3, an entrance camera 4, an indoor camera 5, a robot 6, and a robot control server 7. The presence detection server 1, the person management server 2, the user terminal 3, the entrance camera 4, the indoor camera 5, and the robot control server 7 are connected via a network.
[0052] In the office, desks and work seats (chairs) are arranged side by side. The office uses a free address system, so when a person enters the office, they find an empty work seat and sit down.
[0053] The seat presence detection server 1 detects the presence of a person in a seat in an office based on an image captured by an indoor camera 5. The seat presence detection server 1 obtains the results of personal identification (face matching) performed by the robot control server 7 using an image of the seated person captured by a robot 6, and generates and manages seat presence status information regarding the seat presence status of the person in each seat in the office. The seat presence detection server 1 is equipped with an seat presence status database that manages the seat presence status information. The seat presence detection server 1 provides the registration information of the seat presence status database to a user terminal 3. The seat presence detection server 1 can be configured as a cloud computer.
[0054] The person management server 2 has a person database (employee database) that manages information about each person (employee) who uses the office. The person database stores person identification information, i.e., personal information such as name, email address, and facial image, as well as attribute information such as the group (department, etc.) to which the person belongs. The person management server 2 provides the registered information in the person database to the user terminal 3. The person management server 2 can be configured as a cloud computer.
[0055] The user terminal 3 is carried by the user. The user terminal 3 uses an presence status display application to present to the user information regarding the presence status of people in the office based on information provided by the presence detection server 1 and the person management server 2. The user terminal 3 is configured as a PC, a tablet terminal, or the like.
[0056] The entrance camera 4 is installed near the entrance of the office and captures an image of a person entering through the entrance of the office. The entrance camera 4 may capture an image of a person's face for facial recognition during entry check (entrance procedure).
[0057] The indoor camera 5 is installed in an appropriate location in the office (for example, on the ceiling) and captures images of people who are in the office. The images captured by the indoor camera 5 are used to determine whether or not a person is present in each seat in the office, and the indoor camera 5 functions as an occupancy detection device.
[0058] The robot 6 moves autonomously within the office. The robot 6 has the function of capturing an image of the face of a person sitting at a seat. The image captured by the robot 6 is used for personal identification purposes to identify the person sitting at the seat, and the robot 6 functions as an occupant identification device. The robot 6 also has the function of measuring the body temperature of the person sitting at the seat. The image captured by the robot 6 is also used to determine whether the person sitting at the seat is wearing a mask.
[0059] The robot control server 7 controls the operation of the robot 6. The robot control server 7 also performs face matching on the people present in the seat based on the face images captured by the robot 6, thereby performing personal identification (person identification) to identify the people present in the seat.
[0060] In this embodiment, the presence detection server 1 and the robot control server 7 are provided, but the presence detection server 1 may have the functions of the robot control server 7 .
[0061] Furthermore, in this embodiment, personal identification (person identification) is performed to identify a person present at a seat based on an image of the person captured by the robot 6, but the method of personal identification is not limited to this. For example, a person present at a seat may be identified by reading an IC card (employee ID) carried by the person with a card reader to obtain a person ID (employee ID). Also, a person present at a seat may be identified by obtaining identification information (e.g., a MAC address) of a user terminal 3 carried by the person. Also, a person present at a seat may be identified by attaching a wireless tag to the user terminal 3 or employee ID carried by the person and reading the wireless tag with a tag reader to obtain a tag ID. Also, a person present at a seat may be identified by tracking a person identified by face authentication performed upon entry until they sit down.
[0062] In the present embodiment, the seat presence detection server 1 detects the presence of a person in a seat in the office based on a person image captured by the indoor camera 5. However, the seat presence detection method is not limited to this. For example, a person detection sensor may be installed at each seat to detect the presence of a person in the seat. Alternatively, a tag reader may be used to read a wireless tag attached to a user terminal 3 or employee ID card carried by the person to obtain a tag ID, thereby detecting the presence of a person in the seat and identifying the person. Furthermore, the person may use the user terminal 3 or another terminal to send information about the seat they are sitting in (such as the location name, floor number, room number, and seat number) and the user's personal information (such as the person ID) to the seat presence detection server 1.
[0063] Next, a description will be given of the general configuration of the presence detection server 1, the user terminal 3, the robot 6, and the robot control server 7. FIG. 2 is a block diagram showing the general configuration of the presence detection server 1, the user terminal 3, the robot 6, and the robot control server 7.
[0064] The presence detection server 1 includes a communication unit 11 , a storage unit 12 , and a processor 13 .
[0065] The communication unit 11 communicates with the person management server 2 , the user terminal 3 , the entrance camera 4 , the indoor camera 5 , and the robot control server 7 .
[0066] The storage unit 12 stores programs and the like to be executed by the processor 13. The storage unit 12 also stores registration information of the seat occupancy status database.
[0067] The processor 13 performs various processes by executing the programs stored in the storage unit 12. In this embodiment, the processor 13 performs an occupancy detection process, an occupancy status determination process, and the like.
[0068] In the seat occupancy detection process, the processor 13 performs person detection on the image captured by the indoor camera 5 and determines whether or not a person is present in each seat. If a person is present in the seat, the seat status is set to occupied. On the other hand, if no person is present in the seat, the seat status is set to vacant (not present). The detection results obtained in the seat occupancy detection process are registered in the seat occupancy status database.
[0069] In the seat occupancy status determination process, the processor 13 determines the seat occupancy status of each seat based on the registered information in the seat occupancy status database. For example, if the seat status changes from vacant to occupied, it is determined that a person has taken a seat. Also, if the seat status changes from occupied to vacant, it is determined that the person has left the seat. Also, if a person who was present at the seat does not return within a predetermined time after leaving the seat, it is determined that the person has left the seat. On the other hand, if a person who was present at the seat returns before the predetermined time has passed after leaving the seat, it is determined that the same person continues to be present at the seat.
[0070] The user terminal 3 includes a communication unit 31 , a display unit 32 , an input unit 33 , a storage unit 34 , and a processor 35 .
[0071] The communication unit 31 communicates with the presence detection server 1 and the person management server 2 .
[0072] The display unit 32 displays various screens, for example, the presence status confirmation screen 101 (see FIG. 8 ). The input unit 33 is an input device for operating the screen displayed on the display unit 32. Note that the display unit 32 may be configured as a touch panel display in which a display panel and a touch panel are integrated as the input unit 33.
[0073] The storage unit 34 stores programs executed by the processor 35, such as a program related to a presence status display application.
[0074] The processor 35 performs various processes by executing programs stored in the storage unit 34. In this embodiment, the processor 35 performs an occupancy status display process and the like.
[0075] In the presence status display process, the processor 35 causes the presence status display application to display the presence status check screen 101 (see FIG. 8 ) on the display unit 32. The presence status display application generates display information for the presence status check screen 101 based on information provided by the presence detection server 1 and the person management server 2.
[0076] The robot 6 includes a camera 61 , a body temperature sensor 62 , a speaker 63 , a running unit 64 , a communication unit 65 , a memory unit 66 , and a processor 67 .
[0077] The camera 61 captures an image of the face of a person sitting in the office. A face image for face matching is obtained from the image captured by the camera 61.
[0078] The body temperature sensor 62 detects the body temperature of a person in the office without contacting the person. The body temperature sensor 62 is, for example, a thermo camera (infrared camera).
[0079] The speaker 63 outputs various voice requests, guidance, notifications, etc. in accordance with the control of the robot control server 7.
[0080] The running unit 64 includes wheels, a motor, etc. The running unit 64 is controlled by a processor 67 under the control of the robot control server 7 so as to run autonomously.
[0081] The communication unit 65 communicates with the robot control server 7 .
[0082] The storage unit 66 stores programs executed by the processor 67 and the like.
[0083] The processor 67 performs various processes by executing programs stored in the storage unit 66. In this embodiment, the processor 67 performs autonomous driving control processing and the like.
[0084] In the autonomous driving control process, the processor 67 controls the driving unit 64 to proceed toward the destination instructed by the robot control server 7 while determining a course to avoid obstacles based on the image captured by the camera 61 and the detection results of a distance sensor (not shown).
[0085] In addition, the processor 67 controls the camera 61 to capture an image of the user's face. The processor 67 also controls the speaker 63 to output various kinds of audio such as guidance and notifications from the speaker 63.
[0086] The robot control server 7 includes a communication unit 71 , a storage unit 72 , and a processor 73 .
[0087] The communication unit 71 communicates with the robot 6. The communication unit 71 also communicates with the presence detection server 1 and the person management server 2.
[0088] The storage unit 72 stores programs executed by the processor 73 and the like.
[0089] The processor 73 performs various processes by executing the programs stored in the storage unit 72. In this embodiment, the processor 73 performs a driving control process, a face matching process, a body temperature measurement process, a mask wearing determination process, and the like.
[0090] In the driving control process, when the processor 73 detects the presence of a person in a seat, it sets the seat where the presence is detected as the target position and controls the robot 6 to move from the standby position to the target position, and also controls the robot 6 to return from the current position to the standby position when the facial image capture and body temperature measurement are completed.
[0091] In the face matching process, the processor 73 controls the robot 6 to capture an image of the face of the target person present at the table using the camera 61. Next, facial feature information of the target person is extracted from the image captured by the camera 61. Then, the facial feature information of each registered person is matched with the facial feature information of the target person to identify the target person.
[0092] In the body temperature measurement process, the processor 73 controls the robot 6 to detect the body temperature of the seated target person using the body temperature sensor 62. Then, the measurement result of the target person's body temperature is obtained based on the detection result of the body temperature sensor 62. The body temperature measurement result may be compared with a reference value to determine whether or not the target person has a normal body temperature.
[0093] In the mask wearing determination process, the processor 73 determines whether or not the target person is wearing a mask based on the image captured by the camera 61 of the robot 6.
[0094] Next, a description will be given of the seating status database managed by the seating status detection server 1. Fig. 3 is an explanatory diagram showing an example of the registered contents of the seating status database.
[0095] The seat presence detection server 1 has a seat presence status database that manages the seat presence status of people at each seat in the office. The seat presence status database stores the following information: base name (place name), floor number (floor number), room number, seat number, update time, seat status (occupied, vacant), person ID (employee ID), image of the occupant, temperature check result, and mask wear determination result.
[0096] In the example shown in FIG. 3 , the seat with seat number "0187" has an occupied status, but no personal information (person ID, occupant image, etc.) is registered. This indicates that the person currently occupying the seat has just entered the room, and the occupant identification process using the robot 6 has not yet been completed. The seat with seat number "0188" has an occupied status, but no personal ID is registered. Furthermore, personal information other than the person ID (occupant image, etc.) is registered. This indicates that the occupant is an unregistered visitor (outsider). The seat with seat number "0189" has an unoccupied status, but if the status changes to occupied within a predetermined time, it is assumed that the person currently occupying the seat has temporarily left the seat, and it is determined that the person who was previously seated in the seat before the seat changed to vacant is still seated.
[0097] Next, a description will be given of the procedure of the presence detection process performed by the presence detection server 1. FIG.
[0098] In the presence detection server 1, first, the processor 13 performs the presence detection process (ST101).
[0099] In this seat occupancy detection process, the processor 13 acquires an image captured by the indoor camera 5, performs person detection on the image area of the seat in the captured image, and determines whether a person is present in the target seat. If a person is present in the target seat, the processor 13 sets the status of the target seat to "occupied," and if no person is present in the target seat, the processor 13 sets the status of the target seat to "vacant (not present)," and stores the seat occupancy detection result in the memory unit 12.
[0100] Next, the processor 13 determines whether the state of the seat has changed (ST102).
[0101] If the seat status has changed (Yes in ST102), the processor 13 then performs an information collection process (information collection loop) using the robot 6 for all seats whose status has changed (ST103 to ST112).
[0102] In this information collection process, first, the processor 13 determines whether the seat status has changed from vacant (not present) to occupied (ST104).
[0103] Here, if the seat status changes from vacant to occupied, i.e., if a person is seated (Yes in ST104), the processor 13 then determines whether the target seat has not been checked, i.e., whether an instruction to collect information by the robot 6 has not yet been issued (ST105).
[0104] Here, if the target seat has not been checked (Yes in ST105), the processor 13 then sends an information collection instruction to the robot control server 7 from the communication unit 31 to cause the robot 6 to collect information about the person sitting in the target seat (ST106).
[0105] Next, the processor 13 acquires information about the person present at the table, that is, the face matching result, the body temperature measurement result, and the mask wearing determination result, received from the robot control server 7 via the communication unit 31 (ST107).
[0106] Next, processor 13 updates the registration information for the person in the seat occupancy status database (ST108). That is, the person ID, temperature check result, and mask wearing determination result as the face matching result for the person associated with the target seat are registered in the seat occupancy status database. Processor 13 also updates the registration information for the target seat status in the seat occupancy status database to "occupied" (ST109). Then, the process proceeds to processing the next seat.
[0107] On the other hand, if the target seat has not been checked, i.e., if an instruction to collect information has already been given by the robot 6 (No in ST105), the processor 13 then determines whether or not a predetermined time has passed since the instruction to collect information was given by the robot 6 (ST110).
[0108] If a predetermined time or more has passed since the robot 6 was instructed to collect information (Yes in ST110), the process proceeds to ST106, where the robot 6 is instructed to collect information again. On the other hand, if the predetermined time or more has not passed since the robot 6 was instructed to collect information (No in ST110), the process proceeds to ST109. Note that in the determination in ST110, it is determined that the user has temporarily left the seat for a predetermined time since the previous update.
[0109] If the seat status changes from occupied to vacant (No in ST104), the processor 13 updates the registered information regarding the status of the target seat in the seat occupancy status database to vacant (ST111), and then proceeds to process the next seat.
[0110] Next, a description will be given of the processing procedure performed by the robot control server 7. FIG.
[0111] In the robot control server 7, first, the communication unit 71 receives an instruction to have the robot 6 collect information from the presence detection server 1 (ST201).
[0112] Next, the processor 73 sets a target position near the target seat, i.e., the seat where occupancy is detected, and controls the robot 6 to move from the standby position to the target position (ST202).
[0113] Next, when the robot 6 arrives at the target position, the processor 73 controls the robot 6 to output a voice from the speaker 63 urging the person to turn their face toward the robot 6, such as a voice saying "Turn your face please" (ST203). At this time, the processor 73 controls the robot 6 to capture an image of the face of the person sitting in the target seat with the camera 61.
[0114] Next, the processor 73 performs a mask wearing determination process (ST204). At this time, the processor 73 determines whether or not the target person is wearing a mask based on the image captured by the camera 61 received from the robot 6.
[0115] Next, the processor 73 performs face matching processing (ST205). At this time, facial feature information of the target person is extracted from the image captured by the camera 61. Then, the facial feature information of each registered person is obtained from the storage unit 72, and the facial feature information of the registered person is compared with the facial feature information of the target person to obtain a face matching score.
[0116] Next, the processor 73 determines whether or not the face matching is successful, that is, whether or not the target person matches a registered person, based on the face matching score (ST206).
[0117] If face matching is successful (Yes in ST206), the processor 73 performs a body temperature measurement process (ST207). At this time, the processor 73 controls the robot 6 to measure the body temperature of the target person using the body temperature sensor 62, and obtains the body temperature measurement result received from the robot 6.
[0118] Next, the processor 73 transmits information about the person present at the seat, that is, the face matching result, the body temperature measurement result, and the mask wearing determination result, from the communication unit 71 to the presence detection server 1 (ST208).
[0119] Next, the processor 73 controls the robot 6 to output a voice from the speaker 63 informing the target person that information collection has been completed and the results of the information collection, i.e., the person's name as a result of face matching and the temperature measurement result (e.g., the measured temperature value), for example, a voice such as "Mr. / Ms. XX's temperature is △△ degrees" (ST209).
[0120] Next, the processor 73 controls the robot 6 to return to a predetermined standby position (ST210).
[0121] Next, a description will be given of the procedure for the presence status display process performed by the user terminal 3. FIG.
[0122] In the user terminal 3, the processor 35 first acquires seat presence information from the seat presence detection server 1 (ST301). This seat presence information is information registered in the seat presence database about the seat presence status of people at each seat in the office. Next, the processor 13 performs seat presence processing for all people (occupants) whose presence in the office is detected (ST303 to ST308).
[0123] In this present person processing, first, processor 35 determines whether information (personal information and attribute information) about the target person has been acquired (ST303). Here, attribute information is, for example, the group (department, etc.) to which the person belongs, and personal information is, for example, the person's name, email address, facial image, etc.
[0124] If the information (personal information and attribute information) of the target person has not yet been acquired (No in ST303), the information (personal information and attribute information) of the target person is acquired from the person management server 2 (ST304).
[0125] Next, processor 35 determines whether the target person is a display target (a person who should be displayed) based on the target person's information (personal information and attribute information) (ST305). At this time, if the user operates group tabs 141, 142, 143 (see FIG. 8) to select a group, people belonging to the selected group are set as display targets. Also, if the user enters search criteria in search box 145, people matching the entered search criteria are set as display targets.
[0126] If the target person is a display target (Yes in ST305), the processor 35 then acquires the target person's status information (body temperature confirmation result and mask wearing determination result) (ST306).
[0127] Next, the processor 35 generates display information for the personal card 111 regarding the target person based on the target person's personal information, attribute information, and status information (body temperature confirmation results and mask wearing determination results) (ST307).
[0128] Next, the processor 35 creates a person icon 123 (see Figure 8) of the target person based on the information (personal information and attribute information) of the target person, and generates display information that places the person icon 123 of the target person at the corresponding seat position on the seating map 121 (ST308).
[0129] On the other hand, if the target person is not to be displayed (No in ST305), the processes of ST306 to ST307 are not performed, and the processor 35 then creates a person icon 124 (see Figure 8) for the target person based on the attribute information of the target person, and generates display information that places the person icon 124 for the target person at the corresponding seat position on the seating map 121 (ST308).
[0130] When the above-described occupancy process (ST303 to ST308) is completed for all people whose presence is detected (occupants), processor 35 then calculates the occupancy rate (attendance rate) and seat utilization rate (ST310).
[0131] Next, the processor 35 updates the presence status confirmation screen 101 (see FIG. 8) based on the display information of the personal card 111 and person icons 123 and 124 related to the target person, the presence rate (attendance rate) and the seat occupancy rate (ST311).
[0132] Next, processor 35 determines whether it is time to update (ST312). At this time, it determines that it is time to update if a predetermined time has passed since the previous update or if an operation to instruct a screen update (operation of update button 152) has been performed.
[0133] If it is time to update (Yes in ST312), the process returns to ST301, where the latest seat occupancy status information is acquired, and the seat occupancy processing (ST303 to ST308) is repeated.
[0134] On the other hand, if it is not time to update (No in ST312), the processor 35 next determines whether the display target has changed (ST313). At this time, if the user selects a different group by operating the group tabs 141, 142, and 143, or if the user enters different search criteria in the search box 145, the display target will change.
[0135] If the display object has changed (Yes in ST313), the process returns to ST302 and the present person processing (ST303 to ST308) is repeated. On the other hand, if the display object has not changed (No in ST313), the process returns to ST312.
[0136] Next, a description will be given of the operation procedures of the user terminal 3, the presence detection server 1, and the person management server 2 regarding the presence status display. FIG. 7 is a sequence diagram showing the operation procedures of the user terminal 3, the presence detection server 1, and the person management server 2.
[0137] In the user terminal 3, the presence status display application performs a presence status display process that displays the presence status check screen 101 (see FIG. 8 ). At this time, the presence status display application queries the presence status detection server 1 for the latest presence status information and acquires the latest presence status information from the presence status detection server 1. Based on the latest presence status information, the application also queries the person management server 2 for necessary presence information and acquires the necessary presence information from the person management server 2. The presence status display application then generates and displays the presence status check screen 101 based on the latest presence status information and the presence status information.
[0138] 7, first, the presence detection server 1 performs the presence detection process (see FIG. 4) (ST401). In this presence detection process, the presence status database is updated.
[0139] The user terminal 3 also starts the presence status display application (ST402), and then transmits a request for presence status information to the presence detection server 1 (ST403).
[0140] Next, the seat presence detection server 1 acquires seat presence status information from the seat presence status database and transmits the seat presence status information to the user terminal 3 (ST104). The seat presence status information includes information on whether or not a person is seated at each seat (information on the seat status), the person ID of the seated person, etc.
[0141] Next, the user terminal 3 transmits a request for the person information to the person management server 2 (ST405).
[0142] Next, the person management server 2 acquires the person information from the person database (employee database) and transmits the person information to the user terminal 3 (ST406). The person information (person identification information) includes attribute information and personal information for each person. The attribute information is, for example, the group (department, etc.) to which the person belongs, and the personal information is, for example, the person's name, email address, facial image, etc.
[0143] Next, the user terminal 3 creates the latest presence map 121 and personal card 111 using the presence status display application, and displays the presence status confirmation screen 101 including the latest presence map 121 and personal card 111 (ST407).
[0144] Thereafter, the presence detection server 1 periodically performs presence detection processing, and the user terminal 3 acquires the latest presence status information from the presence detection server 1 and also acquires necessary occupancy information from the person management server 2, and updates the presence status confirmation screen 101 based on that information (automatic update). Also, when a user issues an update instruction operation on the user terminal 3, the presence status confirmation screen 101 is updated in the same manner (manual update).
[0145] In this embodiment, the presence status display application is executed on the user terminal 3. However, the presence status display application may be executed as a web application on a web server. In this case, the user terminal 3 can use the functions of the presence status display application by accessing the web server with a web browser. The web server may be implemented as part of the functions of the presence detection server 1.
[0146] Next, a description will be given of the presence status confirmation screen 101 displayed on the user terminal 3. FIG.
[0147] On the user terminal 3, the presence status display application displays a presence status confirmation screen 101 that presents the presence status of people at each seat in the office to the user.
[0148] The presence status confirmation screen 101 is provided with a card display section 102 (card display area). The card display section 102 displays personal cards 111 of all people who are to be displayed among the people who are present in the office.
[0149] The personal card 111 displays the person's personal information, such as their name and face image (photograph). The personal card 111 also displays the person's attribute information, such as their group (department, etc.) and seat ID (area). The personal card 111 also displays the temperature check result and mask wear determination result (whether or not a mask is being worn). Note that, in the example screen shown in FIG. 8, from the perspective of protecting personal information, information on whether or not a temperature check has been performed is displayed, rather than the measured temperature.
[0150] In addition, a group display section 112 drawn in the group color assigned to the group (department) to which the person belongs is provided at the end of the personal card 111. By visually checking the group display section 112, the user can immediately understand the group to which the person belongs.
[0151] The card display unit 102 has an upper limit on the number of personal cards 111 that can be displayed, and the total number of personal cards 111 to be displayed may exceed this upper limit. That is, there may be a case where there are so many people to be displayed that the personal cards 111 for all of the people to be displayed do not fit in the card display unit 102. In this case, some of the personal cards 111 are hidden. Meanwhile, in this case, a scroll bar 113 is displayed in the card display unit 102. When the user slides the scroll bar 113 to shift the personal cards 111 displayed in the card display unit 102, the hidden personal cards 111 are changed to a displayed state, and the personal cards 111 for all of the people to be displayed can be viewed.
[0152] The seating status confirmation screen 101 is provided with a map display section 103 (map display area). The map display section 103 displays an seating map 121 that shows the seating status of people at each seat in the office. The seating map 121 makes it possible to present information about who is sitting where to the user in an easy-to-understand manner.
[0153] In the seating map 121, person icons 123 and 124 representing people currently seated are superimposed on an area image 122 (layout diagram) showing the layout of an office (work area). Each seat is depicted in the area image 122, and person icons 123 and 124 are positioned at the location of the seat where the person is seated. This allows the user to immediately grasp the location of the people currently seated.
[0154] Here, the person icon 123 is in the first form, and the person icon 124 is in the second form.
[0155] The person icon 123 in the first form has a face image 125 (face photo) as personal information and a frame image 126 as attribute information. The face image 125 is an image of the person's face. The frame image 126 has a ring-like shape that surrounds the face image 125 and is drawn in the group color assigned to the group to which the person belongs. This allows the user to instantly check the group to which an present person belongs on the attendance map 121. Note that the face image 125 is first personal information expressed non-verbally, and information such as name, which is second personal information expressed verbally, as in the personal card 111, is not included in the person icon 123.
[0156] The person icon 124 in the second form does not include a face image as personal information, and is drawn in a circular shape in a group color as attribute information.
[0157] In this embodiment, for a person who can be identified, a person icon 123 in the first form is displayed, and for a person who cannot be identified, a person icon 124 in the second form is displayed. This allows the user to know the presence status of a person who cannot be identified.
[0158] In this embodiment, if a person cannot be identified by personal identification, such as an outside visitor (outsider), that is, if there is no corresponding person among the registered users, the person is assigned to the Other group. In this case, since personal identification is not possible and a facial image cannot be obtained as personal information, a second type of person icon 124 that does not include personal information (facial image) is displayed. Furthermore, the person icon 124 is drawn in a circular shape in the group color assigned to the Other group.
[0159] Furthermore, there are cases where a person is identified by personal identification, but the person does not belong to any group. For example, if a person within a company is registered to use a different office from the group to which he or she belongs, the person is identified by personal identification, but does not belong to any group, and therefore the person is assigned to the "Other" group. In this case, since personal identification is possible, a facial image can be obtained as personal information, and therefore a first type of person icon 123 including the personal information (facial image) is displayed. Furthermore, a frame image 126 is drawn in the group color assigned to the "Other" group.
[0160] The facial image 125 used for the person icon 123 in the first form is a facial image of the person that has been captured in advance and registered in the person database. Alternatively, the facial image 125 may be captured by the entrance camera 4 when the person enters the room on the same day and replaced daily. This allows the user to understand the current state of the person from the facial image captured on the day.
[0161] In the first form of person icon 123, an avatar image (portrait) created from the person's characteristics may be used instead of a facial image. In this case, characteristic information regarding the person's appearance, particularly their looks, clothing, hairstyle, etc., may be extracted from an image capturing the person's face, whole body, or upper body, and the avatar image may be created based on the characteristic information. Furthermore, the avatar image may be created from an image captured on the same day and replaced daily. Furthermore, a representative color related to the person's appearance, such as clothing, may be extracted, and a mark drawn in that representative color may be added to the person icon 123.
[0162] The map display section 103 is provided with a zoom-in button 128 and a zoom-out button 129. When the user operates the zoom-in button 128, the seated map 121 is zoomed in, and when the user operates the zoom-out button 129, the seated map 121 is zoomed out. When the seated map 121 is zoomed in, the user can drag to move the display range of the seated map 121. This allows the user to check the entire seated map 121 even when the seated map 121 is zoomed in.
[0163] The presence status confirmation screen 101 also has a group presence rate display section 104. The group presence rate display section 104 displays the presence rate (attendance rate) for each group. The presence rate (attendance rate) is calculated using the following formula: Presence rate [%] = (total number of people who are present and belong to the group) ÷ (total number of people who belong to the group) × 100 (rounded to the nearest whole number).
[0164] The seat occupancy rate display section 105 is also provided on the seat occupancy rate confirmation screen 101. The seat occupancy rate display section 105 displays the seat occupancy rate of the entire office (work area). The seat occupancy rate is calculated using the following formula: Seat occupancy rate [%] = (total number of people present in the office) ÷ (total number of seats in the office) × 100 (rounded to the nearest whole number). Note that the total number of people present in the office also includes people whose individuals cannot be identified.
[0165] Next, a description will be given of changes in the display form of the person icon 123 and the personal card 111 in response to a user operation on the person icon 123. Fig. 9 is an explanatory diagram showing changes in the display form of the person icon 123 and the personal card 111.
[0166] The card display section 102 of the presence status check screen 101 (see FIG. 8 ) displays a row of personal cards 111 for each person currently present. The map display section 103 of the presence status check screen 101 also displays a person icon 123 for each person currently present on a presence map 121. When the user performs an operation to select a person icon 123, the person icon 123 is highlighted, and at the same time, the personal card 111 corresponding to the selected person icon 123 is highlighted.
[0167] FIG. 9(A-1) shows the personal card 111 in normal times, and FIG. 9(B-1) shows the character icon 123 in normal times.
[0168] Here, when the user performs a hover operation (provisional selection operation) on the person icon 123, as shown in Fig. 9 (B-2), the person icon 123 is enlarged and a tool tip 131 containing the person's name is displayed near the person icon 123. On the other hand, as shown in Fig. 9 (A-2), the personal card 111 does not change.
[0169] Next, when the user performs a click operation (confirmation selection operation) on the person icon 123, the person icon 123 is highlighted as shown in Fig. 9 (B-3). Specifically, the outer periphery 132 of the person icon 123 is displayed flashing. Meanwhile, as shown in Fig. 9 (A-3), the personal card 111 is also highlighted. Specifically, a thick frame 133 is displayed around the personal card 111, and the background color within the personal card 111 changes.
[0170] Next, when the user cancels the operation on the person icon 123, that is, when the user removes the cursor from the person icon 123, the person icon 123 returns to its normal size as shown in Fig. 9 (B-4), but the selected state in which the outer periphery 132 of the person icon 123 is displayed blinking is maintained. Meanwhile, as shown in Fig. 9 (A-4), the personal card 111 also remains highlighted and selected.
[0171] Next, a description will be given of changes in the display form of the person icon 123 and the personal card 111 in response to a user operation on the personal card 111. Fig. 10 is an explanatory diagram showing changes in the display form of the person icon 123 and the personal card 111.
[0172] The card display section 102 of the presence status check screen 101 (see FIG. 8 ) displays a row of personal cards 111 for each person currently present. The map display section 103 of the presence status check screen 101 also displays a person icon 123 for each person currently present on the presence map 121. When the user performs an operation to select a personal card 111, the personal card 111 is highlighted, and at the same time, the person icon 123 corresponding to the selected personal card 111 is also highlighted.
[0173] FIG. 10(A-1) shows the personal card 111 in normal times, and FIG. 10(B-1) shows the character icon 123 in normal times.
[0174] Here, when the user performs a hover operation (provisional selection operation) on the personal card 111, the personal card 111 is highlighted as shown in Fig. 10 (A-2). Specifically, a thick frame 133 is displayed around the personal card 111. Meanwhile, as shown in Fig. 10 (B-2), the person icon 123 does not change.
[0175] Next, when the user performs a click operation (confirmation selection operation) on the personal card 111, the personal card 111 is highlighted as shown in Fig. 10 (A-3). Specifically, a thick frame 133 is displayed around the personal card 111, and the background color of the personal card 111 changes. Meanwhile, as shown in Fig. 10 (B-3), the person icon 123 is highlighted. Specifically, the outer periphery 132 of the person icon 123 is displayed flashing.
[0176] Next, even if the user cancels the operation on the personal card 111, i.e., moves the cursor away from the personal card 111, the selected state in which the outer periphery 132 of the person icon 123 is displayed flashing is maintained, and the selected state in which the personal card 111 is also displayed highlighted is maintained.
[0177] Next, a description will be given of how the display range of the seated map 121 is changed in response to a user's operation to select a personal card 111. Fig. 11 is an explanatory diagram showing how the display range of the seated map 121 is changed in response to the selection of a personal card 111.
[0178] On the attendance status confirmation screen 101 (see FIG. 8 ), the attendance map 121 displayed in the map display section 103 is enlarged when the user operates the enlarge button 128, and is reduced when the user operates the reduce button 129. On the other hand, when the user performs an operation to select a personal card 111 displayed in the card display section 102, the person icon 123 corresponding to the selected personal card 111 is highlighted on the attendance map 121. Specifically, the outer periphery 132 of the person icon 123 is displayed flashing.
[0179] At this time, there are cases where the person icon 123 corresponding to the selected personal card 111 is not located on the seated map 121 enlarged and displayed on the map display unit 103. In this case, in this embodiment, the partially enlarged display state of the seated map 121 is canceled so that the person icon 123 corresponding to the selected personal card 111 is displayed on the seated map 121.
[0180] 11(A-1) shows an example in which the person icon 123 corresponding to the selected personal card 111 is within the display range of the map display unit 103. In this case, as shown in FIG. 11(B-1), the person icon 123 corresponding to the selected personal card 111 is located on the seated person map 121 that is enlarged and displayed in the map display unit 103. Therefore, the display range of the seated person map 121 does not change, and the corresponding person icon 123 displayed in the map display unit 103 is highlighted.
[0181] 11(A-2) shows an example in which the person icon 123 corresponding to the selected personal card 111 is located outside the display range of the map display unit 103. In this case, the partially enlarged display state of the seated map 121 is canceled, and the display range is returned to the entire seated map 121. As a result, as shown in FIG. 11(B-2), the seated map 121 is returned to the full display state, and the corresponding person icon 123 displayed on the map display unit 103 is highlighted.
[0182] 11(A-2), if the person icon 123 corresponding to the selected personal card 111 is located outside the display range of the map display unit 103, the display range may be shifted without canceling the enlarged display so that the corresponding person icon 123 is displayed in the map display unit 103. In this case, the display range may be shifted so that both the person icon 123 of the viewing user and the target person icon 123 are displayed, and the magnification may be reduced to expand the display range if necessary.
[0183] Next, we will explain how the display range of the personal card 111 is changed in response to a user operation of selecting a person icon 123 on the seating map 121. Figure 12 is an explanatory diagram showing how the display range of the personal card 111 is changed in response to a user operation of selecting a person icon 123.
[0184] The card display section 102 of the presence status confirmation screen 101 (see FIG. 8 ) displays a row of personal cards 111 for each person currently present. At this time, when a person icon 123 in the presence map 121 is selected, the personal card 111 corresponding to the selected person icon 123 is highlighted. Specifically, a thick frame 133 is displayed around the personal card 111, and the background color within the personal card 111 changes.
[0185] The card display unit 102 has an upper limit on the number of personal cards 111 that can be displayed, and if the total number of personal cards 111 to be displayed exceeds the upper limit, some of the personal cards 111 will be hidden. For this reason, the personal card 111 corresponding to the selected person icon 123 may not be displayed in the card display unit 102 before the person icon 123 is selected. In this case, in this embodiment, the display range of the arrangement list of the personal cards 111 is shifted so that the personal card 111 corresponding to the selected person icon 123 is displayed in the card display unit 102. Note that the arrangement list of the personal cards 111 is a virtual arrangement of the personal cards 111 for all people currently present.
[0186] 12(A) shows an example in which the personal card 111 corresponding to the selected person icon 123 is included in the current display range and is therefore displayed in the card display unit 102. In this case, the display range of the personal card 111 in the arrangement list is not changed, and there is no change in the display state of the personal card 111 in the card display unit 102.
[0187] 12(B) shows an example in which the personal card 111 corresponding to the selected person icon 123 is not included in the current display range and is therefore not displayed in the card display unit 102. In this case, the display range in the arrangement list of the personal cards 111 is shifted so that the personal card 111 corresponding to the selected person icon 123 is displayed in the card display unit 102. At this time, the display range is shifted so that the personal card 111 corresponding to the selected person icon 123 is displayed first (at the top) of the card display unit 102.
[0188] 12(B), the example shown in FIG. 12(C) is a case where the personal card 111 corresponding to the selected person icon 123 is not included in the current display range and is therefore not displayed in the card display unit 102. In this case, the display range in the arrangement list of the personal cards 111 is shifted so that the personal card 111 corresponding to the selected person icon 123 is displayed in the card display unit 102. In this case, if the personal card 111 corresponding to the selected person icon 123 is displayed at the beginning (top row) of the card display unit 102, a blank space will be created in the card display unit 102. For this reason, the display range is shifted so that the personal card 111 at the bottom of the arrangement list of the personal cards 111 is positioned at the bottom row of the display range.
[0189] The personal cards 111 are arranged based on a predetermined arrangement rule. For example, the personal cards 111 are arranged in descending order of time of entry. In this case, the personal card 111 of the person who entered the room latest is displayed first (at the top). The arrangement rule for the personal cards 111 may be preset, or may be set by the user or administrator as appropriate.
[0190] Furthermore, in this embodiment, the display range of the arrangement list of the personal cards 111 is shifted without changing the arrangement order of the personal cards 111 so that the personal card 111 corresponding to the selected person icon 123 is displayed in the card display unit 102, but the arrangement order of the personal cards 111 may be changed so that the personal card 111 corresponding to the selected person icon 123 is displayed in the card display unit 102. In this case, for example, the personal card 111 corresponding to the selected person icon 123 may be displayed first (at the top).
[0191] Next, a description will be given of the narrowing down of display information using the group tabs 141, 142, and 143. Fig. 13 is an explanatory diagram showing a state in which the display information has been narrowed down using the group tabs 141, 142, and 143 on the presence status confirmation screen 101.
[0192] A plurality of group tabs 141, 142, and 143 (operation units) are provided on the presence status check screen 101. When the user performs an operation to select one of the group tabs 141, 142, and 143, the presence status check screen 101 displays the personal cards 111 and the person icons 123 and 124 related to only the people who belong to the group corresponding to the selected group tab 141, 142, or 143.
[0193] At this time, the user terminal 3 determines whether each person present belongs to the selected group based on the attribute information of each person, and changes the display state or display content of the personal card 111 and person icons 123, 124 for each person present depending on the determination result.
[0194] In the example shown in FIG. 13, there are provided a group tab 141 for "All," group tabs 142 for each department (department A, department B, etc.), and a group tab 143 for "Other."
[0195] When the "All" group tab 141 is selected, the personal cards 111 and person icons 123 and 124 are displayed for all people present in the office, regardless of group (see FIG. 8).
[0196] On the other hand, when the group tab 142 of each group (Department A, Department B, etc.) is selected, the personal cards 111 and personal icons 123 of the people who belong to the selected group are displayed. In the example shown in Fig. 13, the group tab 142 of Department A is selected, and the personal cards 111 and personal icons 123 of the people who belong to Department A are displayed.
[0197] That is, in the card display section 102, personal cards 111 are displayed only for people who belong to the selected group, and personal cards 111 are not displayed for people who do not belong to the selected group.
[0198] Furthermore, for a person who belongs to the selected group, a person icon 123 of a first type including both personal information and attribute information is displayed on the map display unit 103. Specifically, a face image 125 of the target person and a frame image 126 drawn in the group color assigned to the group to which the target person belongs are displayed.
[0199] On the other hand, for a person who does not belong to the selected group, a person icon 124 of a second type that does not include personal information but includes attribute information is displayed. Specifically, the person icon 124 is displayed in a circular shape in the group color.
[0200] As described above, in this embodiment, by selecting a group using the group tab 142, the user can display the personal cards 111 and the person icons 123 and 124 in a state where the display is narrowed down to the people who belong to the selected group. Furthermore, when a group is selected, the person icon 123 in the first form is displayed for the people who belong to the selected group, and the person icon 124 in the second form is displayed for the people who do not belong to the selected group. This allows the user to distinguish between people who belong to the selected group and people who do not belong to the selected group, and further allows the user to know the presence status of people who do not belong to the selected group.
[0201] It should be noted that the person icons 124 of people who do not belong to the selected group may be hidden.
[0202] Furthermore, when the "Other" group tab 143 is selected, among the people assigned to the "Other" group, for those who have been individually identified, a person icon 123 and a personal card 111 are displayed. On the other hand, for those who have not been individually identified, a person icon 124 is displayed, but a personal card 111 is not displayed.
[0203] The presence status confirmation screen 101 also has a search box 145. When the user inputs a string of characters as a search condition into the search box 145, the input string is used as the search condition to search for people who match the search condition. Specifically, the search condition is that the string of characters input into the search box 145 is included in the person's name and group (department) to which the person belongs (partial match), and a search is performed on people who are present. If a group is specified in the group tab 142, a search is performed on people who belong to the specified group. Note that when a string of characters is input into the search box 145, the search continues even while the string is being input, and the search results are displayed as the string is being input.
[0204] When a person matching the search criteria is found, the search results display the personal card 111 and person icon 123 for the person matching the search criteria. That is, in the card display unit 102, only the personal card 111 of the person matching the search criteria is displayed as the search result. Meanwhile, in the map display unit 103, the search results display the person icon 123 in the first form, i.e., the form including a face image and a frame image in the group color, for the person matching the search criteria. Meanwhile, for the person not matching the search criteria, the search results display the person icon 124 in the second form, i.e., the form including only the group color and no face image.
[0205] In this embodiment, the user can input a string of characters as search criteria into the search box 145, and the personal cards 111 and person icons 123 can be displayed with the search narrowed down to people who match the search criteria.
[0206] 8, the presence status check screen 101 is provided with an update date and time display section 151. The last update date and time is displayed in the update date and time display section 151. The last update date and time is set based on the timestamp attached to the latest information obtained from the presence status database when the presence status check screen 101 is generated.
[0207] The presence status confirmation screen 101 also has an update button 152. When the user operates the update button 152, the latest information is obtained from the presence detection server 1 and the person management server 2, and the presence status confirmation screen 101 is regenerated. This updates the personal card 111, person icons 123 and 124, seat utilization rate, and attendance rate (attendance rate) displayed on the presence status confirmation screen 101. In this case, the group selection state in the group tabs 141, 142, and 143 is maintained. The selection state of the personal card 111 and person icons 123 and 124 is reset. The character string entered in the search box 145 is cleared, and the narrowed-down state of the search using the search box 145 is canceled.
[0208] The presence detection server 1 automatically updates the presence status check screen 101 (see FIG. 6 ). That is, the presence status check screen 101 is periodically updated at predetermined intervals (e.g., one minute). Specifically, the latest information is obtained from the presence status database and the presence status check screen 101 is updated when the user terminal 3 accesses the presence detection server 1 to generate a new presence status check screen 101, when the update button 152 is operated to manually update the presence status check screen 101, or when a predetermined time has passed since the presence status check screen 101 was automatically updated.
[0209] This updates the personal card 111, person icons 123 and 124, seat utilization rate, and presence rate (attendance rate) displayed on the presence status confirmation screen 101. In this case, the group selection state in the group tabs 141, 142, and 143 is maintained. The selection state of the personal card 111 and person icons 123 and 124 is also maintained. However, if the selected person becomes absent, the selection state of the personal card 111 and person icons 123 and 124 is reset. The character string entered in the search box 145 and the narrowed-down state of the search using the search box 145 are also maintained.
[0210] Second Embodiment Next, a second embodiment will be described. It should be noted that the points not specifically mentioned here are the same as those of the previous embodiment. Fig. 14 is a diagram showing the overall configuration of an occupancy detection system according to the second embodiment.
[0211] In this embodiment, the presence detection system includes a communication server 8 (communication system) in addition to the presence detection server 1 and the person management server 2. The communication server 8 provides users with services such as chat, email, conference, video call, voice call, and schedule management.
[0212] As in the above embodiment, the person management server 2 is equipped with a person database (employee database) that manages information such as the name and affiliation of each person (employee), but the communication server 8 may also be configured to have a person database, i.e., a server having the functions of both the person management server 2 and the communication server 8 may be provided.
[0213] The user terminal 3 is equipped with a communication application in addition to the presence status display application. The communication application provides users with services such as chat, email, conference, video call, voice call, and schedule management in cooperation with the communication server 8. The communication application is launched by performing a predetermined operation on the presence status display application.
[0214] The presence status display application may also include a communication application that cooperates with the communication server 8 .
[0215] Next, a description will be given of the communication tools displayed on the personal card 111 on the presence status confirmation screen 101. Fig. 15 is an explanatory diagram showing the personal card 111 in a normal state and the personal card 111 in a communication tool display state.
[0216] On the attendance status confirmation screen 101 (see Figure 8), when a hover operation (temporary selection operation) is performed on the personal card 111 displayed in the card display section 102, the personal card 111 transitions from the normal state shown in Figure 15 (A) to the communication tool display state shown in Figure 15 (B).
[0217] In the communication tool display state, a communication tool display section 161 appears on the personal card 111. Icons 162 (operation sections) of chat, email, conference, video call, and voice call are displayed as communication tools in the communication tool display section 161. When the user operates one of the icons 162 of chat, email, conference, video call, and voice call, a communication application is started and the screen transitions to the respective screen of chat, email, conference, video call, or voice call.
[0218] Furthermore, the communication tool display section 161 displays a message box 163 (input field) and a send button 164 (operation section) as communication tools. The user can input a message (text) in the message box 163. When the user inputs a message and operates the send button 164, the message is sent to the destination user terminal 3 via the communication server 8.
[0219] Next, a description will be given of message transmission using a communication application in the user terminal 3. Fig. 16 is a sequence diagram showing the operation procedure of the user terminal 3 and the communication server 8.
[0220] In this embodiment, when a user performs an operation to use a communication tool, the presence detection application on the user terminal 3 launches a communication application, and the communication application works in conjunction with the communication server 8 to send a message entered on the communication application screen to the recipient's user terminal 3 via the communication server 8.
[0221] For example, when a specific person is designated and instructed to send a message on the chat screen displayed by operating the chat icon 162 on the personal card 111 (see Figure 15), a communication application is launched and the message is sent from the communication application to the recipient's user terminal 3 via the communication server 8.
[0222] 16, first, the presence status display application of the user terminal 3 (sending side) detects an operation to select a personal card 111 (ST501). Next, the presence status display application of the user terminal 3 (sending side) detects a button operation of a communication tool in the selected personal card 111 (ST502). Next, the presence status display application of the user terminal 3 (sending side) instructs the launch of a communication application (ST503). At this time, the person in the selected personal card 111 is designated as the message destination, and the email address or person ID of the destination person is provided to the communication application.
[0223] Next, the communication application is started in the user terminal 3 (sending side), and the communication application displays a chat screen with the recipient set (ST504). Next, the communication application of the user terminal 3 (sending side) detects an operation to input a message and instruct transmission (ST505). Next, the communication application of the user terminal 3 (sending side) transmits the input message to the communication server 8 (ST506).
[0224] Next, the communication server 8 distributes the message received from the user terminal 3 (sender) to the user terminal 3 (receiver) of the person designated as the destination (ST507).
[0225] Next, the communication application of the user terminal 3 (receiving side) notifies the user of the reception of the message and displays the message on the screen (ST508).
[0226] Next, a description will be given of message transmission without using a communication application in the user terminal 3. FIG.
[0227] In this embodiment, when a user performs an operation to use a communication tool, the presence detection application of the user terminal 3 directly cooperates with the communication server 8, and a message entered on the screen of the presence detection application can be sent to the recipient's user terminal 3 via the communication server 8. In this case, no communication application is required to send the message.
[0228] For example, on the personal card 111 (see Figure 15), when a user enters a message in the message box 163 and operates the send button 164, the message is sent from the presence detection application to the recipient's user terminal 3 via the communication server 8.
[0229] 17 , first, the presence status display application of the user terminal 3 (sending side) detects an operation to select a personal card 111 (ST601). Next, the presence status display application of the user terminal 3 (sending side) detects an operation to input a message into the selected personal card 111 and instruct transmission (ST602). Next, the presence status display application of the user terminal 3 (sending side) designates the person of the selected personal card 111 as the destination and transmits the message to the communication server 8 (ST603). At this time, the email address or person ID of the destination person is provided to the communication server 8.
[0230] Next, the communication server 8 distributes the message received from the user terminal 3 (sender) to the user terminal 3 (receiver) of the person designated as the destination (ST604).
[0231] Next, the communication application of the user terminal 3 (receiving side) notifies the user of the reception of the message and displays the message on the screen (ST605).
[0232] Next, a description will be given of broadcast message transmission using a communication application of the user terminal 3. Fig. 18 is an explanatory diagram showing a chat screen 171 displayed on the user terminal 3.
[0233] The communication server 8 provides a chat service in cooperation with a communication application of the user terminal 3. The communication application displays a chat screen 171 on the user terminal 3. The chat screen 171 allows a message to be sent to all people participating in the chat service at once. In addition, a mention function allows a message to be sent to a specific person by specifying the recipient, or to a plurality of people by specifying the recipient.
[0234] An input field 172 is provided on the chat screen 171. When the user inputs characters (@attends at work) in the input field 172 to specify all people present in the office (working members) as recipients, characters confirming the recipients are displayed in a display field 173. After confirming the recipients, the user then inputs a message in the input field 172.
[0235] A send button 174 is provided on the chat screen 171. When the user operates the send button 174 to instruct transmission, the message entered in the input field 172 is transmitted simultaneously to the user terminals 3 of all people present in the office (working members) via the communication server 8.
[0236] 18 shows an example in which all people in the office (members in the office) are designated as recipients, but it is possible to narrow down the recipients even further, that is, to specify conditions related to people or seats, and send a message to people who meet those conditions. For example, if characters (@window) are entered in the input field 172 to designate a person sitting by a window as the recipient, the message will be sent simultaneously to the user terminals 3 of the people sitting by the window.
[0237] Next, we will explain the operation procedures of the user terminal 3, presence detection server 1, and communication server 8 when broadcasting messages to people who are present at their desks. Figure 19 is a sequence diagram showing the operation procedures of the user terminal 3, presence detection server 1, and communication server 8.
[0238] The communication application of the user terminal 3 can use the chat mention function to send messages to all people present at their desks at once. At this time, the communication application works in conjunction with the communication server 8 (communication system) to send messages at once, so personal information about the people present (all people present in the office), particularly destination information (person ID, terminal ID, email address, etc.), is provided from the presence detection server 1 to the communication server 8.
[0239] Here, when the seat presence detection server 1 updates the seat presence status database, it notifies the communication server 8 of personal information about the occupants (all people present in the office) and updates the occupant information stored in the communication server 8. Note that personal information about the person present in a specific seat in the office may be provided from the seat presence detection server 1 to the communication server 8.
[0240] 19, first, the presence detection server 1 performs presence status processing and updates the presence status database (ST701). Next, the presence detection server 1 adds personal information (person ID, etc.) of the occupants and sends a request to update the occupant information to the communication server 8 (ST702).
[0241] Next, the communication server 8 updates the occupant information (information about the person currently in the office) based on the occupant's personal information (person ID, etc.) acquired from the presence detection server 1 (ST703).
[0242] Next, the communication application of the user terminal 3 (sender) displays a chat screen (see FIG. 18) and prompts the user to specify the destination (the office group), input a message, and instruct the user to send the message (ST704). Next, the communication application of the user terminal 3 transmits the message to the communication server 8 (ST705).
[0243] Next, the communication server 8 distributes the message received from the user terminal 3 (sender) to the user terminals 3 (receivers) of the people who correspond to the specified recipients (work group) (ST706).
[0244] Next, the communication application of the user terminal 3 (receiving side) notifies the user of the reception of the message and displays the message (ST707).
[0245] In this embodiment, the presence status display application and the communication application are executed on the user terminal 3. However, the presence status display application and the communication application may be executed as web applications on a web server. In this case, the user terminal 3 can use the functions of the presence status display application and the communication application by accessing the web server with a web browser. The web server may be implemented as part of the functions of the presence detection server 1.
[0246] While the above description concerns an office presence status display application capable of visualizing the presence status of people in a work area, the target area may be an area other than the work area, and the detection target may be an object rather than a person. For example, an application may be provided that acquires presence status information regarding the presence or absence of objects in a predetermined area divided into multiple sections, acquires object identification information including attribute information and individual information (e.g., information that can identify the object) of the present object, and generates display information representing the presence status in the predetermined area based on the presence status information and object identification information. The display information may include a map display area displaying an presence map in which object (individual) icons representing the present objects (individuals) are superimposed on an area image representing the predetermined area, and a card display area arranged alongside the map display area displaying a list of object (individual) cards for each present object. Each object icon is displayed with object information, and each object card is displayed with individual information and attribute information. The object may be, for example, an object that cannot move independently (such as a delivery item such as a cardboard box) or an object that can move independently (such as a robot).
[0247] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments.
[0248] The presence status presentation method of the present disclosure has the effect of allowing a user in a free address office to easily check the presence status of a person and to easily contact that person, and is useful as a presence status presentation method and presence status presentation system that executes a process on one or more computers to present to a user the presence status of a person in an office area having multiple seats.
[0249] 1 Presence detection server (computer) 2 Person management server 3 User terminal (computer) 4 Entrance camera 5 Indoor camera 6 Robot 7 Robot control server (computer) 8 Communication server (communication system) 101 Presence status confirmation screen 102 Card display section (card display area) 103 Map display section (map display area) 111 Personal card 112 Group display section 113 Scroll bar 121 Presence map 122 Area image 123 Person icon (first form) 124 Person icon (second form) 125 Face image 126 Frame image 128 Enlarge button 129 Reduce button 131 Tool tip 132 Outer periphery 133 Thick frame 141, 142, 143 Group tab (operation section) 145 Search box 161 Communication tool display section 162 Icon (operation section) 163 Message box (input field) 164 Send button (operation unit) 171 Chat screen 172 Input field 173 Display field 174 Send button
Claims
1. 1. A method for presenting a user with the presence status of people in a work area having a plurality of seats, the method comprising: The computer includes: Acquire seating status information regarding the seating status of a person at each seat in the work area; Acquire attribute information and personal identification information including personal information regarding the person present; generating display information representing the presence status of a person in the work area based on the presence status information and the person identification information; The display information includes: a map display area in which an occupied seat map is displayed in which person icons representing people currently present are superimposed on an area image representing the work area; a card display area arranged in a different area from the map display area, in which a list of personal cards for each person present is displayed; The person icons are displayed including the personal information, The personal cards are displayed including the personal information and the attribute information, How to present presence status.
2. The personal information includes first personal information expressed non-verbally and second personal information expressed verbally; the person icons are displayed including the first personal information, The personal cards are displayed including the first personal information and the second personal information, The method for presenting seat presence status according to claim 1 .
3. The first personal information includes either a face image of the person captured when entering the office area or a face image of the person captured when the person's presence is detected. The method for presenting seat presence status according to claim 2 .
4. The first personal information includes at least one of characteristic information of the person's appearance and clothing extracted from either an image of the person captured when entering the office area or an image of the person captured when the person's presence is detected. The method for presenting seat presence status according to claim 2 .
5. the attribute information includes first attribute information expressed in a non-verbal manner and second attribute information expressed in a linguistic manner; the person icons are displayed including the first attribute information, The personal cards are displayed including the first attribute information and the second attribute information, The method for presenting seat presence status according to claim 1 .
6. The attribute information includes information regarding a group to which a person belongs, the display information includes an operation unit for allowing a user to select a group; The computer includes: determining whether each person currently present belongs to a selected group based on the attribute information for each person; changing the display state or display contents of the personal cards and the person icons related to each person who is present according to the determination result; The method for presenting seat presence status according to claim 1 .
7. the person icon relating to the person belonging to the selected group is displayed in a form including the personal information and the attribute information; the person icon relating to a person not belonging to the selected group is displayed in a form including the attribute information but not including the personal information; The method for presenting seat presence status according to claim 6.
8. The personal cards relating to persons not belonging to the selected group are hidden. The method for presenting seat presence status according to claim 6.
9. When the personal identification information cannot be acquired for a person currently present, the person icon for that person is displayed in a form that does not include the personal information and the attribute information. The method for presenting seat presence status according to claim 1 .
10. The computer includes: Obtaining status information regarding at least one of body temperature and whether a mask is worn for a person present at the seat; said status information is displayed on said personal card together with said personal identification information; The method for presenting seat presence status according to claim 1 .
11. When a user performs an operation of selecting one of the person icon and the personal card, the selected one and the corresponding other one are both highlighted. The method for presenting seat presence status according to claim 1 .
12. the card display area has an upper limit on the number of the personal cards that can be displayed, and when the total number of the personal cards to be displayed exceeds the upper limit, some of the personal cards are hidden; In response to a user operation, the personal card in a hidden state is changed to a displayed state. The method for presenting seat presence status according to claim 1 .
13. In response to a user's operation of selecting the person icon, the personal card corresponding to the selected person icon changes from a hidden state to a displayed state in the card display area. The method for providing presence status according to claim 12.
14. The seated map is displayed in the map display area as a display range of a part of the seated map in response to a user's operation to instruct an enlarged display, in response to a user's operation of selecting the personal card, if the person icon corresponding to the selected personal card is outside the display range, the display range of the attendance map is changed so that the person icon corresponding to the selected personal card is displayed; The method for presenting seat presence status according to claim 1 .
15. the personal card includes an operation unit for a communication tool for using the communication system; When the user selects the personal card and operates the operation unit, a communication application associated with the operation unit is started and the screen transitions to that communication application screen. The method for presenting seat presence status according to claim 1 .
16. the personal card includes an operation unit for a communication tool for using the communication system; the personal card changes from a form not including the operation unit of the communication tool to a form including the operation unit of the communication tool in response to an operation by a user selecting the personal card; The method for presenting seat presence status according to claim 1 .
17. the personal card includes an input field for inputting a message and an operation unit for instructing transmission of the message; when the user selects the personal card and operates the operation unit, a message is sent to the person on the selected personal card via the communication system. The method of claim 16 .
18. The computer includes: providing the personal information about a person present in the work area or a person seated at a particular seat within the work area to a communication system; The method for presenting seat presence status according to claim 1 .
19. A seating status presentation system including one or more computers that executes a process of presenting to a user the seating status of people in a work area having a plurality of seats, The computer includes: Acquire seating status information regarding the seating status of a person at each seat in the work area; Acquire attribute information and personal identification information including personal information regarding the person present; generating display information representing the presence status of a person in the work area based on the presence status information and the person identification information; The display information includes: a map display area in which an occupied seat map is displayed in which person icons representing people currently present are superimposed on an area image representing the work area; a card display area arranged in a different area from the map display area, in which a personal card for each of the people present is displayed; The person icons are displayed including the personal information, The personal cards are displayed including the personal information and the attribute information, Attendance status display system.