Business support system, business support server used for the business support system, and portable device used for the business support system

The business support system addresses the lack of real-time support for inexperienced workers by integrating a mobile device with a camera, microphone, and bone conduction earphones to monitor and manage actions, providing real-time guidance and enhancing operational efficiency and mental health care through data analysis.

JP2024156543AInactive Publication Date: 2024-11-06ADRAY CO LTD

Patent Information

Application Number
JP2023071100
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-24
Publication Date
2024-11-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing systems lack the ability to provide real-time support and guidance to inexperienced personnel working alone, as they do not have the functionality to monitor and manage the actions of individuals in charge, leading to a need for improved business support systems.

Method used

A business support system comprising a mobile device with a camera, microphone, and bone conduction earphones integrated as a headset, connected to an administrator terminal and a business support server, which records and manages actions, provides real-time communication, and analyzes voice and image data to offer guidance and support.

Benefits of technology

The system effectively records and analyzes the actions of individuals, allowing for real-time advice and support, improves operational efficiency, and enhances mental health care and customer satisfaction through voice analysis and facial recognition, while respecting privacy and reducing transcription labor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024156543000001_ABST
    Figure 2024156543000001_ABST
Patent Text Reader

Abstract

To provide a business support system capable of recording actions of a person in charge of a business and providing business support to the person in charge.SOLUTION: A business support system 1 is provided with: a portable device 6 attached to a person in charge; a manager terminal 8 for displaying an image captured by the portable device 6 and capable of communicating with the portable device 6; and a business support server 2 for configuring and storing person-in-charge action information 200 based on data acquired by the portable device 6, and controlling information flow between the portable device 6 and the manager terminal 8. The business support server 2 has: an action information configuration part 23 for configuring the person-in-charge action information 200 including an image photographed by the portable device 6 and a voice around the person in charge acquired by the portable device 6; and an action information storage unit 24 for storing the configured person-in-charge action information 200.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a business support system that monitors and manages the actions of personnel engaged in business. [Background technology]

[0002] Caregiving actions are recorded for the purpose of preventing caregivers from physically assaulting those in care, and an action recording system is known, as described in Patent Document 1. This action recording system has a terminal device worn by the caregiver, and is configured to capture images of the surroundings using an imaging unit built into the terminal device, and record the captured images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-037951 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, due to a shortage of human resources, there are more and more situations where inexperienced staff members are working alone, and there is a growing demand for providing real-time advice and support to such staff members. However, the behavior recording system described in Patent Document 1 does not have a function to support the staff members' work.

[0005] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a work support system that can record the actions of a person in charge and provide work support to the person in charge. [Means for solving the problem]

[0006] In order to solve the above problem, the invention described in claim 1 is a business support system that monitors and manages the actions of a person engaged in a business, comprising: a portable device worn by the person in charge; an administrator terminal on which images captured by the portable device are displayed and which is capable of communicating with the portable device; and a business support server that configures and stores person in charge action information based on data acquired by the portable device and controls the flow of information between the portable device and the administrator terminal, the portable device and the administrator terminal being connected to the business support server via a communication line, the portable device having a camera unit that captures images around the person in charge, a microphone unit that captures sounds around the person in charge, an earphone unit that generates sounds to be transmitted to the person in charge, a captured image sending unit that transmits the captured images captured by the camera unit to the business support server, a person in charge surrounding sound sending unit that transmits the person in charge surrounding sound acquired by the microphone unit to the business support server, and a person in charge transmitted voice receiving unit that receives the person in charge transmitted voice generated from the earphone unit and transmitted from the business support server, ... a display screen receiving unit for receiving an image display screen on which the photographed image is displayed, the image display screen being sent from the business support server; a manager terminal display unit on which the received image display screen is displayed; an output voice receiving unit for receiving the person in charge surrounding voice sent from the business support server; a voice generating unit for generating the received person in charge surrounding voice; a voice transmission input unit for inputting the person in charge transmission voice; a voice transmission sending unit for sending the input person in charge transmission voice to the business support server; and a behavior information receiving unit that receives the staff member behavior information provided from the business support server in response to the behavior information provision request, the business support server having a captured image receiving unit that receives the captured image sent from the captured image sending unit, a staff member surrounding voice receiving unit that receives the staff member surrounding voice sent from the staff member surrounding voice sending unit, a behavior information composing unit that composes the staff member behavior information including the received captured image and the staff member surrounding voice, and a behavior information storage unit that stores the composed staff member behavior information.The system includes a display screen configuration unit that processes the captured image received by the captured image receiving unit to configure the image display screen, a display screen provision unit that provides the configured image display screen to the manager terminal, a transmission voice receiving unit that receives the person in charge transmission voice sent from the transmission voice sending unit, a call establishment unit that sends the person in charge surrounding voice received by the person in charge surrounding voice receiving unit to the manager terminal and sends the person in charge transmission voice received by the transmission voice receiving unit to the mobile device, thereby establishing a call between the mobile device and the manager terminal, a behavior information request receiving unit that receives the behavior information provision request sent from the behavior information provision request unit, and a behavior information providing unit that provides the person in charge behavior information read from the behavior information storage unit in response to the received behavior information provision request to the manager terminal, and is characterized in that when the person in charge behavior information is received by the behavior information receiving unit, the received person in charge behavior information is displayed on the manager terminal display unit.

[0007] The invention according to claim 2 is characterized in that, in addition to the configuration described in claim 1, the earphone unit is configured by a bone conduction earphone.

[0008] The invention of claim 3 is characterized in that, in addition to the configuration described in claim 2, the camera unit, the microphone unit and the earphone unit are integrated as a headset, and the headset is configured to be worn on the head of the person in charge.

[0009] The invention of claim 4 is characterized in that, in addition to the configuration described in claim 3, the portable device has a camera stop mode, in which image capture by the camera unit and audio acquisition by the microphone unit are stopped, and a notification sound is emitted from the earphone unit to notify that the camera stop mode is entered.

[0010] According to a fifth aspect of the present invention, in addition to the configuration according to the fourth aspect, the portable device has a call mode, and in the call mode, a call can be made between the portable device and the administrator terminal, and the image captured by the camera unit is highlighted on the display unit of the administrator terminal. It is characterized by:

[0011] The invention according to claim 6 provides, in addition to the configuration according to claim 5, the portable device includes a location information detection unit that receives radio waves from a satellite positioning system and calculates location information, and a location information transmission unit that transmits the calculated location information to the business support server, the business support server includes a location information reception unit that receives the location information transmitted from the location information transmission unit, a map information request unit that transmits a map information provision request requesting map information of a neighborhood of the received location information, and a map information reception unit that receives the map information provided in response to the map information provision request, and the behavior information configuration The image generating unit configures the person in charge behavior information so as to link the location information received by the location information receiving unit to the captured image received by the captured image receiving unit and the sound around the person in charge received by the sound around the person in charge, and the display screen configuration unit creates a location information image that displays the location information received by the location information receiving unit as the location of the mobile device on the map of the map information received by the map information receiving unit, and configures the image display screen so that the captured image and the location information image received by the captured image receiving unit are displayed on the same screen.

[0012] The invention of claim 7 is characterized in that, in addition to the configuration described in claim 6, the business support server has a voice text generation unit that generates text from voice, and the voice text generation unit generates the person in charge surrounding voice received by the person in charge surrounding voice receiving unit as a surrounding voice string, and the behavior information composition unit configures the person in charge behavior information so as to link the surrounding voice string generated by the voice text generation unit to the captured image received by the captured image receiving unit and the person in charge surrounding voice received by the person in charge surrounding voice receiving unit.

[0013] The invention of claim 8 is characterized in that, in addition to the configuration described in claim 7, the business support server has an abusive language judgment unit that judges abusive language, and the abusive language judgment unit judges whether the surrounding voice string generated by the voice character generation unit contains abusive words registered in advance, and generates abusive language information based on the judgment result, and the behavior information composition unit configures the staff behavior information to include the abusive language information generated by the abusive language judgment unit.

[0014] The invention of claim 9 is characterized in that, in addition to the configuration described in claim 8, the business support server has a voice analysis unit that analyzes voice to estimate a mental state, the voice analysis unit analyzes the person in charge's surrounding voice received by the person in charge surrounding voice receiving unit and the surrounding voice character string generated by the voice character generation unit to estimate the person in charge's mental state, and generates person in charge mental state information based on the estimated mental state of the person in charge, and the behavior information composition unit composes the person in charge behavior information to include the person in charge mental state information generated by the voice analysis unit.

[0015] The invention according to claim 10, in addition to the configuration according to claim 9, further comprises: a face authentication unit that authenticates a face of the care recipient appearing in the photographed image received by the photographed image receiving unit and identifies a name of the care recipient; an expression analysis unit that analyzes an expression of the care recipient appearing in the photographed image received by the photographed image receiving unit and estimates at least one of emotions of joy, anger, sadness, and happiness, vitality, and satisfaction, and calculates an estimated expression value that quantifies the estimation result; a care recipient information configuration unit that configures care recipient information to include the name of the care recipient identified by the face authentication unit and the estimated expression value calculated by the expression analysis unit; a care recipient information storage unit that stores the configured care recipient information; The manager terminal has a care recipient information request receiving unit that receives a care recipient information request requesting the care recipient information that is received, and a care recipient information providing unit that provides the care recipient information read from the care recipient information storage unit in response to the received care recipient information request, wherein the manager terminal has a care recipient information request unit that sends the care recipient information request to the business support server, and a care recipient information receiving unit that receives the care recipient information provided by the business support server in response to the care recipient information request, and when the care recipient information is received by the care recipient information receiving unit, the received care recipient information is displayed on the manager terminal display unit.

[0016] The invention of claim 11 is characterized in that, in addition to the configuration described in claim 10, the business support server has a face-to-face time measurement unit that measures the face-to-face time that the care recipient appears in the captured image received by the captured image receiving unit, and the care recipient information construction unit constructs the care recipient information so as to include the face-to-face time measured by the face-to-face time measurement unit.

[0017] The invention of claim 12 is characterized in that, in addition to the configuration described in claim 11, the business support server has an image and audio analysis unit that performs analysis based on the captured image and the voice around the person in charge, the image and audio analysis unit estimates the behavior of the person in charge from the captured image received by the captured image receiving unit, extracts the person in charge's comments from the voice around the person in charge received by the voice around the person in charge receiving unit, and determines a work evaluation of the person in charge based on the behavior and comments of the person in charge, and the behavior information construction unit constructs the person in charge behavior information so as to include the work evaluation determined by the image and audio analysis unit.

[0018] The invention of claim 13 is characterized in that, in addition to the configuration described in claim 12, the image and audio analysis unit extracts a utterance questioning the care recipient from the personnel surrounding audio received by the personnel surrounding audio receiving unit, estimates the care recipient's reaction to the utterance questioning from the care recipient's movements shown in the captured image received by the captured image receiving unit, and determines the risk of hearing loss or dementia of the care recipient, and the care recipient information construction unit constructs the care recipient information to include the risk of hearing loss or dementia of the care recipient determined by the image and audio analysis unit.

[0019] The invention of claim 14 is characterized in that, in addition to the configuration described in claim 13, the business support server has a plurality of the portable devices, and the business support server has an administrator absence determination unit that determines the absence of the administrator operating the administrator terminal, and when one of the plurality of portable devices transitions to the call mode, if the administrator absence determination unit determines that the administrator is absent, calls can be made between the plurality of portable devices.

[0020] The invention according to claim 15 is characterized in that it is a business support server used in the business support system according to any one of claims 1 to 14.

[0021] The invention according to claim 16 is characterized in that it is a mobile device used in the business support system according to any one of claims 3 to 14. Effect of the Invention

[0022] According to the invention of claim 1, the behavior of the person in charge is recorded by constructing and storing person in charge behavior information including images of the person in charge's surroundings captured by a portable device and audio of the person in charge's surroundings acquired by the portable device.

[0023] In addition, images captured by the portable device are displayed on the administrator terminal, and calls can be made between the portable device and the administrator terminal, allowing the administrator operating the administrator terminal to provide real-time advice and instructions to the person wearing the portable device, thereby supporting the person's work.

[0024] Furthermore, the person in charge's behavior information stored in the business support server can be displayed on the manager's terminal to check the past behavior of the person in charge.

[0025] According to the invention of claim 2, since the earphone unit is composed of bone conduction earphones, the ears of the person wearing the portable device are not blocked by the earphones. The person in charge can receive the sound transmitted from the manager terminal through the bone conduction earphones and hear the surrounding sounds with his / her own ears. In this way, both the sound transmitted from the manager terminal and the surrounding sounds can be clearly heard.

[0026] According to the invention of claim 3, the camera unit, microphone unit, and earphone unit are integrated into a headset that is worn on the head of the person in charge, so that the person in charge wearing the headset can use both hands freely. Also, by aligning the shooting direction of the camera unit with the line of sight of the person in charge, it is possible to capture an image close to the person in charge's field of vision.

[0027] According to the invention of claim 4, in the camera stop mode, the camera unit stops taking pictures and the microphone unit stops acquiring audio. In situations where privacy must be respected, such as bathing care, the camera can be switched to the camera stop mode to stop acquiring images and audio. In addition, a notification sound is emitted from the earphone unit to notify the person in charge that the camera is in the stop mode, so the person in charge can recognize that the camera is in the stop mode.

[0028] According to the invention of claim 5, when the portable device switches to a call mode, a call can be made between the portable device and the administrator terminal. Therefore, when the person in charge wants to receive advice or instructions, the person in charge can switch to the call mode and receive advice, etc. from the administrator operating the administrator terminal.

[0029] In addition, since the image captured by the portable device during the call is highlighted, the manager operating the manager terminal can easily recognize the captured image and provide advice, etc.

[0030] According to the invention of claim 6, the staff member behavior information is configured so that the captured image and the staff member surrounding sound are linked to the location information, so that the location where the image was captured and the location where the sound was acquired can be specified.

[0031] In addition, the location of the mobile device is displayed on a map, making it easy to identify the location of the mobile device.

[0032] According to the invention of claim 7, the staff surrounding voice is generated as a surrounding voice character string, and staff action information is configured to be linked to the photographed image and the staff surrounding voice, so that the voice corresponding to the photographed image and the staff surrounding voice can be recognized as a character string. In addition, there is no need to transcribe when creating a manual or record booklet based on the staff action information, which saves labor.

[0033] According to the invention of claim 8, abusive language information is created based on the result of judging whether abusive language has been used, and the staff action information is configured to include the abusive language information. By referring to this abusive language information, it is possible to prevent abusive language and improve business operations.

[0034] According to the invention of claim 9, the mental state of the person in charge is estimated by analyzing the voice, which can be utilized for mental health care of the person in charge.

[0035] According to the invention of claim 10, the face of the care recipient captured in the photographed image is authenticated to identify the name of the care recipient, and the facial expression of the care recipient is analyzed to estimate at least one of the emotions of joy, anger, sadness, and happiness, vitality, and satisfaction to calculate an estimated facial expression value. By referring to the estimated facial expression value, the customer satisfaction level of each care recipient can be determined.

[0036] According to the invention of claim 11, the face-to-face time for each care recipient is detected. This makes it possible to check the bias in the provision of services and to utilize the information for subsequent operational improvements.

[0037] According to the invention of claim 12, the work evaluation of the staff is judged by analyzing the captured image and the surrounding voice of the staff. The comparison of the images and voices of staff who received good and bad evaluations can be used for creating education and training manuals, etc.

[0038] According to the invention of claim 13, the risk of hearing loss or dementia in the care recipient can be determined by performing analysis based on the captured image and the voices around the caregiver, and this can be utilized for early detection and subsequent care.

[0039] According to the invention of claim 14, when the portable device switches to a call mode and it is determined that the manager operating the manager terminal is absent, multiple personnel wearing the portable device can make calls among themselves, enabling them to receive advice from other personnel.

[0040] According to the invention of claim 15, the behavior of the person in charge is recorded by constructing and storing person in charge behavior information including images of the person in charge's surroundings captured by a portable device and audio of the person in charge's surroundings acquired by the portable device.

[0041] In addition, images captured by the mobile device are displayed on the administrator terminal and conversations can be made between the mobile device and the administrator terminal, allowing the administrator operating the administrator terminal to provide real-time advice and instructions to the person wearing the mobile device, thereby supporting the person's work.

[0042] According to the invention of claim 16, the camera unit, microphone unit, and earphone unit are integrated into a headset that is worn on the head of the person in charge, so that the person in charge wearing the headset can use both hands freely. Also, by aligning the shooting direction of the camera unit with the line of sight of the person in charge, it is possible to capture an image close to the person in charge's field of vision. [Brief description of the drawings]

[0043] [Figure 1] 1 is a schematic block diagram of a configuration of a business support system according to an embodiment of the present invention; [Diagram 2] 2 is a schematic functional block diagram of a portable device according to the embodiment. FIG. [Diagram 3] 1A and 1B are schematic external views of a headset section of a portable device according to the embodiment, in which (a) is a perspective view seen from the upper right direction of the front, (b) is a bottom view, and (c) is a right side view. [Figure 4] 1A is a schematic external view of a communication unit of a portable device according to the embodiment, where (a) is a perspective view seen from the upper left direction of the front, (b) is a left side view, and (c) is a rear view. [Diagram 5] 2 is a schematic functional block diagram of an administrator terminal according to the embodiment; FIG. [Figure 6] 2 is a schematic functional block diagram of a business support server according to the embodiment; FIG. [Figure 7] 1A and 1B are diagrams illustrating the staff member behavior information relating to the embodiment, in which (a) is a diagram showing an example of the configuration of the staff member behavior information, and (b) is a diagram showing an example of the display of staff member mental state information included in the staff member behavior information. [Figure 8] 11 is a schematic diagram showing an example of the configuration of an image display screen displayed on an administrator terminal according to the embodiment. FIG. [Figure 9]4 is a diagram showing an example of a configuration of care recipient information according to the embodiment; FIG. [Figure 10] 11 is a diagram illustrating an example of a flow of operations of the task support system performed while a person in charge is working in the embodiment. FIG. [Figure 11] 13 is a diagram illustrating an example of a flow of analysis based on configured person in charge behavior information in the business support system according to the embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0044] [Embodiment of the invention] An embodiment of the present invention will be described with reference to FIGS. 1 to 11. FIG.

[0045] FIG. 1 is a schematic block diagram of a business support system 1 according to an embodiment of the present invention. In this embodiment, a nursing care business will be described as an example of a business. The form of nursing care includes both nursing care in a facility and home visit nursing care. In addition, a caregiver engaged in nursing care work is called a caregiver.

[0046] This business support system 1 includes portable devices 61, 62, . . . , 6 n and mobile devices 61, 62, . . . , 6 n The images captured by the mobile devices 61, 62, . . . , 6 n and a manager terminal 8 capable of communicating with a mobile device 61, 62, . . . , 6 n Based on the data acquired by the mobile devices 61, 62, . . . , 6 n The mobile device 61, 62, . . . , 6 includes a business support server 2 that controls the flow of information between the mobile device 61 and the administrator terminal 8, and a map information providing server 10 that provides map information. n The administrator terminal 8, the business support server 2, and the map information providing server 10 are connected via a communication line 11, and are capable of transmitting and receiving information to and from each other. The communication line 11 may be the Internet or the like.

[0047] The business support system 1 monitors and manages the actions of staff members by recording the actions of staff members engaged in business and providing business support to the staff members.

[0048] In the following description, unless it is necessary to specify that there are multiple mobile devices 61, 62, . . . , 6 n The portable device 6 is used to represent the above.

[0049] 2 is a schematic functional block diagram of the portable device 6. The portable device 6 is configured to include a control unit 60, a camera unit 61, a captured image transmission unit 62, a microphone unit 63, a person in charge surroundings voice transmission unit 64, a person in charge transmission voice reception unit 65, an earphone unit 66, a position information detection unit 70, a position information transmission unit 71, a portable device display unit 72, a portable device storage unit 73, and a communication unit 74.

[0050] The control unit 60 is configured to include a CPU (Central Processing Unit), not shown, a flash memory which is a non-volatile memory, and a RAM (Random Access Memory), which is a volatile memory. The CPU executes programs, performs arithmetic processing, and controls each element constituting the portable device 6. The flash memory stores programs executed by the CPU, registered data, etc., and the RAM is used as a work area for the CPU to execute programs and perform arithmetic processing.

[0051] The camera unit 61 captures an image of the surroundings of the person in charge. A CMOS (Complementary Metal-Oxide Semiconductor) area sensor, a CCD (Charged-Coupled Device) area sensor, or the like can be used as the imaging element of the camera unit 61. The captured image sending unit 62 sends the captured image 802 captured by the camera unit 61 to the business support server 2. The captured image 802 often constitutes a moving image, but may also be a still image.

[0052] The microphone unit 63 acquires the voice around the person in charge. In particular, the microphone unit 63 detects the voice and converts it into an electrical signal. The person in charge surrounding voice sending unit 64 sends the person in charge surrounding voice 208 acquired by the microphone unit 63 to the business support server 2.

[0053] The person in charge transmission voice receiving unit 65 receives the person in charge transmission voice generated from the earphone unit 66. This person in charge transmission voice is sent from the business support server 2. The earphone unit 66 generates the voice to be transmitted to the person in charge. In concrete terms, the earphone unit 66 converts an electric signal containing voice information into a sound wave.

[0054] The position information detection unit 70 receives radio waves from a satellite positioning system and calculates position information 212. A GPS (Global Positioning System) module can be used for this position information detection unit 70. The GPS module receives a signal from the GPS system and notifies the current position on the earth. The current position of the portable device 6 is obtained by acquiring the position information 212 from the GPS module. The position information transmission unit 71 transmits the position information 212 calculated by the position information detection unit 70 to the business support server 2.

[0055] The portable device display unit 72 displays the operating status of the portable device 6 .

[0056] The portable device storage unit 73 is composed of a non-volatile memory. For example, an SD memory card or the like can be used. The captured image 802, the voice around the person in charge 208, the location information 212, and the like are stored in the portable device storage unit 73. When the connection of the communication line 11 is cut off, the captured image 802 and the like are temporarily stored in the portable device storage unit 73, and after the connection of the communication line 11 is restored, the temporarily stored captured image 802 and the like are transmitted to the business support server 2.

[0057] The communication unit 74 transmits and receives data to and from the outside. The communication unit 74 has a function of connecting to the communication line 11 by Wi-Fi (registered trademark) communication and a function of connecting to the communication line 11 via a mobile communication line by LTE (Long Term Evolution) communication. In an environment where a connection is possible by Wi-Fi communication, the communication unit 74 is controlled to connect to the communication line 11 via Wi-Fi communication, and in an environment where a connection by Wi-Fi communication is not possible, the communication unit 74 is controlled to connect to the communication line 11 via LTE communication.

[0058] The portable device 6 is configured so that a headset section 600 in which a camera section 61, a microphone section 63, and an earphone section 66 are integrated is connected to a communication unit section 620 having a secondary battery 640 and communication functions by a communication cable 650 (not shown).

[0059] FIG. 3 is a schematic diagram of the appearance of the headset unit 600 of the portable device 6, where (a) is a perspective view seen from the upper right direction of the front, (b) is a bottom view, and (c) is a right side view. This headset unit 600 is worn on the head of a person in charge. As shown in FIG. 3(a), a thin-line connecting part 612 made of an elastic material is worn along the back of the head, and at both ends of the connecting part 612, which is a substantially rectangular shape in a side view and widens in the vertical direction, is formed. An electric board on which electronic components are mounted is embedded inside the widening part 614. As shown in FIG. 3(b), a video recording button 604 and a still image recording button 606 are disposed on the bottom surface of the widening part 614 on the right side. When the video recording button 604 is pressed, a video is recorded by the camera unit 61, and the recorded video is stored in the portable device storage part 73 and is also sent to and stored in the business support server 2. When the still image capture button 606 is pressed, a still image is captured by the camera unit 61, and the captured still image is stored in the portable device storage unit 73 and is also sent to the business support server 2 and stored therein. A volume button 608 is provided on the bottom surface of the left-side widening unit 614, and the volume generated from the earphone unit 66 is adjusted. As shown in FIG. 3(c), the portable device storage unit 73 is provided on the side surface of the right-side widening unit 614. A communication cable connection terminal 618 is provided on the rear side of the right-side widening unit 614, and a communication cable 650 is inserted into this connection terminal 618 to connect to the communication unit unit 620. At the tip of the ear hook units 616 on both sides, a head unit 619 incorporating a microphone unit 63 and an earphone unit 66 is formed. A bone conduction earphone is used for this earphone unit 66. On the outer side surface of the right-side head unit 619, the camera unit 61 is provided so as to be rotatable in the vertical direction. The vertical rotation angle of the camera unit 61 is fixed at a number of predetermined positions. When performing care tasks such as bathing or changing clothes, the camera unit 61 can be turned upward to avoid photographing the care recipient. A power button 610 is provided on the outer side surface of the left front part 619, and the power can be turned on and off by pressing and holding this power button 610. Also, by pressing this power button 610 for a short period of time, it is possible to switch between a camera stop mode and a camera operation mode.

[0060] The portable device 6 has a camera stop mode and a camera operation mode, and in the camera stop mode, image capture by the camera unit 61 and acquisition of audio by the microphone unit 63 are stopped, and a notification sound notifying that the camera stop mode is set is emitted from the earphone unit 66. In the camera operation mode, image capture by the camera unit 61 and acquisition of audio by the microphone unit 63 are performed, and the notification sound notifying that the camera stop mode is set is stopped.

[0061] Furthermore, when this headset unit 600 is connected to a commercially available PC (Personal Computer) or smartphone via a communication cable 650, the camera unit 61, microphone unit 63 and earphone unit 66 will operate, allowing images and audio to be sent to the PC or smartphone, and audio sent from the PC, etc. to be heard through the earphone unit 66.

[0062] 3, the microphone unit 63 is incorporated in the front part 619, but the present invention is not limited to this configuration and may be provided at the tip of the camera unit 61. When placed in this manner, the microphone unit 63 is positioned in front of the mouth of the person in charge, making it easier to detect the voice.

[0063] FIG. 4 is a schematic diagram of the appearance of the communication unit 620 of the portable device 6, where (a) is a perspective view seen from the upper left direction of the front, (b) is a left side view, and (c) is a rear view. The communication unit 620 has a captured image sending unit 62, a person in charge surroundings voice sending unit 64, a person in charge transmission voice receiving unit 65, a position information detection unit 70, a position information sending unit 71, and a communication unit 74 built in. As shown in FIG. 4(b), a call button 622 is provided on the left side. By pressing this call button 622, the portable device 6 is switched to a call mode, and a call can be made with the manager terminal 8. In addition, when the call button 622 is pressed and the mode is switched to a call mode, the captured image 206 captured by the camera unit 61 is highlighted on the manager terminal 8.

[0064] A Wi-Fi communication display 624, an LTE display 626, and a GPS display 628 are provided on the left side of the communication unit 620, and these displays light up to indicate that their functions are operating.

[0065] 4(a), a communication cable connection terminal 632 is provided at the upper end of the communication unit 620, and a communication cable 650 is inserted into this connection terminal 632 to connect to the headset 600. Also, a portable device display unit 72 is provided at the top, and the operating state of the portable device 6 is displayed.

[0066] 4(c), a locking part 630 is provided on the back surface of the communication unit 620, and is locked to the clothing of a person in charge. The power source of the portable device 6 is supplied from a secondary battery 640 attached to the communication unit 620.

[0067] 5 is a schematic functional block diagram of the administrator terminal 8. The administrator terminal 8 is configured to include a control unit 80, a display screen receiving unit 81, an administrator terminal display unit 82, an output voice receiving unit 83, a voice generating unit 84, a transmission voice input unit 85, a transmission voice sending unit 86, a behavior information provision request unit 90, a behavior information receiving unit 91, an administrator terminal storage unit 93, a care receiver information provision request unit 94, a care receiver information receiving unit 95, an input unit 98, and a communication unit 99. The administrator terminal 8 can be an information terminal such as a PC, a smartphone, or a tablet.

[0068] The control unit 80 is configured to include a CPU, an auxiliary storage device which is a non-volatile storage device, and a RAM (not shown). The CPU executes programs and controls each element constituting the administrator terminal 8. The auxiliary storage device stores the programs executed by the CPU, and may be an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0069] The display screen receiving unit 81 receives an image display screen 800 on which a captured image 802 is displayed. The image display screen 800 is sent from the business support server 2. The image display screen 800 received by the display screen receiving unit 81 is displayed on the manager terminal display unit 82. The manager terminal display unit 82 is composed of a display device, and a display device such as a touch panel LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) is used.

[0070] The output voice receiving unit 83 receives the person in charge surrounding voice 208 sent from the business support server 2. The voice generating unit 84 generates the person in charge surrounding voice 208 received by the output voice receiving unit 83. The voice generating unit 84 may be a speaker or a headphone.

[0071] The person in charge transmission voice to be transmitted to the portable device 6 is input to the transmission voice input unit 85 by the manager operating the manager terminal 8. A microphone is used for the transmission voice input unit 85. The transmission voice sending unit 86 sends the person in charge transmission voice input to the transmission voice input unit 85 to the business support server 2.

[0072] The behavior information request unit 90 sends a behavior information request for requesting the person in charge behavior information 200 to the business support server 2. This behavior information request is made by specifying the object of the request. For example, the person in charge ID 202 or the person in charge name 204 may be specified, the person in charge ID 202 and the acquisition time 210 may be specified in combination, or a combination of the person in charge ID 202, the acquisition time 210, and the requested item being the photographed image 206 may be specified. The acquisition time 210 may be specified as a specific time, or as a start time and an end time. The person in charge behavior information 200 includes the photographed image 206 and the person in charge surrounding voice 208 acquired by the portable device 6. The behavior information receiving unit 91 receives the person in charge behavior information 200 provided from the business support server 2 in response to the behavior information request. When the behavior information receiving unit 91 receives the person in charge behavior information 200, the received person in charge behavior information 200 is displayed on the manager terminal display unit 82. Specifically, the photographed image 206 and surrounding voice character string 214 generated from the surrounding voice of the person in charge 208 included in the person in charge behavior information 200, as well as other components included in the person in charge behavior information 200, are displayed on the manager terminal display unit 82. In addition, the surrounding voice of the person in charge 208 included in the person in charge behavior information 200 is generated from the voice generating unit 84.

[0073] A non-volatile storage device such as an HDD or SSD is used for the manager terminal storage unit 93. The manager terminal storage unit 93 stores the staff member behavior information 200 and the like received by the behavior information receiving unit 91. In addition, electronic files such as nursing care records and nursing care education training manuals created using the captured images 206 and staff member surrounding voices 208 included in the staff member behavior information 200 are also stored.

[0074] The care recipient information requesting unit 94 sends a request for care recipient information to the business support server 2. This request for care recipient information is made by specifying the target of the request. For example, the care recipient ID 302 or the care recipient name 304 may be specified, or a combination of the care recipient ID 302 and the requested item being meeting time 308 may be specified. The care recipient information receiving unit 95 receives care recipient information 300 provided from the business support server 2 in response to the care recipient information request. When the care recipient information receiving unit 95 receives the care recipient information 300, the received care recipient information 300 is displayed on the administrator terminal display unit 82.

[0075] The input unit 98 is composed of an input device for inputting data, and uses a keyboard, a mouse, a touch panel, etc. The communication unit 99 transmits and receives data to and from the outside.

[0076] 6 is a schematic diagram of the functional blocks of the business support server 2. The business support server 2 is configured to include a control unit 20, a photographed image receiving unit 21, a person in charge surrounding voice receiving unit 22, a behavior information composing unit 23, a behavior information storage unit 24, a display screen composing unit 25, a display screen providing unit 26, a transmission voice receiving unit 27, a call establishment unit 30, a manager absence determining unit 31, a behavior information request receiving unit 32, a behavior information providing unit 33, a position information receiving unit 34, a map information request unit 35, a map information receiving unit 36, a facility interior map storing unit 37, a voice character generating unit 38, abusive language determining unit 40, a voice analysis unit 41, a face authentication unit 42, a facial expression analysis unit 43, a care receiver information composing unit 44, a care receiver information storing unit 45, a care receiver information provision request receiving unit 46, a care receiver information providing unit 47, a meeting time measuring unit 50, an image and voice analysis unit 51, and a communication unit 52. A server device, a PC, or the like is used for the business support server 2.

[0077] The control unit 20 is configured to include a CPU, a non-volatile storage device, and a RAM (not shown). The CPU executes programs and controls each element constituting the business support server 2.

[0078] The captured image receiving unit 21 receives a captured image 802 sent from the captured image sending unit 62 of the portable device 6. The staff surrounding voice receiving unit 22 receives staff surrounding voice 208 sent from the staff surrounding voice sending unit 64 of the portable device 6.

[0079] The behavior information configuration unit 23 configures staff member behavior information 200 including the photographed image 206 received by the photographed image receiving unit 21 and the staff member surrounding voice 208 received by the staff member surrounding voice receiving unit 22 .

[0080] The person in charge action information 200 is a collection of information that consolidates the records of the actions of the person in charge. By specifying an extraction condition, the record of the action of the person in charge can be extracted from the person in charge action information 200.

[0081] The behavior information configuration unit 23 divides the captured images 206 and the person in charge surrounding sounds 208 into predetermined time intervals, for example, 5 minutes or 10 minutes, and configures the person in charge behavior information 200 by associating the captured images 206, etc. with the acquisition times 210. By configuring the person in charge behavior information 200 in this manner, by specifying the acquisition time 210, the captured images 206, etc. corresponding to that time can be extracted from the person in charge behavior information 200.

[0082] FIG. 7(a) is a diagram showing an example of the configuration of the staff member behavior information 200. The staff member ID (Identification) 202 and the staff member name 204 included in the staff member behavior information 200 are input when logging in to the business support server 2 from the portable device 6 at the start of business, etc. Alternatively, when the portable device 6 is assigned to a staff member, the staff member ID 202 and the staff member name 204 are registered in advance in the business support server 2. The staff member ID 202 and the staff member name 204 are stored in the business support server 2 in association with a portable device ID that uniquely identifies the portable device 6. When the portable device 6 transmits a captured image 206 and the like together with the portable device ID, the business support server 2 identifies the staff member ID 202 and the staff member name 204 from the received portable device ID, and configures the staff member behavior information 200 so that the staff member ID 202 and the like and the received captured image 206 and the like are stored. By referring to the staff member ID 202 and the like, it is possible to identify which staff member the staff member behavior information 200 corresponds to. For example, by specifying a person in charge ID 202 or a person in charge name 204, it is possible to extract person in charge action information 200 corresponding to the specified person in charge, or by specifying a combination of person in charge ID 202 and acquisition time 210, it is possible to extract a captured image 206 and person in charge surrounding sound 208 corresponding to that combination from person in charge action information 200. The components of person in charge action information 200 shown in this figure are merely examples, and other elements may be included, or some of the elements may be deleted.

[0083] The action information storage unit 24 shown in FIG. 6 stores the person in charge action information 200 configured by the action information configuration unit 23.

[0084] The display screen composition unit 25 processes the photographed image 206 accepted by the photographed image acceptance unit 21 to compose an image display screen 800 .

[0085] FIG. 8 is a schematic diagram showing an example of the configuration of an image display screen 800. In this figure, the captured images 206 from four portable devices 6 are displayed. Since the call button 622 of one of the four portable devices 6 is pressed and the device is in a call mode, the captured image 206 is highlighted as an enlarged captured image 804. A red frame is displayed around the enlarged captured image 804 to highlight it. The three portable devices 6 that are not in the call mode are displayed as normal-sized captured images 802. On the right end of the image display screen 800, there is a menu display section 810, in which a screen selection button 812, a call selection button 814, and a mass call button 816 are displayed. When the administrator selects the screen selection button 812 from the image display screen 800, the selected captured image 206 is enlarged and the user can make a call with the portable device 6. In addition, the captured image 206 (video, still image) of the selected portable device 6 and the voice around the person in charge 208 are stored in the business support server 2 by the administrator's operation. When the call selection button 814 is selected, a call can be made to the selected portable device 6. When the call all button 816 is selected, a call can be made to all the displayed portable devices 6.

[0086] When there is no portable device 6 in the call mode, all are displayed as normal size photographed images 802, and a maximum of 20 photographed images 206 are displayed per image display screen 800.

[0087] 6 provides the image display screen 800 configured by the display screen configuration unit 25 to the administrator terminal 8. When the administrator terminal 8 accepts the image display screen 800, the screen 800 is displayed on the administrator terminal display unit 82 (see FIG. 8).

[0088] The transmission voice receiving unit 27 receives the person in charge transmission voice sent from the transmission voice sending unit 86 of the manager terminal 8. The call establishment unit 30 sends the person in charge surrounding voice 208 received by the person in charge surrounding voice receiving unit 22 to the manager terminal 8, and sends the person in charge transmission voice received by the transmission voice receiving unit 27 to the portable device 6, thereby establishing a call between the portable device 6 and the manager terminal 8. When the portable device 6 is in the call mode, a call can be made between the portable device 6 and the manager terminal 8.

[0089] When the portable device 6 is switched to the call mode, the manager absence determination unit 31 determines whether the manager who operates the manager terminal 8 is absent. For example, when there is no response from the manager terminal 8 even after a predetermined time has elapsed after the mode is switched to the call mode, the manager absence determination unit 31 determines that the manager is absent, or determines that the manager is absent by detecting that a non-available button (not shown) provided on the manager terminal 8 is pressed. n In the case where the business support system 1 is configured with the above, a plurality of mobile devices 61, 62, . . . , 6 n One of the 6 mobile devices i When the manager absence determination unit 31 determines that the manager is absent when the manager transitions to a call mode, the plurality of portable devices 61, 62, . . . , 6 n The control is performed so that communication is possible between the

[0090] The behavior information request receiving unit 32 receives a behavior information provision request sent from the behavior information provision request unit 90 of the manager terminal 8. The behavior information providing unit 33 provides the person in charge behavior information 200 read from the behavior information storage unit 24 to the manager terminal 8 in response to the behavior information provision request received by the behavior information request receiving unit 32. When the behavior information provision request is made by specifying a person in charge ID, for example, the person in charge behavior information 200 corresponding to the specified person in charge ID is provided. Also, for example, when a person in charge ID 202 and an acquisition time 210 are specified in combination, a photographed image 206 and a person in charge surrounding voice 208 corresponding to the specification are extracted from the person in charge behavior information 200 and provided. Also, for example, when a combination of a person in charge ID 202, an acquisition time 210, and a request target item being a photographed image 206 is specified, a photographed image 206 corresponding to the specification is extracted from the person in charge behavior information 200 and provided.

[0091] The location information receiving unit 34 receives the location information 212 sent from the location information sending unit 71 of the portable device 6 .

[0092] The map information requesting unit 35 sends a map information request for requesting map information about the area around the location information 212 received by the location information receiving unit 34 to the map information providing server 10. The map information receiving unit 36 ​​receives map information provided by the map information providing server 10 in response to the map information request.

[0093] The behavior information configuration unit 23 configures the person in charge behavior information 200 so as to link the position information 212 received by the position information receiving unit 34 to the captured image 206 received by the captured image receiving unit 21 and the person in charge surrounding sound 208 received by the person in charge surrounding sound receiving unit 22 (see FIG. 7(a)). Since the position information 212 is linked to the captured image 206 and the person in charge surrounding sound 208, by specifying the position information 212, the captured image 206 and the person in charge surrounding sound 208 linked to the position information 212 can be extracted from the person in charge behavior information 200.

[0094] The display screen configuration unit 25 creates a position information image that displays the position information 212 received by the position information receiving unit 34 as the position of the portable device 6 on the map of the map information received by the map information receiving unit 36. Then, the image display screen 800 is configured so that the captured image 206 received by the captured image receiving unit 21 and the position information image are displayed on the same screen. The position information image may display the moving path of the portable device 6 from the start of business on the map. The capturing positions of the moving image or still image captured by pressing the moving image capturing button 604 or the still image capturing button 606 of the portable device 6 may be displayed as thumbnails on the map, and when the thumbnail display is selected, the moving image or still image may be displayed. The thumbnail display refers to the display of a sample image of the moving image or still image.

[0095] The facility interior plan storage unit 37 stores in advance facility interior plan information in which the floor plan of the facility and the like are recorded. When the position information 212 received by the position information receiving unit 34 is within the facility, the display screen configuration unit 25 creates a position information image so as to display the position of the mobile device 6 on the floor plan of the facility included in the facility interior plan information. Since the position information 212 also includes height information, it is determined which floor in the facility the position of the mobile device 6 is on, and the position of the mobile device 6 is displayed on the floor plan corresponding to that floor.

[0096] The voice-to-text generating unit 38 generates text from voice. The voice-to-text generating unit 38 generates the staff surrounding voice 208 received by the staff surrounding voice receiving unit 22 as a surrounding voice character string 214. For this voice-to-text conversion process, existing technology is used, and AI (Artificial Intelligence) technology can also be used.

[0097] The behavior information configuration unit 23 configures the staff behavior information 200 so as to link the surrounding voice character string 214 generated by the voice character generation unit 38 to the photographed image 206 received by the photographed image receiving unit 21 and the staff surrounding voice 208 received by the staff surrounding voice receiving unit 22 (see FIG. 7(a)). The generated surrounding voice character string 214 may be added to the photographed image 206 as a subtitle.

[0098] The abusive language determination unit 40 determines whether or not abusive language words registered in advance are included in the surrounding voice character string 214 generated by the voice character generation unit 38, and generates abusive language information 216 based on the determination result. The abusive language information 216 includes the abusive language words used and their frequency.

[0099] The behavior information configuration unit 23 configures the person in charge behavior information 200 so as to include the abusive language information 216 generated by the abusive language determination unit 40 (see FIG. 7(a)).

[0100] The voice analysis unit 41 analyzes the voice to estimate the mental state. The voice analysis unit 41 estimates the mental state of the person in charge by analyzing the person in charge surrounding voice 208 received by the person in charge surrounding voice receiving unit 22 and the surrounding voice character string 214 generated by the voice character generating unit 38, and generates the person in charge mental state information 218 based on the estimated mental state of the person in charge. The voice analysis unit 41 estimates the mental state by comprehensively analyzing factors such as the volume of the person in charge's voice, the intonation of the volume of the voice, the pitch of the voice, the number of sighs per predetermined time, the words used, and the frequency of use of negative words. This analysis can also use AI technology, and the person in charge surrounding voice 208 and the surrounding voice character string 214 are input into a trained generation model to calculate an estimate of the mental state. In addition, a comparison is made between the past and present mental states to determine the stability of the mental state and the direction of change. In addition, a determination is made as to whether or not mental health care is required.

[0101] The staff mental state information 218 is configured to include vitality, voice clarity, accumulated anger level (accumulated anger value), mental state stability, direction (trend) of change in mental state, and degree of need for mental health care.

[0102] The behavior information configuration unit 23 configures the person in charge behavior information 200 so as to include the person in charge mental state information 218 generated by the voice analysis unit 41 (see FIG. 7(a)).

[0103] 7(b) is a diagram showing an example of a display screen of the staff mental state information 218 included in the staff action information 200. In this diagram, the staff mental state information 218 for each staff is displayed side by side. By displaying such a screen on the manager terminal 8, the manager can quickly find staff who need mental health care.

[0104] The face authentication unit 42 shown in FIG. 6 authenticates the face of the care recipient appearing in the captured image 206 received by the captured image receiving unit 21, and identifies the name 304 of the care recipient. The business support server 2 has preregistered features of the face image of the care recipient, and authenticates the care recipient by comparing the features calculated from the face image appearing in the captured image 206. This face authentication process uses existing technology including AI technology. In addition, the name 304 and the care recipient ID 302 of the care recipient are registered in the business support server 2 in association with the features of the face image of the care recipient, and when the care recipient is authenticated, the name 304 and the care recipient ID 302 of the care recipient are identified. When the face authentication unit 42 identifies the care recipient name 304, etc., the care recipient identification information 215 including the care recipient name 304 and the care recipient ID 302 is generated.

[0105] Then, the behavior information configuration unit 23 configures the person in charge behavior information 200 so as to associate the captured image 206, the person in charge surrounding voice 208, and the surrounding voice character string 214 with the care receiver identification information 215 generated in the face authentication unit 42 (see FIG. 7(a)). With this configuration, for example, it is possible to specify the care receiver name 304 or the care receiver ID 302 included in the care receiver identification information 215, and extract the captured image 206 or the like in which the specified care receiver appears from the person in charge behavior information 200. That is, when a combination of the person in charge ID 202 and the care receiver ID 302 is specified and a request for providing the person in charge behavior information 200 (request for providing behavior information) is made, the captured image 206 or the like in which the care receiver corresponding to the care receiver ID 302 appears is extracted from the person in charge behavior information 200 corresponding to the person in charge ID 202 and provided.

[0106] The facial expression analysis unit 43 analyzes the facial expression of the care recipient shown in the captured image 206 received by the captured image receiving unit 21, estimates at least one of the emotions of joy, anger, sadness, and happiness, vitality, and satisfaction, and calculates an estimated facial expression value 306 by quantifying the estimation result. Existing technologies including AI technologies are used for the facial expression analysis process by the facial expression analysis unit 43. For example, feature amounts are calculated from the shape and changes of eyebrows, the shape and changes of eyes, cheeks, and lips, the direction of the chin, etc., and analysis is performed based on these feature amounts.

[0107] The care recipient information configuration unit 44 configures the care recipient information 300 so as to include the name 304 and the care recipient ID 302 of the care recipient identified by the face authentication unit 42 , and the estimated facial expression value 306 determined by the facial expression analysis unit 43 .

[0108] The care recipient information 300 is a collection of information that consolidates the observation records of the care recipients. By specifying a care recipient by name or the like, the observation records of that care recipient can be extracted from the care recipient information 300.

[0109] 9 is a diagram showing an example of the configuration of care recipient information 300. When the name 304 and care recipient ID 302 of the care recipient are identified by face recognition using the captured image 206, the care recipient information 300 is configured to store information that serves as an observation record of the care recipient together with the identified care recipient name 304, etc. The components of the care recipient information 300 shown in this figure are merely examples, and other elements may be included, or some of the elements may be deleted.

[0110] The care receiver information storage unit 45 shown in FIG. 6 stores the care receiver information 300 configured in the care receiver information configuration unit 44.

[0111] The care recipient information request receiving unit 46 receives a request for providing care recipient information, which is sent from the manager terminal 8 and requests the care recipient information 300. The care recipient information providing unit 47 provides the care recipient information 300 read from the care recipient information storage unit 45 to the manager terminal 8 in response to the request for providing care recipient information received by the care recipient information request receiving unit 46. When the request for providing care recipient information is made by designating, for example, a care recipient ID 302, the care recipient information 300 corresponding to the designated care recipient ID 302 is provided. Also, for example, when a combination of the care recipient ID 302 and the requested item being the meeting time 308 is designated, the meeting time 308 corresponding to the care recipient is extracted from the care recipient information 300 and provided.

[0112] The contact time measuring unit 50 measures a contact time 308 during which the care recipient appears in the photographed image 206 received by the photographed image receiving unit 21.

[0113] The care receiver information constructing unit 44 constructs the care receiver information 300 so as to include the contact time 308 measured by the contact time measuring unit 50 (see FIG. 9).

[0114] The image and audio analysis unit 51 performs analysis using AI technology based on the captured image 206 and the surrounding voice of the caregiver 208. The image and audio analysis unit 51 estimates the behavior of the caregiver from the captured image 206 received by the captured image receiving unit 21, extracts the remarks of the caregiver from the surrounding voice of the caregiver 208 received by the surrounding voice receiving unit 22, and judges the work evaluation 220 of the caregiver based on the behavior and remarks of the caregiver. For example, if the caregiver provides care with a smile while speaking kind words to the care recipient, the evaluation is high, and if the caregiver speaks few words, has a soft voice, or shows little facial expression, the evaluation is low.

[0115] The behavior information configuration unit 23 configures the staff member behavior information 200 to include the staff member's work evaluation 220 determined by the image and voice analysis unit 51 (see FIG. 7(a)). The photographed image 206, staff member surrounding voice 208, surrounding voice character string 214, etc. of staff members whose work evaluation 220 is determined to be excellent and those whose work evaluation 220 is determined to be poor can be extracted from the staff member behavior information 200 and used as training materials for the staff members or for creating manuals.

[0116] Furthermore, the image and voice analysis unit 51 extracts a statement questioning the care recipient from the person in charge surrounding voice 208 received by the person in charge surrounding voice receiving unit 22, estimates the care recipient's reaction to the questioning statement from the movement of the care recipient shown in the captured image 206 received by the captured image receiving unit 21, and judges the risk 310 of hearing loss or dementia of the care recipient. For example, if the person in charge asks the care recipient the same question multiple times or the voice of the person in charge gets louder with each question, it is judged that the risk of hearing loss is high. In addition, the risk of dementia is judged by evaluating the time difference between the person in charge's question and the care recipient's reaction, the consistency of the care recipient's answer to the question, etc.

[0117] The care receiver information configuration unit 44 configures the care receiver information 300 so as to include the risk 310 of hearing loss or dementia of the care receiver determined by the image and sound analysis unit 51 (see FIG. 9).

[0118] The communication unit 52 transmits and receives data to and from the outside.

[0119] Next, the operation of the task support system 1 according to the present embodiment will be described.

[0120] FIG. 10 is a diagram for explaining an example of the flow of operations of the task support system 1 performed while a person in charge is working.

[0121] The person in charge works while wearing the portable device 6. In the portable device 6, the camera unit 61 captures an image of the surroundings, the microphone unit 63 acquires the surrounding sounds, and the position information detection unit 70 acquires the position information (step S10). The captured image 206, the person in charge's surrounding sounds 208, and the position information 212 are transmitted to the business support server 2 together with a portable device ID that identifies the portable device 6 (step S11).

[0122] When the business support server 2 receives the photographed image 206, the person in charge's surrounding voice 208, and the position information 212 (step S20), the voice character generation unit 38 generates the person in charge's surrounding voice 208 as a surrounding voice character string 214 (step S21). In addition, the face authentication unit 42 authenticates the care recipient from the photographed image 206, identifies the name 304 and the care recipient ID 302 of the care recipient, and generates the care recipient specific information 215 including the care recipient ID 302 and the like (step S22). After that, the behavior information configuration unit 23 configures the person in charge's behavior information 200 to include the photographed image 206, the person in charge's surrounding voice 208, the surrounding voice character string 214, the position information 212, and the care recipient specific information 215 (step S23). In this staff member behavior information 200, the photographed image 206, staff member surrounding voice 208, and surrounding voice character string 214 are stored in a categorized manner at predetermined time intervals, such as 5-minute intervals, and the photographed image 206, staff member surrounding voice 208, and surrounding voice character string 214 are configured to correspond to the acquisition time 210, the position information 212, and the care recipient specific information 215, respectively. The staff member behavior information 200 configured in this manner is stored in the behavior information storage unit 24 (step S24).

[0123] The display screen configuration unit 25 processes the photographed image 206 to configure the image display screen 800 (step S25), and provides the configured image display screen 800 to the administrator terminal 8 (step S26). When the administrator terminal 8 accepts this image display screen 800 (step S30), it is displayed on the administrator terminal display unit 82 (step S31).

[0124] The above operations are repeated while the person in charge is working.

[0125] When the person in charge talks with the manager, the talk button 622 of the portable device 6 is pressed, and the portable device 6 transitions to a call mode (step S12). When the business support server 2 detects a notice of transition to the call mode (step S27), the call establishment unit 30 operates, and a call is possible between the portable device 6 and the manager terminal 8. When the voice of the person in charge is detected by the microphone unit 63 of the portable device 6, the voice of the person in charge is sent to the business support server 2 (step S13), and the business support server 2 receives this voice (step S28). Then, the received voice is sent to the manager terminal 8 (step S29). In the manager terminal 8, the received voice is output from the voice generation unit 84 (step S32) and reaches the ears of the manager. When the manager speaks, the voice is input to the transmission voice input unit 85 of the manager terminal 8, and is sent from the transmission voice sending unit 86 to the business support server 2 (step S33). When the business support server 2 receives the voice of the manager (step S200), the voice is sent to the portable device 6 (step S200). When the portable device 6 receives the voice of the manager, the voice is generated from the earphone unit 66 (step S14) and reaches the ears of the person in charge. The call establishment unit 30 of the business support server 2 controls the flow of voice between the portable device 6 and the manager terminal 8 to establish a call between the person in charge and the manager.

[0126] When the manager checks the record of the person in charge's actions, he / she specifies the person in charge ID 202 or person in charge name 204, as well as requested items such as captured image 206 and sound around the person in charge 208, acquisition time 210, location information 212, etc., and sends a request for providing action information from the manager terminal 8 to the business support server 2 (step S34).

[0127] When the business support server 2 receives this request for providing behavioral information (step S202), it retrieves the person in charge behavioral information 200 corresponding to this request from the behavioral information storage unit 24 and provides it to the manager terminal 8 (step S203).

[0128] When the manager terminal 8 receives the staff member behavior information 200 (step S35), the received staff member behavior information 200 is displayed on the manager terminal display unit 82 (step S36). In addition, when the staff member surrounding voice 208 included in the staff member behavior information 200 is received, it is generated from the voice generating unit 84.

[0129] 11 is a diagram for explaining an example of the flow of analysis based on the configured staff action information 200 in the business support system 1. The example in this figure shows a flow of collective analysis using staff action information 200 obtained during a predetermined period, such as one day's worth, that is accumulated in the business support server 2 through the work of the staff. However, the present invention is not limited to this example, and real-time analysis may be performed using staff action information 200 obtained during the work of the staff.

[0130] First, the already configured staff member behavior information 200 is read from the behavior information storage unit 24 (step S40). The abusive language determination unit 40 determines the abusive language based on the surrounding voice character string 214 included in the read staff member behavior information 200, and generates the abusive language information 216 (step S41). Next, the voice analysis unit 41 generates staff member mental state information 218 based on the staff member surrounding voice 208 and the surrounding voice character string 214 included in the staff member behavior information 200 (step S42). Next, the image and voice analysis unit 51 determines the staff member's work evaluation 220 based on the photographed image 206 and the staff member surrounding voice 208 included in the staff member behavior information 200 (step S43). The behavior information configuration unit 23 configures the staff member behavior information 200 to include the obtained abusive language information 216, staff member mental state information 218, and staff member work evaluation 220, and the configured staff member behavior information 200 is stored and updated in the behavior information storage unit 24 (step S44).

[0131] Next, the face authentication unit 42 identifies the name 304 of the care recipient based on the captured image 206 included in the staff member behavior information 200 (step S45). The facial expression analysis unit 43 estimates at least one of the emotions of joy, anger, sadness, and happiness, vitality, and satisfaction based on the captured image 206 included in the staff member behavior information 200, and calculates an estimated facial expression value 306 by quantifying the estimation result (step S46). Next, the face-to-face time measurement unit 50 measures the face-to-face time 308 based on the captured image 206 included in the staff member behavior information 200 (step S47). After that, the image and audio analysis unit 51 judges the risk 310 of hearing loss or dementia of the care recipient based on the captured image 206 and the staff member surrounding audio 208 included in the staff member behavior information 200 (step S48). Finally, the care recipient information composition unit 44 composes care recipient information 300 to include the obtained care recipient's name 304, estimated facial expression value 306, face-to-face time 308, and the care recipient's risk of hearing loss or dementia 310 (step S49), and the composed care recipient information 300 is stored in the care recipient information storage unit 45 (step S50).

[0132] When the manager checks the record of the person in charge's behavior, the manager specifies the required items such as the person in charge's mental state information 218 and the work evaluation 220 along with the person in charge's ID 202 or name 204, and sends a request for providing behavior information from the manager terminal 8 to the business support server 2 (step S60).

[0133] When the business support server 2 receives this request for providing behavior information (step S51), it retrieves the person in charge behavior information 200 corresponding to this request from the behavior information storage unit 24 and provides it to the manager terminal 8 (step S52).

[0134] When the manager terminal 8 receives the staff member action information 200 (step S61), the received staff member action information 200 is displayed on the manager terminal display unit 82 (step S62).

[0135] When the manager checks the observation records of the care recipient, the manager specifies the care recipient ID 302 or the care recipient's name 304, as well as requested items such as meeting time 308, and sends a request for care recipient information from the manager terminal 8 to the business support server 2 (step S63).

[0136] When the business support server 2 receives this request for providing care recipient information (step S53), it retrieves the care recipient information 300 corresponding to this request from the care recipient information storage unit 45 and provides it to the manager terminal 8 (step S54).

[0137] When the manager terminal 8 accepts the care receiver information 300 (step S64), the accepted care receiver information 300 is displayed on the manager terminal display unit 82 (step S65).

[0138] Next, the effects of this embodiment will be described.

[0139] According to this embodiment, the actions of the person in charge are recorded by constructing and storing person in charge action information 200, which includes images of the person in charge's surroundings captured by the portable device 6 and audio of the person in charge's surroundings acquired by the portable device 6.

[0140] In addition, images captured by the portable device 6 are displayed on the manager terminal 8, and calls can be made between the portable device 6 and the manager terminal 8, so that the manager operating the manager terminal 8 can provide real-time advice and instructions to the person in charge wearing the portable device 6, thereby supporting the person in charge in their work.

[0141] Furthermore, the person in charge's action information 200 stored in the business support server 2 can be displayed on the manager's terminal 8 to confirm the past actions of the person in charge.

[0142] Furthermore, according to this embodiment, since the earphone unit 66 is configured as a bone conduction earphone, the ear of the person in charge who wears the portable device 6 is not blocked by the earphone. The person in charge can receive the sound transmitted from the manager terminal 8 through the bone conduction earphone and hear the surrounding sounds with his / her own ears. In this way, both the sound transmitted from the manager terminal 8 and the surrounding sounds can be clearly heard.

[0143] According to this embodiment, the camera unit 61, microphone unit 63, and earphone unit 66 are integrated into the headset unit 600 and are configured to be worn on the head of the person in charge, so that the person in charge wearing the headset unit 600 can use both hands freely. Also, by aligning the shooting direction of the camera unit 61 with the line of sight of the person in charge, an image close to the field of vision of the person in charge can be captured.

[0144] Furthermore, according to this embodiment, in the camera stop mode, image capture by the camera unit 61 and acquisition of audio by the microphone unit 63 are stopped. In situations where privacy must be respected, such as during bathing care, the camera can be switched to the camera stop mode to stop image and audio acquisition. In addition, a notification sound notifying the user that the camera is in the stop mode is emitted from the earphone unit 66, so that the person in charge can recognize that the camera is in the stop mode.

[0145] Furthermore, according to this embodiment, when the portable device 6 switches to a call mode, a call can be made between the portable device 6 and the administrator terminal 8. Therefore, when the person in charge wants to receive advice or instructions, the person in charge can switch to the call mode and receive advice, etc. from the administrator operating the administrator terminal 8.

[0146] Furthermore, since the captured image 206 of the mobile device 6 that is making a call is highlighted, the manager operating the manager terminal 8 can easily recognize the captured image 206 and give advice or the like.

[0147] Furthermore, according to this embodiment, the person in charge behavior information 200 is configured so that the captured image 206 and the person in charge surrounding sound 208 are linked to the position information 212, so that the position where the image was captured and the position where the sound was acquired can be specified.

[0148] In addition, since the position of the portable device 6 is displayed on a map, the position of the portable device 6 can be easily recognized.

[0149] Furthermore, according to this embodiment, the person in charge surrounding voice 208 is generated as surrounding voice character string 214, and the person in charge action information 200 is configured so as to be linked to the photographed image 206 and the person in charge surrounding voice 208, so that the voice corresponding to the photographed image 206 and the person in charge surrounding voice 208 can be recognized as a character string. Furthermore, when creating a manual or record booklet based on the person in charge action information 200, there is no need to transcribe the text, which can save labor.

[0150] Furthermore, according to this embodiment, abusive language information 216 is created based on the result of judging whether abusive language has been used, and the staff member action information 200 is configured to include the abusive language information 216. By referring to this abusive language information 216, it is possible to improve business operations, such as preventing abusive language.

[0151] Furthermore, according to this embodiment, the mental state of the person in charge is estimated by analyzing the voice, which can be utilized for mental health care of the person in charge.

[0152] According to this embodiment, the face of the care recipient captured in the photographed image 206 is authenticated to identify the name 304 of the care recipient, and the facial expression of the care recipient is analyzed to estimate at least one of the emotions of joy, anger, sadness, and happiness, vitality, and satisfaction to calculate an estimated facial expression value. By referring to the estimated facial expression value, the customer satisfaction level of each care recipient can be determined.

[0153] Furthermore, according to this embodiment, the contact time 308 for each care recipient is detected. This makes it possible to check the bias in the provision of services and to utilize this information for future work improvements.

[0154] Furthermore, according to this embodiment, the work evaluation 220 of the person in charge is determined by performing an analysis based on the photographed image 206 and the surrounding voice of the person in charge 208. The comparison of the images and voices of the person in charge who received a good evaluation and a bad evaluation can be utilized for creating an education and training manual, etc.

[0155] Furthermore, according to this embodiment, the risk 310 of hearing loss or dementia of the care recipient can be determined by performing an analysis based on the captured image 206 and the surrounding voice 208 of the care recipient, and this can be utilized for early detection and subsequent care.

[0156] Furthermore, according to this embodiment, when the portable device 6 transitions to a call mode, if it is determined that the manager operating the manager terminal 8 is absent, multiple personnel wearing the portable device 6 can make calls among themselves, allowing the manager to obtain advice from other personnel.

[0157] Furthermore, according to this embodiment, the actions of the person in charge are recorded by constructing and storing person in charge action information 200, which includes images of the person in charge's surroundings captured by the portable device 6 and audio of the person in charge's surroundings acquired by the portable device 6.

[0158] [Other embodiments of the invention] The present invention is not limited to the above embodiment and can be modified as appropriate. For example, the functions of the business support server 2 may be integrated into the manager terminal 8. In addition, the behavior information storage unit 24 and the care recipient information storage unit 45 included in the business support server 2 may be constructed as an external server.

[0159] In addition, the business support system 1 according to the above embodiment has been described with a care business as an example of business, but is not limited to the care business and can be applied to other businesses. For example, the business support system 1 can be applied to childcare and education businesses such as nursery schools and kindergartens, construction businesses, and other businesses. In the care business, the captured image 206 taken by the portable device 6 shows a person receiving care, while in the childcare and education business, the captured image 206 shows a nursery school or kindergarten child, and in the construction business, a worker or the like is shown. Then, in face authentication using the captured image 206, authentication is performed for the nursery school or kindergarten child and the worker. When the face authentication unit 42 of the business support server 2 identifies the name and ID of the nursery school or kindergarten child and the worker, nursery school or kindergarten child identification information and worker identification information corresponding to the care recipient identification information 215 including the name and ID are generated. [Explanation of symbols]

[0160] 1...Business support system, 2...Business support server, 61, 62,..., 6 i ,···,6 n,6...mobile device, 8...administrator terminal, 10...map information providing server, 11...communication line, 20...control unit, 21...captured image receiving unit, 22...personnel surrounding voice receiving unit, 23...behavior information composition unit, 24...behavior information storage unit, 25...display screen composition unit, 26...display screen providing unit, 27...transmission voice receiving unit, 30...call establishment unit, 31...administrator absence determination unit, 32...behavior information request receiving unit, 33...behavior information providing unit, 34...location information receiving unit, 35...map information request unit, 36...map information receiving unit, 37...facility interior drawing memory unit, 38...voice text generation unit, 40...abusive language determination unit, 41...voice analysis unit, 4 2...Facial recognition unit, 43...Facial expression analysis unit, 44...Care recipient information configuration unit, 45...Care recipient information storage unit, 46...Care recipient information provision request reception unit, 47...Care recipient information provision unit, 50...Contact time measurement unit, 51...Image and audio analysis unit, 52...Communication unit, 200...Person in charge behavior information, 202...Person in charge ID, 204...Person in charge name, 206...Captured image, 208...Person in charge surrounding voice, 210...Acquisition time, 212...Location information, 214...Surrounding voice character string, 215...Care recipient identification information, 216...Abusive language information, 218...Person in charge mental state information, 220...Work evaluation, 300...Care recipient information, 302...Care recipient care recipient's ID, 304...name of care recipient, 306...estimated facial expression value, 308...face-to-face time, 310...risk of hearing loss or dementia, 60...control unit, 61...camera unit, 62...captured image transmission unit, 63...microphone unit, 64...care recipient's surroundings voice transmission unit, 65...care recipient's voice transmission reception unit, 66...earphone unit, 70...location information detection unit, 71...location information transmission unit, 72...portable device display unit, 73...portable device storage unit, 74...communication unit, 600...headset unit, 604...video recording button, 606...still image recording button, 608...volume button, 610...power button, 612...connection unit, 61 4...widening section, 616...ear hook section, 618...communication cable connection terminal, 619...front section, 620...communication unit section, 622...call button, 624...Wi-Fi communication display, 626...LTE display, 628...GPS display, 630...latching section, 632...communication cable connection terminal, 640...secondary battery, 650...communication cable, 80...control section, 81...display screen reception section, 82...administrator terminal display section, 83...output voice reception section, 84...voice generation section, 85...transmission voice input section, 86...transmission voice transmission section, 90...behavior information provision request section, 91...behavior information reception section, 93...administrator terminal memory section,94: care recipient information provision request unit, 95: care recipient information reception unit, 98: input unit, 99: communication unit, 800: image display screen, 802: normal size captured image, 804: enlarged captured image, 810: menu display unit, 812: screen selection button, 814: call selection button, 816: all call button,

Claims

1. A business support system that monitors and manages the actions of personnel engaged in business, The system includes a portable device worn by the person in charge, a manager terminal on which images captured by the portable device are displayed and which can communicate with the portable device, and a business support server which configures and stores person in charge action information based on data acquired by the portable device and controls the flow of information between the portable device and the manager terminal, the portable device and the administrator terminal are connected to the business support server via a communication line; The mobile device comprises: A camera unit that captures an image of the person in charge's surroundings; A microphone unit for acquiring sounds around the person in charge; an earphone unit for generating a sound to be transmitted to the person in charge; a captured image sending unit that sends an image captured by the camera unit to the business support server; a person in charge surrounding voice sending unit that sends the person in charge surrounding voice acquired by the microphone unit to the business support server; a person in charge voice receiving unit that receives a person in charge voice generated from the earphone unit and sent from the business support server, The administrator terminal, a display screen receiving unit that receives an image display screen on which the captured image is displayed, the image display screen being sent from the business support server; a manager terminal display unit on which the received image display screen is displayed; an output voice receiving unit that receives the surrounding voice of the person in charge sent from the business support server; a voice generating unit that generates the received surrounding voice of the person in charge; a transmission voice input unit to which the person in charge's transmission voice is input; a voice transmission unit that transmits the input person-in-charge voice to the business support server; a behavior information provision request unit that transmits a behavior information provision request for requesting the person in charge behavior information to the business support server; a behavior information receiving unit that receives the person in charge behavior information provided from the business support server in response to the behavior information provision request, The business support server includes: a photographed image receiving unit that receives the photographed image sent from the photographed image sending unit; a person in charge surrounding voice receiving unit that receives the person in charge surrounding voice transmitted from the person in charge surrounding voice transmitting unit; an action information configuration unit that configures the person in charge action information including the received photographed image and the person in charge surrounding sound; An action information storage unit that stores the configured person in charge action information; a display screen configuration unit that processes the photographed image accepted by the photographed image acceptance unit and configures the image display screen; a display screen providing unit that provides the configured image display screen to the administrator terminal; a voice transmission receiving unit that receives the person-in-charge voice transmitted from the voice transmission sending unit; a call establishment unit that sends the person in charge surrounding voice received by the person in charge surrounding voice receiving unit to the manager terminal and sends the person in charge transmission voice received by the transmission voice receiving unit to the portable device, thereby establishing a call between the portable device and the manager terminal; a behavior information request receiving unit that receives the behavior information request sent from the behavior information request unit; a behavior information providing unit that provides the person in charge behavior information read from the behavior information storage unit in response to the received behavior information provision request to the manager terminal, When the action information receiving unit receives the person in charge action information, the received person in charge action information is displayed on the manager terminal display unit.

2. 2. The task support system according to claim 1, wherein the earphone unit is configured by a bone conduction earphone.

3. 2. The business support system according to claim 1, wherein the camera unit, the microphone unit and the earphone unit are integrated as a headset, and the headset is configured to be worn on the head of the person in charge.

4. the mobile device has a camera off mode; In the camera stop mode, 4. The business support system according to claim 3, wherein the camera unit stops taking pictures and the microphone unit stops acquiring sounds, and the earphone unit emits a notification sound to notify the user that the camera is in the camera stop mode.

5. the mobile device has a talk mode; In this call mode, 5. The business support system according to claim 4, wherein the portable device and the manager terminal are capable of communicating with each other, and the image captured by the camera unit is highlighted on a display unit of the manager terminal.

6. The mobile device comprises: a location information detection unit that receives radio waves from a satellite positioning system and calculates location information; a location information sending unit that sends the calculated location information to the business support server; The business support server includes: a location information receiving unit that receives the location information sent from the location information sending unit; a map information request unit that transmits a map information request for requesting map information of the surrounding area of ​​the received position information; a map information receiving unit that receives the map information provided in response to the map information request; In the behavior information configuration unit, The staff member behavior information is configured so as to link the location information received by the location information receiving unit to the photographed image received by the photographed image receiving unit and the staff member surrounding sound received by the staff member surrounding sound receiving unit; In the display screen configuration unit, creating a position information image that displays the position information received by the position information receiving unit as the position of the portable device on the map of the map information received by the map information receiving unit; 6. The business support system according to claim 5, wherein the image display screen is configured so that the photographed image and the position information image accepted by the photographed image accepting section are displayed on the same screen.

7. The business support server includes: A voice-to-text generator that generates text from voice, The voice-to-text generating unit generating the person in charge surrounding voice received by the person in charge surrounding voice receiving unit as a surrounding voice character string; In the behavior information configuration unit, The business support system of claim 6, characterized in that the staff behavior information is configured so as to link the surrounding voice character string generated by the voice character generation unit to the captured image received by the captured image receiving unit and the staff surrounding voice received by the staff surrounding voice receiving unit.

8. The business support server includes: An abusive language determination unit that determines abusive language, The abusive language determination unit determining whether or not the surrounding voice character string generated by the voice character generation unit contains abusive language words registered in advance, and generating abusive language information based on the determination result; In the behavior information configuration unit, The business support system according to claim 7, wherein the staff member action information is configured to include the abusive language information generated by the abusive language determination unit.

9. The business support server includes: A voice analysis unit that analyzes voice and estimates a mental state, The voice analysis unit an analysis unit that analyzes the person in charge's surrounding voice received by the person in charge surrounding voice receiving unit and the surrounding voice character string generated by the voice character generating unit to estimate the mental state of the person in charge, and generates person in charge mental state information based on the estimated mental state of the person in charge; In the behavior information configuration unit, The work support system according to claim 8, wherein the person in charge behavior information is configured to include the person in charge mental state information generated by the voice analysis unit.

10. The business support server includes: a face authentication unit that authenticates a face of the care recipient appearing in the photographed image received by the photographed image receiving unit and identifies a name of the care recipient; an expression analysis unit that analyzes the facial expression of the care recipient shown in the captured image received by the captured image receiving unit, estimates at least one of emotions such as joy, anger, sadness, and happiness, vitality, and satisfaction, and calculates an estimated expression value by quantifying the estimation result; a care recipient information configuration unit that configures care recipient information to include the name of the care recipient identified by the face authentication unit and the estimated facial expression value calculated by the facial expression analysis unit; a care recipient information storage unit configured to store the care recipient information; a care recipient information provision request receiving unit that receives a care recipient information provision request that requests the care recipient information transmitted from the manager terminal; a care recipient information providing unit that provides the care recipient information read from the care recipient information storage unit to the manager terminal in response to the received care recipient information provision request, The administrator terminal, a care recipient information provision request unit configured to send the care recipient information provision request to the business support server; a care receiver information receiving unit that receives the care receiver information provided from the business support server in response to the care receiver information provision request, 10. The business support system according to claim 9, wherein when the care recipient information is received by the care recipient information receiving unit, the received care recipient information is displayed on the manager terminal display unit.

11. The business support server includes: a contact time measurement unit that measures a contact time during which the care recipient appears in the photographed image received by the photographed image receiving unit, In the care recipient information configuration unit, The business support system according to claim 10, wherein the care receiver information is configured to include the face-to-face time measured by the face-to-face time measuring unit.

12. The business support server includes: An image and sound analysis unit that performs analysis based on the captured image and the sound around the person, The image and audio analysis unit an action of the person in charge is estimated from the photographed image received by the photographed image receiving unit, a statement of the person in charge is extracted from the voice around the person in charge received by the voice around the person in charge receiving unit, and a work evaluation of the person in charge is determined based on the action and the voice of the person in charge; In the behavior information configuration unit, The work support system according to claim 11, wherein the staff action information is configured to include the work evaluation determined by the image and voice analysis unit.

13. The image and sound analysis unit extracting a questioning statement for the care recipient from the staff member surrounding voice received by the staff member surrounding voice receiving unit, estimating the care recipient's reaction to the questioning statement from the movement of the care recipient shown in the captured image received by the captured image receiving unit, and determining a risk of hearing loss or dementia for the care recipient; In the care recipient information configuration unit, The business support system according to claim 12, characterized in that the care recipient information is configured to include the risk of hearing loss or dementia of the care recipient determined by the image and audio analysis unit.

14. a plurality of said mobile devices; The business support server includes: an administrator absence determination unit that determines whether the administrator who operates the administrator terminal is absent; The business support system of claim 13, characterized in that when one of the multiple portable devices transitions to the call mode, if the manager absence determination unit determines that the manager is absent, calls become possible between the multiple portable devices.

15. A business support server for use in the business support system according to any one of claims 1 to 14.

16. A portable device for use in the business support system according to any one of claims 3 to 14.

Citation Information

Patent Citations

  • Action recording system, terminal device, and action recording method

    JP2018037951A

Cited By

  • Information processing apparatus, information processing method, and program

    JP2026076925A

  • Information processing apparatus, information processing method, and program

    JP2026076991A

  • Information processing device, information processing method, and program

    JP2026155002A

  • Business support system and mobile device

    JP7631628B1

  • Information provision method and information provision device

    JP7838774B1