Vital sign output device and vital sign measuring system using the same
The vital sign measurement system addresses the lack of user-friendly announcements in health management systems by acquiring and analyzing still-face biometric video to output vital signs and announce content, enhancing user interaction and usability.
Patent Information
- Application Number
- JP2024179506
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-02-19
- Filing Date
- 2024-10-13
- Publication Date
- 2025-08-29
AI Technical Summary
Existing health management systems lack user-friendly audio or visual announcements before or after acquiring biometric information, making them difficult to use.
A vital sign measurement system comprising a vital sign output device that acquires and analyzes still-face biometric video, outputs vital signs, and announces predetermined content, and a vital sign generation server that processes and generates vital signs based on the biometric video.
Enhances user interaction by providing audio-visual announcements during and after biometric processing, improving the usability and effectiveness of health management systems.
Smart Images

Figure 2025126884000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a vital sign output device that acquires a still-face biometric video of a subject, acquires and outputs vital signs that have been analyzed and processed based on the still-face biometric video, and announces to the subject predetermined announcement content selected during and / or after the processing of the still-face biometric video, and a vital sign measurement system that includes the vital sign output device and a vital sign generation server that analyzes and processes the still-face biometric video of the subject acquired from the vital sign output device, and generates and outputs vital signs. [Background technology]
[0002] In recent years, an increasing number of companies in Japan have been proactively working on health and productivity management. Here, "health and productivity management" refers to a management method that considers employee health management from a management perspective and puts it into strategic practice, based on the idea that efforts to maintain and improve the health of employees are an investment that will increase a company's future profits. The promotion of health management is expected to revitalize organizations by increasing employee vitality and productivity, ultimately leading to improved business performance, corporate value, and stock prices. With the aim of achieving this type of health management, various systems are being considered.
[0003] One example of such a system is the invention described in Patent Document 1. This invention provides a fragrance generation system that includes an information processing device and a fragrance emitting device, in which the information processing device acquires biometric information of a user, determines the user's condition based on the acquired biometric information, determines the operation of the fragrance emitting device based on the determined condition of the user, and outputs a control signal to cause the fragrance emitting device to execute the determined operation, and the fragrance emitting device switches between emitting at least two types of fragrance based on the control signal output from the information processing device. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Publication No. 2022-131142 Summary of the Invention [Problem to be solved by the invention]
[0005] However, the above-mentioned invention had a major problem in that the information processing device did not make any audio or visual announcements to the user before or after acquiring the user's biometric information, making it difficult for the user to use and difficult to say that it was a user-friendly system. [Means for solving the problem]
[0006] In consideration of the above-mentioned problems, the present invention aims to provide a vital sign measurement system comprising a vital sign output device that acquires a still biometric video of a subject's face, acquires and outputs vital signs that have been analyzed and processed based on the still biometric video, and announces to the subject predetermined announcement content selected during and / or after the processing of the still biometric video of the face, and a vital sign generation server that analyzes and processes the still biometric video of the subject acquired from the vital sign output device to generate and output vital signs.
[0007] Specifically, the present invention provides a still face biometric video acquisition unit that acquires a still face biometric video that is a still face biometric video of a subject's face for analysis processing; a start command receiving unit that receives a start command that is a command to start acquiring a still face biometric video by the face biometric video acquisition unit; a still face biometric video acquisition control unit that controls the still face biometric video acquisition unit in accordance with the analysis processing status after receiving the start command; an announcement content storage unit that stores a plurality of announcement contents that are contents to be announced by an announcement unit described later; and an announcement content selection unit that selects announcement contents from the announcement contents stored in the announcement content storage unit in accordance with processing of the still face biometric video. Provided is a vital sign output device having an announcement content selection condition holding unit that holds conditions, an announcement content selection unit that selects held announcement content based on the processing status of the still face biometric video and the held announcement content selection conditions, an announcement unit that announces the announcement content selected by the announcement content selection unit to a target person during and / or after processing of the still face biometric video, a vital sign acquisition unit that acquires at least one vital sign from outside, a vital sign holding unit that holds the acquired vital signs, and a vital sign output unit that outputs the acquired vital signs.
[0008] In addition to the above features, the present invention also provides a vital sign output device in which the vital signs are at least one or more of pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, respiratory rate, body surface temperature, and stress index.
[0009] In addition to the above features, the present invention also provides a vital sign measurement system comprising: a vital sign output device having a streaming output unit that streams out still face biometric video, which is a still face biometric video of the acquired subject's face, and a vital sign acquisition unit having an external acquisition means that acquires vital signs generated based on the still face biometric video output from the streaming output unit from a vital sign generation server described below; a still face biometric video streaming acquisition unit that streams the still face biometric video, an analysis processing unit that analyzes and processes the acquired still face biometric video, an analysis processing status output unit that outputs the analysis processing status in the analysis processing unit, a vital sign generation unit that generates vital signs based on the analysis processing in the analysis processing unit, a vital sign storage unit that stores the generated vital signs, and a vital sign output unit that outputs the generated vital signs.
[0010] In addition to the above-mentioned features, the present invention also provides a vital sign measurement system in which the vital sign generation server has a vital sign output request receiving unit that receives a vital sign output request from a terminal, an output request judgment unit that judges whether the received output request is an appropriate request, and an output control unit that controls the vital sign output unit to output the vital sign to the terminal that made the output request if the judgment result of the output request judgment unit is that the request is appropriate.
[0011] In addition to the above features, the present invention also provides a vital sign measurement system in which the vital sign generation server has a statistical processing unit that performs statistical processing on the stored vital signs for each subject group, a statistical processing result storage unit that stores the statistical processing results, which are the results of the statistical processing, and a statistical processing result output unit that outputs the statistical processing results.
[0012] Furthermore, in addition to the above-mentioned features, the present invention provides a vital sign measurement system in which the vital sign generation server has a subject attribute information storage unit that stores subject attribute information, which is attribute information of the subject, in association with the subject, and the statistical processing unit has subject attribute information-attached statistical processing means that performs statistical processing using the subject attribute information and the stored vital signs.
[0013] In addition to the above features, the present invention also provides a vital sign measurement system, wherein the vital sign generation server comprises: a health content identification information storage unit that stores health content identification information, which is information for identifying health content to be selected according to the stored vital sign; a health content identification information selection rule storage unit that stores health content identification information selection rules, which are rules for selecting the stored health content identification information based on the stored vital sign; a health content identification information selection unit that selects at least one of the stored health content identification information based on the stored vital sign and the stored health content identification information selection rules; a health content identification information output unit that outputs the selected health content identification information; a health content storage unit that stores the health content by associating the health content identification information with the health content; and a health content output unit that outputs the stored health content based on the selected health content identification information; and the vital sign output device comprises: a health content acquisition unit that acquires the health content from the health content output unit; and a health content playback unit that plays back the acquired health content.
[0014] In addition to the above features, the present invention also provides a vital sign measurement system in which the health content identification information is information for identifying at least one of the following content: content related to music and / or video, content related to stretching, content related to fitness, content related to yoga, content related to mindfulness and / or meditation, content related to fragrance, and content related to text and / or images.
[0015] In addition to the above features, the present invention also provides a vital sign measurement system, wherein the vital sign includes emotion information, which is information indicating emotion acquired based on a result of facial expression analysis.
[0016] The vital sign measurement system of claim 9, wherein the emotional information is at least one of information indicating "joy," information indicating "satisfaction," information indicating "relief," information indicating "tension," information indicating "normal," information indicating "calm," information indicating "anger," information indicating "dissatisfaction," and information indicating "sadness."
[0017] Furthermore, in order to realize the above-mentioned vital sign output device and vital sign measurement system using it, we provide a method executed by a CPU in the vital sign output device which is a computer and in the vital sign measurement system using it, as well as an operating program for the vital sign output device which is a calculator and in a manner that can be read and executed by the vital sign output device and the vital sign measurement system using it.
[0018] Specifically, the present invention is a method executed by a CPU in a vital sign output device that is a computer, the method including a still face biometric video acquisition step of acquiring a still face biometric video that is a still face biometric video of a subject's face for analysis processing, a start command reception step of receiving a start command that is a command to start acquisition of the still face biometric video by the face biometric video acquisition step, a still face biometric video acquisition control step of controlling the still face biometric video acquisition step in accordance with the analysis processing status after receiving the start command, an announcement content holding step of holding a plurality of announcement contents that are contents to be announced in an announcement step described later, and an announcement content held in the announcement content holding step in accordance with processing of the still face biometric video. The method includes an announcement content selection condition holding step for holding announcement content selection conditions for selecting content, an announcement content selection step for selecting held announcement content based on the status of processing of still face biometric video and the held announcement content selection conditions, an announcement step for announcing to a subject the announcement content selected in the announcement content selection step during and / or after processing of the still face biometric video, a vital sign acquisition step for acquiring at least one vital sign from outside, a vital sign holding step for holding the acquired vital signs, and a vital sign output step for outputting the acquired vital signs.
[0019] In addition to the above-mentioned features, the present invention also provides a method executed by a CPU in a vital sign output device that is a computer, in which the vital sign is at least one or more of pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, respiratory rate, body surface temperature, and stress index.
[0020] In addition to the above-mentioned features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, wherein the CPU in the vital sign output device has a streaming output step of streaming out a still face biometric video that is a still face biometric video of the acquired subject's face, and the vital sign acquisition step has an external acquisition sub-step of acquiring vital signs generated based on the still face biometric video output from the streaming output step from a vital sign generation server described below, and the CPU in the vital sign generation server has a still face biometric video streaming acquisition step of streaming the still face biometric video, an analysis processing step of analyzing and processing the acquired still face biometric video, an analysis processing status output step of outputting the analysis processing status in the analysis processing step, a vital sign generation step of generating vital signs based on the analysis processing in the analysis processing step, a vital sign storage step of storing the generated vital signs, and a vital sign output step of outputting the generated vital signs.
[0021] In addition to the above-mentioned features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, wherein the CPU in the vital sign generation server has a vital sign output request receiving step for receiving a vital sign output request from a terminal, an output request determination step for determining whether the received output request is an appropriate request, and an output control step for controlling the vital sign output step to output the vital sign to the terminal that made the output request if the determination result in the output request determination step is that the request is appropriate.
[0022] In addition to the above-mentioned features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, wherein the CPU in the vital sign generation server has a statistical processing step of statistically processing the stored vital signs by subject group, a statistical processing result storage step of storing the statistical processing results that are the results of the statistical processing, and a statistical processing result output step of outputting the statistical processing results.
[0023] In addition to the above-mentioned features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, in which the CPU in the vital sign generation server has a subject attribute information retention step of retaining subject attribute information, which is attribute information of the subject, in association with the subject, and the statistical processing step has a subject attribute information-attached statistical processing sub-step of performing statistical processing using the subject attribute information and the retained vital signs.
[0024] In addition to the above features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, wherein the CPU in the vital sign generation server has a health content identification information retaining step of retaining health content identification information, which is information for identifying health content to be selected according to the retained vital signs, a health content identification information selection rule retaining step of retaining health content identification information selection rules, which are rules for selecting the retained health content identification information based on the retained vital signs, a health content identification information selection step of selecting at least one of the retained health content identification information based on the retained vital signs and the retained health content identification information selection rules, a health content identification information output step of outputting the selected health content identification information, a health content retaining step of retaining the health content by associating the health content identification information with the health content, and a health content output step of outputting the retained health content based on the selected health content identification information, and the CPU in the vital sign output device has a health content acquisition step of acquiring the health content from the health content output step, and a health content playback step of playing back the acquired health content.
[0025] In addition to the above features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, wherein the health content identification information is information for identifying at least one of the following content: content related to music and / or video, content related to stretching, content related to fitness, content related to yoga, content related to mindfulness and / or meditation, content related to fragrance, and content related to text and / or images.
[0026] In addition to the above-mentioned features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, wherein the vital sign includes emotion information that is information indicating an emotion obtained based on a facial expression analysis result.
[0027] In addition to the above-mentioned features, the present invention also provides a method executed by a CPU in a vital sign measurement system that is a computer, wherein the emotional information is at least one or more of information indicating "joy", information indicating "satisfaction", information indicating "relief", information indicating "tension", information indicating "neutral", information indicating "calm", information indicating "anger", information indicating "dissatisfaction", and information indicating "sadness".
[0028] Specifically, the present invention includes a still face biometric video acquisition step of acquiring a still face biometric video that is a still face biometric video of a subject's face for analysis processing; a start command reception step of receiving a start command that is a command to start acquisition of the still face biometric video by the face biometric video acquisition step; a still face biometric video acquisition control step of controlling the still face biometric video acquisition step in accordance with the analysis processing status after receiving the start command; an announcement content holding step of holding a plurality of announcement contents that are contents to be announced in an announcement step described below; and an announcement content selection step of holding announcement content selection conditions for selecting announcement contents from the announcement contents held in the announcement content holding step in accordance with processing of the still face biometric video. Provided is an operating program for a vital sign output device that is written in a manner that can be read and executed by a computer that has a condition holding step, an announcement content selection step that selects held announcement content based on the processing status of the still face biometric video and the held announcement content selection conditions, an announcement step that announces the announcement content selected in the announcement content selection step to a subject during or / and after the processing of the still face biometric video, a vital sign acquisition step that acquires at least one vital sign from outside, a vital sign holding step that holds the acquired vital signs, and a vital sign output step that outputs the acquired vital signs.
[0029] In addition to the above features, the present invention also provides an operating program for a vital sign output device, which is written in a readable and executable manner on a vital sign output device that is a computer, and in which the vital signs are at least one or more of pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, respiratory rate, body surface temperature, and stress index.
[0030] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system that is written in a readable and executable manner for a vital sign measurement system that is a computer, wherein the vital sign output device has a streaming output step of streaming out a still face biometric video that is a still face biometric video of the acquired subject's face, and the vital sign acquisition step has an external acquisition sub-step of acquiring vital signs generated based on the still face biometric video output from the streaming output step from a vital sign generation server described below, and the vital sign generation server has a still face biometric video streaming acquisition step of streaming the still face biometric video, an analysis processing step of analyzing and processing the acquired still face biometric video, an analysis processing status output step of outputting the analysis processing status in the analysis processing step, a vital sign generation step of generating vital signs based on the analysis processing in the analysis processing step, a vital sign storage step of storing the generated vital signs, and a vital sign output step of outputting the generated vital signs.
[0031] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for the vital sign measurement system, which is a computer having a vital sign generation server that has a vital sign output request receiving step for receiving a vital sign output request from a terminal, an output request judgment step for judging whether the received output request is an appropriate request, and an output control step for controlling the vital sign output step to output the vital sign to the terminal that made the output request if the judgment result in the output request judgment step is that the request is appropriate.
[0032] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for the vital sign measurement system, which is a computer having a vital sign generation server that has a statistical processing step of statistically processing the stored vital signs by subject group, a statistical processing result storage step of storing the statistical processing results that are the results of the statistical processing, and a statistical processing result output step of outputting the statistical processing results.
[0033] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system, the operating program being written in a manner that can be read and executed by a computer in which the vital sign generation server has a subject attribute information retention step for retaining subject attribute information, which is attribute information of the subject, in association with the subject, and the statistical processing step has a subject attribute information-attached statistical processing substep for performing statistical processing using the subject attribute information and the retained vital signs.
[0034] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for a computer that includes the vital sign generation server, the operating program including a health content identification information storage step for storing health content identification information, which is information for identifying health content to be selected according to the stored vital sign; a health content identification information selection rule storage step for storing health content identification information selection rules, which are rules for selecting the stored health content identification information based on the stored vital sign; a health content identification information selection step for selecting at least one of the stored health content identification information based on the stored vital sign and the stored health content identification information selection rule; a health content identification information output step for outputting the selected health content identification information; a health content storage step for storing the health content by associating the health content identification information with the health content; and a health content output step for outputting the stored health content based on the selected health content identification information; and the vital sign output device, the operating program being written in a readable and executable manner for a computer that includes the vital sign measurement system, the operating program including a health content acquisition step for acquiring the health content from the health content output step; and a health content playback step for playing back the acquired health content.
[0035] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system, which is written in a manner that can be read and executed by a computer that is a vital sign measurement system, wherein the health content identification information is information for identifying at least one of the following content: content related to music and / or video, content related to stretching, content related to fitness, content related to yoga, content related to mindfulness and / or meditation, content related to fragrance, and content related to text and / or images.
[0036] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for a vital sign measurement system, which is a computer, and including emotional information, which is information indicating emotions obtained based on the results of facial expression analysis.
[0037] In addition to the above features, the present invention also provides an operating program for a vital sign measurement system that is written in a readable and executable manner for a computer that is a vital sign measurement system, wherein the emotional information is at least one or more of the following: information indicating "joy", information indicating "satisfaction", information indicating "relief", information indicating "tension", information indicating "neutral", information indicating "calm", information indicating "anger", "dissatisfaction", and information indicating "sadness". [Effects of the Invention]
[0038] As described above, the present invention provides a vital sign measurement system comprising a vital sign output device that acquires a still-face biometric video of a subject, acquires and outputs vital signs that have been analyzed and processed based on the still-face biometric video, and announces to the subject predetermined announcement content selected during and / or after the processing of the still-face biometric video, and a vital sign generation server that analyzes and processes the still-face biometric video of the subject acquired from the vital sign output device to generate and output vital signs. [Brief explanation of the drawings]
[0039] [Figure 1] FIG. 1 is a diagram showing a hardware configuration applied to the present invention. [Figure 2] FIG. 1 is a diagram showing an example of the overall configuration of a vital sign measurement system according to the present invention. [Figure 3] FIG. 1 is a diagram showing a functional configuration of a vital sign output device according to a first embodiment. [Figure 4] FIG. 1 is a diagram showing a hardware configuration of a vital sign output device according to a first embodiment. [Figure 5]FIG. 1 is a diagram showing a processing flow when the vital sign output device according to the first embodiment is used. [Figure 6] FIG. 10 is a diagram showing the functional configuration of a vital sign measurement system according to a second embodiment. [Figure 7a] FIG. 10 is a diagram showing the hardware configuration of a vital sign output device of a vital sign measurement system according to a second embodiment. [Figure 7b] FIG. 10 is a diagram showing the hardware configuration of a vital sign generation server of the vital sign measurement system according to the second embodiment. [Figure 8a] FIG. 10 is a diagram showing a processing flow when a vital sign output device of the vital sign measurement system according to the second embodiment is used. [Figure 8b] FIG. 10 is a diagram showing a processing flow when a vital sign generation server of the vital sign measurement system according to the second embodiment is used. [Figure 9] FIG. 10 is a diagram showing the functional configuration of a vital sign generation server according to a third embodiment. [Figure 10] FIG. 10 is a diagram showing the hardware configuration of a vital sign generation server in embodiment 3. [Figure 11] FIG. 10 is a diagram showing a processing flow when a vital sign generation server according to the third embodiment is used. [Figure 12] FIG. 10 is a diagram showing the functional configuration of a vital sign generation server according to a fourth embodiment. [Figure 13] FIG. 10 is a diagram showing the hardware configuration of a vital sign generation server in embodiment 4. [Figure 14] FIG. 10 is a diagram showing a processing flow when a vital sign generation server according to the fourth embodiment is used. [Figure 15] FIG. 13 is a diagram showing the functional configuration of a vital sign generation server according to a fifth embodiment. [Figure 16] FIG. 10 is a diagram showing the hardware configuration of a vital sign generation server in embodiment 5. [Figure 17] FIG. 10 is a diagram showing a processing flow when a vital sign generation server according to the fifth embodiment is used. [Figure 18]FIG. 13 is a diagram showing the functional configuration of a vital sign measurement system according to a sixth embodiment. [Figure 19a] FIG. 13 is a diagram showing the hardware configuration of a vital sign output device of a vital sign measurement system according to a sixth embodiment. [Figure 19b] FIG. 13 is a diagram showing the hardware configuration of a vital sign generation server of the vital sign measurement system according to the sixth embodiment. [Figure 20a] FIG. 20 is a diagram showing a flow when a vital sign output device of the vital sign measurement system according to the sixth embodiment is used. [Figure 20b] FIG. 20 is a diagram showing a flow when a vital sign generation server of the vital sign measurement system according to the sixth embodiment is used. [Figure 21] FIG. 1 is a diagram showing an example of an announcement content storage unit of a vital sign output device according to the present invention. [Figure 22] FIG. 10 is a diagram showing an example of an announcement content selection condition storage unit of the vital sign output device according to the present invention. [Figure 23] FIG. 1 shows an example (adult) of the standard values of vital signs in the present invention. [Figure 24] FIG. 1 is a diagram showing an example of a vital sign storage unit of a vital sign generation server according to the present invention. [Figure 25] FIG. 1 shows an example of a health content identification information storage unit of a vital sign generation server according to the present invention. [Figure 26] FIG. 10 is a diagram showing an example of a health content identification information selection rule storage unit of a vital sign generation server according to the present invention. [Figure 27] FIG. 10 is a diagram showing an example of a screen of the vital sign output device according to the present invention. [Figure 28] FIG. 10 is a diagram showing an example of a login screen of the vital sign output device according to the present invention. [Figure 29] FIG. 10 is a diagram showing an example of an initial screen of the vital sign output device according to the present invention. [Figure 30] FIG. 10 is a diagram showing an example of a measurement screen of the vital sign output device according to the present invention. [Figure 31]FIG. 10 is a diagram showing an example of a measurement result screen of the vital sign output device according to the present invention. [Figure 32] FIG. 10 is a diagram showing an example of a registration screen of the vital sign output device according to the present invention. [Figure 33] FIG. 1 shows an example of a health content acquisition screen of the vital sign output device of the present invention. [Figure 34] FIG. 1 shows an example of a health content playback screen of the vital sign output device of the present invention. [Figure 35] FIG. 1 shows an example of the concept of emotion estimation in the present invention.
[0040] <Hardware that can constitute the present invention>
[0041] FIG. 1 is a diagram showing a hardware configuration applied to the present invention. The present invention is, in principle, an invention that utilizes a computer, but it can also be realized by software, hardware, or the combination of software and hardware. The hardware that realizes all or part of the constituent elements of the present invention is composed of the basic components of a computer, such as a CPU, memory, bus, input / output devices, various peripheral devices, and a user interface. The various peripheral devices include storage devices, internet interfaces, internet devices, displays, keyboards, mice, speakers, cameras, videos, televisions, various sensors for understanding production conditions in laboratories or factories, etc. (flow sensors, temperature sensors, weight sensors, liquid volume sensors, infrared sensors, shipment counting machines, package counting machines, foreign body inspection machines, defective product counters, radiation inspection machines, surface condition inspection machines, circuit inspection machines, human presence sensors, devices for understanding worker work status (using video, ID, PC work volume, etc.)), CD devices, DVD devices, Blu-ray devices, USB memory, USB memory interfaces, removable hard disks, general hard disks, projector devices, SSDs, telephones, fax machines, copiers, printers, movie editing equipment, and various sensor devices. Furthermore, the present system does not necessarily have to be composed of a single device, but may be composed of multiple devices connected via communication. Communication may be via LAN, WAN, Wi-Fi, Bluetooth (registered trademark), infrared communication, or ultrasonic communication. Furthermore, some of the devices may be installed across borders. Furthermore, the multiple devices may be operated by different entities, or may be operated by a single entity. The system of the present invention may be operated by a single or multiple entities. The present invention may also be configured as a system that includes, in addition to the present system, a terminal used by a third party and a terminal used by yet another third party. These terminals may also be installed across borders. Furthermore, in addition to the present system and the aforementioned terminals, devices used to register related information about third parties, related persons, and databases for recording the registration details may also be provided. These may be included in the present system, or the present system may be configured to utilize such information by being installed outside the system.
[0042] As shown in Fig. 1, the computer is configured on a motherboard and includes a chipset, CPU, non-volatile memory, main memory, various buses, BIOS, various interfaces such as USB, HDMI (registered trademark), and LAN, a real-time clock, etc. These operate in cooperation with an operating system, device drivers (for various interfaces such as USB and HDMI (registered trademark), and various built-in devices such as cameras, microphones, speakers or headphones, and displays), various programs, etc. The various programs and data constituting the present invention are configured to efficiently utilize these hardware resources to execute various processes. Chipset
[0043] A "chipset" is a set of large-scale integrated circuits (LSI) mounted on a computer's motherboard that integrates a communication function, or bridge function, between the CPU's external bus and the standard bus that connects memory and peripheral devices. Two chipset configurations are used, or one chipset configuration. The northbridge is located on the side closest to the CPU and main memory, and the southbridge is located on the side farther away, which interfaces with relatively slow external I / O.
[0044] (Northbridge) The northbridge includes a CPU interface, memory controller, and graphics interface. Most of the functions of a conventional northbridge can be performed by the CPU. The northbridge connects to the main memory slot via a memory bus, and to the graphics card slot via a high-speed graphics bus (AGP, PCI Express).
[0045] (Southbridge) The southbridge connects to the PCI interface (PCI slot) via the PCI bus and handles I / O functions such as ATA (SATA), USB, and Ethernet interfaces, as well as sound functions. Incorporating circuits to support features such as PS / 2 ports, floppy disk drives, serial ports, parallel ports, and ISA buses, which do not require or are not capable of high-speed operation, would hinder the speed of the chipset itself, so these can be separated from the southbridge chip and placed in a separate LSI called a super I / O chip. Buses are used to connect the CPU (MPU) to peripheral devices and various control units. Buses are connected by the chipset. The memory bus used to connect to main memory may instead use a channel structure for increased speed. A serial bus or a parallel bus can be used as the bus. While a serial bus transfers data one bit at a time, a parallel bus transmits the original data or multiple bits extracted from the original data as a single block over multiple communication paths simultaneously. A dedicated line for the clock signal runs parallel to the data line, synchronizing data demodulation on the receiving side. It is also used as a bus to connect the CPU (chipset) to external devices, and includes GPIB, IDE / (Parallel) ATA, SCSI, PCI, etc. Because there is a limit to how fast it can be made, in PCI Express, an improved version of PCI, and Serial ATA, an improved version of Parallel ATA, the data line can be a serial bus.
[0046] CPU
[0047] A CPU sequentially reads, interprets, and executes a sequence of instructions called a program stored in main memory, outputting signal-based information to the main memory. The CPU functions as the center of computation within a computer. A CPU consists of a CPU core, which is the center of computation, and its peripheral components, including registers, cache memory, an internal bus connecting the cache memory to the CPU core, a DMA controller, a timer, and an interface with the bus connecting to the north bridge. A single CPU (chip) may have multiple CPU cores. Processing may also be performed by a graphics interface (GPU) or FPU in addition to the CPU. While the embodiments are described as being of a two-core type, this is not limiting. Programs may also be embedded within the CPU.
[0048] <Non-volatile memory>
[0049] (HDD)
[0050] The basic structure of a hard disk drive consists of a magnetic disk, a magnetic head, and an arm on which the magnetic head is mounted. The external interface can be SATA (formerly ATA). A high-performance controller, such as SCSI, is used to support communication between hard disk drives. For example, when copying a file to another hard disk drive, the controller can read the sectors, transfer them to the other hard disk drive, and write them. This does not access the host CPU's memory, so there is no increase in the CPU load.
[0051] <Main memory>
[0052] The CPU directly accesses and executes various programs in main memory. Main memory is volatile memory and uses DRAM. Programs in main memory are expanded from non-volatile memory to main memory upon receiving a program startup command. The CPU then executes the program according to various execution commands and execution procedures within the program.
[0053] Operating System (OS)
[0054] An operating system (OS) is used to manage computer resources for use by applications, to manage various device drivers, and to manage the computer itself (the hardware). Small computers sometimes use firmware as their operating system.
[0055] ≪BIOS≫
[0056] The BIOS causes the CPU to execute procedures for starting up the computer hardware and running the operating system. It is most typically the hardware that the CPU reads first when it receives a computer startup command. The BIOS contains the address of the operating system stored on the disk (non-volatile memory), and the BIOS loaded into the CPU sequentially loads the operating system into main memory, putting it into operation. The BIOS also has a check function that checks the presence or absence of various devices connected to the bus. The check results are stored in main memory and made available to the operating system as appropriate. The BIOS may also be configured to check for external devices, etc. The above applies to all embodiments.
[0057] As shown in Figure 1, the present invention can basically be configured with a general-purpose computer program and various devices. The computer basically operates by loading a program recorded in non-volatile memory into main memory, and then executing processing using the main memory, CPU, and various devices. Communication with devices is performed via an interface connected to a bus line. Possible interfaces include a display interface, keyboard, and communication buffer. Below, an embodiment of the present invention will be described with reference to illustrative examples.
[0058] <Fulfillment of the Laws of Nature of the Invention>
[0059] The present invention functions through the cooperation of a computer, communications equipment, and software. Specifically, the present invention relates to a vital sign measurement system comprising a vital sign output device that acquires a still biometric facial video of a subject, analyzes and processes the video, and outputs the subject's vital signs based on the acquired still biometric facial video, and announces to the subject predetermined announcement content selected during and / or after the processing of the still biometric facial video. The vital sign output device and a vital sign generation server that analyzes and processes the still biometric facial video of the subject acquired from the vital sign output device to generate and output vital signs. Various information and data are exchanged via a network using hardware resources, such as the vital sign output device used by the subject and an administrator terminal primarily used by an administrator responsible for operating and managing the system. Therefore, from this perspective, the present invention, when considered based on the claims and specification and the common general knowledge related to those matters, utilizes a law of nature as a whole and is a computer-software-related invention.
[0060] <The significance of utilizing the laws of nature required by patent law>
[0061] The Patent Act requires that an invention be industrially applicable and contribute to the development of industry. This requirement ensures that the invention is industrially applicable. In other words, the invention must be industrially useful; that is, the effects of the invention declared in the application must be reproducible with a certain degree of certainty through the practice of the invention. From this perspective, the application of the laws of nature is interpreted as the use of the laws of nature to achieve the functions of each of the invention's defining features (invention elements), which constitute the invention's effects. Furthermore, the effect of an invention is sufficient if it has the potential to provide a specific utility to users who use the invention, and should not be viewed in terms of how users feel or think about that utility. Therefore, even if the effect users gain from the system is a psychological effect, that effect itself does not fall within the scope of the required application of the laws of nature. DETAILED DESCRIPTION OF THE INVENTION
[0062] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The relationships between the embodiments and the claims are as follows: The explanation of embodiment 1 mainly relates to claims 1, 11, and 21, the explanation of embodiment 2 relates to claims 3, 13, and 23, embodiment 3 relates to claims 4, 14, and 24, embodiment 4 relates to claims 5, 15, and 25, embodiment 5 relates to claims 6, 16, and 26, and embodiment 6 relates to claims 7, 17, and 27. The present invention should not be limited to these embodiments and may be embodied in various forms without departing from the spirit of the invention.
[0063] <Overall configuration of the vital signs measurement system of the present invention> FIG. 2 is a diagram showing an example of the overall configuration of the vital sign measurement system according to the present invention. The vital sign measurement system 200 is composed of a vital sign generation server having the functions of analyzing and processing the acquired still face biometric video, outputting the analysis processing status, generating vital signs based on the analysis processing, retaining the generated vital signs, and outputting the generated vital signs, and a vital sign output device 202 having the functions of acquiring a still face biometric video of a subject, accepting a command to start acquiring a still face biometric video, selecting from announcement content retained during and / or after processing of the still face biometric video and announcing it to the subject, acquiring vital signs from outside, retaining the acquired vital signs, and outputting the acquired vital signs. Furthermore, the vital sign measurement system 200 is configured to be electrically connectable to the vital sign output device 202 and the administrator terminal 203 via a network 204 (for example, the Internet, a WAN, a LAN, etc.). Here, the vital sign output device 202 and the administrator terminal 203 may be electronic devices (for example, a personal computer, a tablet terminal, a smartphone, a smart mirror, etc.) that can be connected to the network 204 via a wired or wireless interface (for example, a communication cable or a WiFi router, etc.). Furthermore, the term "subject" refers to a person who uses the vital sign output device 202 to measure his or her own vital signs using the vital sign measurement system 200. For example, in the case of a company aiming for health management, employees or executives of the company may be included in the term "subject." Furthermore, an "administrator" is a person who is responsible for managing and operating the entire vital sign measurement system 200 (for example, this may include an individual, or the institution, organization, or corporation to which the individual belongs. It may also include an employee of a government agency or local government, or an institution, organization, or corporation commissioned by a government agency or local government), and may have the authority to edit, add, or delete various information in the vital sign measurement system. For example, in a company aiming for health management, a labor manager in the human resources department may take on this role. In addition, the present invention uses rPPG (Remote Photoplethysmography) technology to measure and analyze small changes in color beneath the epidermis of the skin caused by blood vessel vibrations through images, thereby enabling vital signs to be analyzed and estimated.
[0064] Note that, although the present invention will be described on the assumption that it is configured to function on the same vital sign generation server 201, this is not limiting, and a configuration may also be adopted in which multiple servers are provided, and these servers exchange information and data with each other to execute various functions in cooperation or collaboration. For example, the vital sign generation server 201 may be configured as multiple cloud servers, or as an on-premise local server.
[0065] <Embodiment 1 (corresponding mainly to claims 1, 11, and 21)> <Outline of Embodiment 1> This embodiment provides a vital sign output device that acquires a still face biometric video, which is a still biometric video of a subject's face, and outputs it to the outside, and selects and announces from multiple announcement contents depending on the processing of the still face biometric video, and acquires and outputs the subject's vital signs from the outside.
[0066] <Functional Configuration of Embodiment 1> 3 is a diagram showing the functional configuration of the vital sign output device in embodiment 1. In this embodiment, the device includes a still face biometric video acquisition unit, a start command receiving unit, a still face biometric video acquisition control unit, an announcement content storage unit, an announcement content selection condition storage unit, an announcement content selection unit, an announcement unit, a vital sign acquisition unit, a vital sign storage unit, and a vital sign output unit.
[0067] <Configuration of Embodiment 1: Still Face Biometric Video Acquisition Unit> The 'still face biometric moving image acquisition unit' 301 is configured to have a function of acquiring a still face biometric moving image, which is a still face biometric moving image of the subject's face. For example, this can be achieved by capturing a still biometric video of the subject's face using the camera built into the subject's smartphone. The video codec used in this case may be H.264 (AVC) or H.265 (HEVC). A frame rate of 30 fps is sufficient, but a higher frame rate is acceptable.
[0068] <Configuration of Embodiment 1: Start Command Receiving Unit> The 'start command receiving unit' 302 is configured to have a function of receiving a start command, which is a command to start acquiring a still face biometric moving image. Fig. 27 is a diagram showing an example of a screen of the vital sign output device, and Fig. 28 is a diagram showing an example of a login screen of the vital sign output device. For example, first, a "vital measurement" icon appears on the screen of the smartphone used by the subject. By touching or tapping this "vital measurement" icon, the subject transitions to a login screen. Then, the subject enters the subject's identification information and password on this login screen, and the system authenticates the subject. If there are no problems, the authentication is completed. 29 is a diagram showing an example of the initial screen of the vital sign output device. Once personal authentication is complete, the screen changes to this screen, and by touching or tapping the area displaying "Vital Sign Measurement Camera," a start command is accepted.
[0069] <Configuration of Embodiment 1: Still Face Biometric Video Acquisition Control Unit> The 'still face biometric moving image acquisition control section' 303 is configured to have a function of controlling the still face biometric moving image acquisition section in accordance with the analysis processing status after receiving a start command. Here, for example, if the "analysis processing status" is information indicating that the still face biometric video has been successfully acquired on the system side, the operation of the still face biometric video acquisition unit is terminated. If the "analysis processing status" is information indicating that an abnormality (error) has occurred on the system side and the still face biometric video has not been successfully acquired, the operation of the still face biometric video acquisition unit is resumed and shooting is performed. In other words, it is desirable to configure the system so that if the system can successfully acquire a still face biometric video, it will stop the camera on the smartphone used by the subject, and if an abnormality (error) occurs on the system and the system cannot successfully acquire a still face biometric video, it will restart the camera on the smartphone used by the subject.
[0070] <Configuration of the First Embodiment: Announcement Content Storage Unit> The 'storage unit for announcement content' 304 is configured to have a function of storing a plurality of announcement contents, which are contents to be announced by the announcement unit described later. 21 is a diagram showing an example of the announcement content unit. As shown in this diagram, it is preferable that the announcement content storage unit 304 stores a plurality of various announcement contents that alert the target person by voice and / or display, notifying the target person of the occurrence of an error, etc.
[0071] <Configuration of the First Embodiment: Announcement Content Selection Condition Storage Unit> The 'storage unit for announcement content selection conditions' 305 is configured to have a function of storing announcement content selection conditions for selecting announcement content from the stored announcement content in accordance with processing of still face biological moving images. FIG. 22 is a diagram illustrating an example of the announcement content selection condition storage unit. As shown in this diagram, the processing of still-face biometric moving images may specifically include a moving image capturing process, a captured moving image transmission process, an Ack reception process, and an analysis process. For example, the video recording process refers to a process in which a subject takes a still, biometric video of the subject's own face using a camera built into the subject's smartphone. At this time, if the video recording process is performed normally, the condition of selecting announcement content identified by announcement content identification information, such as AAA001 "Starting vital sign measurement," AAA002 "Vital sign measurement in progress," or AAA003 "Please do not move your face," is maintained. On the other hand, if an abnormality (error) occurs in the video shooting process, the condition is maintained that the announcement content identified by the announcement content identification information, for example, EEE001 "Vital sign measurement failed" or EEE002 "Please try again," is selected. In this case, the abnormality (error) may be that the face position is outside the range of the camera's angle of view, the face is not still but is moving, or the image of the face is dark due to insufficient ambient light.
[0072] For example, the video transmission process refers to the process of transmitting a still biometric facial video taken by the subject to the system. At this time, if the video transmission process is being performed normally, the conditions of selecting AAA002 "Vital signs being measured" and AAA003 "Please do not move your face" are maintained. On the other hand, if an error occurs in the video transmission process, the conditions for selecting, for example, EEE001 "Failed to measure vital signs" or EEE002 "Please try again" are maintained. In this case, the error may be caused by a malfunction of a device that makes up the network, or by a smartphone or other device going out of the wireless service range.
[0073] For example, the Ack reception process refers to the process of transmitting a still biometric video of a subject's face taken by the subject to the system and receiving an Ack (acknowledgment) indicating that the system has successfully received all of the still biometric video of the face. Here too, if the Ack reception process is performed successfully, the conditions for selecting AAA002 "Vital signs measurement in progress" and AAA003 "Please do not move your face" are maintained. On the other hand, if an error occurs in the Ack reception process, the conditions are maintained to select, for example, EEE001 "Vital sign measurement failed" or EEE002 "Please try again." In this case, the error may be due to a congested and unstable network, causing a high error rate, or information being lost during transmission or being unable to be resent.
[0074] For example, the analysis process refers to the process of generating vital signs by analyzing still-face biometric video received by the system. Here, if the analysis process is performed normally, the conditions for selecting, for example, BBB001 "Vital signs analysis in progress," BBB002 "Please wait a little longer," or BBB003 "Vital signs analysis completed" are held. On the other hand, if an abnormality occurs in the analysis process, the conditions are maintained to select, for example, EEE003 "An error has occurred" or EEE004 "Please start again from the beginning." In this case, the abnormality (error) may be a failure of a single server that handles the analysis process on the system side, or an abnormal value (error value) may occur due to a malfunction in information exchange when multiple servers work together to perform processing. Although the above four processes have been described as "processing of still-face biometric video," the present invention is not limited to these. The processing of still-face biometric video may be further divided into smaller categories, and the number of conditions for selecting announcement content may be increased accordingly.
[0075] <Configuration of Embodiment 1: Announcement Content Selection Unit> The 'announcement content selection unit' 306 is configured to have a function of selecting the held announcement content based on the status of processing of the still face biological moving image and the held announcement content selection conditions.
[0076] For example, based on the situation where the video recording process is being performed normally and the stored announcement content selection conditions, i.e., the condition to select AAA001, AAA002, and AAA003, the announcement content selection unit 306 selects the stored announcement contents AAA001 "Starting vital sign measurement," AAA002 "Vital sign measurement in progress," and AAA003 "Please do not move your face." On the other hand, based on the situation in which an abnormality has occurred in the video recording process and the stored announcement content selection conditions, i.e., the condition to select EEE001 and EEE002, the announcement content selection unit 306 selects the stored announcement contents EEE001 ``Vital sign measurement failed'' and EEE002 ``Please try again.''
[0077] For example, based on the situation where the captured video transmission process is being performed normally and the stored announcement content selection conditions, i.e., the condition to select AAA002 and AAA003, the announcement content selection unit 306 selects the stored announcement contents AAA002 ``Vital signs being measured'' and AAA003 ``Please do not move your face.'' On the other hand, based on the situation in which an abnormality has occurred in the video transmission process and the stored announcement content selection conditions, i.e., the condition to select EEE001 and EEE002, the announcement content selection unit 306 selects the stored announcement contents EEE001 "Vital sign measurement failed" and EEE002 "Please try again."
[0078] For example, based on the situation where the Ack reception processing is being performed normally and the stored announcement content selection conditions, i.e., the condition to select AAA002 and AAA003, the announcement content selection unit 306 selects the stored announcement contents AAA002 "Vital signs being measured" and AAA003 "Please do not move your face." On the other hand, based on the situation in which an abnormality has occurred in the Ack reception processing and the stored announcement content selection conditions, i.e., the condition to select EEE001 and EEE002, the announcement content selection unit 306 selects the stored announcement contents EEE001 "Vital sign measurement failed" and EEE002 "Please try again."
[0079] For example, based on the situation that the analysis process is being performed normally and the stored announcement content selection conditions, i.e., the condition to select BBB001, BBB002, and BBB003, the announcement content selection unit 306 selects the stored announcement contents BBB001 ``Vital sign analysis in progress,'' BBB002 ``Please wait a little longer,'' and BBB003 ``Vital sign analysis has been completed.'' On the other hand, based on the situation in which an abnormality has occurred in the analysis process and the stored announcement content selection conditions, i.e., the condition to select EEE003 and EEE004, the announcement content selection unit 306 selects the stored announcement contents EEE003 "An error has occurred" and EEE004 "Please start over again."
[0080] <Configuration of Embodiment 1: Announcement Unit> The 'announcement unit' 307 is configured to have a function of announcing to the target person the announcement content selected by the announcement content selection unit during and / or after processing of the still face biological moving image.
[0081] For example, during processing of still face biometric video, such as video shooting processing, video shooting transmission processing, and Ack reception processing, the announcement unit 307 announces to the subject by voice and / or display one of the selected announcement contents, i.e., AAA001 "Starting vital sign measurement," AAA002 "Vital sign measurement in progress," and AAA003 "Please do not move your face," or EEE001 "Vital sign measurement failed," and EEE002 "Please try again." FIG. 30 shows an example of a measurement screen of the vital sign output device. As shown in this figure, while a still face biometric video is being captured, announcement content such as "Vital signs being measured" and "Please do not move your face" is announced to the subject by voice and / or display. Here, a horizontal indicator may be used as the indicator, and a guideline number may be displayed as a percentage (%) depending on the status of various processes, to support the announcement to the subject.
[0082] For example, after processing a still face biometric video, such as in the case of analysis processing, the announcement unit 307 announces to the subject by voice and / or display one of the selected announcement contents, i.e., BBB001 "Vital signs analysis in progress", BBB002 "Please wait a little longer", and BBB003 "Vital signs analysis has completed", or EEE003 "An error has occurred", and EEE004 "Please start again from the beginning". By announcing announcement content to the target person by voice and / or display in the manner described above, it is possible to provide a user-friendly and easy-to-use device.
[0083] <Configuration of Embodiment 1: Vital Sign Acquisition Unit> The 'vital sign acquisition unit' 308 is configured to have a function of acquiring at least one vital sign from an external device. In this embodiment, pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, body surface temperature, and stress index are acquired as vital signs, but are not limited to these. For example, in addition to the above, possible vital signs include blood sugar levels, facial expression analysis results, anxiety / drowsiness levels, depression levels, dementia levels, nutritional analysis results, skin health levels, muscle mass, age, BMI index, and dehydration levels.
[0084] <Embodiment 1: Description of Configuration: Vital Signs Storage Unit> The 'vital sign storage unit' 309 is configured to have the function of storing the acquired vital signs. For example, the data may be stored in ascending or descending order of the measurement date and time for easy management.
[0085] <Configuration of Embodiment 1: Vital Sign Output Unit> The 'vital sign output unit' 309 is configured to have the function of outputting the acquired vital signs. FIG. 31 is a diagram showing an example of a measurement result screen of the vital sign output device. FIG. 23 is a diagram showing an example of a guideline for reference values of vital signs (for an adult). As shown in these figures, it is preferable that the acquired vital signs, i.e., pulse rate (heart rate), oxygen saturation, blood pressure (diastolic and systolic), body surface temperature (body temperature), and stress index, are output together with their values and an indicator of how they compare to reference values, i.e., whether they fall within the "normal," "caution," or "danger" range. Here, "caution" indicates a state in which the patient has not yet developed a disease, but may develop one if they continue to maintain the same lifestyle habits. It is therefore important to consult a medical professional and take appropriate daily precautions. Meanwhile, "danger" indicates a state in which the patient may already be suffering from a disease, and some symptoms may be present. It is therefore important to visit a medical institution as soon as possible for a medical examination, consult with a doctor, and decide on a treatment plan and implement it.
[0086] <Embodiment 1: Vital Sign Output Device: Hardware Configuration> The hardware configuration of the vital sign output device according to this embodiment will be described with reference to the drawings.
[0087] 4 is a diagram showing the hardware configuration of the vital sign output device of this embodiment. As shown in this diagram, the vital sign output device of this embodiment includes a "CPU (Central Processing Unit)" 401 that performs various arithmetic processing, and a "main memory" 402. It also includes a "non-volatile memory" 403 that stores predetermined information, and a "network I / F (interface)" 404 that transmits and receives information to and from a vital sign generation server 406 and an administrator terminal 407. These components are interconnected by a data communication path such as a "bus" 405, and perform information transmission and reception and processing.
[0088] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area for the programs. Furthermore, multiple addresses are assigned to each of the "main memory" and "non-volatile memory." Programs executed by the "CPU" can exchange data and perform processing by identifying and accessing these addresses. In this embodiment, the programs stored in the "main memory" include a still face biometric video acquisition program, a start command reception program, a still face biometric video acquisition control program, an announcement content storage program, an announcement content selection condition storage program, an announcement content selection program, an announcement program, a vital sign acquisition program, a vital sign storage program, and a vital sign output program. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, a start command, analysis processing status information, announcement content information, announcement content selection condition information, vital sign information, and the like.
[0089] The "CPU" executes a still face biometric video acquisition program stored in the "main memory" to acquire a still face biometric video, which is a still face biometric video of the subject's face, for analysis processing, and stores the still face biometric video information in the "main memory" or "non-volatile memory." It also executes a start command reception program stored in the "main memory" to accept a start command, which is a command to start acquiring a still face biometric video, and stores the start command in the "main memory" or "non-volatile memory." It also executes a still face biometric video acquisition control program stored in the "main memory" to control the still face biometric video acquisition program in accordance with the analysis processing status after accepting the start command, and stores analysis processing status information in the "main memory" or "non-volatile memory." It also executes an announcement content storage program stored in the "main memory" to store multiple announcement contents, which are content to be announced by the announcement program described below, and stores the announcement content information in the "main memory" or "non-volatile memory." The system also executes an announcement content selection condition retention program stored in the "main memory" to retain announcement content selection conditions for selecting announcement content from the retained announcement content in accordance with the processing of the still face biometric video, and stores the announcement content selection condition information in the "main memory" or "non-volatile memory." The system also executes an announcement content selection program stored in the "main memory" to select retained announcement content based on the processing status of the still face biometric video and the retained announcement content selection conditions. The system also executes an announcement program stored in the "main memory" to announce to the target person the announcement content selected by the announcement content selection program during and / or after the processing of the still face biometric video. The system also executes a vital sign acquisition program stored in the "main memory" to acquire at least one vital sign from an external source. The system also executes a vital sign retention program stored in the "main memory" to retain the acquired vital signs, and store the vital signs in the "main memory" or "non-volatile memory."It also executes a vital sign output program stored in the "main memory" to output the acquired vital signs.
[0090] <Embodiment 1 Vital Sign Output Device: Processing Flow> 5 is a diagram showing a processing flow when the vital sign output device of this embodiment is used. As shown in the figure, the processing method includes a still face biometric moving image acquisition step S501, a start command reception step S502, a still face biometric moving image acquisition control step S503, an announcement content storage step S504, an announcement content selection condition storage step S505, an announcement content selection step S506, an announcement step S507, a vital sign acquisition step S508, a vital sign storage step S509, and a vital sign output step S510.
[0091] The "still face biometric moving image acquisition step" S501 is a stage of acquiring a still face biometric moving image, which is a still face biometric moving image of the subject's face, for analysis processing.
[0092] The "start command receiving step" S502 is a stage in which a start command is received, which is a command to start obtaining a still face biometric moving image.
[0093] The "still face biometric moving image acquisition control step" S503 is a stage for controlling the still face biometric moving image acquisition step S501 according to the analysis processing status after receiving a start command.
[0094] The "announcement content holding step" S504 is a stage in which a plurality of announcement contents, which are contents to be announced in the announcement step described later, are held.
[0095] The "step of holding announcement content selection conditions" S505 is a stage of holding announcement content selection conditions for selecting announcement content in accordance with processing of still face biological moving images from the held announcement content.
[0096] The "announcement content selection step" S506 is a stage in which the held announcement content is selected based on the status of processing of the still face biometric moving image and the held announcement content selection conditions.
[0097] The "announcement step" S507 is a step of announcing to the target person the announcement content selected during and / or after processing the still face biometric moving image.
[0098] The "vital sign acquisition step" S508 is a step of acquiring at least one vital sign from the outside.
[0099] The "vital sign storage step" S509 is a stage in which the acquired vital signs are stored.
[0100] The "vital sign output step" S510 is a step of outputting the acquired vital signs.
[0101] <Summary> As described above, the present invention provides a vital sign output device that acquires a still face biometric video, which is a still biometric video of a subject's face, and outputs it to the outside, and selects and announces from a plurality of announcement contents depending on the processing of the still face biometric video, and acquires and outputs the subject's vital signs from the outside.
[0102] <Embodiment 2 (corresponding mainly to claims 3, 13, and 23)> <Outline of Embodiment 2> This embodiment provides a vital sign measurement system comprising a vital sign output device that acquires and outputs a still biometric video of a subject's face, and a vital sign generation server that acquires the still biometric video of the subject's face, performs analysis processing, and generates and outputs vital signs.
[0103] <Functional Configuration of Second Embodiment> 6 is a diagram showing the functional configuration of a vital sign measurement system in embodiment 2. Based on embodiment 1, this embodiment provides a vital sign measurement system including a vital sign output device and a vital sign generation server. The vital sign output device has a streaming output unit that streams out the acquired still face biometric video of the subject, and the vital sign acquisition unit has an external acquisition means that acquires vital signs generated based on the still face biometric video output from the streaming output unit from a vital sign generation server described below. The vital sign generation server includes a still face biometric video streaming acquisition unit that acquires streaming still face biometric video, an analysis processing unit that analyzes and processes the acquired still face biometric video, an analysis processing status output unit that outputs the analysis processing status in the analysis processing unit, a vital sign generation unit that generates vital signs based on the analysis processing in the analysis processing unit, a vital sign storage unit that stores the generated vital signs, and a vital sign output unit that outputs the generated vital signs. Note that the description of the functional configuration, hardware configuration, and processing flow that are the same as those in the first embodiment will be omitted as appropriate and necessary.
[0104] <Configuration of Second Embodiment: Streaming Output Unit in Vital Sign Output Device> The 'streaming output unit' 611 is configured to have a function of streaming outputting the acquired still and living body moving image of the subject's face. In this way, by outputting a still face biometric video in streaming format, the time required to obtain vital signs can be shortened. For example, with the present invention, vital signs can be obtained in as little as 10 seconds.
[0105] <Configuration of Second Embodiment: External Acquisition Means in Vital Sign Output Device> The “external acquisition means” 612 is provided in the vital sign acquisition unit 608 and is configured to have the function of acquiring vital signs generated based on the still face biometric video output from the streaming output unit from the vital sign generation server described below. In this embodiment, pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, body surface temperature, and stress index are acquired as vital signs, but are not limited to these. For example, in addition to the above, possible vital signs include blood sugar levels, facial expression analysis results, anxiety / drowsiness levels, depression levels, dementia levels, nutritional analysis results, skin health levels, muscle mass, age, BMI index, and dehydration levels.
[0106] <Configuration of Second Embodiment: Still Face Biometric Video Streaming Acquisition Unit in Vital Sign Generation Server> The 'still face biometric moving image streaming acquisition unit' 621 is configured to have a function of acquiring still face biometric moving images in streaming form. For example, it is desirable that the vital sign output device be configured so that a still face biological video in streaming format can be acquired in streaming format output from a streaming output unit of the vital sign output device.
[0107] <Configuration of Second Embodiment: Analysis Processing Unit in Vital Sign Generation Server> The 'analysis processing unit' 622 is configured to have a function of analyzing and processing the acquired still face biometric moving image. This allows us to process various information that forms the basis of vital signs from still facial biometric video.
[0108] <Configuration of Second Embodiment: Analysis Processing Status Output Unit in Vital Sign Generation Server> The 'analysis processing status output unit' 623 is configured to have the function of outputting the analysis processing status in the analysis processing unit. For example, information on how far the analysis processing status has progressed is output to the vital sign output device, which serves as a trigger for selecting and outputting announcement content in the vital sign output device.
[0109] <Configuration of Second Embodiment: Vital Sign Generation Unit in Vital Sign Generation Server> The 'vital sign generation unit' 624 is configured to have the function of generating vital signs based on the analysis processing in the analysis processing unit. In this embodiment, pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, body surface temperature, and stress index are generated as vital signs. However, the vital signs are not limited to these. For example, other vital signs may include blood glucose level, facial expression analysis results, anxiety / drowsiness level, depression level, dementia level, nutritional analysis results, skin health level, muscle mass, age, BMI index, and dehydration level.
[0110] <Configuration of Second Embodiment: Vital Sign Storage Unit in Vital Sign Generation Server> The 'vital sign storage unit' 625 is configured to have the function of storing the generated vital signs. 24 is a diagram showing an example of a vital sign storage unit in the vital sign generation server. As shown in this diagram, it is preferable to store vital signs generated for each subject's identification information (e.g., employee number or personal number (My Number information)) together with the measurement date and time.
[0111] <Configuration of Second Embodiment: Vital Sign Output Unit in Vital Sign Generation Server> The 'vital sign output unit' 626 is configured to have the function of outputting the generated vital sign. For example, it is preferable that the vital sign output unit be able to output the generated vital sign to the vital sign output device that has sent the still face biological video.
[0112] Here, the vital signs may include emotion information, which is information indicating emotions acquired based on the results of analyzing the facial expressions of the subject. Furthermore, the emotion information may include at least one of information indicating "joy", information indicating "satisfaction", information indicating "relief", information indicating "tension", information indicating "normal", information indicating "calm", information indicating "anger", "dissatisfaction", and information indicating "sadness". FIG. 35 is a diagram illustrating an example of the concept of emotion estimation. RRI (RR Interval) is the time interval between the R wave, which indicates the contraction of the ventricles in an electrocardiogram, and the next R wave. In other words, as shown in the figure, RRI can be calculated by calculating the peak time of the waveform and obtaining the result value of pNN. Furthermore, pNNx is an index where the greater the proportion of RRI differences between adjacent waves exceeding x (ms) among N RRIs, the more calm is perceived. Specifically, by setting pNNx (simply put, heart rate) on the horizontal axis and the results of the subject's facial expression analysis (positive to neutral to negative) on the vertical axis, the subject's emotions can be estimated. In other words, on the horizontal axis, the further left you go, the more tense you are, and the further right you go, the more calm (relaxed) you are. On the vertical axis, the higher you go, the more positive you are, and the lower you go, the more negative you are. By using this information, the above-mentioned emotional information can be estimated.
[0113] <Embodiment 2: Vital Sign Output Device in Vital Sign Measurement System: Hardware Configuration> The hardware configuration of the vital sign output device in the vital sign measurement system of this embodiment will be described with reference to the drawings.
[0114] 7a is a diagram showing the hardware configuration of a vital sign output device in a vital sign measurement system according to this embodiment. As shown in this diagram, the vital sign output device according to this embodiment includes a "CPU (Central Processing Unit)" 701 that performs various types of arithmetic processing, and a "main memory" 702. It also includes a "non-volatile memory" 703 that stores predetermined information, and a "network I / F (interface)" 704 that transmits and receives information to and from a vital sign generation server 706 and an administrator terminal 707. These components are interconnected by a data communication path such as a "bus" 705, and perform information transmission and reception and processing.
[0115] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area that is a work area for the programs. Furthermore, multiple addresses are assigned to the "main memory" and "non-volatile memory," and programs executed by the "CPU" can exchange data and perform processing by identifying and accessing these addresses. In this embodiment, the programs stored in the "main memory" include streaming output programs and external acquisition subprograms. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, start commands, analysis processing status information, announcement content information, announcement content selection condition information, vital sign information, and the like.
[0116] The "CPU" executes a streaming output program stored in the "main memory" to stream output the acquired still face biometric video to the vital sign generation server, and also executes an external acquisition subprogram stored in the "main memory" to acquire from the vital sign generation server vital signs generated based on the still face biometric video output by executing the streaming output program, and stores the acquired vital sign information in the "main memory" or the "non-volatile memory."
[0117] 7b is a diagram showing the hardware configuration of the vital sign generation server in the vital sign measurement system of this embodiment. As shown in this diagram, the vital sign generation server of this embodiment includes a "CPU (Central Processing Unit)" 721 that performs various arithmetic processing, and a "main memory" 722. It also includes a "non-volatile memory" 723 that stores predetermined information, and a "network I / F (interface)" 724 that transmits and receives information to and from a vital sign output device 726 and an administrator terminal 727. These components are interconnected by a data communication path such as a "bus" 725, and perform information transmission and reception and processing.
[0118] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area that is also a work area for those programs. Furthermore, multiple addresses are assigned to each of the "main memory" and "non-volatile memory," and programs executed by the "CPU" can exchange data and perform processing by identifying and accessing those addresses. In this embodiment, the programs stored in the "main memory" include a still face biometric video streaming acquisition program, an analysis processing program, an analysis processing status output program, a vital sign generation program, a vital sign retention program, and a vital sign output program. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, analysis processing status information, vital sign information, and the like.
[0119] The "CPU" executes a still face biometric video streaming acquisition program stored in the "main memory" to acquire a still face biometric video stream and store it in the "main memory" or "non-volatile memory." It also executes an analysis processing program stored in the "main memory" to analyze and process the acquired still face biometric video. It also executes an analysis processing status output program stored in the "main memory" to output the analysis processing status while the analysis processing program is being executed and store analysis processing status information in the "main memory" or "non-volatile memory." It also executes a vital sign generation program stored in the "main memory" to generate vital signs based on the analysis processing in the analysis processing program. It also executes a vital sign retention program stored in the "main memory" to retain the generated vital signs and store the vital sign information in the "main memory" or "non-volatile memory." It also executes a vital sign output program stored in the "main memory" to output the generated vital signs to a vital sign output device.
[0120] <Second embodiment: Vital sign output device in vital sign measurement system: processing flow> 8a is a diagram showing the flow of processing when the vital sign output device of this embodiment is used. As shown in the diagram, the processing method is made up of an external acquisition step S808 and a streaming output step S811.
[0121] The "external acquisition step" S808 is a stage in which vital signs generated based on the still-face biological moving image output in the streaming output step described later are acquired from a vital sign generation server.
[0122] The "streaming output step" S811 is a step of streaming outputting the acquired still face biometric moving image.
[0123] <Processing flow of vital sign generation server in vital sign measurement system in embodiment 2> 8b is a diagram showing the processing flow when the vital sign generation server of this embodiment is used. As shown in the figure, the processing method includes a still face biometric video streaming acquisition step S821, an analysis processing step S822, an analysis processing status output step S823, a vital sign generation step S824, a vital sign storage step S825, and a vital sign output step S826.
[0124] The "still face biometric video streaming acquisition step" S821 is a step of acquiring a still face biometric video streaming.
[0125] The "analysis processing step" S822 is a stage in which the acquired still face biometric moving image is analyzed.
[0126] The "analysis processing status output step" S823 is a stage in which the analysis processing status in the analysis processing step is output.
[0127] The "vital sign generation step" S824 is a stage in which vital signs are generated based on the analysis processing in the analysis processing step.
[0128] The "vital sign storage step" S825 is a step for storing the generated vital signs.
[0129] The "vital sign output step" S826 is a step of outputting the generated vital signs.
[0130] <Summary> From the above, the present invention provides a vital sign measurement system comprising a vital sign output device that acquires and outputs a still biometric video of a subject's face, and a vital sign generation server that acquires a still biometric video of the subject's face, performs analysis processing, and generates and outputs vital signs.
[0131] <Embodiment 3 (corresponding mainly to claims 4, 14, and 24)> <Outline of Embodiment 3> This embodiment provides a vital sign measurement system equipped with a vital sign generation server that receives a vital sign output request from a terminal, determines whether the request is appropriate, and if it is determined to be appropriate, controls the terminal that made the output request to output the vital sign.
[0132] <Functional Configuration of Third Embodiment> 9 is a diagram showing the functional configuration of a vital sign generation server in a vital sign measurement system in embodiment 3. This embodiment provides a vital sign generation server for a vital sign measurement system based on embodiments 1 and 2. The vital sign generation server includes a vital sign output request receiving unit that receives a vital sign output request from a terminal, an output request judgment unit that judges whether the received output request is an appropriate request, and an output control unit that controls the vital sign output unit to output the vital sign to the terminal that made the output request when the judgment result of the output judgment unit is that the request is appropriate. It should be noted that the description of the functional configuration, hardware configuration, and processing flow similar to those of the first and second embodiments will be omitted as appropriate and as necessary.
[0133] Third Embodiment: Configuration of Vital Sign Output Request Receiving Unit in Vital Sign Generation Server The 'vital sign output request receiving unit' 927 is configured to have a function of receiving a vital sign output request from a terminal. For example, an administrator uses an administrator terminal to make a vital sign output request, and the administrator receives the vital sign output request. Here, the vital sign output request includes personal identification information of the administrator who made the request (e.g., employee number or personal number (My Number information)), subject identification information indicating the subject (e.g., employee number or personal number (My Number information)), etc. Alternatively, a person corresponding to the subject's superior or a family member of the subject may use the vital sign output device to make a vital sign output request, and the vital sign output request may be accepted. In this case, the vital sign output request may include personal identification information (e.g., employee number or personal number (My Number information)) of the person corresponding to the subject's superior or family member who made the request, or subject identification information (e.g., employee number or personal number (My Number information)) indicating the subject.
[0134] <Configuration of Third Embodiment: Output Request Determination Unit in Vital Sign Generation Server> The 'output request determination unit' 928 is configured to have the function of determining whether the received output request is a proper request. For example, an administrator uses an administrator terminal to determine whether the received output request is appropriate based on the administrator's personal identification information (e.g., employee number or personal number (My Number information)) included in the vital sign output request and the subject identification information indicating the subject (e.g., employee number or personal number (My Number information)). In addition, the subject's superior or a family member of the subject may use the vital sign output device to determine whether the received output request is appropriate based on the personal identification information of the requester included in the vital sign output request (e.g., employee number or personal number (My Number information)) and subject identification information indicating the subject (e.g., employee number or personal number (My Number information)).
[0135] <Configuration of Embodiment 3: Output Control Unit in Vital Sign Generation Server> The "output control unit" 929 is configured to have the function of controlling the vital sign output unit to output the vital signs to the terminal that made the output request when the output determination unit determines that the request is appropriate. For example, when an administrator uses an administrator terminal and determines that a received output request is an appropriate request, the administrator controls the vital sign output unit to output the vital signs to the administrator terminal that made the output request.Also, when a person corresponding to the subject's superior or a family member uses a vital sign output device and determines that a received output request is an appropriate request, the administrator may control the vital sign output unit to output the vital signs to the vital sign output device used by the person who made the output request.
[0136] <Embodiment 3: Vital Sign Generation Server in Vital Sign Measurement System: Hardware Configuration> The hardware configuration of the vital sign generation server in the vital sign measurement system of this embodiment will be described with reference to the drawings.
[0137] 10 is a diagram showing the hardware configuration of a vital sign generation server in a vital sign measurement system according to this embodiment. As shown in this diagram, the vital sign generation server according to this embodiment includes a "CPU (Central Processing Unit)" 1021 that performs various types of arithmetic processing, and a "main memory" 1022. It also includes a "non-volatile memory" 1023 that stores predetermined information, and a "network I / F (interface)" 1024 that transmits and receives information to and from a vital sign output device 1026 and an administrator terminal 1027. These components are interconnected by a data communication path such as a "bus" 1025, and perform information transmission and reception and processing.
[0138] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area that is a work area for those programs. Furthermore, multiple addresses are assigned to the "main memory" and "non-volatile memory," and programs executed by the "CPU" can exchange data and perform processing by identifying and accessing those addresses. In this embodiment, the programs stored in the "main memory" include a vital sign output request acceptance program, an output request judgment program, and an output control program. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, analysis processing status information, vital sign information, vital sign output request information, and the like.
[0139] The "CPU" executes a vital sign output request reception program stored in the "main memory" to receive a vital sign output request from the terminal and stores the vital sign output request information in the "main memory" and the "non-volatile memory." It also executes an output request determination program stored in the "main memory" to determine whether the received output request is appropriate. It also executes an output control program stored in the "main memory" to control the vital sign output program so that the vital sign is output to the terminal that made the output request if the determination result is that the request is appropriate.
[0140] <Embodiment 3: Vital Sign Generation Server in Vital Sign Measurement System: Processing Flow> 11 is a diagram showing the processing flow when using the vital sign generation server in this embodiment. As shown in the diagram, the processing method comprises a vital sign output request receiving step S1127, an output request determining step S1128, and an output control step S1129.
[0141] The "vital sign output request receiving step" S1127 is a stage in which a vital sign output request is received from the terminal.
[0142] The "output request determination step" S1128 is a step in which it is determined whether the received output request is a proper request.
[0143] The "output control step" S1129 is a step of controlling the vital sign output step so that the vital signs are output to the terminal that made the output request when the determination result in the output request determination step is that the request is appropriate.
[0144] <Summary> As described above, the present invention provides a vital sign measurement system equipped with a vital sign generation server that receives a vital sign output request from a terminal, determines whether the request is appropriate, and if it is determined to be appropriate, controls the terminal that made the output request to output the vital signs.
[0145] <Fourth Embodiment (corresponding mainly to claims 5, 15, and 25)> <Outline of Embodiment 4> This embodiment provides a vital sign measurement system that includes a vital sign generation server that statistically processes stored vital signs for a subject group, stores the resulting statistical processing results, and outputs the stored statistical processing results.
[0146] <Functional Configuration of Fourth Embodiment> 12 is a diagram showing the functional configuration of a vital sign generation server in a vital sign measurement system in embodiment 4. This embodiment provides a vital sign generation server for a vital sign measurement system based on embodiments 1 to 3. The vital sign generation server includes a statistical processing unit that performs statistical processing on the stored vital signs for each subject group, a statistical processing result storage unit that stores the statistical processing results, which are the results of the statistical processing, and a statistical processing result output unit that outputs the stored statistical processing results. It should be noted that the description of the functional configuration, hardware configuration, and processing flow similar to those of the first to third embodiments will be omitted as appropriate and as necessary.
[0147] <Configuration of Embodiment 4: Statistical Processing Unit in Vital Sign Generation Server> The 'statistical processing unit' 1227 is configured to have a function of statistically processing the stored vital signs for each subject group. For example, the target group may include a team unit, a group unit, a section unit, a department unit, a business division unit, a company unit, and the like.
[0148] <Configuration of Fourth Embodiment: Statistical Processing Result Storage Unit in Vital Sign Generation Server> The 'statistical processing result storage unit' 1228 is configured to have a function of storing the statistical processing result, which is the result of statistical processing. For example, the statistical processing results may be stored in association with a target group unit, which may include a team unit, a group unit, a section unit, a department unit, a division unit, a company unit, etc.
[0149] <Configuration of the Fourth Embodiment: Statistical Processing Result Output Unit in the Vital Sign Generation Server> The 'statistical processing result output unit' 1229 is configured to have a function of outputting the held statistical processing results. For example, the statistical processing results may be output together with the unit of the associated target group, which may include a team unit, a group unit, a section unit, a department unit, a division unit, a company unit, etc.
[0150] <Embodiment 4: Vital Sign Generation Server in Vital Sign Measurement System: Hardware Configuration> The hardware configuration of the vital sign generation server in the vital sign measurement system of this embodiment will be described with reference to the drawings.
[0151] 13 is a diagram showing the hardware configuration of a vital sign generation server in a vital sign measurement system according to this embodiment. As shown in this diagram, the vital sign generation server according to this embodiment includes a "CPU (Central Processing Unit)" 1321 that performs various types of arithmetic processing, and a "main memory" 1322. It also includes a "non-volatile memory" 1323 that stores predetermined information, and a "network I / F (interface)" 1324 that transmits and receives information to and from a vital sign output device 1326 and an administrator terminal 1327. These components are interconnected by a data communication path such as a "bus" 1325, and perform information transmission and reception and processing.
[0152] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area for the programs. Furthermore, multiple addresses are assigned to each of the "main memory" and "non-volatile memory," and programs executed by the "CPU" can exchange data and perform processing by identifying and accessing these addresses. In this embodiment, the programs stored in the "main memory" include a statistical processing program, a statistical processing result retention program, and a statistical processing result output program. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, analysis processing status information, vital sign information, statistical processing result information, and the like.
[0153] The "CPU" executes the statistical processing program stored in the "main memory" to statistically process the stored vital signs for each subject group. It also executes the statistical processing result storage program stored in the "main memory" to store the statistical processing results, which are the results of the statistical processing, and stores the statistical processing result information in the "main memory" and the "non-volatile memory." It also executes the statistical processing result output program stored in the "main memory" to output the statistical processing results.
[0154] <Fourth embodiment: Vital sign generation server in vital sign measurement system: processing flow> 14 is a diagram showing the processing flow when the vital sign generation server of this embodiment is used. As shown in the diagram, the processing method comprises a statistical processing step S1427, a statistical processing result storage step S1428, and a statistical processing result output step S1429.
[0155] The "statistical processing step" S1427 is a stage in which the retained vital signs are statistically processed for each subject group.
[0156] The "statistical processing result holding step" S1428 is a stage for holding the statistical processing result, which is the result of the statistical processing.
[0157] The "statistical processing result output step" S1429 is a step for outputting the statistical processing result.
[0158] <Summary> As described above, the present invention can provide a vital sign measurement system that is equipped with a vital sign generation server that statistically processes retained vital signs for a subject group, retains the resulting statistical processing results, and outputs the retained statistical processing results.
[0159] <Fifth Embodiment (corresponding mainly to claims 6, 16, and 26)> <Outline of Embodiment 5> This embodiment provides a vital sign measurement system that is equipped with a vital sign generation server that associates and stores subject attribute information, which is attribute information of a subject, with the subject, and performs statistical processing using the subject attribute information and the stored vital signs.
[0160] <Functional Configuration of Fifth Embodiment> 15 is a diagram showing the functional configuration of a vital sign generation server in a vital sign measurement system according to embodiment 5. This embodiment provides a vital sign generation server for a vital sign measurement system based on embodiments 1 to 4. The vital sign generation server includes a subject attribute information storage unit that stores subject attribute information, which is attribute information of the subject, in association with the subject, and a subject attribute information-attached statistical processing means that performs statistical processing using the subject attribute information and the stored vital signs. It should be noted that the description of the functional configuration, hardware configuration, and processing flow similar to those of the first to fourth embodiments will be omitted as appropriate and as necessary.
[0161] <Configuration of Embodiment 5: Retention of Subject Attribute Information in Vital Sign Generation Server> The 'storage unit for subject attribute information' 1530 is configured to have a function of storing subject attribute information, which is attribute information of a subject, in association with the subject. For example, it is preferable that the subject's attribute information includes at least information such as the subject's name, age, sex, company name, department, telephone number, and address.
[0162] <Configuration of Fifth Embodiment: Statistical Processing Means with Subject Attribute Information in Vital Sign Generation Server> The "statistical processing means with subject attribute information" 1531 is configured to have a function of performing statistical processing using the subject attribute information and the stored vital signs. For example, it is preferable that the subject's attribute information includes at least information such as the subject's name, age, sex, company name, department, telephone number, and address. Specifically, it will be possible to statistically process vital signs using the subject's age, gender, etc. This will enable statistical analysis based on detailed information to gain new insights.
[0163] <Embodiment 5: Vital Sign Generation Server in Vital Sign Measurement System: Hardware Configuration> The hardware configuration of the vital sign generation server in the vital sign measurement system of this embodiment will be described with reference to the drawings.
[0164] 16 is a diagram showing the hardware configuration of a vital sign generation server in a vital sign measurement system according to this embodiment. As shown in this diagram, the vital sign generation server according to this embodiment includes a "CPU (Central Processing Unit)" 1621 that performs various types of arithmetic processing, and a "main memory" 1622. It also includes a "non-volatile memory" 1623 that stores predetermined information, and a "network I / F (interface)" 1624 that transmits and receives information to and from a vital sign output device 1626 and an administrator terminal 1627. These components are interconnected by a data communication path such as a "bus" 1625, and perform information transmission and reception and processing.
[0165] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area for the programs. Furthermore, multiple addresses are assigned to the "main memory" and "non-volatile memory," and programs executed by the "CPU" can exchange data and perform processing by identifying and accessing these addresses. In this embodiment, the programs stored in the "main memory" include a subject attribute information retention program and a statistical processing subprogram with subject attribute information. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, analysis processing status information, vital sign information, subject attribute information, statistical processing result information with subject attribute information, and the like.
[0166] The "CPU" executes the subject attribute information retention program stored in the "main memory" to retain the subject attribute information, which is attribute information of the subject, in association with the subject, and stores the subject attribute information in the "main memory" and the "non-volatile memory." It also executes the subject attribute information-attached statistical processing subprogram stored in the "main memory" to perform statistical processing using the subject attribute information and the retained vital signs.
[0167] <Embodiment 5: Vital Sign Generation Server in Vital Sign Measurement System: Processing Flow> 17 is a diagram showing the processing flow when using the vital sign generation server in this embodiment. As shown in the diagram, the processing method comprises a subject attribute information retaining step S1727 and a subject attribute information-attached statistical processing step S1728.
[0168] The "subject attribute information holding step" S1727 is a stage in which subject attribute information, which is attribute information of the subject, is held in association with the subject.
[0169] The "statistical processing step with subject attribute information" S1728 is a stage in which statistical processing is performed using the subject attribute information and the retained vital signs.
[0170] <Summary> As described above, the present invention provides a vital sign measurement system that is equipped with a vital sign generation server that stores subject attribute information, which is attribute information of a subject, in association with the subject, and performs statistical processing using the subject attribute information and the stored vital signs.
[0171] <Embodiment 6 (corresponding mainly to claims 7, 17, and 27)> <Outline of Sixth Embodiment> This embodiment provides a vital sign measurement system comprising a vital sign generation server that selects and outputs health content to be selected based on the vital signs stored, and a vital sign output device that acquires and plays the health content output from the vital sign generation server.
[0172] <Functional Configuration of Sixth Embodiment> 18 is a diagram showing the functional configuration of a vital sign measurement system according to embodiment 6. Based on embodiments 1 to 5, this embodiment provides a vital sign measurement system including a vital sign output device and a vital sign generation server. The vital sign generation server includes a health content identification information storage unit that stores health content identification information, which is information for identifying health content to be selected according to the stored vital signs; a health content identification information selection rule storage unit that stores health content identification information selection rules, which are rules for selecting the stored health content identification information based on the stored vital signs; a health content identification information selection unit that selects at least one of the stored health content identification information based on the stored vital signs and the stored health content identification information selection rules; a health content identification information output unit that outputs the selected health content identification information; a health content storage unit that stores the health content by associating the health content identification information with the health content; and a health content output unit that outputs the stored health content based on the selected health content identification information. The vital sign output device includes a health content acquisition unit that acquires health content from a health content output unit, and a health content playback unit that plays back the acquired health content. It should be noted that the description of the functional configuration, hardware configuration, and processing flow similar to those of the first to fifth embodiments will be omitted as appropriate and as necessary.
[0173] Sixth Embodiment: Configuration of Health Content Identification Information Storage Unit in Vital Sign Generation Server The 'health content identification information storage unit' 1827 is configured to have a function of storing health content identification information, which is information for identifying health content to be selected according to the stored vital signs. For example, the content identification information is preferably information for identifying at least one of the following content: content related to music and / or video, content related to stretching, content related to fitness, content related to yoga, content related to mindfulness and / or meditation, content related to fragrance, and content related to text and / or images. FIG. 25 is a diagram showing an example of a content identification information storage unit. It is desirable that content identification information and content be stored in association with each other in this manner. The first three digits of the content identification information are underlined, and this information corresponds to the content category. For example, the first three digits of the content identification information "A01000001" ("A01") correspond to "music and / or video," a content category. A "brief description" field is also provided to briefly describe which content is expected to have an effect on which vital signs, providing a reference for selecting content identification information, as described below.
[0174] Sixth Embodiment: Configuration of Health Content Identification Information Selection Rule Storage Unit in Vital Sign Generation Server The "health content identification information selection rule storage unit" 1828 is configured to have the function of storing health content identification information selection rules, which are rules for selecting stored health content identification information based on the stored vital signs. 26 is a diagram showing an example of a health content identification information selection rule storage unit. As shown in this diagram, it is desirable that the acquired vital sign corresponds to one of the four types of "pulse rate (heart rate)," "blood pressure," "oxygen saturation," and "surface temperature (body temperature)," and that the vital sign is stored in association with whether it is within the "normal" range or the "caution" range compared to the above-mentioned reference values. For example, if the "pulse rate (heart rate)" is "normal," the health content identification information (part) is selected from the "A01" or "G01" category, and if it is "caution," the content identification information (part) is selected from the "A01" to "F01" categories. The same applies to other vital signs.
[0175] <Configuration of Sixth Embodiment: Health Content Identification Information Selection Unit in Vital Sign Generation Server> The "health content identification information selection unit" 1829 is configured to have the function of selecting at least one of the stored health content identification information based on the stored vital signs and the stored health content identification information selection rules. For example, as shown in FIG. 26, it is preferable to select at least one of the stored health content identification information based on the stored vital signs ("pulse rate (heart rate)," "blood pressure," "oxygen saturation," and "surface temperature (body temperature)") and the stored health content identification information selection rule. Specifically, if the "pulse rate (heart rate)" is "normal," at least one of the content identification information "A01" and "G01" will be selected from the health content identification information (partial). Also, if the "pulse rate (heart rate)" is "caution," at least one of the content identification information "A01" to "F01" will be selected from the content identification information (partial). The same applies to other vital signs.
[0176] Sixth Embodiment: Configuration of Health Content Identification Information Output Unit in Vital Sign Generation Server The 'health content identification information output unit' 1830 is configured to have a function of outputting the selected health content identification information. For example, as shown in Figure 25, if the output health content identification information is "A01000001", it is desirable that the corresponding content (title: music / video, playback time: 10:00) be read out and played in streaming format on the screen of the vital sign output device. In the present invention, a "health content storage unit" may be provided for storing content of a plurality of categories in association with health content identification information. Also, for example, if any of the vital signs indicates "danger," the content (title: text / image, playback time: 10:00) corresponding to the content identification information "G01000001" is played on the vital sign output device. At this time, it is desirable that the vital sign output device be configured to play and / or display health content (message) such as "Your vital signs indicate "danger," so please consult a medical professional immediately and have your condition remeasured using specialized medical equipment."
[0177] Sixth Embodiment: Configuration of Health Content Storage Unit in Vital Sign Generation Server The 'health content storage unit' 1831 is configured to have a function of storing health content by associating health content identification information with the health content. For example, as shown in FIG. 25, it is preferable that health content identification information and health content are associated with each other and the health content is stored.
[0178] <Configuration of Sixth Embodiment: Health Content Output Unit in Vital Sign Generation Server> The 'health content output unit' 1832 is configured to have a function of outputting the health content stored based on the selected health content identification information. For example, as shown in FIG. 25, it is preferable to be able to output at least one or more health contents stored based on selected health content identification information.
[0179] Sixth Embodiment: Configuration of a Health Content Acquisition Unit in a Vital Sign Output Device The 'health content acquisition unit' 1812 is configured to have the function of acquiring health content from the health content output unit of the vital sign generation server. At this time, it is desirable that a plurality of health contents be outputted so that the subject who is the user of the vital sign output device can select any one of them.
[0180] <Configuration of Sixth Embodiment: Health Content Playback Unit in Vital Sign Output Device> The 'health content playback unit' 1813 is configured to have the function of playing back the acquired health content. In this case, it is desirable that the health content be replayable in streaming format.
[0181] <Embodiment 6: Vital Sign Output Device in Vital Sign Measurement System: Hardware Configuration> The hardware configuration of the vital sign output device of the vital sign measurement system according to this embodiment will be described with reference to the drawings.
[0182] 19a is a diagram showing the hardware configuration of a vital sign output device of a vital sign measurement system according to this embodiment. As shown in this diagram, the vital sign output device according to this embodiment includes a "CPU (Central Processing Unit)" 1901 that performs various types of arithmetic processing, and a "main memory" 1902. It also includes a "non-volatile memory" 1903 that stores predetermined information, and a "network I / F (interface)" 1904 that transmits and receives information to and from a vital sign generation server 1906 and an administrator terminal 1907. These components are interconnected by a data communication path such as a "bus" 1905, and perform information transmission and reception and processing.
[0183] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area that is a work area for the programs. Furthermore, multiple addresses are assigned to the "main memory" and "non-volatile memory," and programs executed by the "CPU" can exchange data and perform processing by identifying and accessing these addresses. In this embodiment, the programs stored in the "main memory" include a health content acquisition program and a health content playback program. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, start commands, analysis processing status information, announcement content information, announcement content selection condition information, vital sign information, health content information, and the like.
[0184] The "CPU" executes a health content acquisition program stored in the "main memory" to acquire health content from a health content output unit (described later) and stores the health content information in the "main memory" and the "non-volatile memory." It also executes a health content playback program stored in the "main memory" to play the acquired health content.
[0185] 19b is a diagram showing the hardware configuration of a vital sign generation server in a vital sign measurement system according to this embodiment. As shown in this diagram, the vital sign generation server according to this embodiment includes a "CPU (Central Processing Unit)" 1921 that performs various types of arithmetic processing, and a "main memory" 1922. It also includes a "non-volatile memory" 1923 that stores predetermined information, and a "network I / F (interface)" 1924 that transmits and receives information to and from a vital sign output device 1926 and an administrator terminal 1927. These components are interconnected by a data communication path such as a "bus" 1925, and perform information transmission and reception and processing.
[0186] Here, the "main memory" reads out programs that perform various processes to be executed by the "CPU," and also provides a work area for the programs. Furthermore, multiple addresses are assigned to each of the "main memory" and "non-volatile memory." Programs executed by the "CPU" can exchange data and perform processing by identifying and accessing these addresses. In this embodiment, the programs stored in the "main memory" include a health content identification information storage program, a health content identification information selection rule storage program, a health content identification information selection program, a health content identification information output program, a health content storage program, and a health content output program. Furthermore, the "main memory" and "non-volatile memory" store still face biometric video information, analysis processing status information, vital sign information, health content identification information, health content identification information selection rules, health content information, and the like.
[0187] The "CPU" executes a health content identification information holding program stored in the "main memory" to hold health content identification information, which is information for identifying health content to be selected according to the held vital signs, and stores the health content identification information in the "main memory" or "non-volatile memory." The "CPU" also executes a health content identification information selection rule holding program stored in the "main memory" to hold health content identification information selection rules, which are rules for selecting health content identification information held based on the held vital signs, and stores the health content identification information selection rules in the "main memory" or "non-volatile memory." The "CPU" also executes a health content identification information selection program stored in the "main memory" to select at least one of the held health content identification information based on the held vital signs and the held health content identification information selection rules. The "CPU" also executes a health content identification information output program stored in the "main memory" to output the selected health content identification information. The "CPU" also executes a health content holding program stored in the "main memory" to hold the health content by associating the health content identification information with the health content, and stores the health content information in the "main memory" or "non-volatile memory." The health content output program stored in the "main memory" is also executed to output the health content stored based on the selected health content identification information.
[0188] <Sixth Embodiment: Vital Sign Output Device in Vital Sign Measurement System: Processing Flow> 20a is a diagram showing the processing flow when using the vital sign output device of this embodiment. As shown in the figure, the processing method comprises a health content acquisition step S2012 and a health content playback step S2013.
[0189] The "health content acquisition step" S2012 is a stage in which health content is acquired from the health content output step described below.
[0190] The "health content playback step" S2013 is a step in which the acquired health content is played back.
[0191] <Processing flow of vital sign generation server in vital sign measurement system in embodiment 2> 20b is a diagram showing the processing flow when the vital sign generation server of this embodiment is used. As shown in the figure, the processing method includes a health content identification information storing step S2027, a health content identification information selection rule storing step S2028, a health content identification information selecting step S2029, a health content identification information output step S2030, a health content storing step S2031, and a health content output step S2032.
[0192] The "health content identification information storage step" S2027 is a step of storing health content identification information, which is information for identifying health content to be selected according to the stored vital signs.
[0193] The "health content identification information selection rule storing step" S2028 is a step of storing health content identification information selection rules, which are rules for selecting stored health content identification information based on the stored vital signs.
[0194] The "health content identification information selection step" S2029 is a step in which at least one of the stored health content identification information is selected based on the stored vital signs and the stored health content identification information selection rules.
[0195] The "health content identification information output step" S2030 is a step of outputting the selected health content identification information.
[0196] The "health content storage step" S2031 is a stage in which health content identification information is associated with the health content and the health content is stored.
[0197] The "health content output step" S2032 is a step of outputting the health content stored based on the selected health content identification information.
[0198] <Summary> As described above, the present invention provides a vital sign measurement system comprising a vital sign generation server that selects and outputs health content to be selected based on the vital signs stored, and a vital sign output device that acquires and plays back the health content output from the vital sign generation server.
[0199] From here on, we will explain the flow of vital sign measurement, referring to an example of the screen of the vital sign output device used by the subject. 27 is a diagram showing an example of a screen of a vital sign output device. Here, the description will proceed assuming that the vital sign output device is a smartphone. As shown in Figure 27, executable icons (apps) with multiple functions assigned are displayed on the smartphone screen. If the subject wants to measure their own vital signs, they can touch, tap, or click the "Vital Signs Measurement" icon (app) to launch the vital signs measurement app. It is recommended that this app be downloaded in advance.
[0200] FIG. 28 is a diagram showing an example of a login screen for a vital sign output device. When the vital sign measurement app is launched, a login screen like the one shown in this figure is displayed. Here, the subject enters the subject identification information "A0001" in the subject identification information field and the password "6491" in the password field. This information is sent from the smartphone to the system via the network, and if matching information has already been registered, the subject is permitted to log in. If matching information has not been registered, the smartphone sends a request for information registration to the administrator terminal via the network, and if there are no particular problems, the administrator sets and saves the subject's subject identification information and password in the system.
[0201] FIG. 29 is a diagram showing an example of the initial screen of the vital sign output device. In this diagram, a "vital sign measurement camera" icon is displayed at the top, and touching, tapping, or clicking this icon switches to a mode for capturing a biometric video of the subject's face, which is a preprocessing step for measuring vital signs. At the bottom, the "location: Chiyoda Ward" at the time of measurement and weather information (in this case, the weather is sunny, the current temperature is 10°C, and the predicted maximum temperature / predicted minimum temperature is 15°C / 5°C) are displayed. Furthermore, at the top right, the current date and time (date: October 15, 2023, day of the week: Monday, time: 12:30:15) are displayed.
[0202] Figure 30 shows an example of the measurement screen of the vital sign output device. A frame for photographing the subject's face is displayed near the center of the screen, and the subject moves their body to fit their face into the frame. Once the subject's face fits into the frame and photographing begins, an indicator showing the progress is displayed at the bottom of the screen, along with a percentage (%) showing the progress. This system is configured to photograph in approximately 10 seconds and display vital signs immediately afterwards. If you wish to end the photographing process midway, a "Cancel" button is displayed in the upper right corner of the screen, and you can cancel it by touching, tapping, or clicking it.
[0203] Figure 31 is a diagram showing an example of the measurement result screen of the vital sign output device. When measurement is complete, multiple vital signs are displayed. At this time, if each vital sign is within the reference value range, "<Normal>" is displayed, and if it exceeds the reference value range, "[Caution]" is displayed, allowing the subject to visually determine at a glance whether it is normal or requires caution. In addition, a "Register" button is displayed, and by touching, tapping, or clicking this, the measured vital signs are associated with the subject's identification information and registered in this system. In addition, if the vital sign values seem abnormal, a "Remeasure" button is displayed, and by touching, tapping, or clicking this button, the user can return to the screen of Figure 29 and perform the measurement again.
[0204] Figure 32 shows an example of the registration screen of the vital sign output device. On this screen, the company name, department name, subject identification information, name, gender, age, etc. are entered, and the measurement date and time are registered in the system by touching, tapping, or clicking the "Save" button. If you want to stop at this point, you can touch, tap, or click the "Cancel" button to cancel the registration and exit the vital sign measurement mode. In the present invention, a "vital sign storage unit" may be provided to store vital signs in association with subject identification information so that the subject can view past measurement history. In this way, the subject can view changes in their vital signs over time and can diligently work on health management.
[0205] A case where health content is acquired and played back by a vital sign output device will also be described. FIG. 33 is a diagram showing an example of a health content acquisition screen of the vital sign output device. As shown in this figure, health content can be retrieved and displayed in the following categories: "Latest," "Music / Video," "Stretching," "Fitness," "Yoga," "Mindfulness / Meditation," "Scent," and "Text / Image." FIG. 34 is a diagram showing an example of a health content playback screen of the vital sign output device. As shown in this figure, for example, health content that catches your interest in the "Stretching" category can be selected and played by touching or tapping the thumbnail display portion of FIG. 33. If you want to stop playback midway, you can stop the playback of the health content by touching or tapping "Stop." Touching or tapping "Back" will return you to the list display screen of FIG. 33, allowing you to select other health content again.
[0206] <Other Examples> The vital sign measurement system of the present invention can be applied, for example, to a system for managing employee health. A camera is installed on the employee's computer, and vital signs are continuously captured from the camera to track changes in health status over time. If the changes indicate the need for a break, a message recommending taking a break is displayed on the computer's display. Furthermore, schedule information and employee health status can be compared to determine which tasks place pressure on the employee, allowing for records of the employee's aptitude and motivation for better work assignments. Furthermore, in web conferencing systems, vital signs can be used to read the psychological state of meeting participants and ensure smooth progress. Meeting chairpersonship can also be entrusted to artificial intelligence, allowing meetings to proceed according to vital signs. Processing these vital signs as statistical information can also improve overall operational efficiency within large companies. For example, this could involve increasing staffing in departments experiencing high pressure or assigning management to a different person. In addition, vital signs can be acquired from the face of a patient lying in bed in a hospital room, and nurses and doctors can view the patient's health status history at any time.The system can also be designed to automatically notify nurses when they need to respond to the patient. In addition, it can obtain vital signs from the driver's face and recommend rest breaks or temporarily suspend driving, which is particularly applicable to drivers who are prone to fatigue, such as long-distance truck drivers. Furthermore, the vital signs of each student can be obtained from the video of their face and used to gauge their level of understanding of the lesson. This can be used as an indicator of whether each student is tired or not. In addition, in the case of the customer service industry, the quality of customer service can be improved by analyzing the correspondence between customer service responses and customers' vital signs. [Explanation of symbols]
[0207] Vital signs measurement system: 200 Vital signs generation server: 201 Vital sign output device: 202, 300 Administrator terminal: 203 Network: 204 Still face biometric video acquisition unit: 301 Start command reception unit: 302 Still face biometric video acquisition control unit: 303 Announcement content storage unit: 304 Announcement content selection condition storage unit: 305 Announcement Content Selection Section: 306 Announcement Department: 307 Vital Sign Acquisition Department: 308 Vital signs holder: 309 Vital sign output unit: 310
Claims
1. a still face biometric video acquisition unit that acquires a still face biometric video, which is a still face biometric video of a subject's face, for analysis processing; a start command receiving unit that receives a start command that is a command to start acquisition of a still facial biometric moving image by the facial biometric moving image acquisition unit; a still face biometric moving image acquisition control unit that controls the still face biometric moving image acquisition unit according to the analysis processing status after receiving a start command; an announcement content storage unit that stores a plurality of announcement contents to be announced by an announcement unit described later; an announcement content selection condition storage unit that stores announcement content selection conditions for selecting announcement content from the announcement content stored in the announcement content storage unit in accordance with processing of still face biological video; an announcement content selection unit that selects a stored announcement content based on a processing status of the still face biometric video and a stored announcement content selection condition; an announcement unit that announces the announcement content selected by the announcement content selection unit to the target person during and / or after processing the still face biological video; a vital sign acquisition unit that acquires at least one vital sign from an external device; a vital sign storage unit that stores the acquired vital signs; a vital sign output unit that outputs the acquired vital sign; A vital sign output device having the above.
2. 2. The vital sign output device according to claim 1, wherein the vital sign is at least one of pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, respiratory rate, body surface temperature, and stress index.
3. a streaming output unit configured to stream output still face biometric video, which is a still face biometric video of the acquired subject's face, and the vital sign acquisition unit configured to acquire vital signs generated based on the still face biometric video output from the streaming output unit from a vital sign generation server described later; a still face biometric video streaming acquisition unit that acquires the still face biometric video streaming; an analysis processing unit that analyzes and processes the acquired still face biometric video; an analysis processing status output unit that outputs the analysis processing status of the analysis processing unit; a vital sign generation unit that generates a vital sign based on the analysis processing by the analysis processing unit; a vital sign storage unit that stores the generated vital signs; a vital sign output unit that outputs the generated vital sign; a vital sign generation server having A vital signs measurement system consisting of:
4. The vital sign generation server a vital sign output request receiving unit that receives a vital sign output request from the terminal; an output request determination unit that determines whether a received output request is an appropriate request; an output control unit that controls the vital sign output unit to output the vital sign to the terminal that made the output request when the determination result of the output request determination unit indicates that the request is appropriate; 4. The vital signs measurement system according to claim 3, comprising:
5. The vital sign generation server a statistical processing unit that statistically processes the retained vital signs for each subject group; a statistical processing result storage unit that stores a statistical processing result that is a result of the statistical processing; a statistical processing result output unit that outputs the statistical processing result; 4. The vital signs measurement system according to claim 3, comprising:
6. The vital sign generation server a subject attribute information storage unit that stores subject attribute information, which is attribute information of the subject, in association with the subject; 6. The vital sign measurement system according to claim 5, wherein the statistical processing unit includes subject attribute information-attached statistical processing means for performing statistical processing using the subject attribute information and the stored vital signs.
7. The vital sign generation server a health content identification information storage unit that stores health content identification information, which is information for identifying health content to be selected according to the stored vital signs; a health content identification information selection rule storage unit that stores health content identification information selection rules, which are rules for selecting stored health content identification information based on the stored vital signs; a health content identification information selection unit that selects at least one of the stored health content identification information based on the stored vital signs and the stored health content identification information selection rule; a health content identification information output unit that outputs the selected health content identification information; a health content storage unit that stores the health content by associating the health content identification information with the health content; a health content output unit that outputs the stored health content based on the selected health content identification information; and The vital sign output device is a health content acquisition unit that acquires health content from the health content output unit; a health content playback unit that plays the acquired health content; 4. The vital signs measurement system according to claim 3, comprising:
8. The vital sign measurement system of claim 7, wherein the health content identification information is information for identifying at least one of the following content: content related to music and / or video, content related to stretching, content related to fitness, content related to yoga, content related to mindfulness and / or meditation, content related to fragrance, and content related to text and / or images.
9. The vital sign measurement system according to claim 3 , wherein the vital sign includes emotion information that indicates an emotion acquired based on a result of facial expression analysis.
10. 10. The vital sign measurement system of claim 9, wherein the emotional information is at least one of information indicating "joy," information indicating "satisfaction," information indicating "relief," information indicating "tension," information indicating "normal," information indicating "calm," information indicating "anger," information indicating "dissatisfaction," and information indicating "sadness."
11. A method executed by a CPU in a vital sign output device that is a computer, comprising: a still face biometric video acquisition step of acquiring a still face biometric video, which is a still face biometric video of a subject's face, for analysis processing; a start command receiving step of receiving a start command which is a command to start acquiring a still facial biometric moving image by the facial biometric moving image acquiring step; a still face biometric moving image acquisition control step of controlling the still face biometric moving image acquisition step according to an analysis processing status after receiving a start command; an announcement content holding step for holding a plurality of announcement contents to be announced in an announcement step described later; an announcement content selection condition holding step for holding an announcement content selection condition for selecting announcement content from the announcement content held in the announcement content holding step in accordance with processing of the still face biological moving image; an announcement content selection step of selecting a stored announcement content based on the processing status of the still face biometric video and the stored announcement content selection conditions; an announcing step of announcing the announcement content selected in the announcement content selecting step to the target person during and / or after processing the still face biometric video; a vital sign acquiring step of acquiring at least one vital sign from an external device; a vital sign storage step of storing the acquired vital signs; a vital sign output step of outputting the acquired vital sign; A method having the following.
12. A method executed by a CPU in a vital sign output device that is a computer, comprising: The method according to claim 11, wherein the vital signs are at least one of pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, respiratory rate, body surface temperature, and stress index.
13. A method executed by a CPU in a vital sign measurement system that is a computer, comprising: The CPU in the vital sign output device according to claim 11 or 12 a streaming output step of streaming outputting the still face biometric video, which is the acquired still biometric video of the face of the subject; the vital sign acquisition step includes an external acquisition substep of acquiring, from a vital sign generation server described below, vital signs generated based on the still face biological video output from the streaming output step; The CPU in the vital sign generation server a still face biometric video streaming acquisition step of acquiring the still face biometric video streaming; an analysis processing step of analyzing and processing the acquired still face biometric video; an analysis processing status output step for outputting an analysis processing status in the analysis processing step; a vital sign generating step of generating a vital sign based on the analysis processing in the analysis processing step; a vital sign storage step of storing the generated vital signs; a vital sign output step of outputting the generated vital sign; A method having the following.
14. A method executed by a CPU in a vital sign measurement system that is a computer, comprising: The CPU in the vital sign generation server a vital sign output request receiving step of receiving a vital sign output request from the terminal; an output request determination step of determining whether the received output request is a proper request; an output control step of controlling the vital sign output step to output the vital sign to the terminal that has made the output request when the determination result in the output request determination step is that the request is appropriate; 14. The method of claim 13, comprising:
15. A method executed by a CPU in a vital sign measurement system that is a computer, comprising: The CPU in the vital sign generation server a statistical processing step of statistically processing the retained vital signs by subject group; a statistical processing result holding step for holding the statistical processing result, which is the result of the statistical processing; a statistical processing result output step for outputting the statistical processing result; 14. The method of claim 13, comprising:
16. A method executed by a CPU in a vital sign measurement system that is a computer, comprising: The CPU in the vital sign generation server a subject attribute information holding step of holding subject attribute information, which is attribute information of the subject, in association with the subject; The method according to claim 15 , wherein the statistical processing step includes a subject attribute information-added statistical processing sub-step of performing statistical processing using the subject attribute information and the stored vital signs.
17. A method executed by a CPU in a vital sign measurement system that is a computer, comprising: The CPU in the vital sign generation server a health content identification information storage step for storing health content identification information, which is information for identifying health content to be selected according to the stored vital signs; a health content identification information selection rule holding step for holding health content identification information selection rules, which are rules for selecting stored health content identification information based on the stored vital signs; a health content identification information selection step of selecting at least one of the stored health content identification information based on the stored vital signs and the stored health content identification information selection rule; a health content identification information output step of outputting the selected health content identification information; a health content storing step of storing the health content by associating the health content identification information with the health content; a health content output step of outputting the stored health content based on the selected health content identification information; and The CPU in the vital sign output device a health content acquisition step of acquiring health content from the health content output step; a health content replay step of replaying the acquired health content; 14. The method of claim 13, comprising:
18. A method executed by a CPU in a vital sign measurement system that is a computer, comprising: The method of claim 17, wherein the health content identification information is information for identifying at least one of the following content: content related to music and / or video, content related to stretching, content related to fitness, content related to yoga, content related to mindfulness and / or meditation, content related to fragrance, and content related to text and / or images.
19. A method executed by a CPU in a vital sign measurement system that is a computer, comprising: The method according to claim 13 , wherein the vital signs include emotion information that is information indicating an emotion obtained based on a result of facial expression analysis.
20. A method executed by a CPU in a vital sign measurement system that is a computer, comprising:
20. The method according to claim 19, wherein the emotion information is at least one of information indicating "joy", information indicating "satisfaction", information indicating "relief", information indicating "tension", information indicating "neutral", information indicating "calm", information indicating "anger", information indicating "dissatisfaction", and information indicating "sadness".
21. a still face biometric video acquisition step of acquiring a still face biometric video, which is a still face biometric video of a subject's face, for analysis processing; a start command receiving step of receiving a start command which is a command to start acquiring a still facial biometric moving image by the facial biometric moving image acquiring step; a still face biometric moving image acquisition control step of controlling the still face biometric moving image acquisition step according to an analysis processing status after receiving a start command; an announcement content holding step for holding a plurality of announcement contents to be announced in an announcement step described later; an announcement content selection condition holding step for holding an announcement content selection condition for selecting announcement content from the announcement content held in the announcement content holding step in accordance with processing of the still face biological moving image; an announcement content selection step of selecting a stored announcement content based on the processing status of the still face biometric video and the stored announcement content selection conditions; an announcing step of announcing the announcement content selected in the announcement content selecting step to the target person during and / or after processing the still face biometric video; a vital sign acquiring step of acquiring at least one vital sign from an external device; a vital sign storage step of storing the acquired vital signs; a vital sign output step of outputting the acquired vital sign; An operating program for a vital sign output device, the operating program being written so as to be readable and executable by a vital sign output device that is a computer having the above.
22. 22. An operating program for a vital sign output device, the operating program being written in a readable and executable manner on a vital sign output device that is a computer as described in claim 21, wherein the vital sign is at least one or more of pulse interval information (heart beat interval information), pulse rate (heart rate), oxygen saturation, blood pressure, respiratory rate, body surface temperature, and stress index.
23. The vital sign output device is a streaming output step of streaming outputting the still biometric facial video, which is the acquired still biometric facial video of the subject; the vital sign acquisition step includes an external acquisition sub-step of acquiring, from a vital sign generation server described later, vital signs generated based on the still face biological video output from the streaming output step; The vital sign generation server a still face biometric video streaming acquisition step of acquiring the still face biometric video streaming; an analysis processing step of analyzing and processing the acquired still face biometric video; an analysis processing status output step for outputting an analysis processing status in the analysis processing step; a vital sign generating step of generating a vital sign based on the analysis processing in the analysis processing step; a vital sign storage step of storing the generated vital signs; a vital sign output step of outputting the generated vital sign; An operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for a vital sign measurement system that is a computer having the above.
24. The vital sign generation server a vital sign output request receiving step of receiving a vital sign output request from the terminal; an output request determination step of determining whether the received output request is a proper request; an output control step of controlling the vital sign output step to output the vital sign to the terminal that has made the output request when the determination result in the output request determination step is that the request is appropriate; 24. An operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for the vital sign measurement system that is the computer according to claim 23.
25. The vital sign generation server a statistical processing step of statistically processing the retained vital signs by subject group; a statistical processing result holding step for holding the statistical processing result, which is the result of the statistical processing; a statistical processing result output step for outputting the statistical processing result; 24. An operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for the vital sign measurement system that is the computer according to claim 23.
26. The vital sign generation server a subject attribute information holding step of holding subject attribute information, which is attribute information of the subject, in association with the subject; The statistical processing step includes a statistical processing substep with subject attribute information that performs statistical processing using the subject attribute information and the stored vital signs. An operating program for a vital sign measurement system that is written in a manner that can be read and executed by a computer that is the vital sign measurement system described in claim 25.
27. The vital sign generation server a health content identification information storage step for storing health content identification information, which is information for identifying health content to be selected according to the stored vital signs; a health content identification information selection rule holding step for holding health content identification information selection rules, which are rules for selecting stored health content identification information based on the stored vital signs; a health content identification information selection step of selecting at least one of the stored health content identification information based on the stored vital signs and the stored health content identification information selection rule; a health content identification information output step of outputting the selected health content identification information; a health content storing step of storing the health content by associating the health content identification information with the health content; and a health content output step of outputting the stored health content based on the selected health content identification information, The vital sign output device is a health content acquisition step of acquiring health content from the health content output step; a health content replay step of replaying the acquired health content; 24. An operating program for a vital sign measurement system, the operating program being written in a readable and executable manner for the vital sign measurement system that is the computer according to claim 23.
28. The health content identification information is information for identifying at least one of the following content: content related to music and / or video, content related to stretching, content related to fitness, content related to yoga, content related to mindfulness and / or meditation, content related to fragrance, and content related to text and / or images.An operating program for a vital sign measurement system written in a readable and executable manner for a vital sign measurement system that is a computer as described in claim 27.
29. An operating program for a vital sign measurement system written in a readable and executable manner for a vital sign measurement system that is a computer as described in claim 23, wherein the vital sign includes emotion information that is information indicating an emotion obtained based on a facial expression analysis result.
30. The emotional information is at least one of information indicating "joy", information indicating "satisfaction", information indicating "relief", information indicating "tension", information indicating "normal", information indicating "calm", information indicating "anger", "dissatisfaction", and information indicating "sadness". An operating program for a vital sign measurement system written in a readable and executable manner for a vital sign measurement system that is a computer as described in claim 29.
Citation Information
Patent Citations
Aroma generation system, aroma generation device, aroma generation method, and program
JP2022131142A