Face temperature abnormity early warning method based on human-type health care robot and medium
Through the combination of dual-mode sensor array and environmental sensor group, dynamic thresholds are generated and facial temperature abnormality warning is performed, which solves the problem that health care robots cannot accurately warning, and achieves timely warning and safety guarantees for user facial temperature abnormalities.
Patent Information
- Application Number
- CN202510438628.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-09
- Publication Date
- 2025-06-20
AI Technical Summary
Existing health care robots cannot accurately warn of facial temperature abnormalities and cannot detect subacute symptoms in time, resulting in user safety problems and low user experience.
A dual-mode sensor array is used to collect facial images, and the background parameters are collected in real time with the environmental sensor group. Dynamic thresholds are generated through the pre-trained background parameters dynamic matching parameter model, and the forehead temperature zygomatic temperature difference value and temperature rise rate are extracted to perform abnormal warning matching.
It realizes timely warning of facial temperature abnormalities, improves user safety guarantees, and improves user experience.
Smart Images

Figure CN120183139A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of robot control, and particularly to a method and medium for early warning of abnormal facial temperature based on a humanoid health care robot. Background Art
[0002] Traditional health care models rely on human labor, suffering from problems such as low efficiency, high costs, and insufficient emotional companionship, and thus urgently require intelligent solutions. Additionally, traditional health care equipment has the following deficiencies: traditional thermometers or wearable devices require manual operation and cannot achieve continuous and active monitoring; single thermal imaging devices are easily affected by room temperature and air flow, resulting in temperature measurement errors and large environmental interference.
[0003] In recent years, with the rapid development of the Internet and technology, health care robots can better solve safety problems that occur in people's daily lives. Especially for people's physical health, the accuracy of facial temperature detection is crucial.
[0004] In the process of implementing the present invention, the inventors found that the prior art has the following defects: currently, the functions of health care robots are limited to simple companionship and cannot perform early warning interactions; moreover, the static threshold method is used, ignoring individual differences and dynamic characteristics of disease development, making it difficult to detect subacute symptoms at an early stage, with a high missed detection rate, and unable to effectively guarantee the safety of users, resulting in a low user experience. Summary of the Invention
[0005] The present invention provides a method and medium for early warning of abnormal facial temperature based on a humanoid health care robot, so as to enable timely early warning operations, ensure the safety of users, and improve the user experience.
[0006] According to one aspect of the present invention, there is provided a method for early warning of abnormal facial temperature based on a humanoid health care robot, which includes:
[0007] Instruct a dual-modal sensor array to collect a facial image of a target user according to a preset moving speed of the humanoid health care robot, so as to obtain a current facial infrared image for collection;
[0008] Instruct an environmental sensor group to collect current background parameters for collection in real time;
[0009] Input the current background parameters for collection into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold;
[0010] Extract corner features from the current facial infrared image for collection to obtain a forehead temperature and zygomatic temperature difference value, and obtain the temperature rise rate of the target user within a preset time period;
[0011] Match the forehead temperature and zygomatic temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target level abnormal warning, so as to realize the facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning.
[0012] According to another aspect of the present invention, there is provided a facial temperature abnormal warning device based on a humanoid health care robot, which includes:
[0013] A current facial acquisition infrared image determination module, configured to instruct a dual-modal sensor array to collect a facial image of a target user according to a preset moving speed of the humanoid health care robot, so as to obtain a current facial acquisition infrared image;
[0014] A current acquisition background parameter acquisition module, configured to instruct an environmental sensor group to collect current acquisition background parameters in real time;
[0015] A current dynamic threshold generation module, configured to input the current acquisition background parameters into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold;
[0016] A temperature rising rate acquisition module, configured to extract corner features from the current facial acquisition infrared image to obtain a forehead temperature and zygomatic temperature difference value, and acquire the temperature rising rate of the target user within a preset time period;
[0017] A target level abnormal warning determination module, configured to match the forehead temperature and zygomatic temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target level abnormal warning, so as to realize the facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning.
[0018] According to another aspect of the present invention, there is provided an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein when the processor executes the computer program, it implements the method for warning of abnormal facial temperature based on a humanoid health care robot according to any embodiment of the present invention.
[0019] According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement the method for warning of abnormal facial temperature based on a humanoid health care robot according to any embodiment of the present invention when executed.
[0020] The technical solution of the embodiment of the present invention instructs the dual-modal sensor array to collect facial images of the target user according to the preset moving speed of the humanoid health care robot, and obtains the current facial collection infrared image; instructs the environmental sensor group to collect the current collection background parameters in real time; inputs the current collection background parameters into the pre-trained background parameter dynamic matching parameter model to generate the current dynamic threshold; extracts corner features from the current facial collection infrared image to obtain the forehead temperature zygomatic temperature difference value, and obtains the temperature rise rate of the target user within a preset time period; matches the forehead temperature zygomatic temperature difference value and the temperature rise rate with the current dynamic threshold to obtain a target level abnormal warning, so as to realize the facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning. It solves the problem that the health care robot cannot accurately perform warning interaction and cannot well guarantee the safety of users, can perform warning operations in time, guarantee the safety of users, and improve the user experience.
[0021] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present invention, nor is it used to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0023] Figure 1 It is a flowchart of a method for abnormal facial temperature warning based on a humanoid health care robot according to Embodiment 1 of the present invention;
[0024] Figure 2 It is a structural schematic diagram of a device for abnormal facial temperature warning based on a humanoid health care robot according to Embodiment 2 of the present invention;
[0025] Figure 3 It is a structural schematic diagram of an electronic device according to Embodiment 3 of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0026] To enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of protection of the present invention.
[0027] It should be noted that the terms "target", "current", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present invention described here can be implemented in an order other than those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.
[0028] Embodiment 1
[0029] Figure 1 This is a flowchart of a method for warning of abnormal facial temperature based on a humanoid health care robot in Embodiment 1 of the present invention. This embodiment is applicable to the situation of warning of abnormal facial temperature based on a humanoid health care robot. This method can be executed by a device for warning of abnormal facial temperature based on a humanoid health care robot, and the device for warning of abnormal facial temperature based on a humanoid health care robot can be implemented in the form of hardware and / or software.
[0030] Correspondingly, as Figure 1 shown, the method includes:
[0031] S110. According to the preset moving speed of the humanoid health care robot, instruct the dual-modal sensor array to collect a facial image of the target user to obtain the current facial acquisition infrared image.
[0032] Among them, the dual-modal sensor array includes a FLIR thermal imaging module and an RGB camera; among them, the FLIR thermal imaging module and the RGB camera are respectively fixed on both sides of the head of the humanoid health care robot. In addition, the FLIR thermal imaging module and the RGB camera are fixed by a rigid mechanical structure to ensure that the optical axis parallelism error is less than 0.1 degree.
[0033] In this embodiment, assuming that the moving speed of the preset humanoid health care robot is 0.5 m / s, the humanoid health care robot approaches the target user at a moving speed of 0.5 m / s, captures the facial image of the target user through an RGB camera, and triggers a thermal imaging scan through a FLIR thermal imaging module to obtain the current infrared image of the facial collection.
[0034] In addition, the change of the head posture during the movement of the humanoid health care robot can be compensated based on thin plate spline interpolation.
[0035] Optionally, after indicating the dual-modal sensor array to collect the facial image of the target user according to the moving speed of the preset humanoid health care robot to obtain the current infrared image of the facial collection, it further includes: inputting the current infrared image of the facial collection into a pre-trained age prediction model to obtain the predicted age of the target user.
[0036] Among them, the age prediction model can be a model for predicting the age of an image.
[0037] In this embodiment, age prediction processing is performed through the age prediction model to obtain the predicted age of the target user, so that the corresponding age attenuation factor can be matched according to the predicted age.
[0038] S120. Instruct the environmental sensor group to collect the current background parameters in real time.
[0039] Among them, the environmental sensor group can include a thermometer sensor, a hygrometer sensor, and a barometer sensor.
[0040] In this embodiment, the current background parameters can be collected in real time through the environmental sensor group. The current environmental temperature can be collected through the thermometer sensor, the current environmental humidity can be collected through the hygrometer sensor, and the current environmental air pressure can be collected through the barometer sensor.
[0041] In this embodiment, the microsecond-level synchronization of data can also be achieved by setting a CAN bus. For example, the microsecond-level synchronization of the data of the current background parameters can be achieved.
[0042] S130. Input the current background parameters into a pre-trained background parameter dynamic matching parameter model to generate the current dynamic threshold.
[0043] Optionally, inputting the currently collected background parameters into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold includes: inputting the currently ambient temperature collected by the thermometer sensor, the currently ambient humidity collected by the hygrometer sensor, the currently ambient air pressure collected by the barometer sensor, and the predicted age into the pre-trained background parameter dynamic matching parameter model to generate an environmental compensation coefficient and an age decay factor; generating the current dynamic threshold according to the environmental compensation coefficient, the age decay factor, and the currently collected background parameters.
[0044] Among them, the background parameter dynamic matching parameter model can be a model that dynamically performs parameter matching according to different background parameters, and can obtain an environmental compensation coefficient and an age decay factor corresponding to the current environmental parameters. The current dynamic threshold can be a threshold set for the forehead temperature and zygomatic temperature difference value.
[0045] In this embodiment, assuming that the obtained environmental compensation coefficient is α = 0.12 and the age decay factor is β = 0.05, the current dynamic threshold can be calculated according to a preset calculation method for the current dynamic threshold. The formula for the current dynamic threshold is where ΔT is the current dynamic threshold, T base is the initial threshold parameter, T env is the currently collected background parameter, T avg is the pre-obtained average collected background parameter, T age is the obtained predicted age. Then the current dynamic threshold can be further calculated.
[0046] S140. Extract corner features from the currently collected facial infrared image to obtain the forehead temperature and zygomatic temperature difference value, and obtain the temperature rising rate of the target user within a preset time period.
[0047] Optionally, the extracting corner features from the currently collected facial infrared image to obtain the forehead temperature and zygomatic temperature difference value includes: extracting corner features from the currently collected facial infrared image through a convolutional neural network based on an improved ORB-SIFT algorithm to obtain the current forehead temperature and the current zygomatic temperature; calculating the forehead temperature and zygomatic temperature difference value according to the current forehead temperature and the current zygomatic temperature.
[0048] In this embodiment, the current forehead temperature and the current zygomatic temperature of the target user can be obtained through corner feature extraction, so as to calculate the forehead temperature and zygomatic temperature difference value. Since the temperature difference between the forehead and the zygomatic can better reflect the current user's temperature difference, the forehead temperature and zygomatic temperature difference value can be compared with the current dynamic threshold to determine whether there is an abnormality in the facial temperature of the current user.
[0049] Among them, ORB (Oriented FAST and Rotated BRIEF) and SIFT (Scale-Invariant Feature Transform) in the ORB-SIFT algorithm are two feature extraction algorithms.
[0050] Among them, the temperature rising rate is the magnitude of the speed at which the temperature of the target user rises within a certain period of time.
[0051] S150. Match the forehead-temperature zygomatic-temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target-level abnormal warning, so as to implement the facial temperature abnormal warning of the humanoid health care robot according to the target-level abnormal warning.
[0052] Optionally, the matching the forehead-temperature zygomatic-temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target-level abnormal warning includes: comparing the forehead-temperature zygomatic-temperature difference value with the current dynamic threshold to obtain a first comparison result; obtaining a temperature rising rate threshold, and comparing the temperature rising rate with the temperature rising rate threshold to obtain a second comparison result; querying according to the first comparison result and the second comparison result through a pre-set abnormal warning level table to obtain the target-level abnormal warning.
[0053] Among them, the first comparison result can be that the forehead-temperature zygomatic-temperature difference value is greater than, equal to, or less than the current dynamic threshold. The second comparison result can be that the temperature rising rate is greater than, equal to, or less than the temperature rising rate threshold.
[0054] In this embodiment, assuming that the calculated current dynamic threshold is 1.5 degrees Celsius and the forehead-temperature zygomatic-temperature difference value is 1.6 degrees Celsius, the obtained first comparison result is that the forehead-temperature zygomatic-temperature difference value is greater than the current dynamic threshold.
[0055] Furthermore, assuming that the temperature rising rate threshold is 0.1 degrees Celsius and the temperature rising rate is 0.16 degrees Celsius, the second comparison result can be obtained as: the temperature rising rate is greater than the temperature rising rate threshold.
[0056] Correspondingly, according to the fact that the forehead-temperature zygomatic-temperature difference value is greater than the current dynamic threshold and the temperature rising rate is greater than the temperature rising rate threshold, query through the abnormal warning level table to obtain the target-level abnormal warning.
[0057] Specifically, after matching the forehead temperature and zygomatic temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target level abnormal warning, the following steps are included: matching the target execution actions corresponding to the humanoid health care robot according to the target level abnormal warning; wherein, the target level abnormal warning includes at least one of the following: a first-level abnormal warning, a second-level abnormal warning, and a third-level abnormal warning; wherein, the target execution actions corresponding to the first-level abnormal warning are voice prompt and caregiver terminal push operation; the target execution actions corresponding to the second-level abnormal warning are starting the automatic disinfection spray device operation; the target execution actions corresponding to the third-level abnormal warning are making an emergency rescue call operation.
[0058] In this embodiment, the corresponding target execution actions can be matched according to the determined target level abnormal warning. For example, assuming that the first-level abnormal warning is determined, the target execution actions corresponding to the humanoid health care robot are voice prompt and caregiver terminal push operation. Assuming that the second-level abnormal warning is determined, the target execution actions corresponding to the humanoid health care robot are starting the automatic disinfection spray device operation. Assuming that the third-level abnormal warning is determined, the target execution actions corresponding to the humanoid health care robot are making an emergency rescue call operation. In this way, warning operations can be carried out in a timely manner to ensure the safety of users and improve the user experience.
[0059] In addition, data can be uploaded to the cloud platform via Bluetooth or wireless network, and a health risk assessment report can be generated to better perform data analysis and processing operations.
[0060] The technical solution of the embodiment of the present invention instructs the dual-modal sensor array to collect a facial image of a target user according to the preset moving speed of the humanoid health care robot to obtain a current facial collection infrared image; instructs the environmental sensor group to collect the current collection background parameters in real time; inputs the current collection background parameters into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold; extracts corner features from the current facial collection infrared image to obtain a forehead temperature and zygomatic temperature difference value, and obtains the temperature rising rate of the target user within a preset time period; matches the forehead temperature and zygomatic temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target level abnormal warning, so as to implement the facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning. It solves the problem that the health care robot cannot accurately perform warning interaction and cannot well ensure the safety of users, can carry out warning operations in a timely manner, ensure the safety of users, and improve the user experience.
[0061] Embodiment 2
[0062] Figure 2Schematic diagram of a facial temperature anomaly warning device based on a humanoid health care robot provided in Embodiment 2 of the present invention. The facial temperature anomaly warning device based on a humanoid health care robot provided in this embodiment can be implemented through software and / or hardware, and can be configured in a terminal device to implement a facial temperature anomaly warning method based on a humanoid health care robot in the embodiments of the present invention. As Figure 2 shown, the device includes: a current facial infrared image acquisition and determination module 210, a current acquisition background parameter acquisition module 220, a current dynamic threshold generation module 230, a temperature rise rate acquisition module 240, and a target level anomaly warning determination module 250.
[0063] Among them, the current facial infrared image acquisition and determination module 210 is used to instruct the dual-modal sensor array to collect facial images of the target user at a preset moving speed of the humanoid health care robot, so as to obtain the current facial infrared image acquired;
[0064] The current acquisition background parameter acquisition module 220 is used to instruct the environmental sensor group to collect the current acquisition background parameters in real time;
[0065] The current dynamic threshold generation module 230 is used to input the current acquisition background parameters into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold;
[0066] The temperature rise rate acquisition module 240 is used to extract corner features from the current facial infrared image acquired to obtain the forehead temperature and zygomatic temperature difference value, and acquire the temperature rise rate of the target user within a preset time period;
[0067] The target level anomaly warning determination module 250 is used to match the forehead temperature and zygomatic temperature difference value and the temperature rise rate with the current dynamic threshold to obtain a target level anomaly warning, so as to implement facial temperature anomaly warning of the humanoid health care robot according to the target level anomaly warning.
[0068] The technical solution of the embodiment of the present invention instructs the dual-modal sensor array to collect facial images of the target user according to the preset moving speed of the humanoid health care robot, so as to obtain the current facial collection infrared image; instructs the environmental sensor group to collect the current collection background parameters in real time; inputs the current collection background parameters into the pre-trained background parameter dynamic matching parameter model to generate the current dynamic threshold; extracts corner features from the current facial collection infrared image to obtain the forehead temperature and zygomatic temperature difference value, and obtains the temperature rising rate of the target user within a preset time period; matches the forehead temperature and zygomatic temperature difference value and the temperature rising rate with the current dynamic threshold to obtain the target level abnormal warning, so as to realize the facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning. It solves the problem that the health care robot cannot accurately perform warning interaction and cannot well guarantee the safety of users, can perform warning operations in time, guarantee the safety of users, and improve the user experience.
[0069] On the basis of the above embodiments, the dual-modal sensor array includes: a FLIR thermal imaging module and an RGB camera; wherein, the FLIR thermal imaging module and the RGB camera are respectively fixed on both sides of the head of the humanoid health care robot; the environmental sensor group includes: a thermometer sensor, a hygrometer sensor and a barometer sensor.
[0070] On the basis of the above embodiments, it further includes a predicted age determination module, which can specifically be used to input the current facial collection infrared image into the pre-trained age prediction model after instructing the dual-modal sensor array to collect facial images of the target user according to the preset moving speed of the humanoid health care robot to obtain the predicted age of the target user.
[0071] On the basis of the above embodiments, the current dynamic threshold generation module 230 can specifically be used to input the current ambient temperature collected by the thermometer sensor, the current ambient humidity collected by the hygrometer sensor, the current ambient air pressure collected by the barometer sensor, and the predicted age into the pre-trained background parameter dynamic matching parameter model to generate an environmental compensation coefficient and an age attenuation factor; generate the current dynamic threshold according to the environmental compensation coefficient, the age attenuation factor, and the current collection background parameters.
[0072] On the basis of the above embodiments, the temperature rising rate acquisition module 240 can specifically be used to extract corner features from the current facial collection infrared image through a convolutional neural network based on the improved ORB-SIFT algorithm to obtain the current forehead temperature and the current zygomatic temperature; calculate the forehead temperature and zygomatic temperature difference value according to the current forehead temperature and the current zygomatic temperature.
[0073] Based on the above embodiments, the target level abnormal warning determination module 250 may specifically be configured to: compare the forehead temperature zygomatic temperature difference value with the current dynamic threshold to obtain a first comparison result; obtain a temperature rise rate threshold, and compare the temperature rise rate with the temperature rise rate threshold to obtain a second comparison result; query through a preset abnormal warning level table according to the first comparison result and the second comparison result to obtain the target level abnormal warning.
[0074] Based on the above embodiments, it further includes a target execution action matching module, which may specifically be configured to: after matching the forehead temperature zygomatic temperature difference value and the temperature rise rate with the current dynamic threshold to obtain a target level abnormal warning, match the corresponding target execution action of the humanoid health care robot according to the target level abnormal warning; wherein, the target level abnormal warning includes at least one of the following: a first-level abnormal warning, a second-level abnormal warning, and a third-level abnormal warning; wherein, the target execution action corresponding to the first-level abnormal warning is voice prompt and caregiver terminal push operation; the target execution action corresponding to the second-level abnormal warning is to start the automatic disinfection spray device operation; the target execution action corresponding to the third-level abnormal warning is to call the emergency rescue phone operation.
[0075] The facial temperature abnormal warning device based on the humanoid health care robot provided by the embodiments of the present invention can execute the facial temperature abnormal warning method based on the humanoid health care robot provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the method.
[0076] Embodiment 3
[0077] Figure 3 FIG. shows a schematic structural diagram of an electronic device 10 that can be used to implement Embodiment 3 of the present invention. The electronic device is intended to represent various forms of digital computers, such as, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present invention described and / or claimed herein.
[0078] As Figure 3As shown, the electronic device 10 includes at least one processor 11 and a memory communicatively connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc. The memory stores a computer program executable by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.
[0079] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disc, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.
[0080] The processor 11 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include but are not limited to a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the facial temperature anomaly warning method based on a humanoid healthcare robot.
[0081] In some embodiments, the facial temperature anomaly warning method based on a humanoid healthcare robot can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the facial temperature anomaly warning method based on a humanoid healthcare robot described above can be executed. Alternatively, in other embodiments, the processor 11 can be configured to execute the facial temperature anomaly warning method based on a humanoid healthcare robot in any other appropriate manner (e.g., by means of firmware).
[0082] The method includes: instructing a bimodal sensor array to collect a facial image of a target user according to a preset moving speed of a humanoid health care robot, so as to obtain a current facial collection infrared image; instructing an environmental sensor group to collect current collection background parameters in real time; inputting the current collection background parameters into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold; extracting corner features from the current facial collection infrared image to obtain a forehead temperature zygomatic temperature difference value, and obtaining a temperature rising rate of the target user within a preset time period; matching the forehead temperature zygomatic temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target level abnormal warning, so as to implement a facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning.
[0083] The various embodiments of the systems and techniques described above in this article can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs, which can be executed and / or interpreted on a programmable system including at least one programmable processor. The programmable processor can be a dedicated or general programmable processor, and can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.
[0084] The computer programs for implementing the methods of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a dedicated computer, or other programmable data processing devices, such that when the computer programs are executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer programs can be executed entirely on a machine, partially on a machine, as an independent software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.
[0085] In the context of the present invention, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0086] To provide for interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can also be used to provide for interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0087] The systems and techniques described herein can be implemented in a computing system that includes backend components (such as, for example, a data server), or a computing system that includes middleware components (such as, for example, an application server), or a computing system that includes frontend components (such as, for example, a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by any form or medium of digital data communication (such as, for example, a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0088] A computing system may include a client and a server. The client and the server are generally far from each other and usually interact via a communication network. The relationship between the client and the server is created by computer programs running on respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, solving the defects of high management difficulty and weak business scalability existing in traditional physical hosts and VPS services.
[0089] It should be understood that various forms of processes shown above can be used, reordering, adding or deleting steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and no limitation is made herein.
[0090] The above specific embodiments do not constitute a limitation to the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.
[0091] Embodiment 4
[0092] Embodiment 4 of the present invention further provides a computer-readable storage medium, and the computer-readable instructions are used to execute a method for early warning of abnormal facial temperature based on a humanoid health care robot when executed by a computer processor. The method includes: instructing a bimodal sensor array to collect a facial image of a target user according to a preset moving speed of the humanoid health care robot to obtain a current facial infrared image for collection; instructing an environmental sensor group to collect current background parameters of the collection in real time; inputting the current background parameters of the collection into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold; performing corner feature extraction on the current facial infrared image for collection to obtain a forehead temperature zygomatic temperature difference value, and obtaining the temperature rising rate of the target user within a preset time period; matching the forehead temperature zygomatic temperature difference value and the temperature rising rate with the current dynamic threshold to obtain a target level early warning, so as to realize the early warning of abnormal facial temperature of the humanoid health care robot according to the target level early warning.
[0093] Certainly, the computer-executable instructions of a computer-readable storage medium provided by the embodiments of the present invention are not limited to the method operations as described above, and can also execute relevant operations in the early warning of abnormal facial temperature based on a humanoid health care robot provided by any embodiment of the present invention.
[0094] From the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software and the necessary general-purpose hardware. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as a floppy disk, a read-only memory (ROM), a random access memory (RAM), a flash memory (FLASH), a hard disk, or an optical disc of a computer, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present invention.
[0095] It should be noted that in the above embodiments of the face temperature anomaly warning based on the humanoid health care robot, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of the functional units are only for the convenience of mutual distinction and do not limit the protection scope of the present invention.
[0096] The above specific implementation manners do not constitute a limitation on the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.
Claims
1. A facial temperature abnormality warning method based on a humanoid health care robot, characterized in that: include: According to the preset moving speed of the humanoid health care robot, the dual-modal sensor array is instructed to collect facial images of the target user to obtain the current facial collection infrared image; Instruct the environmental sensor group to collect current collection background parameters in real time; Inputting the current collected background parameters into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold; Extract corner features of the current facial infrared image to obtain the forehead temperature and zygomatic temperature difference, and obtain the temperature rise rate of the target user within a preset time period; According to the forehead temperature and zygomatic temperature difference and the temperature rise rate, the current dynamic threshold is matched to obtain a target level abnormal warning, so as to realize the facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning.
2. The method according to claim 1, characterized in that The dual-mode sensor array includes: a FLIR thermal imaging module and an RGB camera; wherein the FLIR thermal imaging module and the RGB camera are respectively fixed on both sides of the head of the humanoid health care robot; The environmental sensor group includes a thermometer sensor, a hygrometer sensor and a barometer sensor.
3. The method according to claim 2, characterized in that After instructing the dual-modal sensor array to collect facial images of the target user according to the preset moving speed of the humanoid health care robot and obtaining the current facial collected infrared image, the method further includes: The current facial infrared image is input into a pre-trained age prediction model to obtain the predicted age of the target user.
4. The method according to claim 3, characterized in that The step of inputting the current collected background parameter into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold value includes: Input the current ambient temperature collected by the thermometer sensor, the current ambient humidity collected by the hygrometer sensor, the current ambient air pressure collected by the barometer sensor, and the predicted age into a pre-trained background parameter dynamic matching parameter model to generate an environmental compensation coefficient and an age attenuation factor; The current dynamic threshold is generated according to the environment compensation coefficient, the age attenuation factor, and the current acquisition background parameter.
5. The method according to claim 4, characterized in that The step of extracting corner features from the current facial infrared image to obtain a forehead temperature and zygomatic temperature difference value includes: By using a convolutional neural network based on an improved ORB-SIFT algorithm, corner feature extraction is performed on the current facial infrared image to obtain a current forehead temperature and a current zygomatic temperature; A forehead temperature and a zygomatic temperature difference is calculated according to the current forehead temperature and the current zygomatic temperature.
6. The method according to claim 5, characterized in that The method of matching the forehead temperature and zygomatic temperature difference and the temperature rise rate with the current dynamic threshold to obtain a target level abnormal warning includes: Compare the forehead temperature and zygomatic temperature difference with the current dynamic threshold to obtain a first comparison result; Acquire a temperature rise rate threshold, and compare the temperature rise rate with the temperature rise rate threshold to obtain a second comparison result; According to the first comparison result and the second comparison result, a query is performed through a preset abnormal warning level table to obtain the target level abnormal warning.
7. The method according to claim 6, characterized in that After matching the forehead temperature and zygomatic temperature difference and the temperature rise rate with the current dynamic threshold to obtain a target level abnormal warning, the method includes: According to the target level abnormal warning, the target execution action corresponding to the humanoid health care robot is matched; Wherein, the target level abnormal warning includes at least one of the following: first level abnormal warning, second level abnormal warning and third level abnormal warning; Among them, the target execution action corresponding to the first-level abnormal warning is voice prompting and nursing terminal push operation; the target execution action corresponding to the second-level abnormal warning is starting the automatic disinfection spray device operation; the target execution action corresponding to the third-level abnormal warning is dialing the emergency rescue phone operation.
8. A facial temperature abnormality warning device based on a humanoid health care robot, characterized in that: include: The current facial infrared image determination module is used to instruct the dual-mode sensor array to collect facial images of the target user according to the preset moving speed of the humanoid health care robot to obtain the current facial infrared image; The current collection background parameter collection module is used to instruct the environmental sensor group to collect the current collection background parameters in real time; A current dynamic threshold generation module, used for inputting the current acquisition background parameter into a pre-trained background parameter dynamic matching parameter model to generate a current dynamic threshold; A temperature rise rate acquisition module is used to extract corner features of the current facial infrared image, obtain the forehead temperature and zygomatic temperature difference, and obtain the temperature rise rate of the target user within a preset time period; The target level abnormal warning determination module is used to match the current dynamic threshold according to the forehead temperature and zygomatic temperature difference and the temperature rise rate to obtain the target level abnormal warning, so as to realize the facial temperature abnormal warning of the humanoid health care robot according to the target level abnormal warning.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, it implements a facial temperature abnormality warning method based on a humanoid health care robot as described in any one of claims 1-7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement a facial temperature abnormality warning method based on a humanoid health care robot as described in any one of claims 1-7 when executed.
