Health monitoring systems and terminal equipment

Abstract

The present application provides a health monitoring system for a communication device. The health monitoring system includes: a sensor for collecting ear temperature data when the communication device is close to the user's ear; a camera for taking a body image of the user; and an analysis module for determining the user's body temperature status based on the ear temperature data, and / or comparing the body image with a standard abnormal image, and determining the user's abnormal status based on the comparison result. The technical solution of the present invention enables health monitoring to be performed while the user is using the communication device, improving the convenience of health monitoring.

Description

Technical Field

[0001] The present application relates to the field of monitoring technology, and in particular to a health monitoring system and terminal equipment. Background Art

[0002] As smart devices are equipped with more and more sensors and more functions, many devices are now equipped with health monitoring functions, such as heart rate monitoring on smart bracelets.

[0003] However, the health monitoring function in current smart devices requires the smart devices to be worn in specific parts of the body, which is inconvenient to use. Summary of the Invention

[0004] This application provides a health monitoring system and terminal device, and provides a technical solution for integrating health monitoring functions into communication equipment, which can perform health monitoring while the user is using the communication equipment, thereby improving the convenience of health monitoring.

[0005] In order to achieve the above objectives, this application provides the following technical solutions:

[0006] In a first aspect, a health monitoring system is provided, which includes: a sensor for collecting ear temperature data when the communication device is close to the user's ear; a shooting device for taking a body picture of the user; and an analysis module for judging the user's body temperature status based on the ear temperature data, and / or comparing the body picture with a standard abnormal picture, and determining the user's abnormal status based on the comparison result.

[0007] Optionally, the sensor includes: a first temperature sensor for collecting initial ear temperature at at least one measurement position of the ear; a second temperature sensor for collecting ambient temperature; and a distance sensor for measuring the distance between the communication device and the cochlea.

[0008] Optionally, the analysis module includes: an ear temperature correction unit, used to determine the nearest measurement position closest to the cochlea, and calculate the average value of the initial ear temperature collected at the nearest measurement position as the corrected ear temperature; an ear temperature calculation unit, used to determine the compensation value based on the ambient temperature, the distance and a preset mapping relationship, and calculate the sum of the corrected ear temperature and the compensation value as the final body temperature, and the preset mapping relationship includes multiple compensation values ​​and their corresponding ambient temperatures and distances.

[0009] Optionally, the analysis module includes: a first acquisition unit, used to obtain the user's age and a standard ear temperature corresponding to the user's age; a first analysis unit, used to compare the user's ear temperature data with the standard ear temperature to obtain the body temperature status.

[0010] Optionally, the analysis module includes: a second analysis unit, used to obtain at least one standard abnormal picture containing the same body part as the body picture, and calculate the similarity between the body picture and the at least one standard abnormal picture, and take the abnormal state indicated by the standard abnormal picture with the highest similarity as the abnormal state of the user.

[0011] Optionally, the standard abnormal pictures are stored in a database, wherein the database stores standard abnormal pictures of various body parts.

[0012] Optionally, the photographing device acquires a plurality of body images at preset time intervals, and the analyzing module generates an abnormal state trend according to abnormal states corresponding to the plurality of body images.

[0013] Optionally, the analysis module generates a monitoring report based on the body temperature status and / or the abnormal status, and outputs it.

[0014] Optionally, when the communication device is in shooting mode, the shooting device shoots two body pictures, one of the two body pictures is stored locally, and the other of the two body pictures is output to the analysis module.

[0015] In a second aspect, the present application also provides a terminal device, which includes the health monitoring system.

[0016] In a third aspect, a computer program product is provided, on which a computer program is stored, and the computer program is executed by a processor to perform a health monitoring method.

[0017] Compared with the prior art, the technical solution of the embodiment of the present application has the following beneficial effects:

[0018] The health monitoring system in this application's technical solution is integrated into a communication device and can monitor a user's health while they are using the device. The system includes a sensor that automatically measures ear temperature when the device is placed close to the user's ear. This allows for health monitoring without the user noticing, avoiding cumbersome operations and improving the user experience. The system also includes a camera and an analysis module. The analysis module compares body images captured by the camera with standard abnormality images to determine whether the user's health is abnormal, expanding the scope of health monitoring.

[0019] Furthermore, when the communication device is in shooting mode, the camera captures two body images, one of which is stored locally, and the other is output to the analysis module. In the technical solution of the present invention, the camera automatically captures the body image that needs to be analyzed when the user takes a photo, enabling body monitoring without the user's awareness, further improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a structural diagram of a health monitoring system provided by an embodiment of the present application;

[0021] Figure 2 is a structural diagram of another health monitoring system provided in an embodiment of the present application;

[0022] Figure 3 This is a flow chart of a health monitoring method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] As described in the background art, the health monitoring function in current smart devices requires the smart devices to be worn at specific locations, which is inconvenient to use.

[0024] This application provides a health monitoring system that is integrated into a communication device and can monitor a user's health while the device is in use. The system includes a sensor that automatically measures ear temperature when the device is placed near the user's ear. This allows for health monitoring without the user noticing, avoiding cumbersome operations and improving the user experience. The system also includes a camera and an analysis module. The analysis module compares body images captured by the camera with standard abnormality images to determine whether the user's health is abnormal, expanding the scope of health monitoring.

[0025] Furthermore, when the communication device is in shooting mode, the camera captures two body images, one of which is stored locally, and the other is output to the analysis module. In the technical solution of the present invention, the camera automatically captures the body image that needs to be analyzed when the user takes a photo, enabling body monitoring without the user's awareness, further improving the user experience.

[0026] See also Figure 1 The health monitoring system 10 provided in this application includes: a sensor 101, a shooting device 102 and an analysis module 103.

[0027] Among them, the sensor 101 is used to collect ear temperature data when the communication device is close to the user's ear; the shooting device 102 is used to take a picture of the user's body; the analysis module 103 is used to determine the user's body temperature status based on the ear temperature data, and / or compare the body picture with a standard abnormal picture, and determine the user's abnormal status based on the comparison result.

[0028] Specifically, the sensor 101 may be a temperature sensor, and the photographing device 102 may be a camera.

[0029] The health monitoring system in the embodiment of the present invention can be integrated into a communication device, such as a mobile phone, a telephone, etc. If the communication device has sensors and a camera, the health monitoring system can reuse the sensors and the camera in the communication device without the need for additional hardware.

[0030] In this embodiment, the body temperature status may be whether the user's body temperature is abnormal, or the type of the user's body temperature, such as normal, low fever, or high fever. In this embodiment, the abnormal state may be whether the user's body has a disease indicated by a standard abnormal picture.

[0031] Furthermore, the analysis module 103 may also generate a health status report, which includes body temperature status and abnormal status.

[0032] It is understood that, in a specific implementation, the analysis module 103 can implement the analysis function in the form of a software program, which runs in a processor integrated within the chip or chip module. The method can also be implemented in a combination of software and hardware, which is not limited in this application.

[0033] In this embodiment, when a user holds a communication device close to their ear while making a call, sensor 101 can detect the proximity of the communication device to the ear and automatically collect ear temperature data. When the user takes a photo, camera 102 can automatically capture a body image for health analysis without displaying the body image to the user. Through the technical solutions of the embodiments of the present invention, health data that needs to be monitored can be automatically collected when the user is using the communication device normally, without requiring additional user operations, thus achieving convenient health monitoring.

[0034] In a specific embodiment, the analysis module 103 can be a processor of the communication device, that is, the processor can determine the user's body temperature status based on the ear temperature data, and / or compare the body picture with the standard abnormal picture, and determine the user's abnormal status based on the comparison results.

[0035] In a non-limiting embodiment, the sensor 101 can directly collect the value of the ear temperature, and the ear temperature data includes the value of the ear temperature. The value of the ear temperature will be directly used to determine the body temperature status of the user.

[0036] In a specific implementation, the ear temperature value can be compared with the standard value to determine whether the body temperature is normal. For example, if the ear temperature value is greater than 37.5, it is considered that the user's body temperature is abnormal.

[0037] Alternatively, the current ear temperature value can be compared with the historical ear temperature value. If the current ear temperature value exceeds the preset threshold of the historical ear temperature value, the user's body temperature is judged to be abnormal. For example, if the current ear temperature value exceeds the historical ear temperature value by 2 degrees, the user's body temperature is considered to be abnormal.

[0038] Furthermore, the analysis module 103 can also determine the user's body temperature based on the user's age. Specifically, the analysis module 103 includes a first acquisition unit and a first analysis unit.

[0039] Among them, the first acquisition unit is used to obtain the user's age and the standard ear temperature corresponding to the user's age; the first analysis unit is used to compare the user's ear temperature data with the standard ear temperature to obtain the body temperature status.

[0040] For example, different standard ear temperatures are set for different age groups. For example, in the age group of 3 to 10 years old, an ear temperature value greater than 37.5 degrees and less than 39 degrees is considered a low fever, and above 39 degrees is considered a high fever.

[0041] In another non-limiting embodiment, see Figure 2 The sensor 101 may include a first temperature sensor 1011 , a second temperature sensor 1012 , and a distance sensor 1013 .

[0042] The first temperature sensor 1011 is used to collect initial ear temperature at at least one measurement location on the ear; the second temperature sensor 1012 is used to collect ambient temperature; and the distance sensor 1013 is used to measure the distance between the communication device and the cochlea. Accordingly, the ear temperature data includes the initial ear temperature, ambient temperature, and distance.

[0043] In this embodiment, by adding the second temperature sensor 1012 and the distance sensor 1013 to respectively collect the ambient temperature and the distance, the ear temperature can be calibrated to achieve more accurate ear temperature measurement.

[0044] It should be noted that the first temperature sensor 1011, the second temperature sensor 1012 and the distance sensor 1013 can be three independent sensors or one sensor. The sensor can measure ear temperature, ambient temperature, and distance, and this application does not impose any restrictions on this.

[0045] Furthermore, the calibration of ear temperature is achieved by the analysis module 103. Figure 3 The analysis module 103 may include an ear temperature correction unit 1031 and an ear temperature calculation unit 1032 .

[0046] Among them, the ear temperature correction unit 1031 is used to determine the nearest measurement position closest to the cochlea, and calculate the average value of the initial ear temperature collected at the nearest measurement position as the corrected ear temperature; the ear temperature calculation unit 1032 is used to determine the compensation value based on the ambient temperature, distance and preset mapping relationship, and calculate the sum of the corrected ear temperature and the compensation value as the final body temperature. The preset mapping relationship includes multiple compensation values ​​and their corresponding ambient temperature and distance.

[0047] Specifically, the ambient temperature, distance, and compensation value have a corresponding relationship, which can be obtained by pre-measurement. Specifically, the preset mapping relationship can be stored in the communication device in the form of a table, and the ear temperature calculation unit can directly call the preset mapping relationship from the communication device when it needs to determine the final body temperature.

[0048] Since the initial ear temperature collected by the first temperature sensor 1011 is affected by the ambient temperature and the distance between the communication device and the cochlea, in order to ensure the accuracy of the measurement, this embodiment can collect the ambient temperature and measure the distance between the communication device and the cochlea to correct the initial ear temperature.

[0049] In a non-limiting embodiment of the present invention, the analysis module 103 may include a second analysis unit configured to obtain at least one standard abnormal image that contains the same body part as the body image, calculate a similarity between the body image and the at least one standard abnormal image, and determine the abnormal state indicated by the standard abnormal image with the highest similarity as the abnormal state of the user. The abnormal state indicated by the standard abnormal image may be a disease.

[0050] Specifically, the body image may include at least one body part of the user. When performing the comparison, a standard abnormal image containing the same body part as the body image needs to be selected. For example, if the body image taken by the user is a facial image, then when performing the comparison, a standard abnormal image containing the face needs to be used for comparison. The process of comparing the body image with the standard abnormal image may refer to calculating the image similarity between the body image and the standard abnormal image.

[0051] Specifically, when comparing the body picture with a plurality of standard abnormal pictures, the standard abnormal picture with the greatest picture similarity to the body picture is selected, and the abnormal state indicated by the standard abnormal picture is used as the abnormal state of the user.

[0052] Of course, if the image similarity between the body image and all corresponding standard abnormal images is lower than a certain threshold, the user's body is considered to be in a normal state.

[0053] In a specific embodiment, each standard abnormal image is stored in a database, and the database stores standard abnormal images including each body part. The database can be a database in a communication device.

[0054] In a non-limiting embodiment, when the communication device is in a shooting mode, the shooting device 102 shoots two body pictures, one of the two body pictures is stored locally, and the other of the two body pictures is output to the analysis module 103 .

[0055] In an embodiment of the present invention, when a user takes a photo, the shooting device 102 will take two pictures. One picture is used to be displayed to the user and stored locally, and the other picture is not displayed to the user, but is directly transmitted to the analysis module 103 for health analysis.

[0056] The following example uses a body image as a face image. When a user opens the camera to take a selfie, a separate, non-beautified photo is automatically captured. After the camera captures the photo, it is automatically transmitted to the analysis module for processing. The analysis module first uses facial recognition to determine whether the user is the user. Once confirmed, it connects to the cloud image library and compares it with abnormal facial images, such as those showing rashes or lumps. The analysis module finds the most similar normal facial image, which then indicates the user's symptoms.

[0057] In a non-limiting embodiment, the photographing device 102 acquires a plurality of body images at a preset time interval, and the analyzing module 103 generates an abnormal state trend according to abnormal states corresponding to the plurality of body images.

[0058] Unlike the previous example, which compared a single body image, this example compares multiple body images, generating multiple comparison results. These results are analyzed chronologically to identify abnormality trends. For example, if a user develops a rash on their face, analyzing the comparison results over a period of time can reveal whether the condition is improving or worsening.

[0059] In a specific application scenario of the present invention, the function of the first sensor 101 to automatically collect ear temperature data can be manually enabled by the user, or automatically enabled when the user is on a call and automatically disabled when the user ends the call. Specifically, whether to enable the automatic ear temperature data collection function can be determined based on the distance between the communication device and the ear measured by the distance sensor. For example, if the measured distance between the communication device and the ear is less than a preset threshold, it can be determined that the user is on a call, and the automatic ear temperature data collection function can be enabled; otherwise, the function can be disabled.

[0060] Please refer to Figure 3 The embodiment of the present invention also discloses a flowchart of a health monitoring method. The method can be executed by a health monitoring system.

[0061] In step 301, ear temperature data and / or body pictures are acquired. Specifically, the ear temperature data can be acquired by a sensor, and the body pictures can be taken by a camera.

[0062] In step 302, the validity of the ear temperature data and / or body image is determined. For example, if the ear temperature data is 15 degrees, which is obviously inconsistent with human body temperature, the ear temperature data is considered invalid; if the body image does not contain any human body parts, the body image is also considered invalid.

[0063] If the ear temperature data and / or the body image are valid, continue to step 303 ; otherwise, continue to step 301 .

[0064] In step 303, the user's body temperature status is determined based on the ear temperature data, and / or the body image is compared with a standard abnormal image, and the user's abnormal status is determined based on the comparison result.

[0065] In step 304, a test report is generated and prompt information is output. The prompt information may output abnormal body temperature when the body temperature state is abnormal; the prompt information may output corresponding abnormal symptoms when the body picture has an abnormal state.

[0066] Specifically, steps 302 to 304 may be performed by an analysis module.

[0067] For more specific implementation methods of the embodiments of the present application, please refer to the aforementioned embodiments, which will not be repeated here.

[0068] Regarding the various modules / units contained in the various devices and products described in the above embodiments, they can be software modules / units, hardware modules / units, or partly software modules / units and partly hardware modules / units. For example, for various devices and products applied to or integrated into a chip, the various modules / units contained therein can all be implemented in the form of hardware such as circuits, or at least part of the modules / units can be implemented in the form of software programs, which run on the processor integrated inside the chip, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits; for various devices and products applied to or integrated into a chip module, the various modules / units contained therein can all be implemented in the form of hardware such as circuits, and different modules / units can be located in the same component of the chip module (such as a chip, circuit module, etc.) or in different components, or at least part of the modules / units can be implemented in the form of software programs. It is implemented in the form of a software program, which runs on the processor integrated inside the chip module, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits; for various devices and products applied to or integrated in the terminal equipment, the various modules / units contained therein can be implemented in the form of hardware such as circuits, and different modules / units can be located in the same component (for example, chip, circuit module, etc.) or different components in the terminal equipment, or, at least some modules / units can be implemented in the form of a software program, which runs on the processor integrated inside the terminal equipment, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits.

[0069] The present application also discloses a storage medium, which is a computer-readable storage medium having a computer program stored thereon, and the steps of the aforementioned method can be executed when the computer program is executed. The storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc. The storage medium may also include a non-volatile memory or a non-transitory memory, etc.

[0070] In a specific implementation, the aforementioned analysis module may be a processor. The processor may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application. The processor may also include multiple CPUs, and the processor may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. The processor here may refer to one or more devices, circuits, or processing cores for processing data (such as computer program instructions).

[0071] The aforementioned preset mapping relationship or standard abnormal picture can be stored in a memory. The memory can be a static storage device of ROM or other types that can store static information and instructions, a RAM or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code with instruction or data structure form and can be accessed by a computer, and the present embodiment does not impose any restrictions on this. The memory can be an independent existence (in this case, the memory can be located outside the device or inside the device), or it can be integrated with the processor. Wherein, a computer program code can be included in the memory. The processor is used to execute the computer program code stored in the memory, so as to realize the method provided by the embodiment of the present application. The processor and the memory are connected by a bus.

[0072] It should be understood that the term "and / or" in this document simply describes a relationship between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document indicates that the related objects are in an "or" relationship.

[0073] The term "plurality" used in the embodiments of the present application refers to two or more.

[0074] The first, second, etc. descriptions appearing in the embodiments of this application are only for illustration and distinction of the description objects. There is no order, nor does it indicate any special limitation on the number of devices in the embodiments of this application, and cannot constitute any limitation on the embodiments of this application.

[0075] The "connection" appearing in the embodiments of the present application refers to various connection methods such as direct connection or indirect connection to achieve communication between devices, and the embodiments of the present application do not impose any limitations on this.

[0076] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer program are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means.

[0077] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0078] In the several embodiments provided in this application, it should be understood that the disclosed methods, devices, and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is merely a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be electrical, mechanical, or other forms.

[0079] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0080] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may be physically included separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0081] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to perform some steps of the method described in each embodiment of the present application.

[0082] Although the present application is disclosed as above, the present application is not limited thereto. Any person skilled in the art may make various changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims.

Claims

1. A health monitoring system for a communication device, characterized in that: The health monitoring system comprises: a sensor for collecting ear temperature data when the communication device is close to the user's ear; a photographing device, configured to take a body picture of the user; an analysis module, configured to compare the body image with a standard abnormal image and determine the abnormal state of the user based on the comparison result; triggering the capture of two body pictures when the communication device is in a capture mode, wherein one of the two body pictures is stored locally, and the other of the two body pictures is output to the analysis module, and the other of the two body pictures is a non-beautified picture; The analysis module determines whether the body picture is the user himself based on the body picture, and compares the body picture with a standard abnormal picture after determining that the body picture is the user himself.

2. The health monitoring system according to claim 1, characterized in that The sensor comprises: a first temperature sensor, configured to collect an initial ear temperature at at least one measurement location in the ear; A second temperature sensor is used to collect ambient temperature; A distance sensor is used to measure the distance between the communication device and the cochlea.

3. The health monitoring system according to claim 2, wherein: The analysis module includes: an ear temperature correction unit, configured to determine a nearest measurement position closest to the cochlea, and calculate an average value of initial ear temperatures collected at the nearest measurement position as a corrected ear temperature; An ear temperature calculation unit is used to determine a compensation value based on the ambient temperature, the distance, and a preset mapping relationship, and calculate the sum of the corrected ear temperature and the compensation value as the final body temperature. The preset mapping relationship includes multiple compensation values ​​and their corresponding ambient temperatures and distances.

4. The health monitoring system according to claim 1, wherein: The analysis module includes: a first acquiring unit, configured to acquire the user's age and a standard ear temperature corresponding to the user's age; The first analyzing unit is used to compare the ear temperature data of the user with the standard ear temperature to obtain the body temperature status.

5. The health monitoring system according to claim 1, wherein: The analysis module includes: The second analysis unit is configured to obtain at least one standard abnormal picture containing the same body part as the body picture, calculate the similarity between the body picture and the at least one standard abnormal picture, and use the abnormal state indicated by the standard abnormal picture with the highest similarity as the abnormal state of the user.

6. The health monitoring system according to claim 5, characterized in that The standard abnormal pictures are stored in a database, and the database stores standard abnormal pictures including various body parts.

7. The health monitoring system according to claim 1, wherein: The photographing device acquires a plurality of body images at preset time intervals, and the analyzing module generates an abnormal state trend according to abnormal states corresponding to the plurality of body images.

8. The health monitoring system according to claim 4, wherein: The analysis module generates a monitoring report according to the body temperature status and / or the abnormal status and outputs it.

9. A terminal device, characterized in that: A health monitoring system comprising the method according to any one of claims 1 to 8.

Images