Data processing method based on indoor environment monitoring and related device

Abstract

The invention provides a data processing method based on indoor environment monitoring and a related device. The data processing method is applied to a server in an environment monitoring system of a target indoor space, and the environment monitoring system further comprises an indoor monitoring device, an environment detection sensor and an environment adjusting device. The method comprises the following steps: acquiring monitoring video data according to a monitoring period; executing a person detection operation according to the monitoring video data to determine a detection result; if the detection result shows that the target user exists in the target indoor space, determining a target parameter value range matched with the target user; and according to the target parameter value range and the real-time parameter values acquired by the environment detection sensor, controlling the environment adjusting device to adjust the environment parameters. Thus, the server interacts with various devices, and adaptive adjustment can be performed on the indoor environment according to the difference of users in the indoor space and the difference of actual environment parameters, so that the requirements of the users are met, and the comprehensiveness and the flexibility of the environment monitoring system are improved.

Description

Technical Field

[0001] The present application belongs to the field of Internet of Things control, and specifically relates to a data processing method and related devices based on indoor environment monitoring. Background Art

[0002] At present, with the improvement of residents' living standards, residents have begun to pay more attention to their living environment, and their demand for intelligent life has also increased.

[0003] However, the existing methods for improving the indoor environment still require users to actively control the corresponding equipment to meet their own needs. For some users, the convenience of manually controlling the equipment is poor and the operation is difficult, so that users may not be able to effectively adjust the indoor environment, thereby reducing the quality of life of users. Summary of the invention

[0004] The present application provides a data processing method and related devices based on indoor environment monitoring, in order to improve the accuracy and flexibility of the environmental monitoring system in adjusting the environmental parameters of the target indoor space, and to improve the comprehensiveness of the environmental monitoring system in performing adaptive environmental adjustment for different users.

[0005] In a first aspect, an embodiment of the present application provides a data processing method based on indoor environment monitoring, which is applied to a server in an environment monitoring system of a target indoor space, wherein the environment monitoring system further includes an indoor monitoring device, an environment detection sensor, and an environment adjustment device, wherein the environment detection sensor is used to collect a preset type of environment parameter in the target indoor space, wherein each environment parameter corresponds to an environment parameter value and an environment adjustment device, and wherein the environment adjustment device is used to execute adjustment measures to adjust the corresponding environment parameter; the method includes:

[0006] According to a preset monitoring cycle, obtain monitoring video data collected by the indoor monitoring device;

[0007] Performing a person detection operation according to the surveillance video data to determine a detection result;

[0008] If the detection result indicates that the target user exists in the target indoor space, user information of the target user is determined according to the detection result, and the user information is used to characterize the type and behavior of the target user;

[0009] Determine a target parameter value range adapted to the user information in a preset parameter value range set, the parameter value range set including a plurality of reference parameter value ranges, each reference parameter value range corresponding to a reference user type and a reference user behavior, the reference parameter value range being used to characterize an interval range corresponding to an environmental parameter value determined to be adapted to the physical needs and activity needs of a target user in a target indoor space;

[0010] According to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

[0011] In a second aspect, an embodiment of the present application provides a data processing device based on indoor environment monitoring, which is applied to a server in an environment monitoring system of a target indoor space. The environment monitoring system also includes an indoor monitoring device, an environment detection sensor, and an environment adjustment device. The environment detection sensor is used to collect a preset type of environmental parameter in the target indoor space. Each environmental parameter corresponds to an environmental parameter value and an environment adjustment device. The environment adjustment device is used to execute adjustment measures to adjust the corresponding environmental parameter. The device includes:

[0012] An acquisition unit, used to acquire monitoring video data collected by the indoor monitoring device according to a preset monitoring cycle;

[0013] A detection unit, used to perform a person detection operation according to the monitoring video data to determine a detection result;

[0014] A first determining unit is configured to determine user information of the target user according to the detection result if the detection result indicates that the target user exists in the target indoor space, wherein the user information is used to characterize the type and behavior of the target user;

[0015] A second determination unit is used to determine a target parameter value range adapted to the user information in a preset parameter value range set, the parameter value range set including a plurality of reference parameter value ranges, each reference parameter value range corresponding to a reference user type and a reference user behavior, the reference parameter value range being used to characterize an interval range corresponding to the environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space;

[0016] The control unit is used to control the corresponding environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor.

[0017] In a third aspect, an embodiment of the present application provides a server, comprising a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the first aspect of the embodiment of the present application.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program / instruction stored thereon, which implements the steps in the first aspect of the embodiment of the present application when the computer program / instruction is executed by a processor.

[0019] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement some or all of the steps described in the first aspect of the embodiment of the present application.

[0020] It can be seen that in the embodiment of the present application, the server in the environmental monitoring system can interact with multiple types of devices to achieve adaptive adjustment of the indoor environment according to the individual differences and behavioral differences of target users in the indoor space, as well as the differences in actual environmental parameters, so as to meet the personalized needs of the target users, thereby improving the comprehensiveness and flexibility of the environmental monitoring system. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0022] Figure 1 is a structural block diagram of an environment monitoring system for a target indoor space provided in an embodiment of the present application;

[0023] Figure 2 It is a flow chart of a data processing method based on indoor environment monitoring provided by an embodiment of the present application;

[0024] Figure 3 It is a schematic diagram of a scenario in which a server performs a person detection operation provided by an embodiment of the present application;

[0025] Figure 4 This is a schematic diagram of a scenario in which different user information corresponds to a user provided in an embodiment of the present application;

[0026] Figure 5 It is a moisture comparison reference diagram corresponding to different preset objects provided in an embodiment of the present application;

[0027] Figure 6 This is a schematic diagram of a scenario in which a target user triggers an alarm provided in an embodiment of the present application;

[0028] Figure 7 This is a block diagram of the functional units of a data processing device based on indoor environment monitoring provided by an embodiment of the present application;

[0029] Figure 8 It is a block diagram of the functional units of another data processing device based on indoor environment monitoring provided by an embodiment of the present application;

[0030] Fig. 9It is a structural block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The technical solutions in the application embodiments are clearly and completely described. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0032] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0033] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0034] See also Figure 1 , Figure 1 is a structural block diagram of an environment monitoring system for a target indoor space provided by an embodiment of the present application. Figure 1As shown, the environment monitoring system 100 includes a server 110, an indoor monitoring device 120, an environment detection sensor 130 and an environment adjustment device 140, and the server 110 is connected to the indoor monitoring device 120, the environment detection sensor 130 and the environment adjustment device 140 by communication. Among them, the server 110 can be a server, or a server cluster composed of several servers, or a cloud computing service center. The indoor monitoring device 120 can be any camera device on the market that can realize communication connection with the server, and the environment detection sensor 130 and the environment adjustment device 140 are adapted according to the preset type of environmental parameters that the user in the target indoor space determines in advance and wants to control, that is, each environmental parameter corresponds to an environmental parameter value and an environmental adjustment device 140, the environment detection sensor 130 is used to collect the environmental parameters in the target indoor space, and the environmental adjustment device 140 is used to execute adjustment measures to adjust the corresponding environmental parameters. An environment monitoring system 100 can correspond to multiple indoor monitoring devices 120, environment detection sensors 130 and environment adjustment devices 140 at the same time, or the target indoor space includes multiple environment monitoring systems 100.

[0035] Based on this, an embodiment of the present application provides a data processing method based on indoor environment monitoring, and the embodiment of the present application is described in detail below in conjunction with the accompanying drawings.

[0036] See also Figure 2 , Figure 2 1 is a flow chart of a data processing method based on indoor environment monitoring provided by an embodiment of the present application, which is applied to a server 110 in an environment monitoring system 100 of a target indoor space, wherein the environment monitoring system 100 also includes an indoor monitoring device 120, an environment detection sensor 130 and an environment adjustment device 140; the method includes:

[0037] Step S201, acquiring monitoring video data collected by an indoor monitoring device according to a preset monitoring cycle.

[0038] Among them, the preset monitoring cycle should be less than the cycle in days. It is recommended to set it to a cycle in hours or minutes for monitoring to avoid too long a cycle, which will cause the environmental monitoring system to be unable to timely adjust the corresponding environmental parameters according to the specific situation of the target users active in the target indoor space, thereby failing to meet the actual needs of the users. Alternatively, the corresponding monitoring cycle can be determined according to the type of user in the target indoor space to ensure that the target indoor space is monitored and the corresponding environmental parameters are adjusted during the time when the user may be active. Specifically, if the user type is a student, the monitoring cycle is determined by combining the indoor monitoring device to determine the time when the student usually goes to and from school; if the user belongs to the working crowd, the monitoring cycle is determined by combining the indoor monitoring device to determine the time when the working crowd usually goes to and from work, which is not limited here. By periodically acquiring monitoring video data to reduce the frequency of environmental parameter adjustment performed by the environmental monitoring system, the energy consumption of the system is reduced.

[0039] It can be understood that this application corresponds to a home scenario, and the acquisition of user data and other data involved in this application should be obtained after user authorization.

[0040] Step S202: Perform a person detection operation based on the monitoring video data to determine a detection result.

[0041] In a possible embodiment, a person detection operation is performed based on monitoring video data to determine a detection result, including: determining audio data and image data based on the monitoring video data; if no user activity sound is detected in the audio data, judging whether there is a target object in motion in the image data based on adjacent image frames in the image data; if there is a target object, and the outer contour of the target object is a human shape, determining that a target user exists in the target indoor space, and determining facial feature information and motion information of the target user based on the image data, the facial feature information including the number of wrinkles and facial contour of a preset facial part; determining a target user type of the target user based on the number of wrinkles and facial contour of the preset facial part; determining the target user behavior based on the posture change information and the spatial position; and determining the detection result based on the target user behavior and the target user type.

[0042] Among them, the motion information includes the posture change information and spatial position of the target user, and the target user types include children, adults, and the elderly. It is understandable that the reason for dividing the target user types into children, adults, and the elderly is that the physical conditions of people at these age stages are different, and the parameter value ranges of the environmental parameters that can be adapted to each age stage are also different. Among them, relatively speaking, the sensitivity of the elderly and children to the environment is higher than that of adults. Therefore, when setting the corresponding parameter value range in the future, this difference needs to be considered. It is understandable that if the user activity sound is detected in the audio data, it can be determined that the target user exists in the target indoor space, and the subsequent steps can be skipped. The target user type can be determined directly through the image data, thereby improving the flexibility and efficiency of the server in data processing. And, if it is determined that there is no user in the target indoor space, there is no need to adjust the environmental parameters of the target indoor space, saving the power consumption of the system.

[0043] Among them, user activity sounds can be understood as sounds that people may make in daily life, which are used to distinguish them from animals and other objects. Specifically, the following sounds may be included: 1. Voice commands: commands or instructions issued by users verbally, such as commands in voice assistant interactions, conversations in telephone communications, etc. 2. Operation sounds: sounds generated when users use devices or perform operations, such as keyboard tapping, mouse clicking, button pressing, book turning, etc. 3. Body movement sounds: sounds generated when users perform physical activities, such as footsteps, hand movement sounds, snoring when sleeping, etc. 4. Other sounds: also includes various other sounds that may be generated by users, such as laughter, crying, singing, etc.

[0044] Among them, see Figure 3 , Figure 3 Schematic diagram of a scenario in which a server performs a person detection operation provided by an embodiment of the present application. Figure 3 As shown, in the process of determining the target user type, the user's facial feature information is obtained, including the number of wrinkles and facial contours in preset facial areas. Figure 3 The 01 in the figure is the facial contour corresponding to an adult. Figure 3 02 in the figure is the facial contour of the child. Figure 3 01 and Figure 3In 02, it can be clearly found that there are differences in the skull structure of different user types, that is, the skull of a child is usually rounder and more prominent, while the skull of an adult may be flatter and more mature. There are differences in the jaw line of different user types, that is, the jaw line of an adult may be more obvious and prominent, while the jaw line of a child may be relatively smooth and soft. By observing the characteristics of the jaw line in the facial contour, the user type of the target user is determined. In addition, there are differences in the cheeks and chins of different user types, that is, the cheeks of children are usually fuller and the chin may be relatively small. The cheeks of adults may be thinner and the chin is more prominent. Among them, the facial feature information also includes the number of wrinkles in preset facial parts. The preset facial parts are specific areas where wrinkles are most likely to appear based on daily experience, such as: around the eyes, forehead, corners of the mouth, and smile lines. Therefore, Figure 3 Picture 03 shows a close-up of a child's eyes. Figure 3 The close-up of the eyes of the elderly shown in 04 in FIG. It can be seen that the corners of the eyes of the child have no wrinkles, while the corners of the eyes of the elderly have wrinkles, and the number of wrinkles is three. The server can determine the relationship between the number of wrinkles in the preset parts, the facial contour characteristics and the age by obtaining enough facial feature information and the corresponding relationship between the actual age of the user in advance. Then, by obtaining the facial feature information of the target user, the actual user type of the target user currently in the target indoor space can be accurately determined.

[0045] It can be seen that in this example, the server obtains and analyzes the video data captured by the indoor monitoring device to determine whether there is a target user in the target indoor space and the type of the target user, so as to subsequently provide the corresponding environmental parameter value range, thereby improving the flexibility and practicality of the server in performing data processing.

[0046] Step S203: If the detection result indicates that the target user exists in the target indoor space, user information of the target user is determined according to the detection result.

[0047] Among them, user information is used to characterize the target user type and target user behavior.

[0048] Step S204: determine a target parameter value range that is adapted to the user information in a preset parameter value range set.

[0049] Among them, the parameter value range set includes multiple reference parameter value ranges, each reference parameter value range corresponds to a reference user type and a reference user behavior, and the reference parameter value range is used to characterize the interval range corresponding to the environmental parameter value determined by the physical needs and activity needs of the user in the target indoor space.

[0050] In one possible embodiment, before determining the target parameter value range based on the user information of the target user and a preset parameter value range set, the method also includes: obtaining the location information of the target indoor space and a historical environment monitoring information set associated with the current time period; determining the historical parameter value set corresponding to the usage information characterized as unused as a natural parameter value set; determining multiple benchmark parameter value ranges based on the natural parameter value set; and performing an update operation on the multiple benchmark parameter value ranges based on the location information and a preset individual preference set to determine the parameter value range set.

[0051] The historical environmental monitoring information set includes a set of historical parameter values ​​collected by the environmental detection sensor corresponding to the reference time period within the first preset number of days, and the use information of the environmental adjustment device, and the reference time period is the same as the current time period. Each reference parameter value range corresponds to an environmental parameter value, the minimum value of the reference parameter value range is the minimum value of the natural parameter values ​​corresponding to the environmental parameter value, and the maximum value of the reference parameter value range is the maximum value of the natural parameter values ​​corresponding to the environmental parameter value. The individual preference set is used to indicate the correction value of the reference parameter value of at least one environmental parameter corresponding to any user information compared to the reference parameter value.

[0052] The common point of the historical parameter value set in the historical environmental monitoring information set is that it is collected by the environmental detection sensor in the reference time period within the preset number of days. The purpose is to set the first preset number of days to avoid the large difference in the parameter value range obtained due to the large date gap causing the local seasonal climate change in the target indoor space to be too fast. The purpose of setting the reference time period is that in different time periods in some areas, the temperature changes too much or the humidity changes too much, and the difference in light intensity is also large. Therefore, it is necessary to obtain the historical parameter value set of the reference time period with the current time for reference. Otherwise, it will reduce the accuracy and effectiveness of the subsequent determination of the benchmark parameter value range.

[0053] For example, different indoor user behaviors may require specific illumination, noise level, temperature, and humidity to ensure their comfort and efficiency. Therefore, different user information will have different individual preferences. The following are some common indoor user behaviors and the specific environmental parameters they require: Work or study: 1. Illuminance: For long-term work or study, appropriate illumination can improve concentration and work efficiency. Generally speaking, the illumination in the work or study area should be between 300 and 500 lux. 2. Noise: A quiet environment is required to maintain concentration, so the noise level in the work or study area should be as low as possible below 50 decibels. 3. Temperature and humidity: Appropriate temperature and humidity help improve comfort and concentration. Generally speaking, the temperature should be kept between 21 and 23 degrees Celsius and the relative humidity should be between 40% and 60%. Sleep behavior: 1. Illuminance: When sleeping at night, a lower illumination is required to promote sleep. Therefore, the illumination in the sleeping environment should be as close to zero as possible. 2. Noise: A quiet environment is required to ensure good sleep quality, so the noise level in the sleeping environment should be as low as possible below 30 decibels. 3. Temperature and humidity: A cooler and moderately humid environment helps promote comfortable sleep. The temperature should be maintained at 18 to 20 degrees Celsius, and the relative humidity should be between 40% and 60%. Leisure and entertainment: 1. Illumination: Different leisure activities may require different light levels. For example, reading and movie watching may require higher illumination, while relaxing or enjoying music may require lower illumination. 2. Noise: When entertaining, the noise level should be adjusted according to the type of activity and personal preference. Some activities may require a quiet environment, while other activities may be accompanied by a certain degree of music or sound. 3. Temperature and humidity: Appropriate temperature and humidity help improve the comfort of leisure and entertainment activities. Generally speaking, the temperature should be maintained at 21 to 24 degrees Celsius, and the relative humidity should be between 40% and 60%. According to different indoor user behaviors, adjusting parameters such as illumination, noise level, temperature and humidity can improve user comfort, health and productivity. In addition, the target user can also communicate with the server based on his terminal device to upload his own environmental parameter preferences to adjust the parameter value range determined by the final server and improve the user experience.

[0054] For example, see Figure 4 , Figure 4 Schematic diagram of a scenario in which different user information corresponds to a user provided in an embodiment of the present application. Figure 4 As shown, Figure 4 The scene of the target indoor space. Figure 4 01 in the figure is an indoor monitoring device. Figure 4 02 in the figure is the environment detection sensor. Figure 403 in the figure is an environmental adjustment device. In this scenario, suppose it is a winter afternoon and the outdoor light is poor. At this time, the lighting system (i.e., environmental adjustment device) of the target indoor space remains on. However, due to the different user information corresponding to the target user in the target indoor space, the server will control the lighting system (i.e., environmental adjustment device) to increase or decrease the light. Specifically, the user information corresponding to the target user in this scenario (target user type, target user behavior) may include the following: Figure 4 The first user information corresponding to 04 in is (adult, learning). Figure 4 The second user information corresponding to 05 in is (adult, sleeping). Figure 4 The third user information corresponding to 06 is (children, entertainment). When the target user is an adult indicated by the first user information (i.e. Figure 4 04), the server will control the lighting system to increase the lighting intensity to ensure that adults can study comfortably; when the target user is an adult indicated by the second user information (i.e. Figure 4 05), the server will control the lighting system to turn off the lights to ensure the sleeping behavior of adults; when the target user is a child indicated by the third user information (i.e. Figure 4 06), the server will control the lighting system to increase the lighting intensity to ensure that children can play. However, it should be noted that, unlike adults, children are more sensitive to lighting intensity, so the lighting intensity of the lighting system will change more slowly, and the final lighting intensity will be softer.

[0055] It can be seen that in this example, the server obtains the location information of the target indoor space and combines it with the historical monitoring information to determine the benchmark parameter values ​​of the climate and season for the location of the target indoor space, and then combines it with the individual preference set to determine the parameter value range set, thereby improving the accuracy of the system in determining the parameter value range and improving the system's operating stability, avoiding frequent triggering of environmental adjustments due to environmental differences and individual differences.

[0056] In a possible embodiment, the individual preference set meets the following preset conditions: the numerical precision of the first correction value is less than the numerical precision of the second correction value, the type of environmental parameters corresponding to the special user behavior is greater than the type of environmental parameters corresponding to the normal user behavior, and any correction value does not exceed the preset correction threshold;

[0057] Among them, the first correction value is the correction value corresponding to when the reference user type is an adult, the second correction value is the correction value corresponding to when the reference user type is a child or an elderly person, special user behavior is user behavior with specific environmental parameter requirements, and normal user behavior is user behavior without environmental parameter requirements.

[0058] The special user behavior may be any of the following behaviors: work / study behavior, sleep behavior, and self-cultivation behavior, which are not limited here. The preset correction threshold is used to prevent the correction value collected by the individual preference set from making the final parameter value range unsuitable for the comfortable range of most people.

[0059] Among them, the determination of specific correction values ​​in the individual preference set can be achieved by collecting the parameter values ​​of the environmental parameter values ​​selected by the target users themselves corresponding to the information of different users living in the same area through big data, and then determining the average value as the correction based on the difference between each parameter value and the benchmark parameter value of the area.

[0060] It can be seen that in this example, by setting preset conditions for the data of the individual preference set, the server can set a more accurate and adaptive parameter value range according to the user information corresponding to each target user, so that the environmental parameters of the target indoor space can meet the user's life needs.

[0061] In one possible embodiment, based on location information and a preset individual preference set, an update operation is performed for multiple benchmark parameter value ranges to determine a parameter value range set, including: based on the location information, obtaining a reference weather type for the time corresponding to the natural parameter value set; if an extreme weather type exists, determining the natural parameter value set for a second preset number of consecutive days at the corresponding time as an abnormal parameter value set; and, if the extreme value of the benchmark parameter value range includes an abnormal parameter value in the abnormal parameter value set, updating the extreme value to the natural parameter value with the smallest difference corresponding to the same environmental parameter; and determining multiple reference parameter value ranges based on the updated benchmark parameter value range and at least one correction value corresponding to each user information.

[0062] Among them, the reference weather type includes extreme weather type or common weather type, the extreme weather type is a weather type whose occurrence frequency in the area where the target indoor space is located is lower than the preset occurrence frequency, the second preset number of days is less than the first preset number of days, and the second preset number of days is associated with the extreme weather type.

[0063] Among them, normal weather usually refers to the normal state of seasonal climate changes and the weather state that conforms to local climatic conditions. Generally speaking, normal weather has the following characteristics: Suitable temperature: The temperature is within the normal range of local seasonality, and there will be no extreme high or low temperature weather. Moderate humidity: The humidity level is within the comfortable range, not too high or too low, making people feel uncomfortable. Good air quality: The concentration of pollutants in the air is within the normal range and will not have a significant impact on human health. Moderate wind speed: The wind speed is moderate and will not affect daily activities and work. Suitable light: The sunshine time and light intensity are in line with the normal seasonal changes, and will not cause insufficient light or overexposure. Extreme weather refers to weather conditions that are beyond the normal range, which may have a greater impact on environmental parameters and even pose a threat to human life and health. The characteristics of extreme weather may include: Extreme temperature: High or low temperature weather exceeds the normal range of local seasonality, which may cause health problems such as heat stroke or frostbite. Extreme humidity: Extreme high or low humidity may affect the comfort and health of the human body, leading to problems such as dehydration or respiratory discomfort. Air pollution: Deterioration of air quality and concentration of pollutants exceeding normal ranges may cause respiratory or cardiovascular diseases. Strong winds and rainstorms: Extreme weather phenomena such as strong winds, heavy rains or hurricanes may cause wind disasters, floods and geological disasters, affecting people's lives and safety. Extreme light: High-intensity sunlight exposure or continuous rainy weather without sunlight may have adverse effects on human health and psychology.

[0064] Among them, the determination criteria for specific extreme weather are defined by the local long-term meteorological observation data and human physiological research of the target indoor space. The frequency of extreme weather is also low, usually lower than the preset frequency of occurrence. The types of extreme weather include but are not limited to the following: extreme temperatures, heavy rains and floods, storms and typhoons, ice and snow storms, droughts, and sandstorms. The parameter values ​​for this type of extreme weather are accidental, and because the environmental parameters in the subsequent days of extreme weather will be affected, the natural parameter values ​​of the second consecutive preset days corresponding to the time of extreme weather are set as abnormal parameter value sets to avoid using the values ​​of these parameter value sets as the extreme values ​​of the final benchmark parameter value range, thereby improving the accuracy of the final determination of the benchmark parameter value range, and thereby improving the accuracy of the parameter value range adapted to each user.

[0065] It can be seen that in this example, the server obtains the reference weather type to determine the extreme value of the parameter value range determined according to the extreme weather type, thereby updating the predetermined baseline parameter value range, avoiding the influence of the baseline parameter value range on the data by extreme weather with lower occurrence frequency and subsequent weather, thereby improving the accuracy of the data and the stability of the subsequent triggered environmental parameter adjustment.

[0066] Step S205 , controlling the corresponding environment adjustment device to adjust the environment parameter according to the target parameter value range and the real-time parameter value collected by the environment detection sensor.

[0067] Among them, the preset type of environmental parameters corresponding to the target parameter value range include but are not limited to temperature and humidity, air quality, noise intensity, and illuminance. For the above-mentioned environmental parameter types, the environmental conditioning device can be the following devices: a humidifier and a dehumidifier, wherein the humidifier is used to increase the indoor humidity, and the dehumidifier is used to reduce the indoor humidity. They can help regulate the humidity in the air and ensure a comfortable environment. An air purifier, wherein the air purifier can remove pollutants from the indoor air, thereby improving the air quality. A noise machine, wherein the noise machine can emit soft white noise or other ambient sounds to cover up the noise indoors and outdoors and provide a quieter environment. Curtains and blinds, wherein the indoor light can be controlled by adjusting the opening and closing degree of the curtains and blinds. Smart lamps, wherein the smart lamps can change the indoor illuminance by adjusting the brightness and color temperature, and provide a lighting environment suitable for different needs. An air conditioning system, wherein the air conditioning system can not only regulate the indoor temperature, but also circulate and filter the air, which helps to improve the air quality. A fan, which can provide air flow, helps to regulate the indoor temperature and air quality.

[0068] In a possible embodiment, if the preset type of environmental parameters includes air quality and temperature and humidity, and the environmental monitoring system also includes an air purification device and a ventilation device; according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the corresponding environmental adjustment device is controlled to adjust the environmental parameters, including: if the real-time parameter value corresponding to the air quality exceeds the corresponding target parameter value range, the monitoring image data taken by the indoor monitoring device and the air pollutant information collected by the environmental detection sensor are obtained; according to the surface image data, the shadow change area is determined; if the concentration of the pollutant is greater than or equal to the preset high concentration threshold, the air purification device is controlled to perform the air purification operation until the air quality is The corresponding real-time parameter value is reduced to within the target parameter value range; if the moisture coverage ratio does not exceed the preset ratio and the concentration of the pollutant is less than the high concentration threshold, the ventilation device is controlled to perform a ventilation operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range; if it is determined according to the video image data that the current user behavior belongs to the preset indoor activity, or the moisture coverage ratio exceeds the preset ratio, then according to the detected duration of the current user behavior, the ventilation device is controlled to perform a ventilation operation and the air purification device is controlled to perform an air purification operation; and, after the ventilation device is turned off, the air purification device is controlled to perform an air purification operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range.

[0069] Among them, the air pollutant information includes the type and concentration of pollutants in the air, the monitoring image data is the surface image data of the preset object captured by the indoor monitoring device during the monitoring period, the shadow change area is used to characterize the wet coverage area of ​​the object surface of the preset object due to the change of temperature and humidity, the high concentration threshold is associated with the type of pollutant, the preset ratio is associated with the object type of the preset object, and the wet coverage ratio is the ratio of the shadow change area to the total surface area of ​​the preset object. Among them, the object type of the preset object can be walls, tiles, floors, glass, etc., which are easy to observe the problem of the surface being affected by temperature and humidity, so that the monitoring device can capture and analyze.

[0070] Among them, when the air quality is poor, that is, when the real-time parameter value corresponding to the air quality exceeds the corresponding target parameter value range, the monitoring image data taken by the indoor monitoring and the air pollutant information collected by the environmental detection sensor are further combined for further data analysis. Among them, the monitoring image data is used to determine the surface image data of the preset object, so as to determine the degree of change of indoor temperature and humidity. The air pollutant information is used to determine the type and concentration of pollutants in the air, so as to determine the degree of air quality pollution. Combined with further analysis of these two types of specific data, the operation of the ventilation device and the air purification device is flexibly controlled in a hierarchical manner according to the actual environmental conditions to improve the environment of the target indoor space and improve the effectiveness and efficiency of the environmental adjustment device in adjusting the environmental parameters.

[0071] Among them, see Figure 5 , Figure 5 This is a humidity comparison reference corresponding to different preset objects provided in the embodiment of the present application. Figure 5 As shown, Figure 5 01 and 02 in the figure correspond to the initial state of the floor tiles and the wet state with the largest shadow change area. Figure 5 03 and 04 in the figure correspond to the initial state of the window glass and the wet state with the largest shadow change area. The surface of the floor tiles is covered with patterns and lines. When the floor tiles are wet, water droplets will condense on the surface. Figure 5 The shaded area of ​​02 in the figure can effectively determine the temperature and humidity in the current target indoor space based on the ratio of the area of ​​these shaded areas to the total surface area of ​​the tiles. The surface of the window glass is smooth and clean. When the glass is wet, water droplets will condense on the surface and there will be water marks where the water droplets slide down. The humidity level of the target indoor space can also be determined based on the wet coverage ratio.

[0072] It can be seen that in this example, when the parameter value of the air quality exceeds the parameter value range set above, the server will determine the specific conditions of the temperature, humidity and air quality of the target indoor space based on more abundant data, and determine the control method and control time of the environmental conditioning device based on the specific conditions and the actual use of the environmental conditioning device, thereby improving the efficiency and practicality of the environmental monitoring system in performing environmental parameter adjustment and enhancing the user experience.

[0073] In one possible embodiment, if the preset type of environmental parameter includes noise intensity, and the environmental monitoring system also includes an intelligent audio device; according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the corresponding environmental adjustment device is controlled to adjust the environmental parameters, including: if the real-time parameter value corresponding to the noise intensity is greater than the corresponding target parameter value range, then the music data of a preset number of songs recently played by the intelligent audio device and the noise data of a preset duration collected by the environmental detection sensor are obtained; according to the noise data, the noise intensity with the longest duration is determined as the initial audio volume; according to the noise data, the noise frequency range is determined; and, according to the music data, the sound frequency range corresponding to each song is determined; the song corresponding to the sound frequency range with the highest coverage of the noise frequency range is determined as the target playback song; the intelligent audio device is controlled to play the target playback song at the initial audio volume, and the audio volume of the intelligent audio device is adjusted in real time according to the environmental parameter value of the noise intensity.

[0074] Among them, obtaining the music data of a preset number of songs that have been played recently by the smart audio device for subsequent playback is to avoid users being uninterested in the songs being played, and playing the recently played songs can allow users to naturally ignore the impact of outdoor noise, thereby improving the user experience. Determining the songs corresponding to the sound frequency range with the highest coverage of the noise frequency range as the target song to be played can increase the success rate of playing songs to cover the noise, minimizing the possibility of users being affected by noise. Afterwards, the server will also adjust the audio volume of the smart audio device in real time according to the environmental parameter value of the noise intensity, so that when the noise intensity gradually decreases, the user can immediately return to a quiet and comfortable environment to work or study.

[0075] It can be seen that in this example, based on the characteristics of the music data and noise intensity recently played by the smart audio device, the adapted initial audio volume and the target song are determined for playback, so that the possibility of users being affected by noise is effectively reduced, thereby improving user comfort and the intelligence of the server-controlled environmental adjustment device.

[0076] In a possible embodiment, the environmental monitoring system also includes a user's terminal device and an alarm device; the method also includes: when the abnormal duration of any environmental parameter is greater than a second preset duration, determining that the environmental parameter corresponding to the abnormal duration is a dangerous environmental parameter; if the absolute value of the parameter value difference of the dangerous environmental parameter is greater than or equal to the alarm threshold, controlling the alarm device to perform an alarm operation and sending a first prompt message to the terminal device; if the absolute value of the parameter value difference of the abnormal environmental parameter exceeds and is less than the alarm threshold, obtaining the environmental parameter values ​​corresponding to multiple dangerous environmental parameters collected by the environmental detection sensor within the preset time period; determining a parameter value change graph based on the environmental parameter values ​​corresponding to the multiple dangerous environmental parameters; and generating a second prompt message based on the location of the environmental adjustment device corresponding to the dangerous environmental parameter.

[0077] Among them, the abnormal duration is the duration that the real-time parameter value corresponding to the environmental parameter is continuously less than or continuously greater than the corresponding target parameter value range, the parameter value difference is the difference between the real-time parameter value corresponding to the dangerous environment parameter and the adjacent extreme values ​​of the target parameter value range, the first prompt information is used to indicate that there is a danger in the target indoor space, and the prompt information is used to prompt the parameter type of the dangerous environment parameter; the second prompt information carrying a parameter value change graph is sent to the terminal device.

[0078] Among them, the reason for setting the second preset time is that when it is found that the environmental parameters exceed the normal range, it is necessary to reserve time for the environmental adjustment device to adjust the environmental parameters. Only when the environmental parameters are in an abnormal state for too long can it be said that the environmental parameters at this time are more dangerous, and the user needs to adjust the environmental parameters by himself or the detection device to see if it is faulty. When the absolute value of the parameter value difference is too large, the alarm device can be directly triggered to prompt the user to notice that there is a problem with the environment of the target indoor space. When the absolute value of the parameter value difference does not exceed the alarm threshold, the user can be prompted to adjust the environment by himself or leave the indoor space in a visual way.

[0079] Among them, the environmental monitoring system also has a natural disaster alarm function, which plays a key role in the environmental detection of indoor spaces. Natural disasters include earthquakes, fires, floods, etc. The server can synchronize the acquired natural disaster parameters to the user's terminal device, and the user can set the corresponding parameters through an intuitive interface. When a natural disaster risk is detected, the system will trigger an alarm in time and send a notification to the user.

[0080] It can be seen that in this example, by setting the second preset duration and alarm threshold to flexibly control the alarm device to alarm or allow the terminal device to visualize parameter messages, the user can intuitively understand the abnormal environmental parameters of the target indoor space and take timely measures, thereby improving the comprehensiveness and practicality of the environmental monitoring system.

[0081] In a possible embodiment, when the target user behavior is sleep behavior, the environment monitoring system also includes a physiological monitoring device, which is used to collect physiological data corresponding to a preset type of physiological indicator of the target user; the method also includes: after the environment adjustment device completes the execution of the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device are obtained in real time; and, if a user activity belonging to an abnormal activity is detected according to the monitoring video data, the corresponding environment adjustment device is controlled to adjust the environmental parameters according to the activity type of the user activity and the preset personalized adjustment strategy; or, if any physiological value of the target user exceeds the first numerical range and is within the second numerical range, the physiological indicator corresponding to the physiological value within the second numerical range is determined to be an abnormal indicator; and, according to the abnormal indicator and the personalized adjustment strategy, the corresponding environment adjustment device is controlled to adjust the environmental parameters.

[0082] Among them, the monitoring video is used to monitor the subsequent user activities that occur after the target user is in sleep behavior, the abnormal activities are used to reflect the physiological activities that the target user naturally performs when he is in sleep behavior with low sleep quality, the personalized adjustment strategy is used to characterize the activity type of each abnormal activity or the type of environmental parameter to be adjusted adapted by each abnormal indicator and the corresponding adjustment parameter value, the abnormal indicator is a physiological indicator whose corresponding physiological data belongs to abnormal physiological data, the first numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user in a normal physiological state during sleep behavior, and the second numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user due to abnormal environmental parameters.

[0083] Among them, physiological monitoring devices are divided into smart wearable devices (smart watches, bracelets) and non-wearable smart devices (mattresses, pillows, buckles, etc.). If it is a smart wearable device, the physiological monitoring device is worn by the target user to ensure that the target user's preset type of physiological indicators can be collected. If it is a non-wearable smart device, it is used according to the device type of the device, so that the device can effectively collect various physiological data when the target user is in sleep behavior. Abnormal activities can also be explained as physiological activities that are externally manifested when the target user is in a low-comfort indoor environment, resulting in low sleep quality or poor sleep status, including but not limited to night sweats (i.e. abnormal sweating during sleep behavior), kicking the quilt, frequent turning over, etc.

[0084] Furthermore, the server in this embodiment communicates and interacts with the devices in the remaining environment monitoring system to realize that after the environment adjustment device executes the preliminary adjustment measures, it will also provide the target user with comfortable personalized and precise further environment adjustment by monitoring the target user's various physiological indicators and the user activities of the target user in the sleep behavior. According to the device type of the remaining communication and interaction devices, this embodiment uses two ways to determine whether the target user has a comfortable experience in the sleep behavior scenario, one is the physiological data of the actual physiological indicators of the target user, and the other is whether the target user performs user activities that belong to abnormal activities. If it is detected that the target user has abnormal indicators (i.e., physiological values ​​that exceed the first numerical range and are in the second numerical range) and / or user activities with abnormal activities, the server can determine that the target user is in a sleep behavior with low sleep quality. At this time, the type and value of the environmental parameters corresponding to the next environmental adjustment operation are determined according to the personalized adjustment strategy to provide the target user with a comfortable sleeping environment. The relationship between the abnormal indicators, abnormal activities and the types and values ​​of the corresponding environmental parameters can be the following: for example, when the abnormal indicators are characterized by an increase in heart rate and respiratory rate, the indoor temperature is appropriately reduced or the air humidity is increased. Alternatively, when abnormal activities are detected such as frequent turning over or large body movements, it may mean that the user's sleep is unstable, which may be caused by factors such as overheating, overcooling or noise in the environment. The system can adjust the room temperature, humidity or start the white noise function based on these data. The detected night sweats may indicate that the user's body temperature is too high or the environment is stuffy. At this time, the system automatically turns on the air conditioner or fan to lower the room temperature. If the target user has abnormal indicators, the change value of the corresponding environmental parameter corresponds to the change value of the physiological value, or if the target user has abnormal activities, the change value of the corresponding environmental parameter can change slowly to a smaller value, and the time to stop the change is determined in combination with the duration of the abnormal activity detected by the target user, that is, when the abnormal activity of the target user is detected to end, the adjustment measures are stopped.

[0085] It can be seen that in this example, the subsequent monitoring operation when the target user behavior is sleeping behavior is protected, ensuring the real-time and accuracy of environmental adjustment, guaranteeing the user's sleep quality and health monitoring, and providing users with a personalized sleep experience. In addition, it avoids the impact of environmental discomfort on user sleep and allows for further adjustments, improving the intelligence and convenience of the system.

[0086] In a possible embodiment, the environmental monitoring system also includes a terminal device, which is carried by a designated guardian of the target user; after the environmental adjustment device completes the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device are obtained in real time, and the method also includes: if any physiological value of the target user exceeds the second numerical range, the physiological indicator corresponding to the physiological value exceeding the second numerical range is determined to be a danger indicator; and, a first alarm message carrying the danger indicator is sent to the terminal device; or, if user activities belonging to waking up behavior are detected according to the monitoring video data, and the current system time is in the local night time period, the indoor relative position and user posture of the target user are determined according to the monitoring video data; when it is detected that the indoor relative position is in a preset danger zone, or the user posture is a falling posture, a second alarm message is sent to the terminal device.

[0087] Among them, the first alarm information is used to instruct the terminal device to execute the first alarm operation corresponding to the danger indicator to prompt the designated guardian, and the second alarm information is used to instruct the terminal device to execute the second alarm operation. The operation types of the first alarm operation and the second alarm operation are different.

[0088] Among them, since the user type of the target user may be a child or an elderly person, when they have user activities of getting up at night, there may be no one to take care of them. In order to avoid sleepwalking or uncontrollable behavior that may cause accidents, it is determined by monitoring the video data whether the target user has moved to a dangerous area in a preset indoor space, or the user posture of the target user is characterized as a falling posture, to ensure that the designated guardian can timely avoid accidents of the target user, shorten the response time and prevent accidents. The preset dangerous area can be a balcony area, an area near a window, an area near unstable furniture or household appliances (such as a bookcase, a drawer cabinet, a TV, a refrigerator, etc.), stairs, steps, etc., which are not limited here. Further, the terminal device can be a mobile phone, a watch, a bracelet, etc. carried by a designated guardian, that is, a device that the designated guardian can carry with him, which has a certain portability. The operation type of the first alarm operation and the second alarm operation can be different, so that the designated guardian can know through the operation type whether the situation that occurred belongs to the user falling or entering the preset dangerous area. Operation types include but are not limited to sound alarms, light signal alarms, vibration alarms, and voice alarms, which can be specifically configured according to the functional modules of the device type of the terminal device to ensure the correct execution of the alarm operation.

[0089] For example, please refer to Figure 6 , Figure 6 Schematic diagram of a scenario in which a target user triggers an alarm provided by an embodiment of the present application. Figure 6As shown, in the target indoor space, taking the target user type as an elderly person as an example, when it is detected that the elderly person has left the bed area (i.e., it is determined that he has gotten up), and the current system time is in the local night time period, the server can execute the data processing in this embodiment to obtain monitoring video data, and determine through the monitoring video data whether the elderly person has entered the preset dangerous area determined by the bookshelf and the window, and whether the elderly person's user posture appears to be a falling posture. If it is determined according to the monitoring video data that the elderly person has the above events, the terminal device of the designated guardian is controlled according to the corresponding event to execute an alarm operation to prompt the designated guardian person to go to the target indoor space to check on the elderly person and protect his safety.

[0090] It can be seen that in this example, the server obtains physiological data to determine the danger index, and obtains monitoring video data to determine whether the target user has got up at night during sleep, and then introduces personnel positioning and fall detection, so as to timely send an alarm to the designated guardian through the terminal device. In this way, the guardian can be quickly notified to take immediate measures to protect the health of the target user, improve the efficiency of treatment, and prevent accidents, which is conducive to reducing the care burden of the guardian.

[0091] visible, Figure 2 It is a flow chart of a data processing method based on indoor environment monitoring provided in an embodiment of the present application. In the embodiment of the present application, the server can realize adaptive adjustment of the indoor environment according to the differences of users in the indoor space and the actual environmental parameters through interaction with multiple types of devices to meet user needs, thereby improving the comprehensiveness and flexibility of the environmental monitoring system, and improving the intelligence of the environmental monitoring system, thereby enhancing the user experience.

[0092] The following is an embodiment of the device of the present application. The embodiment of the device of the present application and the embodiment of the method of the present application are of the same concept and are used to execute the method described in the embodiment of the present application. For the convenience of explanation, the embodiment of the device of the present application only shows the part related to the embodiment of the device of the present application. For the specific technical details not disclosed, please refer to the description of the embodiment of the method of the present application, which will not be repeated here one by one.

[0093] The present invention provides a data processing device based on indoor environment monitoring, which is applied to Figure 1The server 110 in the environment monitoring system 100 of the target indoor space shown in the figure, the environment monitoring system 100 also includes an indoor monitoring device 120, an environment detection sensor 130 and an environment adjustment device 140, the environment detection sensor 130 is used to collect the preset type of environmental parameters in the target indoor space, and the environment adjustment device 140 is used to execute adjustment measures to adjust the corresponding environmental parameters; specifically, the data processing device based on indoor environment monitoring is used to execute the steps executed by the server 110 in the above data processing method based on indoor environment monitoring. The data processing device based on indoor environment monitoring provided in the embodiment of the present application may include modules corresponding to the corresponding steps.

[0094] The embodiment of the present application can divide the functional modules of the data processing device based on indoor environment monitoring according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. The division of modules in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation. In the case of dividing each functional module according to each function, Figure 7 : This is a functional unit composition block diagram of a data processing device based on indoor environment monitoring provided by an embodiment of the present application; the data processing device 70 based on indoor environment monitoring includes: an acquisition unit 701, which is used to acquire monitoring video data collected by an indoor monitoring device according to a preset monitoring period; a detection unit 702, which is used to perform a person detection operation according to the monitoring video data to determine a detection result; a first determination unit 703, which is used to determine the user information of the target user according to the detection result if the detection result indicates that there is a target user in the target indoor space, and the user information is used to characterize the target user type and the target user behavior; a second determination unit 704, which is used to determine a target parameter value range adapted to the user information in a preset parameter value range set, the parameter value range set includes multiple reference parameter value ranges, each reference parameter value range corresponds to a reference user type and a reference user behavior, and the reference parameter value range is used to characterize the interval range corresponding to the environmental parameter value determined by the physical needs and activity needs of the target user in the target indoor space; a control unit 705, which is used to control the corresponding environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor.

[0095] In a possible embodiment, in performing a person detection operation based on video data to determine a detection result, the detection unit 702 is specifically used to: determine audio data and image data based on the video data; if no user activity sound is detected in the audio data, determine whether there is a target object in motion in the image data based on adjacent image frames in the image data; if there is a target object, and the outer contour of the target object is a human shape, determine that there is a user in the target indoor space, and determine the user's facial feature information and motion information based on the image data, the facial feature information includes the number of wrinkles and facial contours of preset facial parts, and the motion information includes the user's posture change information and spatial position; determine the user's target user type based on the number of wrinkles and facial contours of preset facial parts, and the target user types include children, adults, and the elderly; determine the user's target user behavior based on the posture change information and the spatial position; determine the detection result based on the target user behavior and the target user type.

[0096] In a possible embodiment, before determining the target parameter value range according to the user information of the user and the preset parameter value range set, the second determination unit 704 is specifically further used to: obtain the location information of the target indoor space and the historical environment monitoring information set associated with the current time period, the historical environment monitoring information set including the historical parameter value set collected by the environment detection sensor corresponding to the reference time period within the first preset number of days, and the usage information of the environment adjustment device, the reference time period and the current time period being the same period; determine the historical parameter value set corresponding to the usage information characterized as unused as the natural parameter value set; determine multiple benchmark parameter value ranges according to the natural parameter value set, each benchmark parameter value range corresponds to an environmental parameter value, the minimum value of the benchmark parameter value range is the minimum value of the natural parameter values ​​corresponding to the environmental parameter value, and the maximum value of the benchmark parameter value range is the maximum value of the natural parameter values ​​corresponding to the environmental parameter value; perform an update operation on multiple benchmark parameter value ranges according to the location information and the preset individual preference set to determine the parameter value range set, wherein the individual preference set is used to indicate the correction value of the reference parameter value of at least one environmental parameter corresponding to any one user information compared to the benchmark parameter value.

[0097] In a possible embodiment, the individual preference set meets the following preset conditions: the numerical accuracy of the first correction value is less than the numerical accuracy of the second correction value, the types of environmental parameters corresponding to special user behaviors are greater than the types of environmental parameters corresponding to normal user behaviors, and any correction value does not exceed a preset correction threshold; wherein the first correction value is the correction value corresponding to when the reference user type is an adult, the second correction value is the correction value corresponding to when the reference user type is a child or an elderly person, special user behavior is user behavior with specific environmental parameter requirements, and normal user behavior is user behavior without environmental parameter requirements.

[0098] In one possible embodiment, in terms of performing an update operation on multiple benchmark parameter value ranges to determine a parameter value range set based on location information and a preset individual preference set, the second determination unit 704 is specifically used to: obtain a reference weather type for the time corresponding to the natural parameter value set based on the location information, the reference weather type includes an extreme weather type or a common weather type, the extreme weather type being a weather type whose occurrence frequency in the area where the target indoor space is located is lower than a preset occurrence frequency; if an extreme weather type exists, determine that a natural parameter value set for a second consecutive preset number of days at the corresponding time is an abnormal parameter value set, the second preset number of days is less than the first preset number of days, and the second preset number of days is associated with the extreme weather type; and, if an extreme value of the benchmark parameter value range includes an abnormal parameter value in the abnormal parameter value set, update the extreme value to a natural parameter value with the smallest difference corresponding to the same environmental parameter; and determine multiple reference parameter value ranges based on the updated benchmark parameter value range and at least one correction value corresponding to each user information.

[0099] In a possible embodiment, if the preset type of environmental parameters includes air quality and temperature and humidity, and the environmental monitoring system also includes an air purification device and a ventilation device; in terms of controlling the corresponding environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the control unit 705 is specifically used to: if the real-time parameter value corresponding to the air quality exceeds the corresponding target parameter value range, obtain the monitoring image data taken by the indoor monitoring device and the air pollutant information collected by the environmental detection sensor, the air pollutant information includes the type and concentration of pollutants in the air, and the monitoring image data is the surface image data of the preset object taken by the indoor monitoring device during the monitoring period; determine the shadow change area based on the surface image data, and the shadow change area is used to characterize the wet coverage area of ​​the object surface that changes due to changes in temperature and humidity of the preset object; if the concentration of the pollutant is greater than or equal to the preset high concentration threshold, control The air purification device is controlled to perform an air purification operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range, and the high concentration threshold is associated with the type of pollutant; if the moisture coverage ratio does not exceed the preset ratio, and the concentration of the pollutant is less than the high concentration threshold, the ventilation device is controlled to perform a ventilation operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range; if it is determined according to the video image data that the current user behavior belongs to the preset indoor activity, or the moisture coverage ratio exceeds the preset ratio, the ventilation device is controlled to perform a ventilation operation according to the detected duration of the current user behavior; and, after the ventilation device is turned off, the air purification device is controlled to perform an air purification operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range, the preset ratio is associated with the object type of the preset object, and the moisture coverage ratio is the ratio of the shadow change area to the total surface area of ​​the preset object.

[0100] In one possible embodiment, if the preset type of environmental parameter includes noise intensity, and the environmental monitoring system also includes an intelligent audio device; in terms of controlling the corresponding environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the control unit 705 is specifically used to: if the real-time parameter value corresponding to the noise intensity is greater than the corresponding target parameter value range, obtain the music data of a preset number of songs recently played by the intelligent audio device and the noise data of a preset duration collected by the environmental detection sensor; determine the noise intensity with the longest duration as the initial audio volume based on the noise data; determine the noise frequency range based on the noise data; and, determine the sound frequency range corresponding to each song based on the music data; determine the song corresponding to the sound frequency range with the highest coverage of the noise frequency range as the target playback song; control the intelligent audio device to play the target playback song at the initial audio volume, and adjust the audio volume of the intelligent audio device in real time according to the environmental parameter value of the noise intensity.

[0101] In a possible embodiment, when the target user behavior is sleep behavior, the environment monitoring system also includes a physiological monitoring device, which is used to collect physiological data corresponding to a preset type of physiological indicator of the target user; the control unit 705 is also specifically used to: after the environmental adjustment device completes the execution of the adjustment measures, obtain in real time the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device, the monitoring video is used to monitor subsequent user activities after the target user is in sleep behavior; and, if abnormal user activities are detected according to the monitoring video data, the corresponding environment adjustment device is controlled to adjust the environmental parameters according to the activity type of the user activity and the preset personalized adjustment strategy, and the abnormal activity is used to reflect the natural actions of the target user in a sleep behavior with low sleep quality. The personalized adjustment strategy is used to characterize the activity type of each abnormal activity or the type of environmental parameter to be adjusted adapted by each abnormal indicator and the corresponding adjustment parameter value, and the abnormal indicator is a physiological indicator whose corresponding physiological data belongs to abnormal physiological data; or, if any physiological value of the target user exceeds the first numerical range and is within the second numerical range, the physiological indicator corresponding to the physiological value within the second numerical range is determined to be an abnormal indicator, the first numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user in a normal physiological state during sleep behavior, and the second numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user due to abnormal environmental parameters; and, according to the abnormal indicator and the personalized adjustment strategy, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

[0102] In a possible embodiment, the environment monitoring system also includes a terminal device, which is carried by a designated guardian of the target user; after the environment adjustment device completes the execution of the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device are obtained in real time, and the control unit 705 is specifically used to: if any physiological value of the target user exceeds the second numerical range, determine that the physiological indicator corresponding to the physiological value exceeding the second numerical range is a danger indicator; and send a first alarm message carrying the danger indicator to the terminal device, the first alarm message is used to instruct the terminal device to execute a first alarm operation corresponding to the danger indicator to prompt the designated guardian; or, if a user activity belonging to the behavior of getting up is detected according to the monitoring video data, and the current system time is in the local night time period, determine the indoor relative position and user posture of the target user according to the monitoring video data; when it is detected that the indoor relative position is in a preset danger zone, or the user posture is a fall posture, send a second alarm message to the terminal device, the second alarm message is used to instruct the terminal device to execute a second alarm operation, and the operation type of the first alarm operation is different from that of the second alarm operation.

[0103] In the case of an integrated unit, such as Figure 8 As shown, Figure 8 This is a block diagram of the functional units of another data processing device based on indoor environment monitoring provided by an embodiment of the present application. Figure 8 In the embodiment, the data processing device 70 based on indoor environment monitoring includes: a processing module 802 and a communication module 801. The processing module 802 is used to control and manage the actions of the data processing device based on indoor environment monitoring, for example, the steps of the acquisition unit 701, the detection unit 702, the first determination unit 703, the second determination unit 704 and the control unit 705, and / or other processes for executing the technology described herein. The communication module 801 is used to support the interaction between the data processing device based on indoor environment monitoring and other devices. Figure 8 As shown, the data processing device based on indoor environment monitoring may include a storage module 803, and the storage module 803 is used to store program codes and data of the data processing device based on indoor environment monitoring.

[0104] Among them, the processing module 802 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 801 can be a transceiver, an RF circuit or a communication interface, and the like. The storage module 803 can be a memory.

[0105] Among them, all relevant contents of each scene involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here. The above data processing device 70 based on indoor environment monitoring can execute the above Figure 2 The data processing method based on indoor environment monitoring is shown.

[0106] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0107] Fig. 9 is a structural block diagram of a server provided in an embodiment of the present application. Fig. 9As shown, the server 110 may include one or more of the following components: a processor 901, a memory 902 coupled to the processor 901, wherein the memory 902 may store one or more computer programs 903, and the one or more computer programs 903 may be configured to implement the methods described in the above embodiments when executed by one or more processors 901. The server 110 may be the server 110 in the above embodiments.

[0108] The processor 901 may include one or more processing cores. The processor 901 uses various interfaces and lines to connect the various parts of the entire server 110, and executes various functions and processes data of the server 110 by running or executing instructions, programs, code sets or instruction sets stored in the memory 902, and calling data stored in the memory 902. Optionally, the processor 901 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 901 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 901, and it can be implemented separately through a communication chip.

[0109] The memory 902 may include a random access memory (RAM) or a read-only memory (ROM). The memory 902 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the server 110 during use, etc.

[0110] It is understandable that the server 110 may include more or fewer structural elements than those in the above structural block diagram, which is not limited here.

[0111] An embodiment of the present application also provides a computer storage medium, on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, part or all of the steps of any method recorded in the above method embodiments are implemented.

[0112] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any method recorded in the above method embodiments.

[0113] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed methods, devices and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0115] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0116] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0117] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a volatile memory or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) and direct memory bus random access memory (directrambus RAM, DR RAM) and other media that can store program code.

[0118] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the present invention, and can make various changes and modifications, including the combination of the above-mentioned different functions and implementation steps, including software and hardware implementation methods, all of which are within the scope of protection of the present invention.

Claims

1. A data processing method based on indoor environment monitoring, characterized in that: A server used in an environment monitoring system for a target indoor space, wherein the environment monitoring system further comprises an indoor monitoring device, an environment detection sensor and an environment adjustment device, wherein the environment detection sensor is used to collect a preset type of environment parameter in the target indoor space, each of the environment parameters corresponds to an environment parameter value and an environment adjustment device, and the environment adjustment device is used to execute adjustment measures to adjust the corresponding environment parameter; the method comprises: Acquiring monitoring video data collected by the indoor monitoring device according to a preset monitoring cycle; Performing a person detection operation according to the surveillance video data to determine a detection result; If the detection result indicates that a target user exists in the target indoor space, user information of the target user is determined according to the detection result, where the user information is used to characterize the type of the target user and the behavior of the target user; Determine a target parameter value range adapted to the user information in a preset parameter value range set, the parameter value range set comprising a plurality of reference parameter value ranges, each of the reference parameter value ranges corresponding to a reference user type and a reference user behavior, the reference parameter value range being used to characterize an interval range corresponding to the environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space; According to the target parameter value range and the real-time parameter value collected by the environment detection sensor, the corresponding environment adjustment device is controlled to adjust the environment parameter.

2. The method according to claim 1, characterized in that The performing of a person detection operation according to the monitoring video data to determine a detection result includes: Determining audio data and image data according to the surveillance video data; If no user activity sound is detected in the audio data, then judging whether there is a target object in motion in the image data according to adjacent image frames in the image data in sequence: If the target object exists and the outer contour of the target object is a human, it is determined that the target user exists in the target indoor space, and facial feature information and motion information of the target user are determined according to the image data, wherein the facial feature information includes the number of wrinkles and the facial contour of a preset facial part, and the motion information includes posture change information and the spatial position of the target user; Determining the target user type of the target user according to the number of wrinkles in the preset facial area and the facial contour, the target user type including children, adults, and the elderly; Determining the target user behavior according to the posture change information and the spatial position; The detection result is determined according to the target user behavior and the target user type.

3. The method according to claim 2, characterized in that Before determining the target parameter value range according to the user information of the target user and the preset parameter value range set, the method further includes: Acquire geographic location information of the target indoor space and a set of historical environment monitoring information associated with a current time period, wherein the set of historical environment monitoring information includes a set of historical parameter values ​​collected by the environment detection sensor corresponding to a reference time period within a first preset number of days, and usage information of the environment adjustment device, wherein the reference time period is the same as the current time period; Determining that a historical parameter value set corresponding to the usage information characterized as unused is a natural parameter value set; Determine a plurality of reference parameter value ranges according to the natural parameter value set, each reference parameter value range corresponds to one environmental parameter value, the minimum value of the reference parameter value range is the minimum value among the natural parameter values ​​corresponding to the environmental parameter value, and the maximum value of the reference parameter value range is the maximum value among the natural parameter values ​​corresponding to the environmental parameter value; According to the geographic location information and a preset individual preference set, an update operation is performed on the multiple benchmark parameter value ranges to determine the parameter value range set, wherein the individual preference set is used to indicate a correction value of the reference parameter value of at least one of the environmental parameters corresponding to any one type of user information compared to the benchmark parameter value.

4. The method according to claim 3, characterized in that The individual preference set meets the following preset conditions: The numerical precision of the first correction value is less than the numerical precision of the second correction value, the type of the environmental parameter corresponding to the special user behavior is greater than the type of the environmental parameter corresponding to the normal user behavior, and any one of the correction values ​​does not exceed the preset correction threshold; Among them, the first correction value is the correction value corresponding to when the reference user type is the adult, the second correction value is the correction value corresponding to when the reference user type is the child or the elderly, the special user behavior is the user behavior with specific environmental parameter requirements, and the normal user behavior is the user behavior without the environmental parameter requirements.

5. The method according to claim 3, characterized in that: The performing an update operation on the plurality of reference parameter value ranges according to the geographical location information and the preset individual preference set to determine the parameter value range set includes: According to the geographic location information, a reference weather type of the time corresponding to the natural parameter value set is obtained, where the reference weather type includes an extreme weather type or a common weather type, and the extreme weather type is a weather type whose occurrence frequency in the area where the target indoor space is located is lower than a preset occurrence frequency; If the extreme weather type exists, determining the natural parameter value set of a second preset number of consecutive days corresponding to the time as an abnormal parameter value set, the second preset number of days is less than the first preset number of days, and the second preset number of days is associated with the extreme weather type; and, If the extreme value of the reference parameter value range includes the abnormal parameter value in the abnormal parameter value set, then updating the extreme value to the natural parameter value with the smallest difference corresponding to the same environmental parameter; The multiple reference parameter value ranges are determined according to the updated benchmark parameter value range and at least one correction value corresponding to each user information.

6. The method according to any one of claims 1 to 5, characterized in that: When the target user behavior is sleeping behavior, the environment monitoring system further includes a physiological monitoring device, and the physiological monitoring device is used to collect physiological data corresponding to a preset type of physiological indicator of the target user; The method further comprises: After the environmental adjustment device completes the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device are acquired in real time, wherein the monitoring video is used to monitor the subsequent user activities of the target user after the sleep behavior; and If a user activity belonging to an abnormal activity is detected according to the monitoring video data, then according to the activity type of the user activity and a preset personalized adjustment strategy, the corresponding environment adjustment device is controlled to adjust the environmental parameters, the abnormal activity is a physiological activity naturally performed by the target user under the sleep behavior of low sleep quality, the personalized adjustment strategy is used to characterize the activity type of each abnormal activity or the type of environmental parameter to be adjusted adapted by each abnormal indicator and the corresponding adjustment parameter value, and the abnormal indicator is a physiological indicator whose corresponding physiological data belongs to abnormal physiological data; or, If any one of the physiological values ​​of the target user exceeds the first numerical range and is within the second numerical range, the physiological index corresponding to the physiological value within the second numerical range is determined to be the abnormal index, the first numerical range is used to indicate the numerical range corresponding to each physiological index of the target user in a normal physiological state during the sleep behavior, and the second numerical range is used to indicate the numerical range corresponding to each physiological index of the target user due to abnormal environmental parameters; and, according to the abnormal index and the personalized adjustment strategy, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

7. The method according to claim 6, characterized in that The environment monitoring system further includes a terminal device, which is carried by a designated guardian of the target user; after the environment adjustment device completes executing the adjustment measure, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video shot by the indoor monitoring device are acquired in real time, the method further includes: If any of the physiological values ​​of the target user exceeds the second numerical range, determining that the physiological index corresponding to the physiological value exceeding the second numerical range is a danger index; and Sending a first alarm message carrying the danger indicator to the terminal device, wherein the first alarm message is used to instruct the terminal device to execute a first alarm operation corresponding to the danger indicator to prompt the designated guardian; or If user activities belonging to waking up behaviors are detected according to the monitoring video data, and the current system time is in the local nighttime period, the indoor relative position and user posture of the target user are determined according to the monitoring video data; when it is detected that the indoor relative position is in a preset danger zone, or the user posture is a falling posture, a second alarm message is sent to the terminal device, and the second alarm message is used to instruct the terminal device to perform a second alarm operation, and the operation types of the first alarm operation and the second alarm operation are different.

8. A data processing device based on indoor environment monitoring, characterized in that: A server used in an environment monitoring system for a target indoor space, wherein the environment monitoring system further comprises an indoor monitoring device, an environment detection sensor and an environment adjustment device, wherein the environment detection sensor is used to collect a preset type of environment parameter in the target indoor space, each of the environment parameters corresponds to an environment parameter value and an environment adjustment device, and the environment adjustment device is used to execute adjustment measures to adjust the corresponding environment parameter; the device comprises: An acquisition unit, used to acquire the monitoring video data collected by the indoor monitoring device according to a preset monitoring period; A detection unit, configured to perform a person detection operation according to the monitoring video data to determine a detection result; A first determining unit, configured to determine user information of the target user according to the detection result if the detection result indicates that a target user exists in the target indoor space, wherein the user information is used to characterize a type of the target user and a behavior of the target user; A second determination unit is used to determine a target parameter value range adapted to the user information in a preset parameter value range set, the parameter value range set comprising a plurality of reference parameter value ranges, each of the reference parameter value ranges corresponding to a reference user type and a reference user behavior, the reference parameter value range being used to characterize an interval range corresponding to the environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space; The control unit is used to control the corresponding environment adjustment device to adjust the environment parameter according to the target parameter value range and the real-time parameter value collected by the environment detection sensor.

9. A server, characterized in that: The method comprises a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program for electronic data exchange is stored, wherein the computer program causes a computer to execute the method according to any one of claims 1 to 7.

Images