Data processing method and related device based on indoor environment monitoring

Abstract

The present application provides a data processing method and related devices based on indoor environmental monitoring, which are applied to a server in an environmental monitoring system of a target indoor space. The environmental monitoring system also includes an indoor monitoring device, an environmental detection sensor, and an environmental adjustment device. The method includes: obtaining monitoring video data according to a monitoring period; performing a person detection operation according to the monitoring video data to determine a detection result; if the detection result indicates that a target user exists in the target indoor space, determining a target parameter value range adapted to the target user; and controlling the environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor. In this way, the server can achieve adaptive adjustment of the indoor environment according to the differences in users in the indoor space and the differences in actual environmental parameters through interaction with multiple types of devices to meet user needs, thereby improving the comprehensiveness and flexibility of the environmental monitoring system.

Description

Technical Field

[0001] The present application relates to the field of Internet of Things control, and specifically to a data processing method and related devices based on indoor environment monitoring. Background Art

[0002] At present, with the improvement of residents' living standards, residents have begun to pay more attention to their living environment, and their demand for intelligent life has also increased.

[0003] However, existing methods for improving indoor environments still require users to actively control the corresponding equipment to meet their needs. For some users, manual control of equipment is inconvenient and difficult to operate, making it impossible for them to effectively adjust the indoor environment, thereby reducing their quality of life. Summary of the Invention

[0004] The present application provides a data processing method and related devices based on indoor environment monitoring, in order to improve the accuracy and flexibility of the environmental monitoring system in adjusting the environmental parameters of the target indoor space, and to improve the comprehensiveness of the environmental monitoring system in performing adaptive environmental adjustment for different users.

[0005] In a first aspect, an embodiment of the present application provides a data processing method based on indoor environment monitoring, which is applied to a server in an environment monitoring system of a target indoor space. The environment monitoring system also includes an indoor monitoring device, an environment detection sensor, and an environment adjustment device. The environment detection sensor is used to collect preset types of environmental parameters in the target indoor space. Each environmental parameter corresponds to an environmental parameter value and an environment adjustment device. The environment adjustment device is used to execute adjustment measures to adjust the corresponding environmental parameter. The method includes:

[0006] According to the preset monitoring cycle, obtain the monitoring video data collected by the indoor monitoring device;

[0007] Performing a person detection operation based on the surveillance video data to determine a detection result;

[0008] If the detection result indicates that the target user exists in the target indoor space, the user information of the target user is determined based on the detection result. The user information is used to characterize the target user type and target user behavior.

[0009] Determining a target parameter value range adapted to the user information from a preset parameter value range set, the parameter value range set including a plurality of reference parameter value ranges, each reference parameter value range corresponding to a reference user type and a reference user behavior, the reference parameter value range being used to represent an interval range corresponding to an environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space;

[0010] According to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

[0011] In a second aspect, an embodiment of the present application provides a data processing device based on indoor environment monitoring, which is applied to a server in an environment monitoring system for a target indoor space. The environment monitoring system also includes an indoor monitoring device, an environment detection sensor, and an environment adjustment device. The environment detection sensor is used to collect preset types of environmental parameters in the target indoor space. Each environmental parameter corresponds to an environmental parameter value and an environment adjustment device. The environment adjustment device is used to execute adjustment measures to adjust the corresponding environmental parameter. The device includes:

[0012] An acquisition unit, configured to acquire monitoring video data collected by the indoor monitoring device according to a preset monitoring period;

[0013] A detection unit, configured to perform a person detection operation based on the surveillance video data to determine a detection result;

[0014] A first determining unit is configured to determine user information of the target user based on the detection result if the detection result indicates that the target user exists in the target indoor space, where the user information is used to characterize the target user type and target user behavior;

[0015] a second determining unit, configured to determine a target parameter value range adapted to the user information from a preset parameter value range set, the parameter value range set including a plurality of reference parameter value ranges, each reference parameter value range corresponding to a reference user type and a reference user behavior, the reference parameter value range being used to represent an interval range corresponding to an environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space;

[0016] The control unit is used to control the corresponding environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor.

[0017] In a third aspect, an embodiment of the present application provides a server comprising a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the first aspect of the embodiment of the present application.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, the steps in the first aspect of the embodiment of the present application are implemented.

[0019] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements some or all of the steps described in the first aspect of the embodiment of the present application.

[0020] It can be seen that in the embodiment of the present application, the server in the environmental monitoring system can achieve adaptive adjustment of the indoor environment based on the individual differences and behavioral differences of target users in the indoor space, as well as the differences in actual environmental parameters, through interaction with multiple types of devices, so as to meet the personalized needs of the target users, thereby improving the comprehensiveness and flexibility of the environmental monitoring system. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 This is a structural block diagram of an environmental monitoring system for a target indoor space provided by an embodiment of the present application;

[0023] Figure 2 This is a flow chart of a data processing method based on indoor environment monitoring provided by an embodiment of the present application;

[0024] Figure 3 This is a schematic diagram of a scenario in which a server performs a person detection operation, provided by an embodiment of the present application;

[0025] Figure 4 This is a schematic diagram of a scenario in which different user information corresponds to users provided in an embodiment of the present application;

[0026] Figure 5 This is a humidity comparison reference corresponding to different preset objects provided in an embodiment of the present application;

[0027] Figure 6 This is a schematic diagram of a scenario in which a target user triggers an alarm, provided in an embodiment of the present application;

[0028] Figure 7 This is a block diagram of the functional units of a data processing device based on indoor environment monitoring provided by an embodiment of the present application;

[0029] Figure 8 This is a block diagram of the functional units of another data processing device based on indoor environment monitoring provided by an embodiment of the present application;

[0030] Figure 9This is a structural block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The technical solutions in the application embodiments are clearly and completely described. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this application.

[0032] The terms "first," "second," and the like in the specification and claims of this application and the accompanying drawings are used to distinguish between different objects, not to describe a particular order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0033] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0034] See also Figure 1 , Figure 1 This is a structural block diagram of an environmental monitoring system for a target indoor space provided by an embodiment of the present application. Figure 1As shown, the environmental monitoring system 100 includes a server 110, an indoor monitoring device 120, an environmental detection sensor 130, and an environmental adjustment device 140. The server 110 is communicatively connected to the indoor monitoring device 120, the environmental detection sensor 130, and the environmental adjustment device 140. The server 110 can be a single server, a server cluster consisting of multiple servers, or a cloud computing service center. The indoor monitoring device 120 can be any commercially available camera that is communicatively connected to the server. The environmental detection sensor 130 and the environmental adjustment device 140 are adapted to the preset type of environmental parameters that the user in the target indoor space desires to control. That is, each environmental parameter corresponds to an environmental parameter value and an environmental adjustment device 140. The environmental detection sensor 130 is used to collect the environmental parameters in the target indoor space, and the environmental adjustment device 140 is used to perform adjustment measures to adjust the corresponding environmental parameters. A single environmental monitoring system 100 can simultaneously support multiple indoor monitoring devices 120, environmental detection sensors 130, and environmental adjustment devices 140, or the target indoor space can include multiple environmental monitoring systems 100.

[0035] Based on this, an embodiment of the present application provides a data processing method based on indoor environment monitoring, and the embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0036] See also Figure 2 , Figure 2 1 is a flow chart of a data processing method based on indoor environment monitoring provided by an embodiment of the present application, which is applied to a server 110 in an environment monitoring system 100 of a target indoor space. The environment monitoring system 100 also includes an indoor monitoring device 120, an environment detection sensor 130, and an environment adjustment device 140. The method includes:

[0037] Step S201: Acquire monitoring video data collected by an indoor monitoring device according to a preset monitoring cycle.

[0038] Among them, the preset monitoring period should be less than the period in days. It is recommended to set it to a period in hours or minutes for monitoring to avoid an excessively long period, which will result in the environmental monitoring system being unable to timely adjust the corresponding environmental parameters according to the specific circumstances of the target users active in the target indoor space, thereby failing to meet the actual needs of the users. Alternatively, the corresponding monitoring period can be determined based on the type of user in the target indoor space to ensure that the target indoor space is monitored and the corresponding environmental parameters are adjusted during the time when the user is likely to be active. Specifically, if the user type is a student, the monitoring period can be determined by combining the indoor monitoring device to determine the time when the student usually goes to and from school; if the user is an office worker, the monitoring period can be determined by combining the indoor monitoring device to determine the time when the office worker usually goes to and from work. This is not limited here. By periodically acquiring monitoring video data to reduce the frequency of the environmental monitoring system performing environmental parameter adjustments, the energy consumption of the system can be reduced.

[0039] It can be understood that this application corresponds to a home scenario, and the acquisition of user data and other data involved in this application should be obtained after user authorization.

[0040] Step S202: Perform a person detection operation based on the surveillance video data to determine a detection result.

[0041] In one possible embodiment, a person detection operation is performed based on surveillance video data to determine a detection result, including: determining audio data and image data based on the surveillance video data; if no user activity sound is detected in the audio data, determining whether there is a target object in motion in the image data based on adjacent image frames in the image data; if there is a target object and the target object has a human-like outline, determining that a target user exists in the target indoor space, and determining facial feature information and motion information of the target user based on the image data, the facial feature information including the number of wrinkles and facial contour of a preset facial part; determining a target user type of the target user based on the number of wrinkles and facial contour of the preset facial part; determining the target user behavior based on the posture change information and the spatial position; and determining the detection result based on the target user behavior and target user type.

[0042] Among them, the motion information includes the target user's posture change information and spatial position, and the target user types include children, adults, and the elderly. It is understandable that the reason for dividing the target user types into children, adults, and the elderly is that the physical conditions of people in these age groups are different, and the parameter value ranges of the environmental parameters that each age group can adapt to are also different. Among them, relatively speaking, the elderly and children are more sensitive to the environment than adults. Therefore, when setting the corresponding parameter value ranges later, this difference needs to be considered. It is understandable that if the sound of user activity is detected in the audio data, it can be determined that the target user exists in the target indoor space, and the subsequent steps can be skipped. The target user type can be determined directly through the image data, thereby improving the flexibility and efficiency of the server's data processing. And, if it is determined that there is no user in the target indoor space, there is no need to adjust the environmental parameters of the target indoor space, saving the system's power consumption.

[0043] Among them, user activity sounds can be understood as sounds that people may make in daily life, which are used to distinguish them from animals and other objects. Specifically, the following sounds can be included: 1. Voice commands: commands or instructions issued by users verbally, such as commands in voice assistant interactions, conversations in telephone communications, etc. 2. Operation sounds: sounds generated when users use devices or perform operations, such as keyboard tapping, mouse clicking, button pressing, book turning, etc. 3. Body movement sounds: sounds generated when users perform physical activities, such as footsteps, hand movement sounds, snoring while sleeping, etc. 4. Other sounds: also includes various other sounds that may be generated by users, such as laughter, crying, singing, etc.

[0044] Among them, see Figure 3 , Figure 3 Schematic diagram of a scenario in which a server performs a person detection operation provided by an embodiment of the present application. Figure 3 As shown, in the process of determining the target user type, the user's facial feature information is obtained, including the number of wrinkles and facial contours of preset facial parts. Figure 3 The 01 in the figure is the facial contour corresponding to an adult. Figure 3 02 in the figure is the facial contour of the child. Figure 3 01 and Figure 3In 02, it can be clearly found that there are differences in the skull structure of different user types, that is, the skull of a child is usually rounder and more prominent, while the skull of an adult may be flatter and more mature. There are differences in the jaw line of different user types, that is, the jaw line of an adult may be more obvious and prominent, while the jaw line of a child may be relatively smooth and soft. By observing the characteristics of the jaw line in the facial contour, the user type of the target user is determined. In addition, there are differences in the cheeks and chins of different user types, that is, the cheeks of children are usually fuller and the chin may be relatively small. The cheeks of adults may be thinner and the chin is more prominent. Among them, the facial feature information also includes the number of wrinkles in preset facial parts. The preset facial parts are specific areas where wrinkles are most likely to appear based on daily experience, such as: around the eyes, forehead, corners of the mouth, and laugh lines. Therefore, Figure 3 Picture 03 shows a close-up of a child's eyes. Figure 3 The image 04 in the figure shows a close-up of an elderly person's eyes. It can be seen that the child has no wrinkles at the corners of his eyes, while the elderly person has three wrinkles. By obtaining sufficient facial feature information and the corresponding relationship between the user's actual age, the server can determine the relationship between the number of wrinkles in a preset area, facial contour characteristics, and age. Using this acquired facial feature information, the server can accurately determine the actual user type of the target user currently in the target indoor space.

[0045] It can be seen that in this example, the server obtains and analyzes the video data captured by the indoor monitoring device to determine whether there is a target user in the target indoor space and the type of the target user, so as to subsequently provide the corresponding environmental parameter value range, thereby improving the flexibility and practicality of the server in performing data processing.

[0046] Step S203: If the detection result indicates that the target user exists in the target indoor space, user information of the target user is determined according to the detection result.

[0047] Among them, user information is used to characterize the target user type and target user behavior.

[0048] Step S204: determining a target parameter value range that is adapted to the user information in the preset parameter value range set.

[0049] Among them, the parameter value range set includes multiple reference parameter value ranges, each reference parameter value range corresponds to a reference user type and a reference user behavior, and the reference parameter value range is used to represent the interval range corresponding to the environmental parameter value determined by the physical needs and activity needs of the user in the target indoor space.

[0050] In one possible embodiment, before determining the target parameter value range based on the user information of the target user and a preset parameter value range set, the method further includes: obtaining the location information of the target indoor space and a historical environmental monitoring information set associated with the current time period; determining the historical parameter value set corresponding to the usage information characterized as unused as a natural parameter value set; determining multiple baseline parameter value ranges based on the natural parameter value set; and performing an update operation on the multiple baseline parameter value ranges based on the location information and a preset individual preference set to determine the parameter value range set.

[0051] The historical environmental monitoring information set includes a set of historical parameter values ​​collected by environmental detection sensors corresponding to a reference time period within a first preset number of days, as well as usage information of environmental conditioning devices. The reference time period is the same as the current time period. Each baseline parameter value range corresponds to an environmental parameter value. The minimum value of the baseline parameter value range is the minimum value among the natural parameter values ​​corresponding to the environmental parameter value, and the maximum value of the baseline parameter value range is the maximum value among the natural parameter values ​​corresponding to the environmental parameter value. The individual preference set is used to indicate a correction value of the reference parameter value of at least one environmental parameter corresponding to any type of user information compared to the baseline parameter value.

[0052] The common feature of the historical parameter value sets in the historical environmental monitoring information set is that they are collected by environmental detection sensors within a reference time period within a preset number of days. The purpose of setting the first preset number of days is to avoid the large difference in the parameter value range obtained due to the local seasonal climate in the target indoor space changing too quickly due to large date gaps. The purpose of setting the reference time period is that in some areas, the temperature or humidity changes too much in different time periods, and the difference in illumination is also large. Therefore, it is necessary to obtain a historical parameter value set for the reference time period of the current time for reference. Otherwise, the accuracy and effectiveness of the subsequent determination of the benchmark parameter value range will be reduced.

[0053] For example, different indoor user behaviors may require specific lighting levels, noise levels, temperature, and humidity to ensure comfort and efficiency. Therefore, different user profiles may have different individual preferences. The following are some common indoor user behaviors and the specific environmental parameters they require: Working or studying: 1. Light: For long periods of work or study, appropriate lighting levels can improve concentration and productivity. Generally, the lighting level in work or study areas should be between 300 and 500 lux. 2. Noise: A quiet environment is required to maintain concentration, so the noise level in work or study areas should be kept below 50 decibels. 3. Temperature and humidity: Appropriate temperature and humidity contribute to comfort and concentration. Generally, the temperature should be maintained between 21 and 23 degrees Celsius, and the relative humidity should be between 40% and 60%. Sleeping: 1. Light: At night, low lighting levels are required to promote sleep. Therefore, the lighting level in the sleeping environment should be as close to zero as possible. 2. Noise: A quiet environment is required to ensure good sleep quality, so the noise level in the sleeping environment should be kept below 30 decibels. 3. Temperature and Humidity: A cooler and moderately humid environment promotes restful sleep. The temperature should be maintained between 18 and 20 degrees Celsius, and the relative humidity should be between 40 and 60%. Leisure and Entertainment: 1. Lighting: Different leisure activities may require different lighting levels. For example, reading and watching movies may require higher lighting levels, while relaxing or enjoying music may require lower lighting levels. 2. Noise: During leisure and entertainment, the noise level should be adjusted based on the type of activity and personal preference. Some activities may require a quiet environment, while others may be accompanied by a certain level of music or sound. 3. Temperature and Humidity: Appropriate temperature and humidity contribute to increased comfort during leisure and entertainment activities. Generally, the temperature should be maintained between 21 and 24 degrees Celsius, and the relative humidity should be between 40 and 60%. Adjusting parameters such as lighting, noise levels, temperature, and humidity based on different indoor user behaviors can improve user comfort, health, and productivity. Furthermore, target users can upload their environmental parameter preferences through communication with the server through their terminal devices, thereby adjusting the parameter value range determined by the server and enhancing the user experience.

[0054] For example, see Figure 4 , Figure 4 This is a schematic diagram of a scenario in which different user information corresponds to a user provided by an embodiment of the present application. Figure 4 As shown, Figure 4 The scene of the target indoor space. Figure 4 01 in the figure is an indoor monitoring device. Figure 4 02 in the code is an environmental detection sensor. Figure 403 in the example represents an environmental control device. In this scenario, let's assume it's a winter afternoon with poor outdoor light. The lighting system (i.e., environmental control device) in the target indoor space remains on. However, due to the different user information corresponding to the target user in the target indoor space, the server will control the lighting system (i.e., environmental control device) to increase or decrease the brightness. Specifically, the user information corresponding to the target user in this scenario (target user type, target user behavior) can include the following: Figure 4 The first user information corresponding to 04 is (adult, learning), Figure 4 The second user information corresponding to 05 is (adult, sleeping). Figure 4 The third user information corresponding to 06 is (children, entertainment). When the target user is an adult indicated by the first user information (i.e. Figure 4 04), the server will control the lighting system to increase the lighting intensity to ensure that adults can study comfortably; when the target user is the adult indicated by the second user information (i.e. Figure 4 05), the server will control the lighting system to turn off the lights to ensure the sleeping behavior of adults; when the target user is a child indicated by the third user information (i.e. Figure 4 In step 06), the server controls the lighting system to increase the lighting intensity to ensure that children can play. However, it should be noted that unlike adults, children are more sensitive to lighting intensity. Therefore, the lighting system's lighting intensity changes more slowly, and the final lighting intensity is softer.

[0055] It can be seen that in this example, the server obtains the location information of the target indoor space and combines it with historical monitoring information to determine the benchmark parameter values ​​of the climate and season for the location of the target indoor space. Then, combined with the individual preference set, the parameter value range set is determined, thereby improving the accuracy of the system in determining the parameter value range and improving the system's operational stability, avoiding frequent triggering of environmental adjustments due to environmental differences and individual differences.

[0056] In one possible embodiment, the individual preference set meets the following preset conditions: the numerical precision of the first correction value is less than the numerical precision of the second correction value, the types of environmental parameters corresponding to the special user behavior are greater than the types of environmental parameters corresponding to the normal user behavior, and any correction value does not exceed a preset correction threshold;

[0057] Among them, the first correction value is the correction value corresponding to when the reference user type is an adult, the second correction value is the correction value corresponding to when the reference user type is a child or an elderly person, special user behavior is user behavior with specific environmental parameter requirements, and normal user behavior is user behavior without environmental parameter requirements.

[0058] The special user behavior may be any of the following: work / study behavior, sleep behavior, and self-cultivation behavior, without limitation. The preset correction threshold is used to prevent the correction values ​​collected by the individual preference set from causing the final parameter value range to be unsuitable for the comfort of most people.

[0059] Among them, the determination of the specific correction value in the individual preference set can be achieved by collecting the parameter values ​​of the environmental parameter values ​​selected by the target users corresponding to the information of different users living in the same area through big data, and then determining the average value as the correction based on the difference between each parameter value and the benchmark parameter value of the area.

[0060] It can be seen that in this example, by setting preset conditions for the data of the individual preference set, the server can set a more accurate and adaptive parameter value range based on the user information corresponding to each target user, so that the environmental parameters of the target indoor space can meet the user's living needs.

[0061] In one possible embodiment, based on location information and a preset individual preference set, an update operation is performed on multiple benchmark parameter value ranges to determine a parameter value range set, including: obtaining a reference weather type for the time corresponding to the natural parameter value set based on the location information; if an extreme weather type exists, determining the natural parameter value set for a second preset number of consecutive days at the corresponding time as an abnormal parameter value set; and, if the extreme value of the benchmark parameter value range includes an abnormal parameter value in the abnormal parameter value set, updating the extreme value to the natural parameter value with the smallest difference corresponding to the same environmental parameter; and determining multiple reference parameter value ranges based on the updated benchmark parameter value range and at least one correction value corresponding to each user information.

[0062] Among them, the reference weather type includes extreme weather type or common weather type, the extreme weather type is a weather type whose occurrence frequency in the area where the target indoor space is located is lower than the preset occurrence frequency, the second preset number of days is less than the first preset number of days, and the second preset number of days is associated with the extreme weather type.

[0063] Normal weather generally refers to the normal state of seasonal climate change, consistent with local climatic conditions. Generally speaking, normal weather has the following characteristics: Suitable temperature: Temperatures are within the normal seasonal range, with no extreme high or low temperatures. Moderate humidity: Humidity levels are within a comfortable range, neither too high nor too low to cause discomfort. Good air quality: Pollutant concentrations in the air are within normal limits and do not significantly impact human health. Moderate wind speed: Moderate wind speed does not affect daily activities and work. Suitable light: Daylight duration and intensity conform to normal seasonal variations, without causing insufficient or excessive light exposure. Extreme weather, on the other hand, refers to weather conditions that exceed normal ranges and may significantly impact environmental parameters or even pose a threat to human life and health. Characteristics of extreme weather may include: Extreme temperature: High or low temperatures that exceed the normal seasonal range, which may lead to health problems such as heatstroke or frostbite. Extreme humidity: Extremely high or low humidity may affect human comfort and health, leading to dehydration or respiratory problems. Air pollution: Deteriorating air quality and pollutant concentrations exceeding normal ranges can cause respiratory or cardiovascular diseases. Strong winds and rainstorms: Extreme weather phenomena such as strong winds, heavy rain, or hurricanes can cause windstorms, floods, and geological disasters, impacting people's lives and safety. Extreme light: High-intensity sunlight or prolonged, rainy weather can have adverse effects on human health and psychology.

[0064] Among them, the specific criteria for determining extreme weather are defined by the local long-term meteorological observation data and human physiological research of the target indoor space. The frequency of occurrence of extreme weather is also low, usually lower than the preset frequency. The types of extreme weather include but are not limited to the following: extreme temperatures, heavy rains and floods, storms and typhoons, ice and snow storms, droughts, and sandstorms. The parameter values ​​for this type of extreme weather are accidental, and since the environmental parameters in the subsequent days after the occurrence of extreme weather will be affected, the natural parameter values ​​of the second consecutive preset days corresponding to the time of extreme weather are set as an abnormal parameter value set to avoid using the values ​​of these parameter value sets as the extreme values ​​of the final benchmark parameter value range, thereby improving the accuracy of the final determination of the benchmark parameter value range, and further improving the accuracy of the parameter value range adapted to each user.

[0065] It can be seen that in this example, the server obtains the reference weather type to determine the extreme value of the parameter value range determined according to the extreme weather type, thereby updating the predetermined baseline parameter value range, avoiding the influence of the baseline parameter value range on the data by extreme weather with lower frequency and subsequent weather, thereby improving the accuracy of the data and the stability of subsequent triggered environmental parameter adjustments.

[0066] Step S205 : controlling the corresponding environment adjustment device to adjust the environment parameters according to the target parameter value range and the real-time parameter value collected by the environment detection sensor.

[0067] The preset types of environmental parameters corresponding to the target parameter value range include, but are not limited to, temperature and humidity, air quality, noise intensity, and illumination. For the environmental parameter types listed above, environmental conditioning devices may include: humidifiers and dehumidifiers, where humidifiers increase indoor humidity, while dehumidifiers reduce it. They help regulate air humidity and ensure a comfortable environment. Air purifiers, which remove pollutants from indoor air, thereby improving air quality. Noise generators, which emit soft white noise or other ambient sounds to mask indoor and outdoor noise and provide a quieter environment. Curtains and blinds, which can be adjusted to control indoor lighting by adjusting the opening and closing of curtains and blinds. Smart lighting, which can adjust indoor lighting by adjusting brightness and color temperature, providing a lighting environment tailored to different needs. Air conditioning systems, which not only regulate indoor temperature but also circulate and filter air, helping to improve air quality. Fans, which provide air circulation, help regulate indoor temperature and air quality.

[0068] In one possible embodiment, if the preset type of environmental parameters includes air quality and temperature and humidity, and the environmental monitoring system also includes an air purification device and a ventilation device; according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the corresponding environmental adjustment device is controlled to adjust the environmental parameters, including: if the real-time parameter value corresponding to the air quality exceeds the corresponding target parameter value range, the monitoring image data taken by the indoor monitoring device and the air pollutant information collected by the environmental detection sensor are obtained; according to the surface image data, the shadow change area is determined; if the concentration of the pollutant is greater than or equal to the preset high concentration threshold, the air purification device is controlled to perform the air purification operation until the air quality is The corresponding real-time parameter value is reduced to within the target parameter value range; if the moisture coverage ratio does not exceed the preset ratio and the concentration of the pollutant is less than the high concentration threshold, the ventilation device is controlled to perform a ventilation operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range; if it is determined according to the video image data that the current user behavior belongs to the preset indoor activity, or the moisture coverage ratio exceeds the preset ratio, then according to the detected duration of the current user behavior, the ventilation device is controlled to perform a ventilation operation and the air purification device is controlled to perform an air purification operation; and, after the ventilation device is turned off, the air purification device is controlled to perform an air purification operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range.

[0069] The air pollutant information includes the type and concentration of pollutants in the air. The monitoring image data is the surface image data of a preset object captured by the indoor monitoring device during the monitoring period. The shadow change area is used to represent the moisture coverage area of ​​the preset object due to changes in temperature and humidity. The high concentration threshold is associated with the type of pollutant, the preset ratio is associated with the object type of the preset object, and the moisture coverage ratio is the ratio of the shadow change area to the total surface area of ​​the preset object. The preset object type can be walls, tiles, floors, glass, etc., where the surface effects of temperature and humidity are easily observed, so that the monitoring device can capture and analyze the surface.

[0070] When air quality is poor, meaning the real-time parameter value for air quality exceeds the corresponding target parameter value range, further data analysis is performed by combining the monitoring image data captured by indoor surveillance cameras with the air pollutant information collected by environmental detection sensors. The monitoring image data is used to determine the surface image data of pre-set objects, thereby determining the degree of change in indoor temperature and humidity. Airborne contaminant information is used to identify the type and concentration of air pollutants, thereby determining the degree of air pollution. By combining further analysis of these two types of specific data, the ventilation and air purification systems are flexibly controlled in a hierarchical manner based on actual environmental conditions to improve the environment of the target indoor space and enhance the effectiveness and efficiency of the environmental control device in adjusting environmental parameters.

[0071] Among them, see Figure 5 , Figure 5 This is a comparison of the humidity of different preset objects provided in the embodiment of the present application. Figure 5 As shown, Figure 5 01 and 02 in the image correspond to the initial state of the floor tiles and the wet state with the largest shadow change area. Figure 5 03 and 04 in the figure correspond to the initial state of the window glass and the wet state with the largest shadow change area. The surface of the floor tiles is covered with patterns. When the floor tiles are wet, water droplets will condense on the surface. Figure 5 The shaded area in 02 can be used to effectively determine the temperature and humidity of the target indoor space based on the ratio of the shaded area to the total tile surface area. Window glass has a smooth and clean surface. When it gets wet, water droplets condense on the surface, leaving traces of water droplets sliding down. The moisture coverage ratio can also be used to determine the humidity level of the target indoor space.

[0072] It can be seen that in this example, when the parameter value of the air quality exceeds the parameter value range set above, the server will determine the specific conditions of the temperature, humidity and air quality of the target indoor space based on more abundant data, and determine the control method and control time of the environmental conditioning device based on the specific conditions and the actual use of the environmental conditioning device, thereby improving the efficiency and practicality of the environmental monitoring system in performing environmental parameter adjustment and enhancing the user experience.

[0073] In one possible embodiment, if the preset type of environmental parameter includes noise intensity, and the environmental monitoring system also includes an intelligent audio device; according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the corresponding environmental adjustment device is controlled to adjust the environmental parameters, including: if the real-time parameter value corresponding to the noise intensity is greater than the corresponding target parameter value range, then the music data of a preset number of songs recently played by the intelligent audio device and the noise data of a preset duration collected by the environmental detection sensor are obtained; according to the noise data, the noise intensity with the longest duration is determined as the initial audio volume; according to the noise data, the noise frequency range is determined; and, according to the music data, the sound frequency range corresponding to each song is determined; the song corresponding to the sound frequency range with the highest coverage of the noise frequency range is determined as the target playback song; the intelligent audio device is controlled to play the target playback song at the initial audio volume, and the audio volume of the intelligent audio device is adjusted in real time according to the environmental parameter value of the noise intensity.

[0074] The purpose of obtaining the music data of a preset number of songs recently played by the smart speaker for subsequent playback is to prevent users from losing interest in the songs being played. Playing recently played songs can also help users naturally ignore the impact of outdoor noise, improving the user experience. Targeting songs that correspond to the sound frequency range with the highest coverage of the noise frequency range can increase the success rate of playing songs to cover up the noise, minimizing the possibility of users being affected by noise. The server will then adjust the volume of the smart speaker in real time based on the environmental parameter value of the noise intensity, so that when the noise intensity gradually decreases, the user can immediately return to a quiet and comfortable environment to work or study.

[0075] It can be seen that in this example, based on the characteristics of the music data and noise intensity recently played by the smart audio device, the adapted initial audio volume and target song are determined for playback, so that the possibility of the user being affected by noise is effectively reduced, thereby improving user comfort and the intelligence of the server-controlled environmental adjustment device.

[0076] In a possible embodiment, the environmental monitoring system also includes a user's terminal device and an alarm device; the method also includes: when the abnormal duration of any environmental parameter is greater than a second preset duration, determining that the environmental parameter corresponding to the abnormal duration is a dangerous environment parameter; if the absolute value of the parameter value difference of the dangerous environment parameter is greater than or equal to the alarm threshold, controlling the alarm device to perform an alarm operation and sending a first prompt message to the terminal device; if the absolute value of the parameter value difference of the abnormal environmental parameter exceeds or is less than the alarm threshold, obtaining the environmental parameter values ​​corresponding to multiple dangerous environment parameters collected by the environmental detection sensor within the preset time period; determining a parameter value change graph based on the environmental parameter values ​​corresponding to the multiple dangerous environment parameters; and generating a second prompt message based on the location of the environmental adjustment device corresponding to the dangerous environment parameter.

[0077] Among them, the abnormal duration is the duration that the real-time parameter value corresponding to the environmental parameter is continuously less than or continuously greater than the corresponding target parameter value range, the parameter value difference is the difference between the real-time parameter value corresponding to the dangerous environment parameter and the adjacent extreme values ​​of the target parameter value range, the first prompt information is used to indicate that there is a danger in the target indoor space, and the prompt information is used to prompt the parameter type of the dangerous environment parameter; and the second prompt information carrying a parameter value change graphic is sent to the terminal device.

[0078] Among them, the reason for setting the second preset time length is that when it is found that the environmental parameters exceed the normal range, time needs to be reserved for the environmental adjustment device to adjust the environmental parameters. Only when the environmental parameters are in an abnormal state for too long can it be said that the environmental parameters at this time are more dangerous, and the user needs to adjust the environmental parameters by himself or detect whether the device is faulty. When the absolute value of the parameter value difference is too large, the alarm device can be directly triggered to remind the user to pay attention to the problem of the environment of the target indoor space. When the absolute value of the parameter value difference does not exceed the alarm threshold, the user can be prompted to adjust the environment by himself or leave the indoor space in a visual way.

[0079] The environmental monitoring system also features a natural disaster alarm function, which plays a key role in monitoring the indoor environment. Natural disasters include earthquakes, fires, and floods. The server synchronizes acquired natural disaster parameters to the user's terminal device, and the user can set the corresponding parameters through an intuitive interface. When a natural disaster risk is detected, the system will trigger an alarm and send a notification to the user.

[0080] It can be seen that in this example, by setting the second preset time length and alarm threshold to flexibly control the alarm device to alarm or allow the terminal device to visualize the parameter message, the user can intuitively understand the abnormal environmental parameters of the target indoor space and take timely measures, thereby improving the comprehensiveness and practicality of the environmental monitoring system.

[0081] In one possible embodiment, when the target user behavior is sleeping behavior, the environmental monitoring system also includes a physiological monitoring device, which is used to collect physiological data corresponding to a preset type of physiological indicator of the target user; the method also includes: after the environmental adjustment device completes the execution of the adjustment measures, obtaining in real time the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device; and, if a user activity that is an abnormal activity is detected based on the monitoring video data, the corresponding environmental adjustment device is controlled to adjust the environmental parameters according to the activity type of the user activity and the preset personalized adjustment strategy; or, if any physiological value of the target user exceeds the first numerical range and is within the second numerical range, the physiological indicator corresponding to the physiological value within the second numerical range is determined to be an abnormal indicator; and, according to the abnormal indicator and the personalized adjustment strategy, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

[0082] Among them, the monitoring video is used to monitor subsequent user activities after the target user is in sleep behavior, abnormal activities are used to reflect the physiological activities naturally performed by the target user when he is in sleep behavior with low sleep quality, and the personalized adjustment strategy is used to characterize the activity type of each abnormal activity or the type of environmental parameter to be adjusted adapted by each abnormal indicator and the corresponding adjustment parameter value. The abnormal indicator is a physiological indicator whose corresponding physiological data belongs to abnormal physiological data. The first numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user in a normal physiological state during sleep behavior, and the second numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user due to abnormal environmental parameters.

[0083] Among them, physiological monitoring devices are divided into smart wearable devices (smart watches, bracelets) and non-wearable smart devices (mattresses, pillows, clips, etc.). If it is a smart wearable device, the physiological monitoring device is worn by the target user to ensure that it can collect various physiological data of the target user's preset types of physiological indicators. If it is a non-wearable smart device, it is used according to the device type of the device, so that the device can effectively collect various physiological data when the target user is in sleep behavior. Abnormal activities can also be explained as physiological activities that are externally manifested when the target user is in a low-comfort indoor environment, resulting in low sleep quality or poor sleep status, including but not limited to night sweats (i.e. abnormal sweating during sleep behavior), kicking the quilt, frequent tossing and turning, etc.

[0084] Furthermore, the server in this embodiment communicates and interacts with the remaining devices in the environmental monitoring system to implement, after the environmental adjustment device completes the initial adjustment measures, further personalized and precise environmental adjustment is provided to the target user by monitoring the target user's various physiological indicators and the target user's user activities during sleep. Depending on the device types of the other devices communicating and interacting, this embodiment uses two approaches to determine whether the target user has a comfortable experience during sleep behavior: one is the target user's actual physiological data of various physiological indicators, and the other is whether the target user has engaged in abnormal user activities. If the target user is detected to have abnormal indicators (i.e., physiological values ​​that are outside the first numerical range and within the second numerical range) and / or abnormal user activities, the server can determine that the target user is experiencing low sleep quality. In this case, the server determines the type and value of the environmental parameter corresponding to the next environmental adjustment operation based on the personalized adjustment strategy to provide the target user with a comfortable sleeping environment. The relationship between abnormal indicators, abnormal activities, and the type and value of the corresponding environmental parameters can be as follows: for example, when the abnormal indicators are characterized by increased heart rate and respiratory rate, the indoor temperature can be appropriately lowered or the air humidity can be increased. Alternatively, when abnormal activities are detected such as frequent tossing and turning or large body movements, it may mean that the user's sleep is unstable, which may be caused by factors such as overheating, overcooling or noise in the environment. The system can adjust the room temperature, humidity or start the white noise function based on these data. The detected night sweats may indicate that the user's body temperature is too high or the environment is stuffy. At this time, the system automatically turns on the air conditioner or fan to lower the room temperature. If the target user has abnormal indicators, the change value of the corresponding environmental parameter corresponds to the change value of the physiological value, or if the target user has abnormal activities, the change value of the corresponding environmental parameter can change slowly to a smaller value, and the time to stop the change is determined in combination with the duration of the abnormal activity detected by the target user, that is, when the abnormal activity of the target user is detected to end, the adjustment measures are stopped.

[0085] As can be seen in this example, protecting subsequent monitoring operations when the target user behavior is sleeping ensures the real-time and accuracy of environmental adjustments, safeguarding the user's sleep quality and health monitoring, and providing a personalized sleep experience. Furthermore, it prevents the user's sleep from being disturbed by environmental discomfort, allowing for further adjustments, thereby improving the system's intelligence and convenience.

[0086] In one possible embodiment, the environmental monitoring system also includes a terminal device, which is carried by a designated guardian of the target user; after the environmental adjustment device completes the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device are obtained in real time, the method also includes: if any physiological value of the target user exceeds the second numerical range, then the physiological indicator corresponding to the physiological value exceeding the second numerical range is determined to be a danger indicator; and, a first alarm message carrying the danger indicator is sent to the terminal device; or, if user activity belonging to getting up behavior is detected according to the monitoring video data, and the current system time is in the local night time period, then the indoor relative position and user posture of the target user are determined according to the monitoring video data; when it is detected that the indoor relative position is in a preset danger zone, or the user posture is a falling posture, a second alarm message is sent to the terminal device.

[0087] Among them, the first alarm information is used to instruct the terminal device to perform the first alarm operation corresponding to the danger indicator to prompt the designated guardian, and the second alarm information is used to instruct the terminal device to perform the second alarm operation. The operation types of the first alarm operation and the second alarm operation are different.

[0088] Among them, since the user type of the target user may be a child or an elderly person, when they have user activities such as getting up at night, there may be no one to look after them. In order to avoid accidents caused by sleepwalking or uncontrollable behavior, the target user is determined by monitoring video data to determine whether he has moved to a dangerous area in a preset indoor space, or the user posture of the target user is characterized as a fall posture, to ensure that the designated guardian can avoid accidents to the target user in time, shorten the response time and prevent accidents. The preset dangerous area can be a balcony area, an area near a window, an area near unstable furniture or home appliances (such as bookcases, drawers, TVs, refrigerators, etc.), stairs, steps, etc., which are not limited here. Furthermore, the terminal device can be a mobile phone, watch, bracelet, etc. carried by the designated guardian, that is, a device that the designated guardian can carry with him, which has a certain degree of portability. The operation type of the first alarm operation and the second alarm operation can be different, so that the designated guardian can know by the operation type whether the situation is that the user has fallen or entered the preset dangerous area. Operation types include but are not limited to sound alarms, light signal alarms, vibration alarms, and voice alarms, which can be specifically equipped according to the functional modules of the device type of the terminal device to ensure the correct execution of the alarm operation.

[0089] For example, please refer to Figure 6 , Figure 6 This is a schematic diagram of a scenario in which a target user triggers an alarm, as provided in an embodiment of the present application. Figure 6As shown, in the target indoor space, taking the target user type as an elderly person as an example, when the elderly person is detected to have left the bed area (i.e., it is determined that he has gotten up), and the current system time is in the local night time period, the server can execute the data processing in this embodiment to obtain monitoring video data, and determine through the monitoring video data whether the elderly person has entered the preset dangerous area determined by the bookshelf and the window, and whether the elderly person's user posture has fallen. If it is determined according to the monitoring video data that the elderly person has the above events, the terminal device of the designated guardian is controlled according to the corresponding event to perform an alarm operation to prompt the designated guardian to go to the target indoor space to check on the elderly person's situation and protect his safety.

[0090] As can be seen, in this example, the server acquires physiological data to identify risk indicators and video data to confirm that the target user has gotten up during sleep. It then incorporates location tracking and fall detection to promptly alert designated caregivers via the terminal device. This allows for rapid notification of caregivers, allowing them to take immediate action, safeguard the target user's health, improve treatment efficiency, and prevent accidents, alleviating the care burden on caregivers.

[0091] visible, Figure 2 This is a flow chart of a data processing method based on indoor environment monitoring provided in an embodiment of the present application. In this embodiment of the present application, the server can interact with multiple types of devices to adaptively adjust the indoor environment according to the differences between users in the indoor space and the actual environmental parameters to meet user needs, thereby improving the comprehensiveness and flexibility of the environmental monitoring system, and improving the intelligence of the environmental monitoring system, thereby enhancing the user experience.

[0092] The following is an embodiment of the device of the present application. The embodiment of the device of the present application and the embodiment of the method of the present application are based on the same concept and are used to perform the method described in the embodiment of the present application. For ease of explanation, the embodiment of the device of the present application only shows the parts related to the embodiment of the device of the present application. For specific technical details not disclosed, please refer to the description of the embodiment of the method of the present application, and will not be repeated here.

[0093] The present invention provides a data processing device based on indoor environment monitoring, which is applied to Figure 1The server 110 in the target indoor space environment monitoring system 100 shown in the figure, the environment monitoring system 100 also includes an indoor monitoring device 120, an environment detection sensor 130 and an environment adjustment device 140. The environment detection sensor 130 is used to collect preset types of environmental parameters in the target indoor space, and the environment adjustment device 140 is used to execute adjustment measures to adjust the corresponding environmental parameters. Specifically, the data processing device based on indoor environment monitoring is used to execute the steps performed by the server 110 in the above data processing method based on indoor environment monitoring. The data processing device based on indoor environment monitoring provided in the embodiment of the present application can include modules corresponding to the corresponding steps.

[0094] The embodiment of the present application can divide the functional modules of the data processing device based on indoor environment monitoring according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. The division of modules in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation. In the case of dividing each functional module according to each function, Figure 7 : This is a functional unit block diagram of a data processing device based on indoor environment monitoring provided by an embodiment of the present application; the data processing device based on indoor environment monitoring 70 includes: an acquisition unit 701, which is used to acquire monitoring video data collected by an indoor monitoring device according to a preset monitoring period; a detection unit 702, which is used to perform a person detection operation based on the monitoring video data to determine a detection result; a first determination unit 703, which is used to determine user information of the target user based on the detection result if the detection result indicates that a target user exists in the target indoor space, the user information being used to characterize the target user type and target user behavior; a second determination unit 704, which is used to determine a target parameter value range adapted to the user information in a preset parameter value range set, the parameter value range set including multiple reference parameter value ranges, each reference parameter value range corresponding to a reference user type and a reference user behavior, the reference parameter value range being used to characterize an interval range corresponding to an environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space; and a control unit 705, which is used to control a corresponding environmental adjustment device to adjust the environmental parameters based on the target parameter value range and the real-time parameter value collected by the environmental detection sensor.

[0095] In one possible embodiment, in performing a person detection operation based on video data to determine a detection result, the detection unit 702 is specifically used to: determine audio data and image data based on the video data; if no user activity sound is detected in the audio data, then determine whether there is a target object in motion in the image data based on adjacent image frames in the image data; if there is a target object, and the outer contour of the target object is human, then determine that there is a user in the target indoor space, and determine the user's facial feature information and motion information based on the image data, the facial feature information includes the number of wrinkles and facial contours of preset facial parts, and the motion information includes the user's posture change information and spatial position; determine the user's target user type based on the number of wrinkles and facial contours of preset facial parts, and the target user types include children, adults, and the elderly; determine the user's target user behavior based on the posture change information and spatial position; determine the detection result based on the target user behavior and target user type.

[0096] In one possible embodiment, before determining the target parameter value range based on the user information of the user and a preset parameter value range set, the second determination unit 704 is further specifically used to: obtain the location information of the target indoor space and a historical environment monitoring information set associated with the current time period, the historical environment monitoring information set including a historical parameter value set collected by the environment detection sensor corresponding to a reference time period within a first preset number of days, and usage information of the environment adjustment device, the reference time period being the same as the current time period; determine the historical parameter value set corresponding to the usage information characterized as unused as a natural parameter value set; determine multiple benchmark parameter value ranges based on the natural parameter value set, each benchmark parameter value range corresponding to an environmental parameter value, the minimum value of the benchmark parameter value range being the minimum value among the natural parameter values ​​corresponding to the environmental parameter value, and the maximum value of the benchmark parameter value range being the maximum value among the natural parameter values ​​corresponding to the environmental parameter value; perform an update operation on the multiple benchmark parameter value ranges based on the location information and a preset individual preference set to determine a parameter value range set, wherein the individual preference set is used to indicate a correction value of a reference parameter value of at least one environmental parameter corresponding to any one type of user information compared to the benchmark parameter value.

[0097] In one possible embodiment, the individual preference set meets the following preset conditions: the numerical accuracy of the first correction value is less than the numerical accuracy of the second correction value, the types of environmental parameters corresponding to special user behavior are greater than the types of environmental parameters corresponding to normal user behavior, and any correction value does not exceed the preset correction threshold; wherein, the first correction value is the correction value corresponding to when the reference user type is an adult, the second correction value is the correction value corresponding to when the reference user type is a child or an elderly person, special user behavior is user behavior with specific environmental parameter requirements, and normal user behavior is user behavior without environmental parameter requirements.

[0098] In one possible embodiment, in terms of performing an update operation on multiple benchmark parameter value ranges based on location information and a preset individual preference set to determine a parameter value range set, the second determination unit 704 is specifically used to: obtain a reference weather type for the time corresponding to the natural parameter value set based on the location information, the reference weather type includes an extreme weather type or a common weather type, and the extreme weather type is a weather type whose occurrence frequency in the area where the target indoor space is located is lower than the preset occurrence frequency; if an extreme weather type exists, determine the natural parameter value set for a second consecutive preset number of days at the corresponding time as an abnormal parameter value set, the second preset number of days is less than the first preset number of days, and the second preset number of days is associated with the extreme weather type; and, if the extreme value of the benchmark parameter value range includes an abnormal parameter value in the abnormal parameter value set, update the extreme value to the natural parameter value with the smallest difference corresponding to the same environmental parameter; and determine multiple reference parameter value ranges based on the updated benchmark parameter value range and at least one correction value corresponding to each user information.

[0099] In one possible embodiment, if the preset type of environmental parameters includes air quality and temperature and humidity, and the environmental monitoring system also includes an air purification device and a ventilation device; in terms of controlling the corresponding environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the control unit 705 is specifically used to: if the real-time parameter value corresponding to the air quality exceeds the corresponding target parameter value range, then obtain the monitoring image data taken by the indoor monitoring device and the air pollutant information collected by the environmental detection sensor, the air pollutant information includes the type and concentration of pollutants in the air, and the monitoring image data is the surface image data of the preset object taken by the indoor monitoring device during the monitoring period; based on the surface image data, determine the shadow change area, the shadow change area is used to characterize the wet coverage area of ​​the object surface that changes due to changes in temperature and humidity of the preset object; if the concentration of the pollutant is greater than or equal to the preset high concentration threshold, then control The air purification device is controlled to perform an air purification operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range, and the high concentration threshold is associated with the type of pollutant; if the moisture coverage ratio does not exceed the preset ratio and the concentration of the pollutant is less than the high concentration threshold, the ventilation device is controlled to perform a ventilation operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range; if it is determined according to the video image data that the current user behavior belongs to the preset indoor activity, or the moisture coverage ratio exceeds the preset ratio, the ventilation device is controlled to perform a ventilation operation according to the duration of the detected current user behavior; and, after the ventilation device is turned off, the air purification device is controlled to perform an air purification operation until the real-time parameter value corresponding to the air quality is reduced to within the target parameter value range, the preset ratio is associated with the object type of the preset object, and the moisture coverage ratio is the ratio of the shadow change area to the total surface area of ​​the preset object.

[0100] In one possible embodiment, if the preset type of environmental parameter includes noise intensity, and the environmental monitoring system also includes an intelligent audio device; in terms of controlling the corresponding environmental adjustment device to adjust the environmental parameters according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor, the control unit 705 is specifically used to: if the real-time parameter value corresponding to the noise intensity is greater than the corresponding target parameter value range, then obtain the music data of a preset number of songs recently played by the intelligent audio device and the noise data of a preset duration collected by the environmental detection sensor; determine the noise intensity with the longest duration as the initial audio volume based on the noise data; determine the noise frequency range based on the noise data; and determine the sound frequency range corresponding to each song based on the music data; determine the song corresponding to the sound frequency range with the highest coverage of the noise frequency range as the target playback song; control the intelligent audio device to play the target playback song at the initial audio volume, and adjust the audio volume of the intelligent audio device in real time according to the environmental parameter value of the noise intensity.

[0101] In one possible embodiment, when the target user behavior is sleep behavior, the environmental monitoring system also includes a physiological monitoring device, which is used to collect physiological data corresponding to a preset type of physiological indicator of the target user; the control unit 705 is specifically further used to: after the environmental adjustment device completes the execution of the adjustment measures, obtain in real time the physiological data collected by the physiological monitoring device, as well as the monitoring video data corresponding to the monitoring video shot by the indoor monitoring device, the monitoring video is used to monitor subsequent user activities that occur after the target user is in sleep behavior; and, if abnormal user activities are detected according to the monitoring video data, the corresponding environmental adjustment device is controlled to adjust the environmental parameters according to the activity type of the user activity and the preset personalized adjustment strategy, and the abnormal activity is used to reflect the natural behavior of the target user in low sleep quality sleep behavior. The personalized adjustment strategy is used to characterize the activity type of each abnormal activity or the type of environmental parameter to be adjusted adapted by each abnormal indicator and the corresponding adjustment parameter value. The abnormal indicator is a physiological indicator whose corresponding physiological data belongs to abnormal physiological data; or, if any physiological value of the target user exceeds the first numerical range and is within the second numerical range, the physiological indicator corresponding to the physiological value within the second numerical range is determined to be an abnormal indicator. The first numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user in a normal physiological state during sleep behavior, and the second numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user due to abnormal environmental parameters; and, according to the abnormal indicator and the personalized adjustment strategy, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

[0102] In one possible embodiment, the environmental monitoring system also includes a terminal device, which is carried by a designated guardian of the target user; after the environmental adjustment device completes the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video taken by the indoor monitoring device are obtained in real time, and the control unit 705 is specifically further used to: if any physiological value of the target user exceeds the second numerical range, determine that the physiological indicator corresponding to the physiological value exceeding the second numerical range is a danger indicator; and send a first alarm message carrying the danger indicator to the terminal device, the first alarm message is used to instruct the terminal device to execute a first alarm operation corresponding to the danger indicator to prompt the designated guardian; or, if a user activity belonging to the behavior of getting up is detected according to the monitoring video data, and the current system time is in the local nighttime period, determine the indoor relative position and user posture of the target user according to the monitoring video data; when it is detected that the indoor relative position is in a preset danger zone, or the user posture is a falling posture, send a second alarm message to the terminal device, the second alarm message is used to instruct the terminal device to execute a second alarm operation, and the operation types of the first alarm operation and the second alarm operation are different.

[0103] In the case of integrated units, such as Figure 8 As shown, Figure 8 This is a block diagram of the functional units of another data processing device based on indoor environment monitoring provided by an embodiment of the present application. Figure 8 In the embodiment, the data processing device 70 based on indoor environment monitoring includes: a processing module 802 and a communication module 801. The processing module 802 is used to control and manage the actions of the data processing device based on indoor environment monitoring, for example, the steps of the acquisition unit 701, the detection unit 702, the first determination unit 703, the second determination unit 704 and the control unit 705, and / or other processes for executing the technology described herein. The communication module 801 is used to support the interaction between the data processing device based on indoor environment monitoring and other devices. Figure 8 As shown, the data processing device based on indoor environment monitoring may include a storage module 803, and the storage module 803 is used to store program codes and data of the data processing device based on indoor environment monitoring.

[0104] The processing module 802 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an ASIC, an FPGA, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 801 may be a transceiver, an RF circuit, or a communication interface, and the like. The storage module 803 may be a memory.

[0105] Among them, all relevant contents of each scene involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here. The above data processing device 70 based on indoor environment monitoring can execute the above Figure 2 The data processing method based on indoor environment monitoring is shown.

[0106] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer program are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via wired or wireless means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state drive.

[0107] Figure 9 This is a structural block diagram of a server provided in an embodiment of the present application. Figure 9As shown, the server 110 may include one or more of the following components: a processor 901, a memory 902 coupled to the processor 901, wherein the memory 902 may store one or more computer programs 903, and the one or more computer programs 903 may be configured to implement the methods described in the above embodiments when executed by the one or more processors 901. The server 110 may be the server 110 in the above embodiments.

[0108] The processor 901 may include one or more processing cores. The processor 901 utilizes various interfaces and circuits to connect various components within the server 110. It executes instructions, programs, code sets, or instruction sets stored in the memory 902, as well as accesses data stored in the memory 902, to perform various functions and process data for the server 110. Optionally, the processor 901 may be implemented using at least one of the following hardware forms: a digital signal processing (DSP), a field-programmable gate array (FPGA), or a programmable logic array (PLA). The processor 901 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem handles wireless communications. It is understood that the modem may not be integrated into the processor 901 and may be implemented separately via a communications chip.

[0109] The memory 902 may include a random access memory (RAM) or a read-only memory (ROM). The memory 902 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 902 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the server 110 during use.

[0110] It is understandable that the server 110 may include more or fewer structural elements than those in the above structural block diagram, which is not limited here.

[0111] An embodiment of the present application also provides a computer storage medium, on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, part or all of the steps of any method described in the above method embodiments are implemented.

[0112] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute part or all of the steps of any method described in the above method embodiments.

[0113] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0114] In the several embodiments provided in this application, it should be understood that the disclosed methods, devices, and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is merely a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be electrical, mechanical, or other forms.

[0115] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0116] In addition, the functional units in various embodiments of the present invention may be integrated into a single processing unit, each unit may be physically included separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or hardware plus software functional units.

[0117] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a volatile memory or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DR RAM), among other media that can store program code.

[0118] Although the present invention is disclosed above, it is not limited thereto. Any person skilled in the art may readily conceive of variations or substitutions, and may make various modifications and alterations without departing from the spirit and scope of the present invention. Combinations of the above-described functions and implementation steps, including software and hardware implementations, are all within the scope of protection of the present invention.

Claims

1. A data processing method based on indoor environment monitoring, characterized in that: A server for use in an environment monitoring system for a target indoor space, the environment monitoring system further comprising an indoor monitoring device, an environment detection sensor, an environment adjustment device, and a physiological monitoring device, the environment detection sensor being configured to collect preset types of environmental parameters within the target indoor space, each of the environmental parameters corresponding to an environmental parameter value and an environment adjustment device, the environment adjustment device being configured to execute adjustment measures to adjust the corresponding environmental parameter, and the physiological monitoring device being configured to collect physiological data corresponding to preset types of physiological indicators of a target user; The method comprises: Acquiring the monitoring video data collected by the indoor monitoring device according to a preset monitoring period; Performing a person detection operation based on the surveillance video data to determine a detection result; If the detection result indicates that a target user exists in the target indoor space, determining user information of the target user according to the detection result, where the user information is used to characterize the target user type and target user behavior; Determining a target parameter value range adapted to the user information from a preset parameter value range set, the parameter value range set including a plurality of reference parameter value ranges, each of the reference parameter value ranges corresponding to a reference user type and a reference user behavior, the reference parameter value ranges being used to represent an interval range corresponding to the environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space; Controlling the corresponding environmental adjustment device to adjust the environmental parameter according to the target parameter value range and the real-time parameter value collected by the environmental detection sensor; After the environmental adjustment device completes executing the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video captured by the indoor monitoring device are acquired in real time, wherein the monitoring video is used to monitor subsequent user activities of the target user after the target user falls asleep; and If a user activity belonging to an abnormal activity is detected according to the monitoring video data, the corresponding environmental adjustment device is controlled to adjust the environmental parameters according to the activity type of the user activity and a preset personalized adjustment strategy, wherein the abnormal activity is a physiological activity naturally performed by the target user under a sleep behavior with low sleep quality, and the personalized adjustment strategy is used to characterize the activity type of each abnormal activity or the type of environmental parameter to be adjusted adapted to each abnormal indicator and the corresponding adjustment parameter value, and the abnormal indicator is a physiological indicator whose corresponding physiological data belongs to abnormal physiological data; or If any one of the physiological data of the target user exceeds the first numerical range and is within the second numerical range, the physiological indicator corresponding to the physiological data within the second numerical range is determined to be the abnormal indicator, and the first numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user in the normal physiological state of the sleep behavior, and the second numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user due to abnormal environmental parameters; and, according to the abnormal indicator and the personalized adjustment strategy, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

2. The method according to claim 1, characterized in that The performing of a person detection operation according to the monitoring video data to determine a detection result includes: Determining audio data and image data based on the surveillance video data; If no user activity sound is detected in the audio data, then judging whether there is a target object in motion in the image data based on adjacent image frames in sequence: If the target object exists and the target object's outline is human, determining that the target user is in the target indoor space, and determining facial feature information and motion information of the target user based on the image data, wherein the facial feature information includes the number of wrinkles and facial contours of a preset facial area, and the motion information includes posture change information and the spatial position of the target user; Determining the target user type of the target user according to the number of wrinkles in the preset facial area and the facial contour, the target user type including children, adults, and the elderly; determining the target user behavior according to the posture change information and the spatial position; The detection result is determined according to the target user behavior and the target user type.

3. The method according to claim 2, characterized in that Before determining the target parameter value range based on the user information of the target user and the preset parameter value range set, the method further includes: Obtaining geographic location information of the target indoor space and a set of historical environmental monitoring information associated with a current time period, the set of historical environmental monitoring information including a set of historical parameter values ​​collected by the environmental detection sensor corresponding to a reference time period within a first preset number of days, and usage information of the environmental conditioning device, wherein the reference time period is the same as the current time period; Determining a historical parameter value set corresponding to the usage information characterized as unused as a natural parameter value set; Determine, based on the natural parameter value set, a plurality of reference parameter value ranges, each of the reference parameter value ranges corresponding to one of the environmental parameter values, the minimum value of the reference parameter value range being the minimum value among the natural parameter values ​​corresponding to the environmental parameter value, and the maximum value of the reference parameter value range being the maximum value among the natural parameter values ​​corresponding to the environmental parameter value; Based on the geographic location information and a preset individual preference set, an update operation is performed on the multiple baseline parameter value ranges to determine the parameter value range set, wherein the individual preference set is used to indicate the reference parameter value of at least one of the environmental parameters corresponding to any one user information compared to the correction value of the baseline parameter value.

4. The method according to claim 3, characterized in that The individual preference set meets the following pre-set conditions: The numerical precision of the first correction value is less than the numerical precision of the second correction value, the type of the environmental parameter corresponding to the special user behavior is greater than the type of the environmental parameter corresponding to the normal user behavior, and any one of the correction values ​​does not exceed the preset correction threshold; Among them, the first correction value is the correction value corresponding to when the reference user type is the adult, the second correction value is the correction value corresponding to when the reference user type is the child or the elderly, the special user behavior is the user behavior with specific environmental parameter requirements, and the normal user behavior is the user behavior without the environmental parameter requirements.

5. The method according to claim 3, characterized in that The updating operation is performed on the plurality of reference parameter value ranges according to the geographic location information and the preset individual preference set to determine the parameter value range set, including: Obtaining, based on the geographic location information, a reference weather type for the time corresponding to the natural parameter value set, the reference weather type including an extreme weather type or a common weather type, the extreme weather type being a weather type having an occurrence frequency lower than a preset occurrence frequency in the area where the target indoor space is located; If the extreme weather type exists, determining the natural parameter value set for a second preset number of consecutive days corresponding to the time as an abnormal parameter value set, the second preset number of days being less than the first preset number of days, and the second preset number of days being associated with the extreme weather type; and If the extreme value of the reference parameter value range includes an abnormal parameter value in the abnormal parameter value set, then updating the extreme value to the natural parameter value with the smallest difference corresponding to the same environmental parameter; The multiple reference parameter value ranges are determined according to the updated baseline parameter value range and the at least one correction value corresponding to each piece of user information.

6. The method according to claim 1, characterized in that The environmental monitoring system further includes a terminal device, which is carried by a designated guardian of the target user. After the environmental adjustment device completes executing the adjustment measure, the method further includes obtaining in real time the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video captured by the indoor monitoring device: If any of the physiological data of the target user exceeds the second numerical range, determining that the physiological indicator corresponding to the physiological data exceeding the second numerical range is a danger indicator; and Sending a first alarm message carrying the risk indicator to the terminal device, wherein the first alarm message is used to instruct the terminal device to perform a first alarm operation corresponding to the risk indicator to prompt the designated guardian; or If user activity that belongs to getting up is detected based on the monitoring video data, and the current system time is in the local nighttime period, the indoor relative position and user posture of the target user are determined based on the monitoring video data; when it is detected that the indoor relative position is in a preset dangerous area, or the user posture is a falling posture, a second alarm message is sent to the terminal device, and the second alarm message is used to instruct the terminal device to perform a second alarm operation, and the operation types of the first alarm operation and the second alarm operation are different.

7. A data processing device based on indoor environment monitoring, characterized in that: A server for use in an environment monitoring system for a target indoor space, the environment monitoring system further comprising an indoor monitoring device, an environment detection sensor, an environment adjustment device, and a physiological monitoring device, the environment detection sensor being configured to collect preset types of environmental parameters within the target indoor space, each of the environmental parameters corresponding to an environmental parameter value and an environment adjustment device, the environment adjustment device being configured to execute adjustment measures to adjust the corresponding environmental parameter, and the physiological monitoring device being configured to collect physiological data corresponding to preset types of physiological indicators of a target user; The device comprises: an acquisition unit, configured to acquire the monitoring video data collected by the indoor monitoring device according to a preset monitoring period; a detection unit, configured to perform a person detection operation based on the surveillance video data to determine a detection result; a first determining unit configured to determine user information of the target user according to the detection result if the detection result indicates that a target user exists in the target indoor space, wherein the user information is used to characterize a type of the target user and a behavior of the target user; a second determining unit, configured to determine a target parameter value range adapted to the user information from a preset parameter value range set, the parameter value range set comprising a plurality of reference parameter value ranges, each of the reference parameter value ranges corresponding to a reference user type and a reference user behavior, the reference parameter value ranges being used to represent an interval range corresponding to the environmental parameter value determined to be adapted to the physical needs and activity needs of the target user in the target indoor space; A control unit, configured to control the corresponding environment adjustment device to adjust the environment parameter according to the target parameter value range and the real-time parameter value collected by the environment detection sensor; After the environmental adjustment device completes executing the adjustment measures, the physiological data collected by the physiological monitoring device and the monitoring video data corresponding to the monitoring video shot by the indoor monitoring device are obtained in real time, and the monitoring video is used to monitor the subsequent user activities of the target user after the sleep behavior; and, if the user activity belonging to abnormal activity is detected according to the monitoring video data, the corresponding environmental adjustment device is controlled to adjust the environmental parameters according to the activity type of the user activity and the preset personalized adjustment strategy, the abnormal activity is used to reflect the physiological activity naturally performed by the target user when the sleep behavior is low in sleep quality, and the personalized adjustment strategy is used to characterize the activity type of each abnormal activity or the adaptation of each abnormal indicator. The type of environmental parameter to be adjusted and the corresponding adjustment parameter value, the abnormal indicator is a physiological indicator whose corresponding physiological data belongs to abnormal physiological data; or, if any one of the physiological data of the target user exceeds the first numerical range and is within the second numerical range, then the physiological indicator corresponding to the physiological data within the second numerical range is determined to be the abnormal indicator, the first numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user in the normal physiological state of the sleep behavior, and the second numerical range is used to indicate the numerical range corresponding to each physiological indicator of the target user due to abnormal environmental parameters; and, according to the abnormal indicator and the personalized adjustment strategy, the corresponding environmental adjustment device is controlled to adjust the environmental parameters.

8. A server, characterized in that: The system comprises a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that A computer program for electronic data exchange is stored, wherein the computer program causes a computer to execute the method according to any one of claims 1 to 6.

Images