Equipment control method and device, storage medium and electronic equipment

Abstract

The invention discloses an equipment control method and device, a storage medium and electronic equipment, and relates to the technical field of smart home, the equipment control method comprises the steps that environment information and sound signals of a target area and object information of a target object are acquired, and the target area is the area where the target object is located; determining equipment noise and non-equipment noise in the sound signal, and determining first sound intensity of the equipment noise and second sound intensity of the non-equipment noise; determining whether to generate a control instruction according to the environment information, the object information, the first sound intensity and the second sound intensity; under the condition that the control instruction is determined to be generated, the equipment in the target area is controlled according to the control instruction, and by adopting the technical scheme, the problem that in the prior art, under the condition that different types and sources of noise cannot be recognized, the operation frequency of the smart home is adjusted at one time, and the noise control effect is poor is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of smart home, in particular to a device control method and device, storage medium and electronic device. BACKGROUND

[0002] With the rapid development of global economy and the vigorous rise of Internet of Things technology, people's demand for quality of life is getting higher and higher, and traditional household appliances have been unable to meet the personalized needs of users. Various smart home devices are becoming more and more popular with people. However, many functions of smart home need to rely on software on hardware as a medium for calculation when implemented, which will undoubtedly increase the noise of the device when working. Generally speaking, the noise generated by smart home devices when working is related to the physical properties of the device itself, mainly including component model, running power, and the number of driving motors.

[0003] In some scenarios, the size of the noise will affect the user's home experience. The existing smart home noise control system mainly relies on simple sound intensity detection or preset threshold control method. However, these methods are too single and rigid in judging noise, and cannot accurately identify different types and sources of noise, nor can they dynamically adjust control parameters according to noise changes, resulting in poor noise control effect.

[0004] In the related art, in the case where different types and sources of noise cannot be identified, blindly adjusting the running frequency of smart home will result in poor noise control effect, and no effective solution has been proposed. SUMMARY

[0005] The embodiments of the present application provide a device control method and device, storage medium and electronic device to at least solve the problem of poor noise control effect in the related art when blindly adjusting the running frequency of smart home in the case where different types and sources of noise cannot be identified.

[0006] According to an embodiment of the present application, a device control method is provided, comprising: obtaining environment information, a sound signal and object information of a target object of a target area, wherein the target area is an area where the target object is located; determining device noise and non-device noise in the sound signal, and determining a first sound intensity of the device noise and a second sound intensity of the non-device noise; determining whether to generate a control instruction according to the environment information, object information, first sound intensity and second sound intensity; and controlling a device in the target area according to the control instruction in the case of determining to generate the control instruction.

[0007] In an example embodiment, determining whether to generate the control instruction according to the environment information, the object information, the first sound intensity and the second sound intensity comprises: determining a first sound intensity level of the device noise according to the first sound intensity, and determining a first sound intensity level of the non-device noise according to the second sound intensity; determining a current state of the target object according to the object information, and determining a target sound intensity level according to the environment information and the current state; determining a first matching relationship between the first sound intensity level and the target sound intensity level, and a second matching relationship between the second sound intensity level and the target sound intensity level; and determining whether to generate the control instruction according to the first matching relationship and the second matching relationship.

[0008] In an example embodiment, determining whether to generate the control instruction according to the first matching relationship and the second matching relationship comprises: in a case where the first matching relationship indicates that the first sound intensity meets a preset matching relationship with the target sound intensity level, and the second sound intensity meets a preset matching relationship with the target sound intensity level, generating the control instruction, wherein the control instruction comprises: a first control instruction for controlling a running number of the driving motor of the device and a running frequency of each driving motor, and a second control instruction for controlling the multimedia device in the target area to send prompt information, the prompt information being used to instruct other objects in the target area to reduce the volume; in a case where the first matching relationship indicates that the first sound intensity meets a preset matching relationship with the target sound intensity level, but the second sound intensity does not meet a preset matching relationship with the target sound intensity level, generating the control instruction, wherein the control instruction comprises: the first control instruction; in a case where the first matching relationship indicates that the first sound intensity does not meet a preset matching relationship with the target sound intensity level, but the second sound intensity meets a preset matching relationship with the target sound intensity level, generating the control instruction, wherein the control instruction comprises: the first control instruction and / or the second control instruction; and in a case where the first matching relationship indicates that the first sound intensity does not meet a preset matching relationship with the target sound intensity level, and the second sound intensity does not meet a preset matching relationship with the target sound intensity level, prohibiting the generation of the control instruction.

[0009] In an example embodiment, in a case where the first matching relationship indicates that the first sound intensity conforms to a preset matching relationship with the target sound intensity level, and the second sound intensity does not conform to the preset matching relationship with the target sound intensity level, the control instruction is generated by determining an operation state of each device in the target area according to the environment information and the object information, determining current operation data of each device in the target area, and generating the control instruction for controlling each device according to the current operation data of each device and the operation state of each device.

[0010] In an example embodiment, in a case where the first matching relationship indicates that the first sound intensity does not conform to a preset matching relationship with the target sound intensity level, and the second sound intensity conforms to the preset matching relationship with the target sound intensity level, the control instruction is generated by determining a type of the non-device noise, wherein the type of the non-device noise includes at least one of indoor noise and outdoor noise, determining a multimedia device in the target area and generating a second control instruction for the multimedia device to send the prompt information in a case where the type of the non-device noise is indoor noise, and determining a door and window device in the target area and generating a first control instruction for controlling an operation frequency of the door and window device in a case where the type of the non-device noise is outdoor noise.

[0011] In an example embodiment, whether to generate the control instruction is determined according to the environment information, the object information, the first sound intensity and the second sound intensity, including determining a current state of the target object according to the object information and determining a target sound intensity according to the environment information and the current state, determining a third matching relationship between the first sound intensity and a first preset sound intensity and a fourth matching relationship between the second sound intensity and a second preset sound intensity, wherein the first preset sound intensity is determined according to the target sound intensity and a first ratio, the second preset sound intensity is determined according to the target sound intensity and a second ratio, the first ratio is a ratio of the first sound intensity to a sound intensity of the sound signal, and the second ratio is a ratio of the second sound intensity to the sound intensity of the sound signal, and determining whether to generate the control instruction according to the third matching relationship and the fourth matching relationship.

[0012] In an example embodiment, determining the device noise and the non-device noise in the sound signal comprises: determining a noise signal in the sound signal according to the environment information of the target object and the object information; performing spectrum analysis on the noise signal to determine a spectrum graph of the noise signal; determining noise signals of different frequencies in the spectrum graph; and determining the device noise and the non-device noise according to the noise signals of the different frequencies.

[0013] According to another embodiment of the embodiments of the present application, a device control method is also provided, comprising: acquiring environment information of a target region, a sound signal and object information of a target object, wherein the target region is a region where the target object is located; determining device noise and non-device noise in the sound signal, and determining a first sound intensity of the device noise and a second sound intensity of the non-device noise; determining whether to generate a control instruction according to the environment information, the object information, the first sound intensity and the second sound intensity; and controlling a device in the target region according to the control instruction in a case where it is determined to generate the control instruction.

[0014] According to still another aspect of the embodiments of the present application, a computer readable storage medium is also provided, and the computer readable storage medium stores a computer program, wherein the computer program is configured to execute the device control method described above when running.

[0015] According to still another aspect of the embodiments of the present application, an electronic device is also provided, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the device control method described above through the computer program.

[0016] According to still another aspect of the embodiments of the present application, a computer program product is also provided, comprising a computer program, and the computer program is executed by a processor to implement the steps of the device control method described above.

[0017] In the embodiment of the present application, the environment information of a target region, a sound signal and object information of a target object are acquired, wherein the target region is a region where the target object is located; device noise and non-device noise in the sound signal are determined, and a first sound intensity of the device noise and a second sound intensity of the non-device noise are determined; it is determined whether to generate a control instruction according to the environment information, the object information, the first sound intensity and the second sound intensity; in the case of determining to generate the control instruction, a device in the target region is controlled according to the control instruction. That is, in the embodiment of the present application, the acquired sound signal is divided into device noise and non-device noise, and it is determined whether to generate a control instruction for controlling a device in the target region in combination with the object information of the target object and the environment information, and in the case of determining to generate the control instruction, the running state of the device is adjusted through the control instruction to reduce the noise in the target region. By using the above technical solution, the problem that the noise control effect is poor when the running frequency of the smart home is blindly adjusted in the case of being unable to identify noise of different types and sources is solved, and the noise can be more accurately reduced. BRIEF DESCRIPTION OF DRAWINGS

[0018] The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate embodiments consistent with the present application and, together with the description, further serve to explain the principles of the application.

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, for those skilled in the art, other drawings can also be obtained based on these drawings without creative labor.

[0020] Figure 1 is a hardware environment schematic diagram of a device control method according to an embodiment of the present application;

[0021] Figure 2 is a flowchart of a device control method according to an embodiment of the present application;

[0022] Figure 3 is a structural block diagram of a device control device according to an optional embodiment of the present application;

[0023] Figure 4 is a schematic diagram (I) of a device control method according to an optional embodiment of the present application;

[0024] Figure 5 is a schematic diagram (II) of a device control method according to an optional embodiment of the present application;

[0025] Figure 6is an electronic device structure diagram of a control method of a device according to an optional embodiment of the present application;

[0026] Figure 7 is a structure block diagram of a control device of a device according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to enable persons skilled in the art to better understand the scheme of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative labor should be within the scope of protection of the present application.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0029] According to an aspect of an embodiment of the present application, a control method of a device is provided. The control method of the device is widely applied to smart home (Smart Home), smart home, smart home device ecology, intelligence house (Intelligence House) ecology and other whole-house intelligent digital control application scenarios. Optionally, in the present embodiment, the control method of the device can be applied to the hardware environment composed of a terminal device 102 and a server 104 as shown in Figure 1 As shown in Figure 1 , the server 104 is connected with the terminal device 102 through a network, can be used to provide services (such as application services, etc.) for terminals or clients installed on terminals, can set a database on the server or independently of the server, and can be used to provide data storage services for the server 104, can configure cloud computing and / or edge computing services on the server or independently of the server, and can be used to provide data operation services for the server 104.

[0030] The network can include, but is not limited to, at least one of the following: a wired network, a wireless network. The wired network can include, but is not limited to, at least one of the following: a wide area network, a metropolitan area network, a local area network. The wireless network can include, but is not limited to, at least one of the following: WIFI (Wireless Fidelity), Bluetooth. The terminal device 102 can be, but is not limited to, a PC, a mobile phone, a tablet computer, a smart air conditioner, a smart range hood, a smart refrigerator, a smart oven, a smart stove, a smart washing machine, a smart water heater, a smart washing device, a smart dishwasher, a smart projection device, a smart television, a smart clothesline, a smart curtain, a smart audio and video, a smart socket, a smart sound, a smart sound box, a smart fresh air device, a smart kitchen and bathroom device, a smart bathroom device, a smart sweeping robot, a smart window cleaning robot, a smart mopping robot, a smart air purification device, a smart steamer, a smart microwave oven, a smart kitchen treasure, a smart purifier, a smart water dispenser, a smart door lock, etc.

[0031] In the present embodiment, a control method of a device is provided, which is applied to a terminal device, Figure 2 is a flowchart of the control method of the device according to the embodiments of the present application, which comprises the following steps:

[0032] In step S202, environment information, a sound signal and object information of a target object of a target area are acquired, wherein the target area is an area where the target object is located;

[0033] The target area can be understood as a home area, a work area; it can also be understood as a small area such as a bedroom, a living room in a home area, and the present embodiment does not limit this.

[0034] In step S204, device noise and non-device noise in the sound signal are determined, and a first sound intensity of the device noise and a second sound intensity of the non-device noise are determined;

[0035] The device noise includes, but is not limited to, the sound emitted by the air conditioner, the sound emitted by the water heater, and the sound emitted by the range hood; the non-device noise includes, but is not limited to, the user's voice, the sound in the community, and the sound of the outside traffic.

[0036] In step S206, it is determined whether to generate a control instruction according to the environment information, the object information, the first sound intensity and the second sound intensity;

[0037] The environment information includes, but is not limited to, temperature, humidity, and brightness.

[0038] In step S208, in the case where it is determined to generate the control instruction, a device in the target area is controlled according to the control instruction.

[0039] The environment information, the sound signal and the object information of the target object in the target area are obtained through the above steps, the device noise and the non-device noise in the sound signal are determined, and the first sound intensity of the device noise and the second sound intensity of the non-device noise are determined; whether to generate a control instruction is determined according to the environment information, the object information, the first sound intensity and the second sound intensity; and in the case of determining to generate the control instruction, a device in the target area is controlled according to the control instruction, which solves the problem that in the related art, in the case of being unable to identify noises of different types and sources, blindly adjusting the operation frequency of smart home may result in poor noise control effect, and thus the noise can be more accurately reduced.

[0040] Optionally, the step S206 can be implemented in the following manner: determining a first sound intensity level of the device noise according to the first sound intensity, and determining a first sound intensity level of the non-device noise according to the second sound intensity; determining a current state of the target object according to the object information, and determining a target sound intensity level according to the environment information and the current state; determining a first matching relationship between the first sound intensity level and the target sound intensity level, and a second matching relationship between the second sound intensity level and the target sound intensity level; and determining whether to generate the control instruction according to the first matching relationship and the second matching relationship.

[0041] In the embodiments of the present application, the sound intensity levels of the device noise and the non-device noise are first determined, and then according to the environment information and the current state of the target object, the sound intensity level that the target object can tolerate in the current environment and the current state is determined, and then whether to generate the control instruction is determined according to the first matching relationship between the first sound intensity level and the target sound intensity level, and the second matching relationship between the second sound intensity level and the target sound intensity level.

[0042] In the embodiments of the present application, whether to generate the control instruction is determined according to the first matching relationship between the sound intensity level of the device noise and the target sound intensity level, and the second matching relationship between the sound intensity level of the non-device noise and the target sound intensity level, that is, in the embodiments of the present application, whether to generate the control instruction is determined according to noises of different sources, which solves the problem that in the related art, in the case of being unable to identify noises of different types and sources, blindly adjusting the operation frequency of smart home may result in poor noise control effect, and thus the noise can be more accurately reduced.

[0043] Specifically, whether to generate the control instruction is determined according to the first matching relationship and the second matching relationship, including:

[0044] In a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level conform to a preset matching relationship, and the second sound intensity and the target sound intensity level conform to a preset matching relationship, the control instruction is generated, wherein the control instruction comprises: a first control instruction and a second control instruction, the first control instruction is used to control the number of operations of the driving motor of the device and the operation frequency of each driving motor; and the second control instruction is used to control the multimedia device in the target area to send prompt information, the prompt information is used to instruct other objects in the target area to reduce the volume.

[0045] In a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level conform to a preset matching relationship, but the second sound intensity and the target sound intensity level do not conform to a preset matching relationship, the control instruction is generated, wherein the control instruction comprises: the first control instruction.

[0046] In a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level do not conform to a preset matching relationship, but the second sound intensity and the target sound intensity level conform to a preset matching relationship, the control instruction is generated, wherein the control instruction comprises: the first control instruction and / or the second control instruction.

[0047] In a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level do not conform to a preset matching relationship, and the second sound intensity and the target sound intensity level do not conform to a preset matching relationship, the control instruction is prohibited to be generated.

[0048] The first matching relationship indicates that the first sound intensity and the target sound intensity level conform to a preset matching relationship, which can be understood as that the first sound intensity is higher than the target sound intensity level, that is, the sound intensity of the device noise exceeds the noise sound intensity that the target object can tolerate, and therefore, the control instruction of the control device needs to be generated. The second matching relationship indicates that the second sound intensity and the target sound intensity level conform to a preset matching relationship, which can be understood as that the second sound intensity is higher than the target sound intensity level, that is, the sound intensity of the non-device noise exceeds the noise sound intensity that the target object can tolerate. The first matching relationship indicates that the first sound intensity and the target sound intensity level do not conform to a preset matching relationship, which can be understood as that the first sound intensity is lower than or equal to the target sound intensity level. The second matching relationship indicates that the second sound intensity and the target sound intensity level do not conform to a preset matching relationship, which can be understood as that the second sound intensity is lower than or equal to the target sound intensity level.

[0049] Therefore, in the case that the first matching relationship indicates that the first sound intensity meets the preset matching relationship with the target sound intensity level, a first control instruction for controlling the operation quantity and the operation frequency of each driving motor of the device is generated; in the case that the non-device noise is human voice, and the second matching relationship indicates that the second sound intensity meets the preset matching relationship with the target sound intensity level, a second control instruction for controlling the multimedia device in the target area to send a prompt information is generated; in the case that the non-device noise is noise other than human voice, and the second matching relationship indicates that the second sound intensity meets the preset matching relationship with the target sound intensity level, a first control instruction for controlling the door and window device in the target area to close is generated.

[0050] Further, the multimedia device is determined as follows: a first object in the target area is determined, wherein the first object is an object that emits sound in the target area; a multimedia device bound to the first object is determined as the multimedia device; a plurality of multimedia devices existing in the target area are determined, and the distance between the first device and any multimedia device is determined, and a multimedia device closest to the first object is determined as the multimedia device.

[0051] Optionally, in the case that the first matching relationship indicates that the first sound intensity meets the preset matching relationship with the target sound intensity level, but the second sound intensity does not meet the preset matching relationship with the target sound intensity level, the control instruction is generated, including: determining the operation state of each device in the target area according to the environment information and the object information; determining the current operation data of each device in the target area; and generating a control instruction for controlling each device according to the current operation data of each device and the operation state of each device.

[0052] That is, the operation state in which each device in the target area needs to be in is determined according to the environment information and the object information, wherein the operation state includes operation data and on-off state; and a control instruction corresponding to each device is determined according to the operation state in which each device needs to be in and the current operation data of each device.

[0053] For example, when the user is lying on the bed and sleeping, the sensor collects the information of the environment (11 o'clock at night, indoor brightness), the device (which devices are working, such as air conditioner) and the user (the user is sleeping, receiving heart rate through a smart mattress or a smart bracelet), and the sound and sound intensity in the current environment. Then the system makes inference calculation according to the above-mentioned environment information and object information, filters out non-device noise, only keeps device noise, and combines the current user scenario and the grading of device noise to calculate the parameters of device control.

[0054] In an example embodiment, in the case where the first matching relationship indicates that the first sound intensity does not meet the preset matching relationship with the target sound intensity level, but the second sound intensity meets the preset matching relationship with the target sound intensity level, the control instruction is generated, including: determining the type of non-device noise, wherein the type of non-device noise at least includes one of indoor noise and outdoor noise; in the case where the type of non-device noise is indoor noise, determining the multimedia device in the target area and generating a second control instruction for the multimedia device to send the prompt information; in the case where the type of non-device noise is outdoor noise, determining the door and window device in the target area and generating a first control instruction for controlling the operation frequency of the door and window device.

[0055] That is, in the case where the non-device noise is too large, the noise can be reduced in the following way, for example, in the case where the non-device noise is indoor noise (human voice, game sound), the multimedia device in the target area can be used to send prompt information to make the object producing noise in the room reduce the volume; in the case where the non-device noise is outdoor noise, the door and window in the target area can be closed to reduce the sound intensity of outdoor noise.

[0056] Optionally, the step S206 can also be determined in the following way: determining the current state of the target object according to the object information, and determining the target sound intensity according to the environment information and the current state; determining the third matching relationship between the first sound intensity and the first preset sound intensity, and the fourth matching relationship between the second sound intensity and the second preset sound intensity, wherein the first preset sound intensity is determined according to the target sound intensity and a first ratio, the second preset sound intensity is determined according to the target sound intensity and a second ratio, the first ratio is the ratio of the first sound intensity to the sound intensity of the sound signal, and the second ratio is the ratio of the second sound intensity to the sound intensity of the sound signal; determining whether to generate the control instruction according to the third matching relationship and the fourth matching relationship.

[0057] In the embodiments of the present application, a manner for determining whether to generate a control instruction is also provided, specifically: first, determining sound intensities of device noise and non-device noise, and then determining sound intensities that a target object can tolerate in a current environment and a current state of the target object according to environmental information and the current state of the target object, and further determining whether to generate the control instruction according to a third matching relationship between the first sound intensity and a first preset sound intensity and a fourth matching relationship between the second sound intensity level and a second preset sound intensity.

[0058] Optionally, the step S204 can be implemented by the following manner: determining noise signals in the sound signals according to the environmental information of the target object and the object information; performing spectrum analysis on the noise signals to determine a spectrum graph of the noise signals; determining noise signals of different frequencies in the spectrum graph; and determining the device noise and the non-device noise according to the noise signals of the different frequencies.

[0059] In the embodiments of the present application, the noise signals in the sound signals are determined through the environmental information and the object information, which can improve the accuracy of determining the noise signals. For example, the sound of a water heater does not belong to noise signals when a user is taking a bath, but the sound of the water heater belongs to noise signals when the user is sleeping.

[0060] Further, the step S204 can also process the sound signals based on a sound source separation algorithm to determine the device noise and the non-device noise in the noise signals.

[0061] In order to better understand the process of the control method of the device, the implementation method flow of the control of the device will be described below in combination with optional embodiments, but the optional embodiments are not used to limit the technical solutions of the embodiments of the present application.

[0062] In the embodiments of the present application, a device control apparatus is provided, Figure 3 is a structural block diagram of the device control apparatus according to the optional embodiments of the present application, as Figure 3 shown, specifically comprising: an information acquisition module 301, a module parameter learning module 302, and a device control module 303.

[0063] The information acquisition module 301 is configured to acquire environmental information, user information, and device information.

[0064] The information acquisition module combines the environmental information, the user information, and the device information into a whole to form a specific scene, and then combines the scene with the sound intensity of noise as an input of a deep learning model.

[0065] The parameter learning module 302 is configured to learn parameters of the deep learning model.

[0066] The parameter learning module takes the data collected by the information collection module as input, uses a deep learning algorithm to learn and infer, and then outputs the results of the device control parameters.

[0067] The device regulation module 303 is configured to execute the output results of the parameter learning module.

[0068] The device regulation module adjusts the response parameters of each device using the smart home system according to the control parameters calculated by the parameter learning module, to achieve the purpose of noise control.

[0069] In this embodiment, a device control method is provided, Figure 4 is a schematic diagram of the device control method according to an optional embodiment of the present application, as Figure 4 shown, specifically comprising the following steps:

[0070] Step S401: Collecting environmental information, user information and device information.

[0071] The environmental information includes sound, temperature, humidity, brightness, air quality and the like. The user information includes user behavior information and user health information, wherein the user behavior information represents the user's current behavior, such as sleeping, watching TV, bathing, etc., and the user health information includes the user's heart rate, breathing rate, sleep, fatigue level (face collection) and the like. The device information includes device model, location, power and the like;

[0072] Step S402: Classifying the sound information and grading according to the sound intensity.

[0073] Through the above step S402, the device noise and non-device noise can be distinguished, because sometimes the noise intensity is large, which does not mean that the noise is large, but is caused by other non-device noise. At this time, adjusting the device running state, the effect of reducing noise is not obvious.

[0074] Step S403: Inference and calculation of the deep learning model according to the environmental information, user information, device information and different types of noise, and obtaining an adaptive device noise control parameter to control the running state of the driving motor.

[0075] The running state includes the number of driving motors and the running power of each driving motor. When the noise is too large in a scene, the system will automatically reduce the sound intensity of the noise, and when the noise has little effect on people in a scene, the system will increase or decrease or keep the running power and the number of driving motors unchanged according to the specific situation of the current scene.

[0076] Step S404: Execute the result instruction generated by the deep learning model (equivalent to the control instruction in the above embodiment).

[0077] Based on the results of the instructions, the number and efficiency of the drive motors are adjusted, thereby adaptively regulating the noise level of smart home devices.

[0078] This embodiment also provides a method for controlling the device. Figure 5 This is a schematic diagram (II) of a control method for a device according to an optional embodiment of this application, as shown below. Figure 5 As shown, the specific steps include:

[0079] Step 1: Collect data from three directions: environment, equipment, and user.

[0080] Environmental information includes, but is not limited to, sound (such as user voice, device sound, sounds in the neighborhood, and traffic sounds outside), temperature, humidity, and brightness. Device status data includes, but is not limited to, device model, device placement in the home, sound volume emitted by the device, number of drive motors operating on the device, and operating power of each drive motor. User information collection is divided into user behavior information and user health information. User behavior information describes the user's behavioral characteristics at home, such as sleeping, bathing, watching TV, and cooking. User health information describes some attributes of the user, such as heart rate, respiratory rate, and can also detect the user's fatigue level by recognizing facial features through a camera.

[0081] Step 2: Noise identification, classification, and grading.

[0082] First, deep learning algorithms are needed to classify various noises detected in the environment, such as equipment noise (air conditioner, television, washing machine), human voices, and outdoor traffic noise. Second, a sound intensity mapping table for human health noise is used to classify various noise levels.

[0083] Step 3: Generate device control commands.

[0084] Based on deep learning algorithms, the system calculates the optimal control parameters and generates device control commands by taking into account noise type, level, and input information from the environment, equipment, and user.

[0085] Step 4: Execute the equipment control command.

[0086] The output of step 3 is used as input to adjust the number of driving motors and the operating frequency of each driving motor to ensure the adaptability of noise control.

[0087] For example, when the user is lying on the bed and sleeping, the sensor collects the information of the environment (11 o'clock at night, indoor brightness), the device (which devices are working, such as air conditioner), and the user (the user is sleeping, receiving heart rate through a smart mattress or a smart bracelet), and the sound and sound intensity in the current environment at the same time. Then the system inputs these information into the model for inference calculation, filters out the non-device noise, only keeps the device noise, and combines the current user scene and the grading of the device noise to calculate the device control parameters, including the number of driving motors and the driving motor operation efficiency. Finally, the system will execute the control command, and then adaptively adjust the noise of the home device.

[0088] An electronic device structure diagram of a device control method is also provided in the embodiment, Figure 6 An electronic device structure diagram of a device control method is also provided in the embodiment, Figure 6 As shown in the figure, the system of the electronic device is controlled by a bus. The center console is the core of the whole system, and the center console includes a memory and a processor, wherein the memory and the processor are used for data collection and deep learning model inference, and the learned control instructions are sent to the smart home device for adjustment. The sensor device includes but is not limited to a temperature sensor, a camera, and an optical sensor. The sensor device is used to collect the information of the environment and the user. The smart home device not only receives the control instructions, but also reports the device state information to the center console in real time, so as to obtain the above-mentioned device state information during the training of the deep learning model.

[0089] Through the above embodiment, the user information, the environment information, and the device state are collected, and the data is inferred through the deep learning model, so that the adaptive noise reduction parameter adjustment mode can be obtained. The application can also automatically correct errors according to the learning condition, and reduce the operation and human intervention of the user.

[0090] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be realized by means of software and a general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a plurality of instructions for making a terminal device (which can be a mobile phone, computer, server, or network device) execute the method of each embodiment of the present application.

[0091] Figure 7 An electronic device structure diagram of a device control method is also provided in the embodiment, Figure 7 As shown in the figure, the system of the electronic device is controlled by a bus. The center console is the core of the whole system, and the center console includes a memory and a processor, wherein the memory and the processor are used for data collection and deep learning model inference, and the learned control instructions are sent to the smart home device for adjustment. The sensor device includes but is not limited to a temperature sensor, a camera, and an optical sensor. The sensor device is used to collect the information of the environment and the user. The smart home device not only receives the control instructions, but also reports the device state information to the center console in real time, so as to obtain the above-mentioned device state information during the training of the deep learning model.

[0092] The acquisition module 72 is configured to acquire environment information of a target area, a sound signal, and object information of a target object, where the target area is an area where the target object is located.

[0093] The first determination module 74 is configured to determine device noise and non-device noise in the sound signal, and determine a first sound intensity of the device noise and a second sound intensity of the non-device noise.

[0094] The second determination module 76 is configured to determine whether to generate a control instruction according to the environment information, the object information, the first sound intensity, and the second sound intensity.

[0095] The adjustment module 78 is configured to control a device in the target area according to the control instruction in a case where it is determined to generate the control instruction.

[0096] According to the above device, the environment information of the target area, the sound signal, and the object information of the target object are acquired, where the target area is an area where the target object is located; the device noise and the non-device noise in the sound signal are determined, and the first sound intensity of the device noise and the second sound intensity of the non-device noise are determined; whether to generate the control instruction is determined according to the environment information, the object information, the first sound intensity, and the second sound intensity; and the device in the target area is controlled according to the control instruction in a case where it is determined to generate the control instruction, thereby solving the problem that, in the related art, in a case where different types and sources of noise cannot be identified, the operation frequency of the smart home is blindly adjusted, which may result in poor noise control effect, and thus the noise can be more accurately reduced.

[0097] In one example embodiment, the second determination module 76 is configured to determine a first sound intensity level of the device noise according to the first sound intensity, and determine a first sound intensity level of the non-device noise according to the second sound intensity; determine a current state of the target object according to the object information, and determine a target sound intensity level according to the environment information and the current state; determine a first matching relationship between the first sound intensity level and the target sound intensity level, and a second matching relationship between the second sound intensity level and the target sound intensity level; and determine whether to generate the control instruction according to the first matching relationship and the second matching relationship.

[0098] In an example embodiment, the second determining module 76 is configured to generate the control instruction in the case that the first matching relationship indicates that the first sound intensity and the target sound intensity level meet the preset matching relationship and the second sound intensity and the target sound intensity level meet the preset matching relationship, wherein the control instruction comprises: the first control instruction for controlling the number of running motors and the running frequency of each motor of the device; and the second control instruction for controlling the multimedia device in the target area to send the prompt information for instructing other objects in the target area to reduce the volume; generate the control instruction in the case that the first matching relationship indicates that the first sound intensity and the target sound intensity level meet the preset matching relationship but the second sound intensity and the target sound intensity level do not meet the preset matching relationship, wherein the control instruction comprises the first control instruction; generate the control instruction in the case that the first matching relationship indicates that the first sound intensity and the target sound intensity level do not meet the preset matching relationship but the second sound intensity and the target sound intensity level meet the preset matching relationship, wherein the control instruction comprises the first control instruction and / or the second control instruction; and prohibit generating the control instruction in the case that the first matching relationship indicates that the first sound intensity and the target sound intensity level do not meet the preset matching relationship and the second sound intensity and the target sound intensity level do not meet the preset matching relationship.

[0099] In an example embodiment, the second determining module 76 is configured to determine the running state of each device in the target area according to the environment information and the object information; determine the current running data of each device in the target area; and generate the control instruction for controlling each device according to the current running data of each device and the running state of each device.

[0100] In an example embodiment, the second determining module 76 is configured to determine the type of the non-device noise, wherein the type of the non-device noise comprises at least one of the following: indoor noise and outdoor noise; determine the multimedia device in the target area and generate the second control instruction for the multimedia device to send the prompt information in the case that the type of the non-device noise is indoor noise; and determine the door and window device in the target area and generate the first control instruction for controlling the running frequency of the door and window device in the case that the type of the non-device noise is outdoor noise.

[0101] In an example embodiment, the second determining module 76 is configured to determine a current state of the target object according to the object information, and determine a target sound intensity according to the environment information and the current state; determine a third matching relationship between the first sound intensity and a first preset sound intensity, and a fourth matching relationship between the second sound intensity and a second preset sound intensity, wherein the first preset sound intensity is determined according to the target sound intensity and a first ratio, the second preset sound intensity is determined according to the target sound intensity and a second ratio, the first ratio is a ratio of the first sound intensity to a sound intensity of the sound signal, and the second ratio is a ratio of the second sound intensity to the sound intensity of the sound signal; and determine whether to generate the control instruction according to the third matching relationship and the fourth matching relationship.

[0102] In an example embodiment, the first determining module 74 is configured to determine a noise signal in the sound signal according to the environment information of the target object and the object information; perform a spectrum analysis on the noise signal to determine a spectrum graph of the noise signal; determine different frequency noise signals in the spectrum graph; and determine the device noise and the non-device noise according to the different frequency noise signals.

[0103] Embodiments of the present application also provide a storage medium including a stored program, wherein the program performs any of the above methods when executed.

[0104] Optionally, in the present embodiment, the storage medium can be configured to store program code for performing the following steps:

[0105] S1, obtaining environment information of a target region, a sound signal, and object information of a target object, wherein the target region is a region where the target object is located;

[0106] S2, determining a device noise and a non-device noise in the sound signal, and determining a first sound intensity of the device noise and a second sound intensity of the non-device noise;

[0107] S3, determining whether to generate a control instruction according to the environment information, the object information, the first sound intensity, and the second sound intensity;

[0108] S4, in a case where it is determined to generate the control instruction, controlling a device in the target region according to the control instruction.

[0109] Embodiments of the present application also provide an electronic device including a memory and a processor, the memory storing a computer program, and the processor being configured to execute the computer program to perform the steps in any of the above method embodiments.

[0110] Optionally, the electronic device can further include a transmission device connected to the processor and an input and output device connected to the processor.

[0111] Optionally, in the embodiment, the processor can be configured to execute the following steps by using a computer program:

[0112] S1, obtaining environment information of a target area, a sound signal and object information of a target object, wherein the target area is an area where the target object is located;

[0113] S2, determining device noise and non-device noise in the sound signal, and determining a first sound intensity of the device noise and a second sound intensity of the non-device noise;

[0114] S3, determining whether to generate a control instruction according to the environment information, the object information, the first sound intensity and the second sound intensity;

[0115] S4, in the case of determining to generate the control instruction, controlling a device in the target area according to the control instruction.

[0116] Optionally, in the embodiment, the storage medium can include but is not limited to a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk and various storage program codes.

[0117] The embodiment of the present application also provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to realize the steps in any one of the method embodiments.

[0118] The embodiment of the present application also provides another computer program product, which comprises a non-volatile computer readable storage medium, and the non-volatile computer readable storage medium stores a computer program, and the computer program is executed by a processor to realize the steps in any one of the method embodiments.

[0119] The embodiment of the present application also provides a computer program, which comprises computer instructions stored in a computer readable storage medium; a processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to make the computer device execute the steps in any one of the method embodiments.

[0120] Optionally, specific examples in the embodiment can refer to the examples described in the above embodiments and optional implementation manners, and the embodiment will not be described here.

[0121] It should be apparent to those skilled in the art that the modules or steps of the application described above can be implemented using general computing devices, which can be centralized on a single computing device or distributed across a network of multiple computing devices, and optionally implemented using program code executable by a computing device, which can be stored in a storage device and executed by a computing device, and in some cases the steps shown or described can be performed in a different order than shown, or made into individual integrated circuit modules, or multiple modules or steps made into a single integrated circuit module. Thus, the application is not limited to any particular combination of hardware and software.

[0122] The above description is merely that of the preferred embodiments of the application, and modifications and alterations are possible without departing from the principles of the application, which are intended to be as broad as possible in scope.

Claims

1. A control method of an apparatus, characterized by, The method comprises: acquiring environmental information, a sound signal and object information of a target object in a target area in which the target object is located; determining device noise and non-device noise in the sound signal, and determining a first sound intensity of the device noise and a second sound intensity of the non-device noise; determining whether to generate a control instruction according to the environmental information, the object information, the first sound intensity and the second sound intensity; controlling a device in the target area according to the control instruction in a case where it is determined to generate the control instruction.

2. The control method of the apparatus according to claim 1, characterized by, The determining whether to generate the control instruction according to the environmental information, the object information, the first sound intensity and the second sound intensity comprises: determining a first sound intensity level of the device noise according to the first sound intensity, and determining a first sound intensity level of the non-device noise according to the second sound intensity; determining a current state of the target object according to the object information, and determining a target sound intensity level according to the environmental information and the current state; determining a first matching relationship between the first sound intensity level and the target sound intensity level, and a second matching relationship between the second sound intensity level and the target sound intensity level; determining whether to generate the control instruction according to the first matching relationship and the second matching relationship.

3. The control method of the apparatus according to claim 2, characterized by, The determining whether to generate the control instruction according to the first matching relationship and the second matching relationship comprises: generating the control instruction in a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level meet a preset matching relationship, and the second sound intensity and the target sound intensity level meet a preset matching relationship, wherein the control instruction comprises: a first control instruction for controlling a running number of drive motors of a device and a running frequency of each drive motor, and a second control instruction for controlling a multimedia device in the target area to send prompt information, the prompt information being used to instruct other objects in the target area to reduce a volume; generating the control instruction in a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level meet a preset matching relationship, but the second sound intensity and the target sound intensity level do not meet a preset matching relationship, wherein the control instruction comprises: the first control instruction; generating the control instruction in a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level do not meet a preset matching relationship, but the second sound intensity and the target sound intensity level meet a preset matching relationship, wherein the control instruction comprises: the first control instruction and / or the second control instruction; inhibiting generation of the control instruction in a case where the first matching relationship indicates that the first sound intensity and the target sound intensity level do not meet a preset matching relationship, and the second sound intensity and the target sound intensity level do not meet a preset matching relationship.

4. The control method of the apparatus according to claim 3, characterized by, In a case where the first matching relationship indicates that the first sound intensity conforms to a preset matching relationship with the target sound intensity level, but the second sound intensity does not conform to the preset matching relationship with the target sound intensity level, the control instruction is generated, including: determining an operation state of each device in the target area according to the environment information and the object information; determining current operation data of each device in the target area; generating a control instruction for controlling each device according to the current operation data of each device and the operation state of each device.

5. The control method of the apparatus according to claim 3, characterized by, In a case where the first matching relationship indicates that the first sound intensity does not conform to a preset matching relationship with the target sound intensity level, but the second sound intensity conforms to the preset matching relationship with the target sound intensity level, the control instruction is generated, including: determining a type of the non-device noise, wherein the type of the non-device noise at least includes one of indoor noise and outdoor noise; in a case where the type of the non-device noise is indoor noise, determining a multimedia device in the target area and generating a second control instruction for the multimedia device to send the prompt information; in a case where the type of the non-device noise is outdoor noise, determining a door and window device in the target area and generating a first control instruction for controlling an operation frequency of the door and window device.

6. The control method of the apparatus according to claim 1, characterized by, determining whether to generate a control instruction according to the environment information, the object information, the first sound intensity and the second sound intensity, including: determining a current state of the target object according to the object information, and determining a target sound intensity according to the environment information and the current state; determining a third matching relationship between the first sound intensity and a first preset sound intensity, and a fourth matching relationship between the second sound intensity and a second preset sound intensity, wherein the first preset sound intensity is determined according to the target sound intensity and a first ratio, the second preset sound intensity is determined according to the target sound intensity and a second ratio, the first ratio is a ratio of the first sound intensity to a sound intensity of the sound signal, and the second ratio is a ratio of the second sound intensity to the sound intensity of the sound signal; determining whether to generate the control instruction according to the third matching relationship and the fourth matching relationship.

7. The control method of the apparatus according to claim 1, characterized by, determining device noise and non-device noise in the sound signal, including: determining a noise signal in the sound signal according to environment information of the target object and the object information; performing spectrum analysis on the noise signal to determine a spectrum graph of the noise signal; determining noise signals of different frequencies in the spectrum graph; determining the device noise and the non-device noise according to the noise signals of different frequencies.

8. A control device of an apparatus, characterized by comprising: including: an acquisition module, configured to acquire environment information of a target area, a sound signal and object information of a target object, wherein the target area is an area where the target object is located; The first determining module is configured to determine device noise and non-device noise in the sound signal, and determine a first sound intensity of the device noise and a second sound intensity of the non-device noise. The second determining module is configured to determine whether to generate a control instruction according to the environment information, the object information, the first sound intensity, and the second sound intensity. The adjusting module is configured to control a device in a target area according to the control instruction when it is determined that the control instruction is generated.

9. A computer readable storage medium, characterized in that, The computer readable storage medium comprises a stored program, wherein the program performs the method in any one of claims 1 to 7 when executed. 10.An electronic device comprising a memory and a processor, the electronic device characterized by, The memory stores a computer program, and the processor is configured to execute the method in any one of claims 1 to 7 by using the computer program.

11. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the method in any one of claims 1 to 7.

Images