Household equipment control method and device based on scene control

Abstract

The invention discloses a household equipment control method and device based on scene control. The method comprises the following steps: acquiring scene broadcast search information; the scene broadcast search information comprises a plurality of pieces of to-be-searched home equipment information; determining target home equipment information based on the scene broadcast search information; the target home equipment information comprises a plurality of pieces of target control home equipment information; determining target equipment control information based on the target home equipment information; the target equipment control information comprises a plurality of pieces of target audio control information.

Description

Technical Field

[0001] The present invention relates to the field of control technology, and in particular to a method and device for controlling home appliances based on scene control. Background Art

[0002] From the perspective of business forms, the scenes of the KNX gateway itself include built-in scenes and user-defined scenes. Customized scenes are scenes created by users through smart home apps, and built-in scenes are configured in the gateway through configuration apps. Built-in scenes are further divided into KNX scenes and configured scenes. The difference between the two is that one is based on the KNX native protocol implementation, and the other is implemented by configuring the scene logic through the configuration app. From the perspective of scene implementation, the scenes of the KNX gateway can be divided into KNX protocol scenes and custom protocol scenes. The KNX protocol scene does not support modification. The principle is to send the group address to the KNX bus. The custom protocol scene supports modification. The principle is to record the devices and device functions that need to execute the scene. When executing, the function key-value pairs of the device model are sent. When controlling the scene, it is necessary to distinguish the classification of scene implementation. Since the custom protocol scene supports user modification, there may be scenes stored in the current gateway, in which the device does not belong to the gateway. When the above situation occurs, the App control scene needs to distinguish whether it is a KNX protocol scene or a custom protocol scene. If it is a KNX protocol scene, the scene ID control can be sent directly. Otherwise, the App needs to disassemble the protocol content and broadcast the control command. Device and scene control itself is not complicated, but the devices in the local area network are complicated. How to accurately control the corresponding devices, such as how to control sub-devices and how to control the KNX scenes built into the gateway, is one of the current research hotspots. Therefore, a method and device for controlling home appliances based on scene control are provided to improve the control efficiency and accuracy of home appliances, thereby improving the user experience. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide a method and device for controlling home appliances based on scene control, which is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0004] In order to solve the above technical problems, the first aspect of the embodiment of the present invention discloses a method for controlling a home appliance based on scene control, the method comprising: Acquire scene broadcast search information; the scene broadcast search information includes information of several home appliances to be searched; Based on the scene broadcast search information, target home device information is determined; the target home device information includes information of several target controlled home devices; Based on the target home device information, target device control information is determined; the target device control information includes a plurality of target audio control information.

[0005] A second aspect of an embodiment of the present invention discloses a home appliance control device based on scene control, the device comprising: An acquisition module, used to acquire scene broadcast search information; the scene broadcast search information includes information of a plurality of home appliances to be searched; A first determination module is used to determine target home device information based on the scene broadcast search information; the target home device information includes information of a plurality of target control home devices; The second determination module is used to determine target device control information based on the target home device information; the target device control information includes a plurality of target audio control information.

[0006] The third aspect of the present invention discloses another home appliance control device based on scene control, the device comprising: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute part or all of the steps in the scene control-based home appliance control method disclosed in the first aspect of the embodiment of the present invention.

[0007] The fourth aspect of the present invention discloses a computer-readable storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute some or all of the steps in the scene-control-based home appliance control method disclosed in the first aspect of an embodiment of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0009] Figure 1 is a schematic diagram of a scene of a home appliance control system based on scene control provided by an embodiment of the present invention; Figure 2 It is a flowchart of a method for controlling a household appliance based on scene control disclosed in an embodiment of the present invention; Figure 3 It is a structural schematic diagram of a home appliance control device based on scene control disclosed in an embodiment of the present invention; Figure 4It is a structural schematic diagram of another household appliance control device based on scene control disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0010] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0011] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or equipment that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or equipment.

[0012] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0013] In this application, the word "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described in this application as "exemplary" is not necessarily to be construed as being preferred or advantageous over other embodiments. The following description is given to enable any technician in the field to implement and use the present application. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present application can be implemented without using these specific details. In other instances, well-known structures and processes will not be elaborated in detail to avoid obscuring the description of the present application with unnecessary details. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in the present application.

[0014] It should be noted that since the method of the embodiment of the present application is executed in a computer device, the processing objects of each computer device exist in the form of data or information. For example, time is actually time information. It can be understood that if size, quantity, position, etc. are mentioned in subsequent embodiments, they are all corresponding data for processing by the computer device. The details will not be repeated here.

[0015] It should be noted that the artificial intelligence related technologies that may be involved in this application are briefly described. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making.

[0016] Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0017] Computer Vision (CV) is a science that studies how to make machines "see". To put it more specifically, it refers to machine vision such as using cameras and computers to replace human eyes to identify and measure targets, and further perform graphic processing so that computer processing becomes an image that is more suitable for human eye observation or transmission to instrument detection. As a scientific discipline, computer vision studies related theories and technologies, and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous positioning and map construction, and other technologies, as well as common biometric recognition technologies such as face recognition and fingerprint recognition.

[0018] Unimodal information is data of only one type, such as text, image, audio, video, electromagnetic signal, etc. Multimodal information is data that includes at least two types of unimodal information. Furthermore, multimodal information is suitable for complex tasks that require the integration of multiple information sources, such as sentiment analysis, robot interaction, autonomous driving, etc. By integrating information from multiple modalities, higher performance and accuracy can usually be achieved on the task.

[0019] A large model refers to an artificial neural network model with a very large number of parameters. In the field of artificial intelligence, a large model generally refers to a model with hundreds of millions to trillions of parameters. Models usually need to be trained on large-scale data sets and require a large amount of computing resources to be optimized and adjusted. Large models are often used to solve complex tasks such as natural language processing, computer vision, and speech recognition. Generative AI is an AI that can create new content and ideas, including conversations, stories, images, videos, and music. In an embodiment of the present application, the large model may be ChatGPT, BERT, XLNet, Zhipu model, Claude, Moonshot AI model, ChatGLM model, Qianyi Tongwen model, MiniMax model, Spark model, Llama model, 360GPT model, Qwen model, Baichuan model, Skylark model, vivoLM model, and Wenxin Yiyan scale language models, which are not limited in the embodiments of the present application.

[0020] The embodiments of the present application provide a scene-based home appliance control method, device, computer equipment, and computer-readable storage medium, which are described in detail below.

[0021] See also Figure 1 , Figure 1 A schematic diagram of a scene of a home appliance control system based on scene control provided in an embodiment of the present application. The home appliance control system based on scene control may include a computer device 100, in which a home appliance control device based on scene control is integrated, such as Figure 1 Computer equipment in.

[0022] In the embodiment of the present application, the computer device 100 is mainly used to obtain scene broadcast search information; the scene broadcast search information includes a plurality of household device information to be searched; Based on the scene broadcast search information, target home device information is determined; the target home device information includes information of several target controlled home devices; Based on the target home device information, target device control information is determined; the target device control information includes a plurality of target audio control information.

[0023] It can improve the control efficiency and accuracy of home appliances, thereby improving the user experience.

[0024] In the embodiment of the present application, the computer device 100 may be an independent server, or a server network or server cluster composed of servers. For example, the computer device 100 described in the embodiment of the present application includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud server composed of a plurality of servers. The cloud server is composed of a large number of computers or network servers based on cloud computing.

[0025] It is understandable that the computer device 100 used in the embodiments of the present application may be a device including both receiving and transmitting hardware, that is, a device having receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such a device may include: a cellular or other communication device having a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The specific computer device 100 may be a desktop terminal or a mobile terminal, and the computer device 100 may also be one of a mobile phone, a tablet computer, a laptop computer, etc.

[0026] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or less computer equipment as shown in Figure 1 Only one computer device is shown. It can be understood that the scene-based home appliance control system may also include one or more other services, which are not specifically limited here.

[0027] In addition, if Figure 1 As shown, the scene-control-based home appliance control system may further include a memory 200 for storing data, such as image data, location information, and the like.

[0028] It should be noted that Figure 1 The scene diagram of the scene-controlled home appliance control system shown is only an example. The scene-controlled home appliance control system and the scene described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided in the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the scene-controlled home appliance control system and the emergence of new business scenarios, the technical solution provided in the embodiment of the present application is also applicable to similar technical problems.

[0029] The present invention discloses a method and device for controlling household appliances based on scene control, which are beneficial to improving the control efficiency and accuracy of household appliances, thereby improving the user experience. Detailed descriptions are given below.

[0030] Embodiment 1 See also Figure 2 , Figure 2 is a flow chart of a method for controlling home appliances based on scene control disclosed in an embodiment of the present invention. Figure 2 The described scene-based home appliance control method is applied to a management system, such as a local server or cloud server for management, and is not limited in the embodiments of the present invention. Figure 2 As shown, the scene-based home appliance control method may include the following operations: 101. Obtain scene broadcast search information.

[0031] In the embodiment of the present invention, the scene broadcast search information includes information of a plurality of home appliances to be searched.

[0032] 102. Based on the scene broadcast search information, determine the target home device information.

[0033] In the embodiment of the present invention, the target home appliance information includes information of a plurality of target controlled home appliances.

[0034] 103. Determine target device control information based on the target home device information.

[0035] In the embodiment of the present invention, the target device control information includes a plurality of target audio control information.

[0036] It should be noted that the target audio control information represents control instruction information executable by the smart home device, and the target audio control information may be in the form of binary instructions or other recognizable instructions, which is not limited in the embodiment of the present invention.

[0037] It should be noted that the above-mentioned home appliance information to be searched represents various types of smart home appliances in a home scene, such as smart TVs, smart air conditioners, smart speakers, smart curtains, etc., which is not limited in the embodiment of the present invention.

[0038] It can be seen that implementing the scene control-based home appliance control method described in the embodiment of the present invention is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0039] In an optional embodiment, the scene-based broadcast search information to determine the target home device information includes: For any home appliance information to be searched in the scene broadcast search information, and for any smart home information to be controlled in the scene home library, the search home feature information corresponding to the home appliance information to be searched and the smart home feature information corresponding to the smart home information to be controlled are calculated and processed using the feature matching model to obtain the feature matching value corresponding to the smart home information to be controlled; Among them, the feature matching model is: ; in, is the feature matching value; To search for home feature information, It is the smart home feature information; is the number of element values ​​in the searched home feature information; To search for home feature information element value; It is the first element value; , and are respectively the first matching parameter, the second matching parameter and the third matching parameter; Determine whether the feature matching value is less than or equal to the matching threshold, and obtain the matching judgment result corresponding to the smart home information to be controlled; When the match determination result is yes, the smart home information to be controlled is determined as a standby smart home information; When the matching result is no, the processing flow corresponding to the smart home information to be controlled is terminated; Based on the backup smart home information, the target controlled home device information corresponding to the home device information to be searched is determined.

[0040] It should be noted that the first matching parameter, the second matching parameter and the third matching parameter are all values ​​between [0, 1], which are not limited in the embodiment of the present invention. Further, the sum of the first matching parameter, the second matching parameter and the third matching parameter is 1, which is not limited in the embodiment of the present invention.

[0041] It should be noted that the calculation and analysis of the feature matching values ​​mentioned above can find all possible smart home devices that the user intends to control. For example, if the user intends to control a TV-type smart home device, TVs including Xiaomi smart TV, TCL smart TV, Hisense smart TV, etc. will all be included in the candidate range, and the embodiment of the present invention is not limited to this.

[0042] It should be noted that the above matching threshold may be set by a user, or may be a default value given by the system, or may be obtained by averaging historical matching thresholds, which is not limited in the embodiment of the present invention.

[0043] It can be seen that implementing the scene control-based home appliance control method described in the embodiment of the present invention is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0044] In another optional embodiment, based on the backup smart home information, determining the target controlled home device information corresponding to the home device information to be searched includes: Determine whether the amount of standby smart home information is equal to 1, and obtain a quantity determination result; When the result of the quantity determination is yes, determining that the standby smart home information is the target controlled home device information corresponding to the home device information to be searched; When the result of the quantity judgment is no, the backup smart home information corresponding to the largest feature matching value among all the backup smart home information corresponding to the home device information to be searched is determined as the target controlled home device information corresponding to the home device information to be searched.

[0045] It should be noted that the above analysis and determination of the quantity of the standby smart home information can ensure that each home device information to be searched can control the smart home device with the highest correlation therewith, which is not limited in the embodiment of the present invention.

[0046] It can be seen that implementing the scene control-based home appliance control method described in the embodiment of the present invention is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0047] In yet another optional embodiment, the target device control information is determined based on the target home device information, including: For any target controlled home device information in the target home device information, establish a local area network communication channel between the smart mobile terminal and the smart home corresponding to the target controlled home device information; Detect whether the intelligent mobile terminal displays a channel signal corresponding to the local area network communication channel, and obtain a signal detection result; When the signal detection result is no, triggering execution to establish a local area network communication channel of the smart home corresponding to the smart mobile terminal and the target controlled home device information; Detect whether the voice control information input by the user is received and obtain the voice detection result; When the voice detection result is negative, obtaining the prompt interval time corresponding to the target home device control information; Triggering execution at a prompt interval to detect whether voice control information input by the user is received, and obtaining a voice detection result; When the voice detection result is yes, the target audio control information corresponding to the target controlled home device information is determined based on the voice control information.

[0048] It should be noted that the above-mentioned smart home LAN communication channel establishing the smart mobile terminal corresponding to the target controlled home device information can be established through Bluetooth, or a temporary wired connection established by the LAN, or a LAN communication channel established by other means, and the embodiment of the present invention is not limited thereto.

[0049] It should be noted that the above channel signal indicates that the local area network communication channel has been established, such as a Bluetooth connection symbol, which is not limited in the embodiment of the present invention.

[0050] It should be noted that the above-mentioned voice control information represents the voice control instructions for controlling furniture equipment, which is not limited in the embodiment of the present invention.

[0051] It should be noted that the prompt interval corresponding to the above-mentioned target controlled home appliance information is set according to the device type. Furthermore, the prompt interval set according to the device type is set according to the user's attention response to the device type. For example, the user's attention response to televisions is higher and the required feedback time is faster, and the interval time should be shorter. For example, the prompt interval time for air conditioners is 1 minute, and the prompt interval time for televisions is 30 seconds. This is not limited in the embodiments of the present invention.

[0052] It can be seen that implementing the scene control-based home appliance control method described in the embodiment of the present invention is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0053] In yet another optional embodiment, determining the target audio control information corresponding to the target controlled home device information based on the voice control information includes: Performing noise reduction processing on the voice control information to obtain first voice feature information; Performing feature extraction processing on the first voice feature information to obtain second voice feature information; The target voice conversion model is used to perform voice conversion processing on the second voice feature information to obtain target audio control information corresponding to the target controlled home appliance information.

[0054] It should be noted that the feature extraction process for the first voice feature information may be implemented based on a trained BERT model or a BiLSTM model, which is not limited in the embodiment of the present invention.

[0055] In this optional embodiment, as an optional implementation manner, the above-mentioned performing noise reduction processing on the voice control information to obtain the first voice feature information includes: Performing low-frequency filtering on the voice control information to obtain first processing feature information; Extracting time domain features from the first processing feature information to obtain second processing feature information; Determine whether the data length of the second processing characteristic information is equal to a preset length value, and obtain a length determination result; When the length judgment result is no, the data length is filled to the length value at the end of the second processing feature information using the binary symbol 0 to obtain the first voice feature information; When the length judgment result is yes, the second processing feature information is determined as the first voice feature information.

[0056] It should be noted that the frequency of the above low-frequency filtering process does not exceed 3 Hz, which is not limited in the embodiment of the present invention.

[0057] It should be noted that the above length value does not exceed 100, and this embodiment of the present invention does not limit this.

[0058] It can be seen that implementing the scene control-based home appliance control method described in the embodiment of the present invention is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0059] In an optional embodiment, the target speech conversion model is obtained based on the following steps: Acquire initial training sample information; the initial training sample information includes a number of initial speech training samples; Based on the initial training sample information, target training sample information is determined; the target training sample information includes a plurality of target training samples; Using the target training sample information to train the initial speech conversion model, and obtaining the training speech conversion model and training result information; The training result information is calculated and processed using a loss function model to obtain target training parameter information; the loss function model includes a first loss function model and a second loss function model; Determine whether the target training parameter information meets the training termination condition and obtain the training judgment result; When the training judgment result is no, the training speech conversion model is used to perform parameter update processing on the initial speech conversion model, and trigger execution based on the initial training sample information to determine the target training sample information; When the training judgment result is yes, the training speech conversion model is determined as the audio recognition model.

[0060] It should be noted that the above-mentioned target speech conversion model is constructed by a Transformer encoder including multiple Attention mechanisms, and it can also be obtained by fine-tuning a large model, which is not limited in the embodiment of the present invention.

[0061] It should be noted that the above-mentioned training termination conditions include the convergence of the loss function value and the historical loss function value in the target training parameter information, and / or the number of training times in the target training parameter information reaches 100 times, which is not limited in the embodiment of the present invention.

[0062] It should be noted that the above determination of the target training sample information based on the initial training sample information is to randomly select a number of samples as target training samples, which is not limited in the embodiment of the present invention. Further, the number of the above target training samples is not less than 10, which is not limited in the embodiment of the present invention.

[0063] It should be noted that the above-mentioned initial speech training samples may be annotated by user recordings or downloaded from the Internet, which is not limited in the embodiment of the present invention.

[0064] It can be seen that implementing the scene control-based home appliance control method described in the embodiment of the present invention is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0065] In another optional embodiment, the training result information is calculated and processed using a loss function model to obtain target training parameter information, including: Using the first loss function model to calculate the training result information to obtain first training parameter information; Among them, the first loss function model is: ; In the formula, Characterizing first training parameter information; Represents the training result information Prediction labels; Characterization The true labels corresponding to the target training samples; Using the second loss function model to calculate the training result information to obtain second training parameter information; A weighted sum process is performed on the first training parameter information and the second training parameter information to obtain target training parameter information.

[0066] It should be noted that each of the above predicted labels corresponds to a real label, which is not limited in the embodiment of the present invention.

[0067] It should be noted that the second loss function model mentioned above is a cross entropy loss function, which is not limited in the embodiment of the present invention.

[0068] It should be noted that the weight coefficients of the weighted summation process performed on the first training parameter information and the second training parameter information are both 0.5, which is not limited in the embodiment of the present invention.

[0069] It can be seen that implementing the scene control-based home appliance control method described in the embodiment of the present invention is conducive to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0070] Embodiment 2 See also Figure 3 , Figure 3 is a schematic diagram of the structure of a home appliance control device based on scene control disclosed in an embodiment of the present invention. Figure 3 The described device can be applied to a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. Figure 3 As shown, the device may include: The acquisition module 201 is used to acquire scene broadcast search information; the scene broadcast search information includes information of several home appliances to be searched; The first determination module 202 is used to determine target home device information based on the scene broadcast search information; the target home device information includes information of several target controlled home devices; The second determination module 203 is used to determine target device control information based on the target home device information; the target device control information includes a plurality of target audio control information.

[0071] It can be seen that the implementation Figure 3 The described scene-control-based home appliance control device is beneficial to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0072] In another optional embodiment, Figure 3 As shown, the first determination module 202 determines the target home device information based on the scene broadcast search information, including: For any home appliance information to be searched in the scene broadcast search information, and for any smart home information to be controlled in the scene home library, the search home feature information corresponding to the home appliance information to be searched and the smart home feature information corresponding to the smart home information to be controlled are calculated and processed using the feature matching model to obtain the feature matching value corresponding to the smart home information to be controlled; Among them, the feature matching model is: ; in, is the feature matching value; To search for home feature information, It is the smart home feature information; is the number of element values ​​in the searched home feature information; To search for home feature information element value; It is the first element value; , and are respectively the first matching parameter, the second matching parameter and the third matching parameter; Determine whether the feature matching value is less than or equal to the matching threshold, and obtain the matching judgment result corresponding to the smart home information to be controlled; When the match determination result is yes, the smart home information to be controlled is determined as a standby smart home information; When the matching result is no, the processing flow corresponding to the smart home information to be controlled is terminated; Based on the backup smart home information, the target controlled home device information corresponding to the home device information to be searched is determined.

[0073] It can be seen that the implementation Figure 3 The described scene-control-based home appliance control device is beneficial to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0074] In yet another optional embodiment, Figure 3 As shown, the first determination module 202 determines the target controlled home device information corresponding to the home device information to be searched based on the backup smart home information, including: Determine whether the amount of standby smart home information is equal to 1, and obtain a quantity determination result; When the result of the quantity determination is yes, determining that the standby smart home information is the target controlled home device information corresponding to the home device information to be searched; When the result of the quantity judgment is no, the backup smart home information corresponding to the largest feature matching value among all the backup smart home information corresponding to the home device information to be searched is determined as the target controlled home device information corresponding to the home device information to be searched.

[0075] It can be seen that the implementation Figure 3 The described scene-control-based home appliance control device is beneficial to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0076] In yet another optional embodiment, Figure 3 As shown, the second determination module 203 determines the target device control information based on the target home device information, including: For any target controlled home device information in the target home device information, establish a local area network communication channel between the smart mobile terminal and the smart home corresponding to the target controlled home device information; Detect whether the intelligent mobile terminal displays a channel signal corresponding to the local area network communication channel, and obtain a signal detection result; When the signal detection result is no, triggering execution to establish a local area network communication channel of the smart home corresponding to the smart mobile terminal and the target controlled home device information; Detect whether the voice control information input by the user is received and obtain the voice detection result; When the voice detection result is negative, obtaining the prompt interval time corresponding to the target home device control information; Triggering execution at a prompt interval to detect whether voice control information input by the user is received, and obtaining a voice detection result; When the voice detection result is yes, the target audio control information corresponding to the target controlled home device information is determined based on the voice control information.

[0077] It can be seen that the implementation Figure 3 The described scene-control-based home appliance control device is beneficial to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0078] In yet another optional embodiment, Figure 3 As shown, the second determination module 203 determines the target audio control information corresponding to the target controlled home device information based on the voice control information, including: Performing noise reduction processing on the voice control information to obtain first voice feature information; Performing feature extraction processing on the first voice feature information to obtain second voice feature information; The target voice conversion model is used to perform voice conversion processing on the second voice feature information to obtain target audio control information corresponding to the target controlled home appliance information.

[0079] It can be seen that the implementation Figure 3 The described scene-control-based home appliance control device is beneficial to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0080] In yet another optional embodiment, Figure 3 As shown, the target speech conversion model is obtained based on the second determination module 203 executing the following steps: Acquire initial training sample information; the initial training sample information includes a number of initial speech training samples; Based on the initial training sample information, target training sample information is determined; the target training sample information includes a plurality of target training samples; Using the target training sample information to train the initial speech conversion model, and obtaining the training speech conversion model and training result information; The training result information is calculated and processed using a loss function model to obtain target training parameter information; the loss function model includes a first loss function model and a second loss function model; Determine whether the target training parameter information meets the training termination condition and obtain the training judgment result; When the training judgment result is no, the training speech conversion model is used to perform parameter update processing on the initial speech conversion model, and trigger execution based on the initial training sample information to determine the target training sample information; When the training judgment result is yes, the training speech conversion model is determined as the audio recognition model.

[0081] It can be seen that the implementation Figure 3 The described scene-control-based home appliance control device is beneficial to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0082] In yet another optional embodiment, Figure 3 As shown, the second determination module 203 uses the loss function model to calculate and process the training result information to obtain target training parameter information, including: Using the first loss function model to calculate the training result information to obtain first training parameter information; Among them, the first loss function model is: ; In the formula, Characterizing first training parameter information; Represents the training result information Prediction labels; Characterization The true labels corresponding to the target training samples; Using the second loss function model to calculate the training result information to obtain second training parameter information; A weighted sum process is performed on the first training parameter information and the second training parameter information to obtain target training parameter information.

[0083] It can be seen that the implementation Figure 3 The described scene-control-based home appliance control device is beneficial to improving the control efficiency and control accuracy of home appliances, thereby improving the user experience.

[0084] Embodiment 3 See also Figure 4 , Figure 4 is a structural diagram of another household appliance control device based on scene control disclosed in an embodiment of the present invention. Figure 4The described device can be applied to a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. Figure 4 As shown, the device may include: A memory 301 storing executable program codes; a processor 302 coupled to the memory 301; The processor 302 calls the executable program code stored in the memory 301 to execute the steps in the scene control-based home appliance control method described in the first embodiment.

[0085] Embodiment 4 An embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps of the scene-control-based home appliance control method described in the first embodiment.

[0086] Embodiment 5 An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps in the scene-control-based home appliance control method described in Example 1.

[0087] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0088] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0089] Finally, it should be noted that the scene-control-based home appliance control method and device disclosed in the embodiments of the present invention only disclose the preferred embodiments of the present invention, which are only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for controlling home appliances based on scene control, characterized in that: The method comprises: Acquire scene broadcast search information; the scene broadcast search information includes information of several home appliances to be searched; Based on the scene broadcast search information, target home device information is determined; the target home device information includes information of several target controlled home devices; Based on the target home device information, target device control information is determined; the target device control information includes a plurality of target audio control information.

2. The method for controlling home appliances based on scene control according to claim 1, characterized in that: The determining target home device information based on the scene broadcast search information includes: For any of the home device information to be searched in the scene broadcast search information, and for any of the smart home information to be controlled in the scene home library, a feature matching model is used to calculate and process the search home feature information corresponding to the home device information to be searched and the smart home feature information corresponding to the smart home information to be controlled, to obtain a feature matching value corresponding to the smart home information to be controlled; Wherein, the feature matching model is: ； in, is the feature matching value; For searching the home feature information, The smart home feature information; is the number of element values ​​in the searched home feature information; The first element value; The smart home feature information element value; , and are respectively the first matching parameter, the second matching parameter and the third matching parameter; Determine whether the feature matching value is less than or equal to a matching threshold, and obtain a matching judgment result corresponding to the smart home information to be controlled; When the match judgment result is yes, the smart home information to be controlled is determined as a backup smart home information; When the matching result is no, the processing flow corresponding to the smart home information to be controlled is terminated; Based on the backup smart home information, target controlled home device information corresponding to the home device information to be searched is determined.

3. The method for controlling home appliances based on scene control according to claim 2, characterized in that: The step of determining target controlled home device information corresponding to the home device information to be searched based on the standby smart home information includes: Determine whether the quantity of the backup smart home information is equal to 1, and obtain a quantity determination result; When the result of the quantity determination is yes, determining that the standby smart home information is the target controlled home device information corresponding to the home device information to be searched; When the result of the quantity judgment is no, the backup smart home information corresponding to the largest feature matching value among all the backup smart home information corresponding to the home device information to be searched is determined as the target controlled home device information corresponding to the home device information to be searched.

4. The method for controlling home appliances based on scene control according to claim 1, characterized in that: The determining target device control information based on the target home device information includes: For any target controlled home device information in the target home device information, establishing a local area network communication channel between the smart mobile terminal and the smart home corresponding to the target controlled home device information; Detecting whether the intelligent mobile terminal displays a channel signal corresponding to the local area network communication channel, and obtaining a signal detection result; When the signal detection result is no, triggering the execution of establishing a local area network communication channel of the smart home corresponding to the smart mobile terminal and the target controlled home device information; Detect whether the voice control information input by the user is received and obtain the voice detection result; When the voice detection result is no, obtaining the prompt interval time corresponding to the target home appliance control information; Triggering the detection of whether the voice control information input by the user is received at an interval of the prompt time to obtain a voice detection result; When the voice detection result is yes, the target audio control information corresponding to the target controlled home appliance information is determined based on the voice control information.

5. The method for controlling home appliances based on scene control according to claim 4, characterized in that: The determining, based on the voice control information, target audio control information corresponding to the target controlled home device information includes: Performing noise reduction processing on the voice control information to obtain first voice feature information; Performing feature extraction processing on the first speech feature information to obtain second speech feature information; The target voice conversion model is used to perform voice conversion processing on the second voice feature information to obtain target audio control information corresponding to the target controlled home appliance information.

6. The method for controlling home appliances based on scene control according to claim 5, characterized in that: The target speech conversion model is obtained based on the following steps: Acquire initial training sample information; the initial training sample information includes a plurality of initial speech training samples; Based on the initial training sample information, determine target training sample information; the target training sample information includes a plurality of target training samples; Using the target training sample information to train the initial speech conversion model to obtain a training speech conversion model and training result information; Using the loss function model to calculate the training result information to obtain target training parameter information; The loss function model includes a first loss function model and a second loss function model; Determine whether the target training parameter information meets the training termination condition, and obtain a training determination result; When the training judgment result is no, performing parameter update processing on the initial speech conversion model using the training speech conversion model, and triggering the execution of determining target training sample information based on the initial training sample information; When the training judgment result is yes, the training speech conversion model is determined as the audio recognition model.

7. The method for controlling home appliances based on scene control according to claim 6, characterized in that: The method of calculating and processing the training result information using the loss function model to obtain target training parameter information includes: Using the first loss function model to calculate the training result information to obtain first training parameter information; Among them, the first loss function model is: ； In the formula, Characterizing the first training parameter information; Characterizes the first Prediction labels; Characterization The true labels corresponding to the target training samples; Using the second loss function model to calculate the training result information to obtain second training parameter information; A weighted sum process is performed on the first training parameter information and the second training parameter information to obtain target training parameter information.

8. A home appliance control device based on scene control, characterized in that: The device comprises: An acquisition module, used to acquire scene broadcast search information; the scene broadcast search information includes information of a plurality of home appliances to be searched; A first determination module is used to determine target home device information based on the scene broadcast search information; the target home device information includes information of a plurality of target control home devices; The second determination module is used to determine target device control information based on the target home device information; the target device control information includes a plurality of target audio control information.

9. A home appliance control device based on scene control, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the scene-control-based home appliance control method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, which, when called, are used to execute the scene-control-based home appliance control method as described in any one of claims 1-7.

Images