Lighting control method, control system, and storage medium

Abstract

The present invention discloses a lighting control method, a control system and a storage medium, the method including: acquiring a user behavior for characterizing a user's emotion; inputting the user behavior into an emotion prediction network acquired by training an algorithm based on an attention mechanism to perform prediction, and acquiring a user emotion classification result; and generating a control command configured to control a preset lighting mode of a lighting device based on the emotion classification result. The present invention acquires a user emotion classification result by analyzing and predicting the user behavior, generates a control command based on the emotion classification result, and is configured to control a preset lighting mode of a lighting device, so that the lighting device controls the switched lighting mode based on the control command to match the user emotion implicitly included in the user behavior, thereby improving the user experience and realizing intelligent control of the lighting mode.

Description

[Technical field]

[0001] The present invention relates to the field of lighting control, and in particular to a lighting control method, a control system and a storage medium. [Background technology]

[0002] With the continuous development of science and technology, people's living standards are also improved accordingly, and for lighting equipment, in order to meet the needs of different scenarios, a plurality of adjustable lighting modes are usually set for the lighting equipment, so that users can adjust the lighting mode of the lighting equipment according to the usage needs to meet the needs of corresponding scenarios. However, in the related art, most lighting equipment often requires users to actively switch to meet the usage needs of the scenarios, and the operation of lighting control is complicated, and users find it difficult to quickly control the lighting equipment to achieve the required lighting mode, which affects the user experience. Summary of the Invention [Problem to be solved by the invention]

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention provides a lighting control method, a control system, and a storage medium that can analyze a control command for controlling a lighting device by acquiring a user's behavior, and the control command can correspond to a lighting mode of the lighting device and match the user's emotion, thereby improving the user experience. [Means for solving the problem]

[0004] An embodiment of a first aspect of the present invention provides a lighting control method, the method comprising: acquiring a user behavior to characterize a user's emotion; Inputting the user's behavior into an emotion prediction network obtained by training an algorithm based on an attention mechanism to make a prediction, and obtaining a classification result of the user's emotion; and generating a control command configured to adjust a lighting mode of at least one lighting device based on the emotion classification result.

[0005] The above embodiment of the present invention has at least the following beneficial effects: By obtaining a user's emotion classification result through analysis and prediction of user behavior, generating a control command based on the emotion classification result, and configuring the control command to adjust the lighting mode of a lighting device, the lighting device controls the adjusted lighting mode according to the control command to match the user emotion implicitly contained in the user behavior, thereby improving the user experience and realizing intelligent control of the lighting mode.

[0006] According to some embodiments of the first aspect of the present invention, the user behavior is user voice data or user facial expression data or user gesture data.

[0007] According to some embodiments of the first aspect of the present invention, inputting a user behavior into an emotion prediction network to perform prediction and obtain an emotion classification result of the user includes: Inputting the user's behavior into an emotion extraction model obtained by training an algorithm based on a self-attention mechanism to extract emotion features, and acquiring implicit emotion features; and inputting the implicit emotion features into a multi-layer perceptron to obtain an emotion classification result of the user.

[0008] According to some embodiments of the first aspect of the present invention, generating a control instruction based on the emotion classification result includes: determining an emotion classification result based on a preset set of specific emotions; If the emotion classification result belongs to a special emotion set, inputting the emotion classification result into a lighting prediction model to perform lighting prediction and obtain a control command.

[0009] According to some embodiments of the first aspect of the present invention, after determining an emotion classification result based on a preset special emotion set, If the emotion classification result does not belong to the special emotion set, input the history control command into a preference extraction model obtained by training using an algorithm based on a self-attention mechanism to extract preference features, and obtain implicit preference features; The method further includes inputting the implicit preference features into a preference prediction model to perform preference prediction and obtain a control command.

[0010] An embodiment of a second aspect of the present invention provides a lighting control system, the system comprising: An analysis system including a mobile terminal and a specific cloud connected to each other, the mobile terminal is configured to receive a user behavior and transmit the user behavior to the specific cloud, the specific cloud is configured to input the received user behavior into an emotion prediction network to perform prediction to obtain an emotion classification result, generate a control command based on the emotion classification result, and then transmit the control command to the mobile terminal, the mobile terminal is also configured to transmit the control command, in which the user behavior is used to characterize the user's emotion, and the emotion prediction network is obtained by training by an algorithm based on an attention mechanism; The lighting device is connected to the mobile terminal, has a lighting mode that is arbitrarily adjustable, and is configured to receive a control command from the mobile terminal and control the lighting mode based on the control command.

[0011] The above embodiment of the present invention has at least the following beneficial effects: the analysis system can connect and control the lighting device to realize intelligent control of the lighting mode of the lighting device, the analysis system can automatically monitor and obtain user behavior that can reflect user emotions, the emotion prediction network can predict the user behavior, and obtain a control command that matches the user emotion, the analysis system can send the control command to the lighting device, and the lighting device can be controlled to adjust to a lighting mode that matches the user emotion according to the received control command, the lighting mode switching control effect is high, and the control operation is intelligent and simple.

[0012] According to some embodiments of the second aspect of the present invention, the mobile terminal is connected in a telecommunication manner to a particular cloud and to a lighting device, respectively.

[0013] An embodiment of a third aspect of the present invention provides a lighting control system, the system comprising: An analysis system including a mobile terminal, a specific cloud, and a router, the mobile terminal being connected to the router, the router being connected to the specific cloud, the mobile terminal being configured to receive the user behavior and transmit the user behavior to the router, the router being configured to transmit the user behavior to the specific cloud, the specific cloud being configured to input the received user behavior into an emotion prediction network to perform prediction and obtain an emotion classification result, generate a control command based on the emotion classification result, and then transmit the control command to the router, the router also being configured to transmit the control command, where the user behavior is used to characterize a user's emotion, and the emotion prediction network is obtained by training with an algorithm based on an attention mechanism; and a lighting device connected to the router, capable of arbitrarily adjusting a lighting mode, and configured to receive the control command from the router and control the lighting mode based on the control command.

[0014] The above embodiment of the present invention has at least the following beneficial effects: A lighting device can be connected and controlled by a controller to realize intelligent control of the lighting mode of the lighting device, the controller can automatically monitor and obtain user behavior that can reflect user emotions, predict user behavior by an emotion prediction network, and obtain a control command that matches the user emotion, the controller can send the control command to the lighting device, and the lighting device can be controlled to adjust to a lighting mode that matches the user emotion according to the received control command, the lighting mode adjustment control effect is high, and the control operation is intelligent and simple.

[0015] An embodiment of a fourth aspect of the present invention provides a lighting control system, the system comprising: A controller configured to obtain a user behavior, and then input the user behavior into an emotion prediction network to make a prediction and obtain an emotion classification result, and generate a control command based on the emotion classification result, and then send the control command, in which the user behavior is used to characterize the user's emotion, and the emotion prediction network is obtained by training through an algorithm based on an attention mechanism; The lighting device is connected to the controller, the lighting mode is arbitrarily adjustable, and the lighting device is configured to receive a control command and control the lighting mode based on the control command.

[0016] The above embodiment of the present invention has at least the following beneficial effects: A lighting device can be connected and controlled by a controller to realize intelligent control of the lighting mode of the lighting device, the controller can automatically monitor and obtain user behavior that can reflect user emotions, predict user behavior by an emotion prediction network, and obtain a control command that matches the user emotion, the controller can send the control command to the lighting device, and the lighting device can be controlled to adjust to a lighting mode that matches the user emotion according to the received control command, the lighting mode adjustment control effect is high, and the control operation is intelligent and simple.

[0017] A computer storage medium according to an embodiment of the fifth aspect of the present invention has stored thereon computer executable instructions for carrying out the lighting control method of any one of the first aspect.

[0018] A computer storage medium according to an embodiment of the fifth aspect is capable of executing any one of the lighting control methods according to the first aspect, and thus has all the beneficial effects of the first aspect of the present invention.

[0019] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The above and / or additional aspects and advantages of the present invention will become apparent and will be more readily understood from the following detailed description of the embodiments taken in conjunction with the accompanying drawings. [Brief description of the drawings]

[0020] [Figure 1] 2 is a schematic diagram of the main steps of a lighting control method according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a schematic diagram of specific steps of step S200 in FIG. [Diagram 3] FIG. 2 is a schematic diagram of specific steps of step S300 in FIG. [Figure 4] FIG. 4 is a schematic diagram of another specific step after step S310 in FIG. 3. [Diagram 5] 1 is a structural schematic diagram of a lighting control system according to an embodiment of the present invention; [Figure 6] FIG. 2 is a structural schematic diagram of a lighting control system according to another embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] In the description of the present invention, unless otherwise clearly limited, terms such as installing, mounting, connecting, etc. should be understood in a broad sense, and those skilled in the art can reasonably determine the specific meaning of the above terms in the present invention by combining the specific content of the technical solution. In the description of the present invention, some means one or more, and more means two or more, and greater than, less than, exceed, etc. are understood as not including the number, and more than, less than, within, etc. are understood as including the number. In addition, a feature defined by "first" or "second" can explicitly or implicitly include one or more of the feature. In the description of the present invention, unless otherwise specified, "more than" means two or more than two.

[0022] First, the multiple nouns in this application are analyzed.

[0023] Artificial Intelligence (AI) is a new technology and science that researches and develops theories, methods, technologies, and application systems that simulate, extend, and expand human intelligence. AI is a branch of computer science, and AI aims to produce intelligent machines that can understand the nature of intelligence and react in new ways similar to human intelligence, and research in this field includes robots, language recognition, image recognition, natural language processing, expert systems, etc. AI can simulate human consciousness and the information process of thinking. AI is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, sense the environment, acquire knowledge, and use the knowledge to obtain optimal results.

[0024] Natural language processing (NLP) is the processing, understanding and use of human languages ​​(e.g. Chinese, English, etc.) by computers. NLP belongs to a branch of artificial intelligence and is the cross-discipline of computer science and linguistics, and is often called computational linguistics. Natural language processing includes grammar analysis, semantic analysis, chapter understanding, etc. Natural language processing is often used in technical fields such as machine translation, cursive and printed character recognition, speech recognition and text conversion, information retrieval, information extraction and filtering, text classification and clustering, opinion analysis and viewpoint mining, etc. It is related to data mining, machine learning, knowledge acquisition, knowledge engineering, artificial intelligence research related to language processing, linguistics research related to language computation, etc.

[0025] In the related art, in order to adapt to different scenario needs, some lighting devices are set with multiple adjustable lighting modes, and users can switch the lighting modes of the lighting devices according to usage needs to adapt to corresponding scenario needs, but switching the lighting modes of the lighting devices requires active operation by the user, and the switching control of the lighting modes every time requires user operation, and the operation of such lighting control is cumbersome. In order to reduce user operation, some lighting devices perform corresponding adjustment control for the lighting modes based on preset solutions, and the lighting modes can only be switched based on preset solutions, and although such lighting control can reduce user operation, it is difficult for the lighting modes to effectively meet the lighting usage needs of actual scenarios.

[0026] Based on this, in order to reduce user operations and effectively adapt the lighting mode to the lighting usage needs of actual scenarios, the present invention combines with artificial intelligence to analyze the acquired user behavior to obtain control commands, and controls the lighting mode of the lighting equipment to adapt to the user's emotions.

[0027] Hereinafter, with reference to Figures 1 to 6, a lighting control method, control system, and storage medium of the present invention will be described, which can analyze control commands for controlling lighting devices by acquiring user behavior, and the control commands can correspond to the lighting modes of the lighting devices to match user emotions and improve user experience.

[0028] An embodiment of the first aspect of the present invention describes a lighting control method, and the embodiment of the present application can acquire and process relevant data based on artificial intelligence, where artificial intelligence is the theory, method, technique and application system of utilizing a digital computer or a machine controlled by a digital computer to simulate, extend and expand human intelligence, sense the environment, acquire knowledge and use the knowledge to obtain optimal results.

[0029] As shown in FIG. 1 , an embodiment of a first aspect of the present invention provides a lighting control method, the control method including: A step S100 of acquiring a user behavior for characterizing the user's emotions; Step S200: inputting user behavior into an emotion prediction network obtained by training an algorithm based on an attention mechanism to make a prediction, and acquiring a user emotion classification result; and generating a control command S300 configured to adjust a lighting mode of at least one lighting device 2000 based on the emotion classification result.

[0030] The user's emotion classification result is obtained by analyzing and predicting the user's behavior, a control command is generated based on the emotion classification result, and the control command is configured to adjust a preset lighting mode of the lighting device 2000. Based on the control command, the lighting device 2000 controls the adjusted lighting mode to match the user emotion implicitly contained in the user's behavior, thereby improving the user experience and realizing intelligent control of the lighting mode.

[0031] As can be understood, the user action is an indirect control command expression, and the indirect control command expression is voice expression data or facial expression data or body and limb expression data that implicitly includes the user emotion, for example, the voice expression data that implicitly includes the user emotion may be the user's voice such as passed the exam, sad, etc., the facial expression data that implicitly includes the user emotion may be a captured picture of the user's facial expression, such as a picture of the user's facial expression such as smiling, crying, etc., and the body and limb expression data that implicitly includes the user emotion may be a captured picture of the user's body language, such as a picture capturing pointing a finger at the lighting device 2000, a picture capturing a specific gesture movement, or a picture capturing the user's body and limb language such as other specific postures.

[0032] As can be understood, when the analysis system includes a mobile terminal 1100 and a specific cloud 1200, the mobile terminal 1100 is connected to the specific cloud 1200 through remote communication, and the mobile terminal 1100 is also connected to the lighting device 2000 through remote communication. The lighting control method is as follows: the mobile terminal 1100 obtains a user behavior and transmits the user behavior to the specific cloud 1200 through remote communication; the specific cloud 1200 receives the user behavior from the mobile terminal 1100, inputs the user behavior into an emotion prediction network to perform prediction to obtain a user emotion classification result, and generates a control command based on the emotion classification result; and the specific cloud 1200 transmits the control command to the lighting device 2000 through remote communication, so that the lighting device 2000 controls a lighting mode based on the received control command.

[0033] As can be understood, as shown in FIG. 2, in step S200, the user behavior is inputted into the emotion prediction network to perform prediction, and the user emotion classification result is obtained. Step S210 of inputting the user behavior into an emotion extraction model that can extract and obtain corresponding implicit emotion features based on the user behavior, the implicit emotion features being obtained by training the user behavior using an algorithm based on a self-attention mechanism, to extract the emotion features and obtain the implicit emotion features; The method includes, but is not limited to, step S220 of inputting the implicit emotion features into a multi-layer perceptron to obtain a user emotion classification result matching the user emotion corresponding to the user behavior.

[0034] In addition, when inputting user behavior into the emotion extraction model, since the user behavior is initial data such as voice, image, etc., these initial data are first converted into sequence data that can be recognized by the emotion extraction model through preprocessing. For example, if the user expression is voice expression data, the data is generally sequence data, which can be directly recognized by the emotion extraction model. Also, for example, if the user expression is a catch picture of facial expression or body language, the data is generally matrix data, which needs to be converted into sequence data, and after preprocessing, it can be recognized by the emotion extraction model.

[0035] The user behavior is input to the emotion prediction network, and based on the acquired emotion classification result, it is determined whether the user behavior belongs to a special emotion. The special emotion may be, for example, joy, anger, sadness, fear, etc. If the user behavior belongs to a special emotion, the user behavior is a special expression, and if the user behavior does not belong to a special emotion, the user behavior is a normal expression for characterizing a non-special voice, a non-special facial expression, a non-special movement, etc.

[0036] In some embodiments, after going through the processing of the multi-layer perceptron, the obtained user emotion classification result may be a direct control command matching the user expression.

[0037] As can be seen, as shown in FIG. 3, in step S300, generating a control command based on an emotion classification result includes: Step S310: determining an emotion classification result based on a preset special emotion set, and if the emotion classification result belongs to the special emotion set, determining that the user behavior is a special expression; If the emotion classification result belongs to a special emotion set, the emotion classification result is input into a lighting prediction model to perform lighting prediction, and obtain a control command in step S320, but this is not limited thereto.

[0038] As can be seen, the user behavior is first converted into sequence data, and the sequence data is input into an emotion extraction model to extract features and obtain implicit emotion features, where the emotion extraction model is obtained by training a transformer model as a frame, and the implicit emotion features can represent the relationship between the initial data corresponding to the sequence data and the channel. The implicit emotion features are input into a multi-layer perceptron to obtain multiple emotion classification results, and the multiple emotion classification results are all input into a lighting prediction model to make predictions, and the multiple emotion classification results are fused to obtain an analyzed and predicted control command.

[0039] In addition, after the implicit emotions are input into the multi-layer perceptron, they are activated by an activation function to calculate the probability, and the probability of the user expressing various emotions can be obtained. Since human emotions are complex, that is, users have various emotions at the same time, a threshold is set for emotion judgment, and the probability corresponding to various emotions is compared with the threshold. If the probability of an emotion exceeds the threshold, it is determined that the emotion currently corresponding to the user is the emotion, and all emotions with probabilities exceeding the threshold constitute an emotion classification result, and the emotion classification result is usually one multi-tag result.

[0040] An exemplary description is given of converting a user behavior into sequence data. If the user behavior is a voice expression, the voice data is originally in sequence format, so that the corresponding sequence data can be obtained by encoding the received voice data. If the user behavior is an expression of facial expression, the received facial expression picture data is converted from a matrix into sequence data.

[0041] In order to help users who lack professional knowledge on lighting design and color psychology to obtain a good lighting experience, the lighting prediction model in step S320 is generated in a manner of setting a corresponding training set based on knowledge on lighting design and color psychology, and training a neural network based on attention mechanism as a frame to obtain a lighting prediction model. The lighting prediction model is a neural network model set based on lighting design and color psychology analysis, and can obtain corresponding lighting effects by analyzing based on emotion classification results, and can map corresponding control commands based on the lighting effects to realize output, and the lighting device controls the lighting mode formed based on the control command to match and adapt to the user emotion.

[0042] As can be seen, as shown in FIG. 4, after step S310, i.e., after determining the emotion classification result based on the pre-defined special emotion set, If the emotion classification result does not belong to the special emotion set, that is, the user behavior is a normal expression, the history control command is input into a preference extraction model obtained by training an algorithm based on a self-attention mechanism to extract preference features, and a step S330 of obtaining implicit preference features; The method further includes, but is not limited to, a step S340 of inputting the implicit preference features into a preference prediction model to perform preference prediction and obtain a control command.

[0043] The lighting device 2000 can perform calculations based on the user's historical control commands to obtain the user's lighting preferences and form corresponding control commands, and if the user behavior is normal, the lighting device 2000 can be controlled to obtain a lighting mode matching the user preferences.

[0044] As can be seen, when the user behavior is a normal expression, the historical control commands corresponding to the historical lighting modes of the lighting device 2000 are organized into sequence data, the sequence data is input into a preference extraction model to perform feature extraction and obtain implicit preference features, where the preference extraction model is obtained by training with a transformer model as a frame, and the implicit preference features are input into a preference prediction model to perform prediction and obtain control commands, where the preference prediction model is obtained by training with an algorithm based on a self-attention mechanism.

[0045] As can be seen, the control instructions include lamp color data and color rhythm data.

[0046] The control command may further include lamp brightness in addition to the lamp color data and color rhythm data.

[0047] As shown in Fig. 5, the lighting control system according to the embodiment of the second aspect of the present invention includes an analysis system including a mobile terminal 1100 and a specific cloud 1200 connected to each other, and a lighting device 2000, where the mobile terminal 1100 is configured to receive a user behavior and transmit the user behavior to the specific cloud 1200, where the specific cloud 1200 is configured to input the received user behavior into an emotion prediction network to make a prediction and obtain an emotion classification result, and then generate a control command based on the emotion classification result and transmit the control command to the mobile terminal 1100, where the mobile terminal 1100 is also configured to transmit the control command, where the user behavior is used to characterize the user's emotion, and the emotion prediction network is trained and obtained by an algorithm based on an attention mechanism. The lighting device 2000 is connected to the mobile terminal 1100, and the lighting mode of the lighting device 2000 is adjustable, and the lighting device 2000 is configured to receive a control command from the mobile terminal 1100 and control the lighting mode based on the control command.

[0048] The analysis system can connect and control the lighting device 2000, thereby realizing intelligent control of the lighting mode of the lighting device 2000. The analysis system can automatically monitor and acquire user behavior that can reflect the user emotion, predict the user behavior by an emotion prediction network, and acquire a control command that matches the user emotion. The analysis system can transmit a control command to the lighting device 2000, and control the lighting device 2000 to switch to a lighting mode that matches the user emotion based on the received control command, thereby achieving a high adjustment control effect of the lighting mode, and an intelligent and simple control operation.

[0049] As can be understood, the analysis system monitors the user through interaction methods such as voice, video, etc., to obtain user behavior that can reflect user sentiment.

[0050] As can be seen, as shown in Fig. 5, the mobile terminal 1100 is respectively connected to a specific cloud 1200 and a lighting device 2000 in a manner of remote communication, the mobile terminal 1100 is configured to receive a user behavior and transmit the user behavior to the specific cloud 1200, the specific cloud 1200 is configured to receive a user behavior, perform a corresponding analysis based on the user behavior to obtain a control command, and then transmit the control command to the mobile terminal 1100, and the mobile terminal 1100 is also configured to receive a control command and transmit the control command to the lighting device 2000. By realizing the information communication between the mobile terminal 1100 and the specific cloud 1200 and the information communication between the mobile terminal 1100 and the lighting device 2000 in a manner of remote communication, the use of wiring can be effectively reduced, and the structural complexity of the lighting control system can be effectively simplified. Here, the mobile terminal 1100 may be a mobile terminal device, an imaging device, a video doorbell or door lock, or other device with voice recording and image recording functions, so as to ensure that user behavior, which may be voice expression, facial expression, or body expression, etc., that can reflect user emotions, can be acquired.

[0051] The video doorbell or door lock can recognize the user's identity information through the captured image, and can match the user's historical control commands. The historical control commands are input into a preference extraction model to extract preference features to obtain implicit preference features, and then the implicit preference features are input into a preference prediction model to perform preference prediction to obtain new control commands, so that the lighting device 2000 can control the corresponding lighting mode based on the new control commands to match the usage habits of the corresponding user.

[0052] As can be understood, the mobile terminal 1100 is connected between a specific cloud 1200 and a lighting device 2000 by a network or by Bluetooth, and remote communication is realized by installing corresponding network communication modules or Bluetooth communication modules in the mobile terminal 1100, the specific cloud 1200 and the lighting device 2000.

[0053] As can be understood, as shown in FIG. 5 , the lighting device 2000 includes a plurality of light-emitting modules 2100, each of which is connected to an analysis system, and the analysis system sends a control command to each of the light-emitting modules 2100, and each of the light-emitting modules 2100 receives the control command and controls it to adjust to a corresponding lighting mode, so as to form a lighting effect that adapts to a user's mood.

[0054] As shown in Fig. 6, a lighting control system according to an embodiment of the third aspect of the present invention includes an analysis system including a mobile terminal 1100, a specific cloud 1200, and a router 1300, and a lighting device 2000. The mobile terminal 1100 is connected to the router 1300, and the router 1300 is connected to the specific cloud 1200, and the mobile terminal 1100 is configured to receive a user behavior and transmit the user behavior to the router 1300, and the router 1300 is configured to transmit the user behavior to the specific cloud 1200, and the specific cloud 1200 is configured to input the received user behavior into an emotion prediction network to perform prediction and obtain an emotion classification result, and generate a control command based on the emotion classification result and then transmit the control command to the router 1300, and the router 1300 is also configured to transmit a control command that is fed back by the specific cloud 1200, where the user behavior is used to characterize the user's emotion, and the emotion prediction network is trained and obtained by an algorithm based on an attention mechanism. The lighting device 2000 is connected to the router 1300, a lighting mode of the lighting device 2000 is adjustable, and the lighting device 2000 is configured to receive a control command from the router 1300 and control the lighting mode based on the control command.

[0055] As can be understood, as shown in FIG. 6 , the lighting device 2000 includes a plurality of light-emitting modules 2100, each of which is connected to an analysis system, and the analysis system sends a control command to each of the light-emitting modules 2100, and each of the light-emitting modules 2100 receives the control command and controls it to adjust to a corresponding lighting mode, so as to form a lighting effect that adapts to a user's mood.

[0056] A lighting control system according to an embodiment of the fourth aspect of the present invention includes a controller and a lighting device 2000, the controller is configured to obtain a user behavior, input the user behavior into an emotion prediction network to make a prediction and obtain an emotion classification result, generate a control command based on the emotion classification result, and then transmit the control command, where the user behavior is used to characterize the user's emotion, and the emotion prediction network is trained and obtained by an algorithm based on an attention mechanism. The lighting device 2000 is connected to the controller, and a lighting mode of the lighting device 2000 is adjustable, and the lighting device 2000 is configured to receive the control command and control the lighting mode based on the control command.

[0057] The controller connects and controls the lighting device 2000, thereby realizing intelligent control of the lighting mode of the lighting device 2000. The controller automatically monitors and acquires user behavior that can reflect the user's emotions, predicts the user behavior through an emotion prediction network, and acquires a control command that matches the user's emotions. The controller transmits the control command to the lighting device 2000, and controls the lighting device 2000 to adjust to a lighting mode that matches the user's emotions based on the received control command. The lighting mode adjustment control effect is high, and the control operation is intelligent and simple.

[0058] An embodiment of the fifth aspect of the present invention further provides an electronic device including a memory, a processor, and a computer program stored in the memory and operable to run on the processor.

[0059] The processor and memory may be connected by a bus or in another manner.

[0060] The memory can be used as a non-transitory computer-readable storage medium to store non-transitory software programs and non-transitory computer-executable programs. The memory may include high-speed random access memory and may further include non-transitory memory, such as at least one disk storage device, flash memory, or other non-transitory solid storage device. In some embodiments, the memory may optionally include memory located remotely to the processor, and these remote memories may be connected to the processor by a network. Examples of such networks include, but are not limited to, the Internet, a corporate intranet, a local area network, a mobile communication network, and combinations thereof.

[0061] When the non-transitory software programs and instructions required to realise the lighting control method of the embodiment of the first aspect above are stored in a memory and executed by a processor, it performs the lighting control method of the above embodiment, for example performing method steps S100-S300, method steps S210-S220, method steps S310-S320 and method steps S330-S340 described above.

[0062] The above described embodiment of the device is merely illustrative, and the units described herein as separate components may or may not be physically separated, i.e., located in one place or distributed across multiple network units. According to actual needs, some or all of the modules can be selected to achieve the objective of the solution of the embodiment.

[0063] In addition, an embodiment of the sixth aspect of the present invention provides a computer-readable storage medium having stored thereon computer-executable instructions which can be executed by one processor or controller, for example, by one processor in the above-mentioned device embodiment, and cause the processor to execute the lighting control method in the above-mentioned embodiment, for example, to execute method steps S100 to S300, method steps S210 to S220, method steps S310 to S320, and method steps S330 to S340 described above.

[0064] As will be appreciated by those skilled in the art, all or part of the steps in the methods and systems disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all of some physical assemblies may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (e.g., computer readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other disk storage, cartridge, magnetic tape, disk storage or other magnetic storage device, or any other medium that can be used to store the desired information and that can be accessed by a computer. As known to those skilled in the art, communication media typically includes computer readable instructions, data structures, program modules or other data in a regulated data signal such as a carrier wave or other transport mechanism and may include any information delivery media.

[0065] In the description herein, references to the terms "one embodiment," "some embodiments," "exemplary embodiments," "examples," "particular examples," or "some examples" mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In the description herein, generalized expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0066] While embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present invention, and the scope of the present invention is limited by the claims and their equivalents.

Claims

1. acquiring a user behavior to characterize a user's emotion; The user behavior is inputted into an emotion prediction network obtained by training an algorithm based on an attention mechanism to perform prediction, and an emotion classification result of the user is obtained; and generating a control command configured to adjust a lighting mode of at least one lighting device based on the emotion classification result; The above-mentioned generating a control command based on the emotion classification result includes: determining the emotion classification result based on a preset set of specific emotions; If the emotion classification result belongs to the special emotion set, inputting the emotion classification result into a lighting prediction model to perform lighting prediction and obtain the control command; The lighting prediction model is a neural network model set based on a psychological analysis of lighting design and color, and can obtain corresponding lighting effects by analyzing based on the emotion classification result, and can map the corresponding control command based on the lighting effect to realize output. Lighting control methods.

2. The user behavior is user voice data, user facial expression data, or user gesture data. The lighting control method according to claim 1 .

3. The above-mentioned user behavior is inputted into an emotion prediction network to perform prediction, and an emotion classification result of the user is obtained. Inputting the user behavior into an emotion extraction model obtained by training an algorithm based on a self-attention mechanism to extract emotion features, and obtaining latent emotion features as the extracted results; inputting the latent emotion features into a multi-layer perceptron (MLP) to obtain an emotion classification result of the user; The lighting control method according to claim 1 .

4. After determining the emotion classification result based on the preset special emotion set as described above, If the emotion classification result does not belong to the specific emotion set, inputting the history control command into a preference extraction model obtained by training an algorithm based on a self-attention mechanism to extract preference features, and obtaining latent preference features; and inputting the latent preference features into a preference prediction model to perform preference prediction and obtain the control command. The lighting control method according to claim 1 .

5. An analysis system including a mobile terminal and a specific cloud connected to each other, the mobile terminal being configured to receive a user behavior and transmit the user behavior to the specific cloud, the specific cloud being configured to input the received user behavior into an emotion prediction network to perform prediction and obtain an emotion classification result, generate a control command based on the emotion classification result, and then transmit the control command to the mobile terminal, the mobile terminal also being configured to transmit the control command, wherein the user behavior is used to characterize a user's emotion, and the emotion prediction network is obtained by training an algorithm based on an attention mechanism; a lighting device connected to the mobile terminal, the lighting device being capable of adjusting a lighting mode, and configured to receive the control command from the mobile terminal and control the lighting mode based on the control command; The above-mentioned generating a control command based on the emotion classification result includes: determining the emotion classification result based on a preset set of specific emotions; If the emotion classification result belongs to the special emotion set, inputting the emotion classification result into a lighting prediction model to perform lighting prediction and obtain the control command; The lighting prediction model is a neural network model set based on a psychological analysis of lighting design and color, and can obtain corresponding lighting effects by analyzing based on the emotion classification result, and can map the corresponding control command based on the lighting effect to realize output. Lighting control system.

6. The mobile terminal is connected to the specific cloud and the lighting device via a remote communication method, 6. A lighting control system as claimed in claim 5.

7. An analysis system including a mobile terminal, a specific cloud, and a router, the mobile terminal being connected to the router, the router being connected to the specific cloud, the mobile terminal being configured to receive a user behavior and transmit the user behavior to the router, the router being configured to transmit the user behavior to the specific cloud, the specific cloud being configured to input the received user behavior into an emotion prediction network to perform prediction and obtain an emotion classification result, generate a control command based on the emotion classification result, and then transmit the control command to the router, the router also being configured to transmit the control command, where the user behavior is used to characterize a user's emotion, and the emotion prediction network is obtained by training by an algorithm based on an attention mechanism; a lighting device connected to the router, the lighting device being capable of adjusting a lighting mode, and configured to receive the control command from the router and control the lighting mode based on the control command; The above-mentioned generating a control command based on the emotion classification result includes: determining the emotion classification result based on a preset set of specific emotions; If the emotion classification result belongs to the special emotion set, inputting the emotion classification result into a lighting prediction model to perform lighting prediction and obtain the control command; The lighting prediction model is a neural network model set based on a psychological analysis of lighting design and color, and can obtain corresponding lighting effects by analyzing based on the emotion classification result, and can map the corresponding control command based on the lighting effect to realize output. Lighting control system.

8. a controller configured to obtain a user behavior, and then input the user behavior into an emotion prediction network to make a prediction and obtain an emotion classification result, and generate a control command based on the emotion classification result and then send the control command, where the user behavior is used to characterize an emotion of a user, and the emotion prediction network is obtained by training an algorithm based on an attention mechanism; a lighting device connected to the controller, the lighting device being capable of adjusting a lighting mode, and configured to receive the control command and control the lighting mode based on the control command; The above-mentioned generating a control command based on the emotion classification result includes: determining the emotion classification result based on a preset set of specific emotions; If the emotion classification result belongs to the special emotion set, inputting the emotion classification result into a lighting prediction model to perform lighting prediction and obtain the control command; The lighting prediction model is a neural network model set based on a psychological analysis of lighting design and color, and can obtain corresponding lighting effects by analyzing based on the emotion classification result, and can map the corresponding control command based on the lighting effect to realize output. Lighting control system.

9. A lighting control method according to any one of claims 1 to 4, comprising: Computer storage media.

Images