Lamp with voice interaction function and control method thereof

Abstract

The invention discloses a lamp with a voice interaction function and a control method, and the lamp comprises a lamp main body which comprises a light source assembly and an adjustable mechanical structure; the voice interaction module is used for receiving and transmitting a voice instruction; the control module is connected with the voice interaction module and is used for analyzing the instruction and controlling the brightness of the light source and the movement of the mechanical structure; and the power supply module is used for supplying power to the voice interaction module and the control module. Intelligent control over the lamp is achieved through voice instructions and wireless communication, remote operation and linkage with other intelligent home equipment are supported, and the intelligent control system has the advantages of being high in integration level, low in power consumption and high in robustness.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent lamps, and in particular to a lamp with a voice interaction function and a control method thereof. Background Art

[0002] With the continuous development of intelligent technology, people's functional requirements for lamps are no longer limited to simple lighting. Traditional lamps have a single operation mode and are mostly controlled by manual switches. They are inconvenient to use in some scenarios. For example, the lamps cannot be easily turned on or off when both hands are occupied. At the same time, the lack of intelligent interaction functions cannot meet users' needs for convenient life and diversified services. However, existing smart lamps have deficiencies in voice interaction module design and overall structural design, such as the inflexible connection between the voice interaction module and the lamp body, and the voice reception effect is greatly affected by the environment. For example, the patent document with application number 201621155657.6 also discloses a voice interaction lamp, which also has the above-mentioned problems. Summary of the invention

[0003] In view of this, an object of the present invention is to provide a lamp having an intelligent voice interaction function and capable of improving voice reception effect and a control method thereof.

[0004] The technical solution adopted by the present invention to solve the technical problem is:

[0005] A lamp with voice interaction function, comprising a light source component and an adjustable mechanical structure; a voice interaction module for receiving and transmitting voice commands;

[0006] A control module, connected to the voice interaction module, for parsing instructions and controlling the brightness of the light source and the movement of the mechanical structure; and a power module, for supplying power to the voice interaction module and the control module.

[0007] In a preferred embodiment of the present invention, the voice interaction module is a FLM140D wireless communication module, which supports Wi-Fi 802.11b / g / n protocol and Bluetooth BLE 5.2 protocol, and is connected to external buttons or sensors through the GPIO multiplexing function.

[0008] In a preferred solution of the present invention, the control module is an XK3031TW chip, and the XK3031 TW chip has a built-in three-phase MOS drive module, which adjusts the brightness of the light source through a PWM signal and monitors current and voltage parameters in real time through an ADC interface.

[0009] In a preferred embodiment of the present invention, the adjustable mechanical structure is a rotating bracket or a telescopic arm, and the XK3031 TW chip drives a brushless motor to achieve motion control.

[0010] In a preferred embodiment of the present invention, the voice interaction module supports cloud semantic analysis and communicates with the local control module through the UART interface of the FLM140D module.

[0011] In a preferred embodiment of the present invention, the lamp further comprises:

[0012] A remote communication module, used to receive input information from the control module, the remote communication module integrates a blockchain node function, and is used to encrypt the user's voice command and transmit the input information to the AI ​​large model system through a wireless network; the AI ​​large model system includes distributed AI nodes, each node collaboratively processes the voice command through a smart contract and generates a return result; the return result includes a lamp control command and a smart service recommendation related to the user context;

[0013] The control module is configured with an edge computing unit for performing lightweight semantic parsing locally and performing dynamic task allocation with distributed AI nodes;

[0014] The voice interaction module is also used to output the returned result.

[0015] In a preferred embodiment of the present invention, the control module is further used to pre-acquire the prompt word rules of the AI ​​large model system, and determine whether the input information needs to be modified based on the prompt word rules; when it is determined that the input information needs to be modified, the input information is modified based on the prompt word rules to generate modified input information;

[0016] The prompt word rule library includes context-aware templates and user behavior portraits. The control module generates modified input information through the following steps:

[0017] a) Extracting spatiotemporal characteristic parameters from voice commands, including current time, ambient light intensity, and mechanical structure position status;

[0018] b) Calculate the context weight coefficient based on the user's historical operation records;

[0019] c) matching the optimal prompt word frame from the template library according to the weight coefficient;

[0020] d) embedding the original voice command into the framework to generate a structured query statement;

[0021] The distributed AI node calls the multimodal large model to generate a response according to the structured query statement.

[0022] In a preferred embodiment of the present invention, the control module is further used to determine whether it is necessary to add description information to the returned result after obtaining the returned result from the AI ​​large model system; after determining that it is necessary to add description information to the returned result, based on the preference information pre-set by the lamp user, generate description information by calling the description information generation module, and add the description information to the returned result to generate a modified returned result;

[0023] The description information generation module includes: a credibility evaluation unit, which calculates the confidence score based on the feature vector of the result returned by the AI ​​large model system;

[0024] The personalized adaptation unit calls the user preference model in the storage module, and the user preference model is continuously updated through federated learning; when the confidence score is lower than the threshold, the alternative solution description and verification request are automatically attached;

[0025] The description information is output in the form of interactive voice clips, supporting users to provide feedback and corrections through natural language.

[0026] In a preferred embodiment of the present invention, the lamp further comprises a storage module for storing user preference information;

[0027] The storage module comprises:

[0028] Privacy-preserving partitions that use homomorphic encryption technology to store user biometric data;

[0029] Interactive memory unit, which records the triple relationship graph of device status-voice command-user feedback;

[0030] Model cache area, which stores lightweight inference models issued by the AI ​​large model system and supports maintaining basic intelligent services when the network is interrupted;

[0031] The control module automatically optimizes the local decision tree according to the memory unit data to achieve intention prediction in an offline state.

[0032] A control method for a lamp with a voice interaction function, the lamp comprising a lamp body, a voice interaction module, a control module and a power module, the control method comprising: the voice interaction module receiving and transmitting voice commands; the control module parsing the commands and controlling the brightness of the light source and the movement of the mechanical structure.

[0033] The beneficial effects of the present invention are: intelligent control of lamps is achieved through voice commands and wireless communications, remote operation and linkage with other smart home devices are supported, and the present invention has the characteristics of high integration, low power consumption and strong robustness. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The above and other purposes, features and advantages of the present invention will become more apparent by describing the embodiments of the present invention in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0035] Figure 1 is a structural schematic diagram of a first embodiment of a lamp with a voice interaction function of the present invention;

[0036] Figure 2 is a structural schematic diagram of a second embodiment of a lamp with a voice interaction function of the present invention;

[0037] Figure 3 is an exploded schematic diagram of a second embodiment of a lamp with a voice interaction function of the present invention;

[0038] Figure 4 It is a flow chart of a method for controlling a lamp with voice interaction function of the present invention. DETAILED DESCRIPTION

[0039] Below, the exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments of the present invention, and it should be understood that the present invention is not limited to the exemplary embodiments described here.

[0040] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

[0041] Those skilled in the art can understand that the terms "first" and "second" in the embodiments of the present invention are only used to distinguish different steps, devices or modules, etc., and neither represent any specific technical meaning nor indicate the necessary logical order between them.

[0042] It should also be understood that, in the embodiments of the present invention, “plurality” may refer to two or more than two, and “at least one” may refer to one, two or more than two.

[0043] It should also be understood that any component, data or structure mentioned in the embodiments of the present invention can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0044] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings.

[0045] Reference Figure 1, a lamp with voice interaction function, comprising: a lamp body,

[0046] The main body of the lamp includes a light source component and an adjustable mechanical structure; the voice interaction module is used to receive and transmit voice commands; the control module is connected to the voice interaction module, and is used to analyze and transmit commands.

[0047] Control the brightness of the light source and the movement of the mechanical structure; and the power module supplies power to the voice interaction module and the control module.

[0048] The present invention realizes intelligent control of lamps through voice commands and wireless communications, supports remote operation and linkage with other smart home devices, and has the characteristics of high integration, low power consumption and strong robustness.

[0049] Specifically, various embodiments of the present invention may include one or more of the following preferred implementations:

[0050] The first type: the voice interaction module is a FLM140D wireless communication module, which supports Wi-Fi 802.11b / g / n protocol and Bluetooth BLE 5.2 protocol, and is connected to external buttons or sensors through the GPIO multiplexing function.

[0051] The second type: the control module is an XK3031TW chip, which has a built-in three-phase MOS drive module, adjusts the brightness of the light source through a PWM signal, and monitors current and voltage parameters in real time through an ADC interface.

[0052] The third type: the adjustable mechanical structure is a rotating bracket or a telescopic arm, and the XK3031TW chip drives a brushless motor to achieve motion control.

[0053] Fourth type: The voice interaction module supports cloud semantic analysis and communicates with the local control module through the UART interface of the FLM140D module.

[0054] Fifth: The lamp further comprises: a remote communication module, which is used to receive input information from the control module, and the remote communication module integrates a blockchain node function, which is used to encrypt the user's voice command and transmit the input information to the AI ​​large model system through a wireless network; the AI ​​large model system comprises distributed AI nodes, and each node collaboratively processes the voice command through a smart contract and generates a return result; the return result includes the lamp control command and the smart service recommendation related to the user context;

[0055] The control module is configured with an edge computing unit for performing lightweight semantic parsing locally and performing dynamic task allocation with distributed AI nodes;

[0056] The voice interaction module is also used to output the returned result.

[0057] Sixth: the control module is further used to pre-acquire the prompt word rule of the AI ​​large model system, and determine whether the input information needs to be modified based on the prompt word rule; when it is determined that the input information needs to be modified, modify the input information based on the prompt word rule to generate modified input information;

[0058] The prompt word rule library includes context-aware templates and user behavior portraits. The control module generates modified input information through the following steps:

[0059] a) Extracting spatiotemporal characteristic parameters from voice commands, including current time, ambient light intensity, and mechanical structure position status;

[0060] b) Calculate the context weight coefficient based on the user's historical operation records;

[0061] c) matching the optimal prompt word frame from the template library according to the weight coefficient;

[0062] d) embedding the original voice command into the framework to generate a structured query statement;

[0063] The distributed AI node calls the multimodal large model to generate a response according to the structured query statement.

[0064] The seventh type: the control module is further used to determine whether it is necessary to add description information to the returned result after obtaining the returned result from the AI ​​large model system; after determining that it is necessary to add description information to the returned result, based on the preference information pre-set by the lamp user, generate description information by calling the description information generation module, and add the description information to the returned result to generate a modified returned result;

[0065] The description information generation module includes: a credibility evaluation unit, which calculates the confidence score based on the feature vector of the result returned by the AI ​​large model system;

[0066] The personalized adaptation unit calls the user preference model in the storage module, and the user preference model is continuously updated through federated learning; when the confidence score is lower than the threshold, the alternative solution description and verification request are automatically attached;

[0067] The description information is output in the form of interactive voice clips, supporting users to provide feedback and corrections through natural language.

[0068] The eighth type: the lamp further includes a storage module for storing user preference information;

[0069] The storage module comprises:

[0070] Privacy-preserving partitions that use homomorphic encryption technology to store user biometric data;

[0071] Interactive memory unit, which records the triple relationship graph of device status-voice command-user feedback;

[0072] Model cache area, which stores lightweight inference models issued by the AI ​​large model system and supports maintaining basic intelligent services when the network is interrupted;

[0073] The control module automatically optimizes the local decision tree according to the memory unit data to achieve intention prediction in an offline state.

[0074] Reference Figures 2 to 3 A lamp with a voice interaction function comprises a lamp housing 1, wherein the interior of the lamp housing 1 is hollow to form a cavity 11, wherein an intelligent voice device 2 for receiving voice commands or performing voice interaction is arranged in the cavity 11, wherein a connecting seat 3 for assembling the intelligent voice device 2 is arranged in the cavity 11, and an opening 12 communicating with the cavity 11 is arranged at the bottom of the lamp housing 1, and a mesh cover 4 covering the opening 12 is arranged at the bottom of the lamp housing 1, so that the intelligent voice device 2 can perform intelligent voice interaction with a user, thereby satisfying the user's needs for convenient life and diversified services, and at the same time, the intelligent voice device 2 is arranged inside the lamp housing 1, making its structure more compact and beautiful, and through the design of the mesh cover 4, the intelligent voice device 2 can receive clear voice information, so that the sound can be smoothly transmitted in and out, reducing obstacles to voice interaction, and protecting the components in the cavity 11.

[0075] Reference Figure 2 and Figure 3 In this solution, the intelligent voice device 2 is connected to the connection base 3 in a detachable manner, and the two can be detachably connected by means of threaded connection or snap connection. Specifically, the outer side of the connection base 3 is provided with a positioning protrusion 31 for positioning the intelligent voice device 2, and the outer side of the intelligent voice device 2 is provided with a positioning block 21 that can abut against the positioning protrusion 31, and the positioning protrusion 31 is provided with a first threaded hole 32, and the positioning block 21 is provided with a second threaded hole 22 that matches the first threaded hole 32. In this way, the connection between the intelligent voice device 2 and the connection base 3 is more stable, and it is convenient to disassemble the intelligent voice device 2 when it needs to be repaired or replaced.

[0076] Reference Figure 2 and Figure 3In this solution, the light-emitting part 6 is provided in the lamp housing 1, and the housing is provided with a power driver 5 capable of providing a stable and safe voltage for the light-emitting part 6 and the intelligent voice device 2. Specifically, the power driver 5 includes a first connector 51 and a second connector 52 provided at its output end, the light-emitting part 6 includes a first power line 61 connected to the first connector 51, and the intelligent voice device 2 includes a second power line 23 connected to the second connector 52. In this way, the independence and stability of the power supply of each component are ensured, and a stable and safe voltage of less than 60V is provided for it. At the same time, the light-emitting part 6 and the intelligent voice device 2 are connected to a power driver 5, making the structure simpler.

[0077] Reference Figure 2 and Figure 3 In this solution, a lamp trough 13 is provided inside the lamp housing 1 and outside the cavity 11, and the light emitting portion 6 includes a lamp belt 62 provided in the lamp trough 13. The design of the lamp belt can provide uniform and soft light, and can achieve different lighting effects, such as indirect lighting, atmosphere lighting, etc., according to the shape and layout of the lamp trough 13.

[0078] Reference Figure 4 , a control method for a lamp with voice interaction function, Figure 1-Figure 3 The explanation in can be applied to this embodiment, such as Figure 4 As shown, the method includes:

[0079] Step 101, the voice interaction module receives and transmits voice commands; and

[0080] Step 102: The control module parses the instruction and controls the brightness of the light source and the movement of the mechanical structure.

[0081] Reference Figure 4In this solution, the intelligent voice device 2 includes a voice command receiving module 24 for receiving voice commands to control the light-emitting unit 6 to work. The voice command receiving module 24 adopts high-sensitivity microphone array technology, which can effectively collect voice signals in the surrounding environment. The module has a powerful voice signal preprocessing capability. Even in a complex sound environment, it can reduce the interference of environmental noise through an adaptive filtering algorithm and accurately identify the user's voice command. For example, in a living room environment with TV playing sound and people talking, the user's control command for the lamp can still be accurately captured. In the absence of a network, the module pre-stores a series of basic voice command recognition models, covering a variety of control commands for the light strip, such as "turn on the light", "turn off the light", "turn on the light after half an hour", "turn off the light after one hour", etc. When receiving the corresponding voice command, it will quickly convert the command into an electrical signal and transmit it to the control unit of the light strip. The control unit implements the opening, closing, timing opening and timing closing operations of the light strip according to the command.

[0082] Reference Figure 4 In this solution, the intelligent voice device 2 includes an intelligent voice interaction module 25 that can interact with the user by voice. The intelligent voice interaction module 25 integrates advanced voice recognition, natural language processing and speech synthesis technologies. In terms of speech recognition, it uses a deep neural network model with extremely high recognition accuracy and can recognize speech content in multiple languages ​​and different accents. The natural language processing part adopts a language understanding model based on the Transformer architecture, which can deeply understand the semantics and intentions of the user's voice instructions. For example, when the user says "I want a brighter light when reading", the module can not only recognize keywords, but also understand the user's intention to adjust the brightness of the light. Then, it will send an instruction to adjust the brightness of the light to the control unit of the lamp based on the result of understanding. At the same time, the module can also interact with the cloud server for data and obtain rich information resources. When communicating with the user to feedback the weather conditions, it will send a request to the cloud weather data server to obtain local real-time weather information, and feedback the weather conditions to the user in a clear and natural voice through speech synthesis technology. In terms of playing music, it can connect with mainstream music platforms and search and play corresponding music resources according to the user's voice commands, such as "play the song of so-and-so". The speech synthesis part adopts advanced text-to-speech conversion technology, which can simulate a variety of timbres to meet the personalized needs of different users.

[0083] The present invention realizes intelligent control of lamps through voice commands and wireless communications, supports remote operation and linkage with other smart home devices, and has the characteristics of high integration, low power consumption and strong robustness.

[0084] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limitations. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0085] Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0086] The block diagrams of the devices, apparatuses, equipment, and systems involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including," "comprising," "having," and the like are open words, referring to "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0087] The method and apparatus of the present disclosure may be implemented in many ways. For example, the method and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless otherwise specifically stated. In addition, in some embodiments, the present disclosure may also be implemented as a program recorded in a recording medium, which includes machine-readable instructions for implementing the method according to the present disclosure. Therefore, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

[0088] It should also be noted that in the apparatus, equipment and method of the present disclosure, each component or each step can be decomposed and / or recombined. These decompositions and / or recombinations should be regarded as equivalent schemes of the present disclosure. The above description of the disclosed aspects is provided to enable any technician in the field to make or use the present disclosure. Various modifications to these aspects are very obvious to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown here, but to the widest scope consistent with the principles and novel features disclosed herein.

[0089] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A lamp with voice interaction function, comprising: The main body of the lamp includes a light source assembly and an adjustable mechanical structure; Voice interaction module, used to receive and transmit voice commands; A control module is connected to the voice interaction module to parse the command and Control light source brightness and mechanical structure movement; and, A power module is used to supply power to the voice interaction module and the control module.

2. The lamp with voice interaction function according to claim 1, characterized in that: The voice interaction module is a FLM140D wireless communication module. The FLM140D module supports Wi-Fi 802.11b / g / n protocol and Bluetooth BLE 5.2 protocol, and is connected to external buttons or sensors through the GPIO multiplexing function.

3. The lamp with voice interaction function according to claim 2, characterized in that: The control module is an XK3031 TW chip, which has a built-in three-phase MOS drive module, adjusts the brightness of the light source through a PWM signal, and monitors current and voltage parameters in real time through an ADC interface.

4. The lamp with voice interaction function according to claim 1, characterized in that: The adjustable mechanical structure is a rotating bracket or a telescopic arm, and the XK3031 TW chip drives a brushless motor to achieve motion control.

5. The lamp with voice interaction function according to claim 4, characterized in that: The voice interaction module supports cloud semantic analysis and communicates with the local control module through the UART interface of the FLM140D module.

6. The lamp with voice interaction function according to claim 4, characterized in that: The lamp also includes: A remote communication module, used to receive input information from the control module, the remote communication module integrates a blockchain node function, and is used to encrypt the user's voice command and transmit the input information to the AI ​​large model system through a wireless network; the AI ​​large model system includes distributed AI nodes, each node collaboratively processes the voice command through a smart contract and generates a return result; the return result includes a lamp control command and a smart service recommendation related to the user context; The control module is configured with an edge computing unit for performing lightweight semantic parsing locally and performing dynamic task allocation with distributed AI nodes; The voice interaction module is also used to output the returned result.

7. The lamp with voice interaction function according to claim 6, characterized in that: The control module is further used to pre-acquire the prompt word rules of the AI ​​large model system, and determine whether the input information needs to be modified based on the prompt word rules; when it is determined that the input information needs to be modified, modify the input information based on the prompt word rules to generate modified input information; The prompt word rule library includes context-aware templates and user behavior portraits. The control module generates modified input information through the following steps: a) Extracting spatiotemporal characteristic parameters from voice commands, including current time, ambient light intensity, and mechanical structure position status; b) Calculate the context weight coefficient based on the user's historical operation records; c) matching the optimal prompt word frame from the template library according to the weight coefficient; d) embedding the original voice command into the framework to generate a structured query statement; The distributed AI node calls the multimodal large model to generate a response according to the structured query statement.

8. The lamp with voice interaction function according to claim 6, characterized in that: The control module is further used to determine whether it is necessary to add description information to the returned result after obtaining the returned result from the AI ​​large model system; after determining that it is necessary to add description information to the returned result, based on the preference information pre-set by the lamp user, generate description information by calling the description information generation module, and add the description information to the returned result to generate a modified returned result; The description information generation module includes: a credibility evaluation unit, which calculates the confidence score based on the feature vector of the result returned by the AI ​​large model system; The personalized adaptation unit calls the user preference model in the storage module, and the user preference model is continuously updated through federated learning; when the confidence score is lower than the threshold, the alternative solution description and verification request are automatically attached; The description information is output in the form of interactive voice clips, supporting users to provide feedback and corrections through natural language.

9. The lamp with voice interaction function according to claim 1, characterized in that: The lamp also includes a storage module for storing user preference information; The storage module comprises: Privacy-preserving partitions that use homomorphic encryption technology to store user biometric data; Interactive memory unit, which records the triple relationship graph of device status-voice command-user feedback; Model cache area, which stores lightweight inference models issued by the AI ​​large model system and supports maintaining basic intelligent services when the network is interrupted; The control module automatically optimizes the local decision tree according to the memory unit data to achieve intention prediction in an offline state.

10. A control method for a lamp with voice interaction function, characterized in that: The lamp includes a lamp body, a voice interaction module, a control module and a power module, and the control method includes: The voice interaction module receives and transmits voice commands; The control module analyzes the instructions and controls the brightness of the light source and the movement of the mechanical structure.

Images