AI voice assistant application method on projection equipment and projection system

Abstract

The invention relates to an AI voice assistant application method on projection equipment and a projection system, and the method comprises the steps: displaying a role model of a universal AI voice assistant in a home page interface of the projection system; under the condition that a user voice instruction is received, voiceprint recognition is carried out on the user voice instruction to judge whether the user voice instruction is bound with a personalized AI voice assistant or not; if the personalized AI voice assistant is bound, switching to the personalized AI voice assistant, and using the personalized AI voice assistant to interact with the user; and if not, interacting with the user by using the universal AI voice assistant. According to the method and the device, the corresponding bound personalized assistant is automatically called out by using the voiceprint of the user, the switching between the universal assistant and the personalized assistant does not need additional manual operation of the user, the use experience of the AI voice assistant on the projection equipment is improved, and the problem of how to apply the intelligent AI voice assistant on the projection equipment is solved.

Description

Technical Field

[0001] This application relates to the field of intelligent projection technology, and in particular to an AI voice assistant application method and projection system on a projection device. Background Technology

[0002] In recent years, artificial intelligence (AI) technology has rapidly emerged globally, triggering revolutionary changes across numerous industries. In particular, the integration of large language models with traditional voice assistants has revolutionized product design. Traditional voice assistants can only execute simple commands, while AI voice assistants integrating large language models not only transform traditional product forms but also significantly enhance the interactive experience between devices and users. They offer a more realistic, natural, and dynamic communication experience, allowing users to enjoy unprecedented interactive fun and the convenience brought by technology. Intelligent AI voice assistants powered by large language models have broad application prospects across various industries and urgently need to be developed and applied by professionals in these sectors.

[0003] Currently, no effective solution has been proposed for how to apply intelligent AI voice assistants to projection devices in related technologies. Summary of the Invention

[0004] This application provides a method and system for applying an AI voice assistant on a projection device, in order to at least solve the problem of how to apply an intelligent AI voice assistant on a projection device in related technologies.

[0005] In a first aspect, embodiments of this application provide a method for applying an AI voice assistant on a projection device, the method comprising: When you enter the homepage of the projection system of the projection device, the role model of the general AI voice assistant is displayed on the homepage of the projection system. Upon receiving a user's voice command, voiceprint recognition is performed on the user's voice command to determine whether the user's voice command is bound to a personalized AI voice assistant. If a personalized AI voice assistant is bound, then switch to the personalized AI voice assistant and use the personalized AI voice assistant to interact with the user; If no personalized AI voice assistant is paired, a general AI voice assistant will be used to interact with the user.

[0006] In some embodiments, before performing voiceprint recognition on the user's voice command to determine whether the user's voice command is bound to a personalized AI voice assistant, the method includes: The user's voiceprint is recorded through the projection system of the projection device, a personalized AI voice assistant is created, and the user's voiceprint is bound to the personalized AI voice assistant.

[0007] In some embodiments, recording a user's voiceprint via the projection system of the projection device includes: User voiceprints are recorded through the member management interface of the projection system, and corresponding usernames are set for different user voiceprints. The usernames are used to distinguish different user voiceprints and to bind personalized AI voice assistants.

[0008] In some embodiments, creating a personalized AI voice assistant through the projection system of the projection device includes: The system receives customized voice assistant information sent by the user's mobile terminal, creates and displays a corresponding personalized AI voice assistant on the role switching interface of the projection system, wherein the customized voice assistant information includes role name, role gender, role settings and role voice.

[0009] In some embodiments, binding the user's voiceprint to the personalized AI voice assistant via the projection system of the projection device includes: Through the role switching interface of the projection system, the user's voiceprint corresponding to the set user name is bound to the personalized AI voice assistant.

[0010] In some embodiments, the method includes: Set a default personalized AI voice assistant through the role switching interface of the projection system; After the default voice assistant is set, when you enter the home page of the projection system of the projection device, the role model of the default voice assistant will be displayed on the home page of the projection system.

[0011] In some embodiments, the general AI voice assistant and the personalized AI voice assistant are voice assistants that access open-source large language models, including DeepSeek and Tongyi Qianwen.

[0012] Secondly, embodiments of this application provide a projection system deployed on a projection device. The projection system is used to perform the method described in the first aspect above. The system includes a display module and a personalization module. The display module is used to display a role model of a general AI voice assistant on the homepage interface of the projection system when the user enters the projection system homepage interface of the projection device. The personalization module is used to perform voiceprint recognition on the user's voice command upon receiving the command, in order to determine whether the user's voice command is bound to a personalized AI voice assistant. If a personalized AI voice assistant is bound, the module switches to the personalized AI voice assistant and uses it to interact with the user. If no personalized AI voice assistant is bound, the module uses a general AI voice assistant to interact with the user.

[0013] Thirdly, this application provides a projection device, characterized in that a projection system is deployed on the projection device, and the AI ​​voice assistant application method described in the first aspect is accessed in the projection device.

[0014] Fourthly, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the AI ​​voice assistant application method as described in the first aspect above.

[0015] Compared to related technologies, this application provides an AI voice assistant application method and projection system on a projection device. The method involves displaying a general AI voice assistant role model on the homepage of the projection system when the user enters the projection device. Upon receiving a user's voice command, the method performs voiceprint recognition to determine if the command is bound to a personalized AI voice assistant. If a personalized AI voice assistant is bound, the method switches to that assistant and uses it to interact with the user. If no personalized AI voice assistant is bound, the general AI voice assistant is used. This achieves the application of a personalized AI voice assistant on the projection device. Upon recognizing the user's voiceprint, the corresponding bound personalized assistant is automatically activated. Switching between the general and personalized assistants requires no additional manual operation from the user, significantly improving the user experience of the AI ​​voice assistant on the projection device and solving the problem of how to apply an intelligent AI voice assistant on a projection device. Attached Figure Description

[0016] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings: Figure 1 This is a flowchart of the steps of an AI voice assistant application method on a projection device according to an embodiment of this application; Figure 2 This is a schematic diagram of the homepage interface of a projection system according to an embodiment of this application; Figure 3 This is a schematic diagram of a member management interface according to an embodiment of this application; Figure 4 This is a schematic diagram of the role switching interface according to an embodiment of this application; Figure 5 This is a schematic diagram illustrating the creation of a personalized AI voice assistant according to an embodiment of this application; Figure 6 This is a schematic diagram of the internal structure of an electronic device according to an embodiment of this application. Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of this application clearer, the application is described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0018] Obviously, the accompanying drawings described below are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar scenarios based on these drawings without any inventive effort. Furthermore, it is understood that although the efforts made in this development process may be complex and lengthy, for those skilled in the art related to the content disclosed in this application, any changes to design, manufacturing, or production based on the technical content disclosed in this application are merely conventional technical means and should not be construed as insufficient disclosure of the content of this application.

[0019] In this application, the reference to "embodiment" means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment that is mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0020] Unless otherwise defined, the technical or scientific terms used in this application shall have the ordinary meaning understood by one of ordinary skill in the art to which this application pertains. The terms “a,” “an,” “an,” “the,” and similar words used in this application do not indicate quantity limitation and may indicate singular or plural. The terms “comprising,” “including,” “having,” and any variations thereof used in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that includes a series of steps or modules (units) is not limited to the listed steps or units, but may also include steps or units not listed, or may include other steps or units inherent to these processes, methods, products, or devices. The terms “connected,” “linked,” “coupled,” and similar words used in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. “Multiple” used in this application refers to two or more. “And / or” describes the relationship between related objects, indicating that three relationships may exist; for example, “A and / or B” can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following objects are in an "or" relationship. The terms "first," "second," and "third" used in this application are merely to distinguish similar objects and do not represent a specific ordering of the objects.

[0021] This application provides a method for applying an AI voice assistant on a projection device. Figure 1 This is a flowchart illustrating the steps of an AI voice assistant application method on a projection device according to an embodiment of this application, such as... Figure 1 As shown, the method includes the following steps: Step S102: When entering the projection system homepage interface of the projection device, the role model of the general AI voice assistant is displayed on the projection system homepage interface. It should be noted that, Figure 2 This is a schematic diagram of the homepage interface of the projection system according to an embodiment of this application, as shown below. Figure 2 As shown, Figure 2 The left side displays the role model of the general AI voice assistant. Preferably, in this embodiment, the general AI voice assistant and the personalized AI voice assistant are voice assistants that access open-source large language models, including DeepSeek, Tongyi Qianwen, etc., which will not be described in detail here.

[0022] Step S104: Upon receiving a user's voice command, perform voiceprint recognition on the user's voice command to determine whether the user's voice command is bound to a personalized AI voice assistant. It should be noted that there are multiple ways to implement voiceprint recognition, and different voiceprint recognition algorithm models can be deployed according to different scenario requirements. One approach is to use a Gaussian Mixture Model-Unified Background Model (GMM-UBM). First, a general background model (UBM) is trained, and then maximum likelihood ratio estimation (MLLR) is used to adapt the model to the speech data of a specific speaker, generating a personalized voiceprint model. This approach is suitable for small-scale datasets and has low computational complexity. Another approach is to use a Hidden Markov Model (HMM), which combines time-series information to model the dynamic features of continuous speech streams, making it suitable for continuous speech recognition tasks. A third approach is to use Vector Quantization (VQ) clustering, which clusters speech feature vectors into codebooks, and then determines the speaker's identity based on codebook similarity. These algorithms are simple and computationally efficient.

[0023] It should be noted that, in addition to voiceprint recognition via user voice commands, other methods can be used to determine whether to bind a personalized AI voice assistant, such as collecting the user's facial features and binding those features to the personalized AI voice assistant.

[0024] Before step S104, the method includes step S103, which involves recording the user's voiceprint through the projection system of the projection device, creating a personalized AI voice assistant, and binding the user's voiceprint with the personalized AI voice assistant.

[0025] Step S103 specifically includes the following steps: Step S1031: Record user voiceprints through the member management interface of the projection system and set corresponding usernames for different user voiceprints. The usernames are used to distinguish different user voiceprints and to bind personalized AI voice assistants.

[0026] It should be noted that, Figure 3 This is a schematic diagram of the member management interface according to an embodiment of this application, such as... Figure 3 As shown, different user voiceprints correspond to different usernames (such as Xiaoliang and Xiaoming).

[0027] Step S1032: Receive the voice assistant customization information sent by the user's mobile terminal, create and display the corresponding personalized AI voice assistant on the role switching interface of the projection system, wherein the voice assistant customization information includes the role name, role gender, role settings and role voice.

[0028] It should be noted that, Figure 4 This is a schematic diagram of the role switching interface according to an embodiment of this application, such as... Figure 4 As shown, users can click the "+" sign in the character switching interface to add and create their own personalized AI voice assistant; Figure 5 This is a schematic diagram illustrating the creation of a personalized AI voice assistant according to an embodiment of this application, such as... Figure 5 As shown, after clicking the "+" sign in the character switching interface, the user needs to use their mobile device (such as a mobile phone, tablet, etc.) to scan the QR code that appears to display the character creation interface. In this interface, the user sets the customized information of the personalized AI voice assistant (such as character name, character gender, character settings and character voice) to complete the creation.

[0029] It's worth noting that the projection system also allows users to create personalized voice assistants via remote control selection and voice input. For example, the projection system's camera captures the user's image to generate a cartoon-style personalized AI voice assistant, while the microphone captures the user's voice, identifies their voiceprint, and binds it to the corresponding personalized AI voice assistant. Furthermore, when the user is using the projection system to play videos or images, they can take a screenshot of the current screen and generate a personalized AI voice assistant based on that screenshot. For instance, if the projection system is playing the movie "Nezha," a screenshot can be taken of the Nezha character's appearance. In the character creation interface, users can select to generate an AI voice assistant based on the screenshot, simultaneously capturing the creator's voiceprint or image and binding the Nezha-style AI voice assistant to the creator. During subsequent use, the system can recognize the creator's image or voiceprint and interact with the Nezha-style AI voice assistant.

[0030] Step S1033: Through the role switching interface of the projection system, the user voiceprint corresponding to the user name is bound to the personalized AI voice assistant using the set user name.

[0031] It should be noted that the usernames are all different. Based on the association between user voiceprint, username, and personalized AI voice assistant, a one-to-one binding (one user voiceprint corresponds to only one username) or a one-to-many binding (one user voiceprint corresponds to only multiple usernames) is achieved between user voiceprint and personalized AI voice assistant. Obviously, in the case of one-to-many binding, a conflict may occur in the personalized AI voice assistant switching in the subsequent step S106. To address this, after recording the user voiceprint in the above step S1031, the similarity between the newly recorded user voiceprint and the previously recorded user voiceprint can be automatically detected. If it is determined that there is a matching user voiceprint, the user is prompted to repeat the recording and two options, cancel and continue, are displayed. If the user chooses to continue recording and set a username, then in the case where the same user voiceprint is bound to different personalized AI voice assistants through different usernames (e.g., voiceprint 1 - name a - personalized assistant A, voiceprint 1 - name b - personalized assistant B), after the user voiceprint is identified in the subsequent step S104, step S106 displays these different personalized AI voice assistants for the user to manually select and interact with. In this way, the one-to-one binding between the user's voiceprint and the personalized AI voice assistant is maintained to a certain extent, and the switching conflict of the personalized AI voice assistant is avoided in the case of one-to-many binding.

[0032] Step S106: If a personalized AI voice assistant is bound, switch to the personalized AI voice assistant and use it to interact with the user; if no personalized AI voice assistant is bound, use the general AI voice assistant to interact with the user.

[0033] Through the steps described in this application embodiment, a personalized AI voice assistant is introduced into the projection device, enhancing the emotional interaction between the user and the device. This assistant possesses self-learning capabilities and can dynamically optimize service content based on user habits. Simultaneously, it can switch to a designated AI assistant based on the voice questioner; that is, it automatically invokes the corresponding personalized assistant after recognizing the user's voiceprint. Switching between the general assistant and the personalized assistant requires no additional manual operation from the user, greatly improving the user experience of the AI ​​voice assistant on the projection device. This promotes the development of projection devices towards intelligence, scenario-based applications, and an ecosystem, expanding their application boundaries in multiple scenarios such as home entertainment, education, and office work, and solving the problem of how to apply intelligent AI voice assistants to projection devices.

[0034] In some embodiments, the method for applying an AI voice assistant on the projection device further includes: like Figure 4As shown, the default personalized AI voice assistant can be set through the role switching interface of the projection system; after the default voice assistant is set, when entering the home page of the projection system of the projection device, the role model of the default voice assistant will be displayed on the home page of the projection system.

[0035] It should be noted that the steps shown in the above process or in the flowchart of the accompanying figures can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0036] This application provides a projection system deployed on a projection device. The projection system is used to execute the methods provided in the above embodiments. The system includes a display module and a personalization module. The display module is used to display the role model of the general AI voice assistant on the home page of the projection system when the user enters the projection system home page of the projection device. The personalization module is used to perform voiceprint recognition on user voice commands upon receipt to determine whether the user voice command is bound to a personalized AI voice assistant. If a personalized AI voice assistant is bound, the module switches to the personalized AI voice assistant and uses it to interact with the user. If no personalized AI voice assistant is bound, the module uses a general AI voice assistant to interact with the user.

[0037] The display module and personalization module in this application embodiment realize the application of a personalized AI voice assistant on the projection device. After recognizing the user's voiceprint, the corresponding bound personalized assistant can be automatically brought up. Switching between the general assistant and the personalized assistant does not require the user to perform any additional manual operation, which greatly improves the user experience of the AI ​​voice assistant on the projection device and solves the problem of how to apply an intelligent AI voice assistant on the projection device.

[0038] It should be noted that the above modules can be functional modules or program modules, and can be implemented through software or hardware. For modules implemented through hardware, the above modules can reside in the same processor; or the above modules can be located in different processors in any combination.

[0039] This embodiment provides an electronic device including a memory and a processor. The memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0040] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0041] Optionally, the electronic device may further include a processor, memory, network interface, display screen, and input device connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements an AI voice assistant application method on a projection device. The display screen may be a liquid crystal display (LCD) or an e-ink display. The input device may be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.

[0042] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, and will not be repeated here.

[0043] Furthermore, in conjunction with the AI ​​voice assistant application method on the projection device in the above embodiments, this application embodiment can provide a storage medium for implementation. The storage medium stores a computer program; when the computer program is executed by a processor, it implements any of the AI ​​voice assistant application methods on the projection device in the above embodiments.

[0044] In one embodiment, Figure 6 This is a schematic diagram of the internal structure of an electronic device according to an embodiment of this application, such as... Figure 6 As shown, an electronic device is provided, which can be a server, and its internal structure diagram can be as follows. Figure 6 As shown, the electronic device includes a processor, a network interface, internal memory, and non-volatile memory connected via an internal bus. The non-volatile memory stores an operating system, computer programs, and a database. The processor provides computing and control capabilities, the network interface communicates with external terminals via a network, the internal memory provides an environment for the operation of the operating system and computer programs, the computer programs are executed by the processor to implement an AI voice assistant application method on a projection device, and the database stores data.

[0045] Those skilled in the art will understand that Figure 6The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. A specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0046] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0047] Those skilled in the art should understand that the technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments have been described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0048] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. An AI voice assistant application method on a projection device, characterized in that, The method comprises: When entering the home page interface of the projection system of the projection device, a role model of a general AI voice assistant is displayed in the home page interface of the projection system; In the case of receiving a user voice instruction, voiceprint recognition is performed on the user voice instruction to determine whether the user voice instruction is bound to a personalized AI voice assistant; If the personalized AI voice assistant is bound, the personalized AI voice assistant is switched to, and the personalized AI voice assistant is used to interact with the user; If there is no personalized AI voice assistant bound, the general AI voice assistant is used to interact with the user.

2. The method of claim 1, wherein, Before the voiceprint recognition is performed on the user voice instruction to determine whether the user voice instruction is bound to a personalized AI voice assistant, the method comprises: Through the projection system of the projection device, a user voiceprint is entered, a personalized AI voice assistant is created, and the user voiceprint is bound to the personalized AI voice assistant.

3. The method of claim 2, wherein, Entering a user voiceprint through the projection system of the projection device comprises: A user voiceprint is entered through a member management interface of the projection system, and a corresponding user name is set for different user voiceprints, wherein the user name is used to distinguish different user voiceprints and to bind a personalized AI voice assistant.

4. The method of claim 3, wherein, Creating a personalized AI voice assistant through the projection system of the projection device comprises: Receiving voice assistant customization information sent by a user mobile terminal, creating and displaying a corresponding personalized AI voice assistant on a role switching interface of the projection system, wherein the voice assistant customization information includes a role name, a role gender, a role setting, and a role tone.

5. The method of claim 4, wherein, Binding the user voiceprint to the personalized AI voice assistant through the projection system of the projection device comprises: Through the role switching interface of the projection system, the user voiceprint corresponding to the user name is bound to the personalized AI voice assistant by using the set user name.

6. The method of claim 1, wherein, The method comprises: Setting a default personalized AI voice assistant through a role switching interface of the projection system; After the default voice assistant is set, when entering the home page interface of the projection system of the projection device, a role model of the default voice assistant is displayed in the home page interface of the projection system.

7. The method of claim 1, wherein, The general AI voice assistant and the personalized AI voice assistant are voice assistants accessing an open source large language model, wherein the open source large language model includes DeepSeek and Tongyi Qianwen.

8. A projection system, characterized by The projection system is deployed on a projection device, and is used to execute the method of any one of claims 1 to 7, and the system comprises a display module and a personalization module. The display module is configured to display a role model of a general AI voice assistant in the home page interface of the projection system when entering the home page interface of the projection system of the projection device. The personalization module is used to perform voiceprint recognition on the user's voice command upon receiving the command, in order to determine whether the user's voice command is bound to a personalized AI voice assistant. If a personalized AI voice assistant is bound, the module switches to the personalized AI voice assistant and uses it to interact with the user. If no personalized AI voice assistant is bound, the module uses a general AI voice assistant to interact with the user.

9. A projection apparatus, characterized by, The projection device is equipped with a projection system, and the projection device is connected to the AI ​​voice assistant application method according to any one of claims 1 to 7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, When the program is executed by the processor, it implements the AI ​​voice assistant application method as described in any one of claims 1 to 7.

Images