Custom timbre voice broadcasting method and system applied to intelligent door lock

Abstract

The invention discloses a timbre-customized voice broadcasting method and device applied to an intelligent door lock. The timbre-customized voice broadcasting method comprises the following steps: receiving a timbre demand of a user; voice broadcasting is carried out according to the timbre requirement; wherein the timbre requirement is obtained through a user interface arranged on the intelligent door lock. The user interface is introduced to the intelligent door lock, so that a user can freely select or customize favorite timbres for voice broadcast, and the experience of the user in using the intelligent door lock is improved; by collecting and processing various voice data, a user-defined timbre library containing various timbres is established, and the requirement of a user for personalized voice broadcast is met; the tone is processed through the voice synthesis technology, and the more natural and vivid voice broadcast effect is achieved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent voice interaction systems, and in particular to a method and system for customized tone voice broadcasting applied to intelligent door locks. Background Art

[0002] With the rapid development of society, security technology is also developing accordingly, and smart door locks are gradually occupying an important position in smart homes. Smart door locks are a type of door lock used by modern people. Different from traditional mechanical locks, smart door locks can be opened by passwords, fingerprints, chips and other commands, which are more intelligent and simple in terms of user security, identification and management. Smart door locks are easy to use, efficient and have good safety performance, and are favored by consumers. In order to pursue a better user experience, manufacturers use existing technological innovations to add voice chips to smart door locks, so that smart door locks have added a voice broadcast function on the basis of the original function to help users set up and use.

[0003] With the rapid development of artificial intelligence technology, intelligent voice interaction systems have become an increasingly common application in people's lives. However, the timbre of existing smart door lock broadcast voices is uniformly set by the manufacturer and stored in the smart door lock, and cannot be set by the user. The effect of voice broadcast is relatively simple and lacks personalization, making it difficult to meet the diverse needs of users. Therefore, designing a voice broadcast solution with customized timbre has become an urgent problem to be solved. Summary of the invention

[0004] In order to solve at least one of the technical problems raised above, the purpose of the present invention is to provide a customized tone voice broadcast method and system for smart door locks, so as to solve the problem that the voice broadcast effect of smart door locks is single and lacks personalization.

[0005] The purpose of the present invention is achieved by the following technical means:

[0006] In a first aspect, the present invention provides a custom tone voice broadcast method applied to a smart door lock, comprising:

[0007] Receive the broadcast tone required by the user;

[0008] Perform voice broadcast according to the broadcast tone;

[0009] Wherein, the broadcast tone is obtained through a user interface set on the smart door lock.

[0010] Preferably, before receiving the user's broadcast tone, the method further includes:

[0011] Collect voice data;

[0012] A custom timbre library is established based on the voice data.

[0013] Preferably, establishing a custom timbre library according to the voice data comprises:

[0014] Preprocessing the voice data;

[0015] Extracting timbre features of the speech data;

[0016] A timbre label is added to the speech data according to the timbre feature.

[0017] Preferably, the voice broadcasting according to the broadcasting tone includes:

[0018] Performing speech synthesis on the broadcast tone to obtain the smart door lock broadcast voice;

[0019] Use the smart door lock broadcast voice for voice broadcasting.

[0020] Preferably, the performing speech synthesis on the announcement tone to obtain the smart door lock announcement voice includes:

[0021] Set the output text;

[0022] The output text and the broadcast tone are input into a speech synthesis neural network model to obtain the smart door lock broadcast voice.

[0023] Preferably, the speech synthesis neural network model is established by:

[0024] Get input text and construct the original sample set;

[0025] Preprocessing the original sample set to obtain the training sample set;

[0026] The speech synthesis neural network model is trained based on the training sample set.

[0027] In a second aspect, the present invention provides a custom tone voice broadcast system applied to a smart door lock, comprising:

[0028] Docking module: used to receive the broadcast tone required by the user;

[0029] A broadcast module: used for performing voice broadcast according to the broadcast tone;

[0030] Wherein, the broadcast tone is obtained through a user interface set on the smart door lock.

[0031] Preferably, it also includes:

[0032] Collection module: used to collect voice data;

[0033] Processing module: used to establish a custom timbre library according to the voice data.

[0034] In a third aspect, the present invention provides an electronic device comprising a processor and a memory, wherein the memory is used to store computer program code, and the computer program code comprises computer instructions. When the processor executes the computer instructions, the electronic device executes the above-mentioned custom tone voice broadcast method applied to a smart door lock.

[0035] In a fourth aspect, the present invention provides a computer-readable storage medium, in which a computer program is stored. The computer program includes program instructions, and when the program instructions are executed by a processor of an electronic device, the processor executes the above-mentioned custom tone voice broadcast method applied to a smart door lock.

[0036] Compared with the prior art, the present invention has the following beneficial effects:

[0037] The present invention introduces a user interface on the smart door lock, so that the user can freely choose or customize the tone he likes for voice broadcast, thereby improving the user's experience of using the smart door lock; by collecting and processing a variety of voice data, a custom tone library containing a variety of tones is established to meet the user's demand for personalized voice broadcast; the tone is processed by voice synthesis technology to achieve a more natural and vivid voice broadcast effect.

[0038] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the drawings required for use in the embodiments of the present application or the background technology will be described below.

[0040] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.

[0041] Figure 1 A flowchart of a method for customized tone voice broadcasting applied to a smart door lock provided by an embodiment of the present invention;

[0042] Figure 2 A schematic diagram of the structure of a custom tone voice broadcast system applied to a smart door lock provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0043] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0044] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0045] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0046] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0047] In addition, in order to better illustrate the present invention, numerous specific details are provided in the following specific embodiments. It should be understood by those skilled in the art that the present invention can be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present invention.

[0048] With the rapid development of society, security technology is also developing accordingly, and smart door locks are gradually occupying an important position in smart homes. Smart door locks are a type of door lock used by modern people. Different from traditional mechanical locks, smart door locks can be opened by passwords, fingerprints, chips and other commands, which are more intelligent and simple in terms of user security, identification and management. Smart door locks are easy to use, efficient and have good safety performance, and are favored by consumers. In order to pursue a better user experience, manufacturers use existing technological innovations to add voice chips to smart door locks, so that smart door locks have added a voice broadcast function on the basis of the original function to help users set up and use.

[0049] With the rapid development of artificial intelligence technology, intelligent voice interaction systems have become an increasingly common application in people's lives. However, the timbre of existing smart door lock broadcast voices is uniformly set by the manufacturer and stored in the smart door lock, and cannot be set by the user. The effect of voice broadcast is relatively simple and lacks personalization, making it difficult to meet the diverse needs of users. Therefore, designing a voice broadcast solution with customized timbre has become an urgent problem to be solved.

[0050] The present invention introduces a user interface on the smart door lock, so that the user can freely choose or customize the tone he likes for voice broadcast, thereby improving the user's experience of using the smart door lock; by collecting and processing a variety of voice data, a custom tone library containing a variety of tones is established to meet the user's demand for personalized voice broadcast; the tone is processed by voice synthesis technology to achieve a more natural and vivid voice broadcast effect.

[0051] Example 1

[0052] Provides a custom voice announcement method for smart door locks. Figure 1 ,include:

[0053] S100, receiving the broadcast tone required by the user;

[0054] S200, voice broadcast according to the broadcast tone;

[0055] Among them, the broadcast tone is obtained through the user interface set on the smart door lock.

[0056] In this embodiment, the user selects or changes the timbre of the voice broadcast of the smart door lock through the user interface set on the smart door lock. In S100, the user can select the timbre provided by the smart door lock, that is, the timbre contained in the custom timbre library as the broadcast timbre, or customize the timbre he likes for voice broadcast. In some embodiments, multiple timbre in the custom timbre library can be added with labels belonging to the timbre, such as "male host", "female anchor", etc. The user can select the timbre label he likes through the user interface. After the user selects the timbre label he likes, the smart door lock will obtain the broadcast timbre corresponding to the timbre label selected by the user from the custom timbre library for voice broadcast. In some embodiments, the smart door lock provides audition and adjustment functions. When there is no timbre label that the user likes in the custom timbre library or the timbre of the voice broadcast is somewhat different from the timbre imagined by the user, the user can select one of the existing timbres in the custom timbre library, and adjust the timbre based on the selected timbre to obtain the broadcast timbre that the user wants. In some embodiments, the smart door lock also provides a customization function. When the user wants to use a specified tone as the broadcast tone, such as the user intends to use the voice of a certain cartoon character as the broadcast tone, or the user intends to use the voice of his or her own child as the broadcast tone, the user can prepare the speaker's voice for the user interface to record, and then use the customized tone for voice broadcast.

[0057] The user interface is the medium for interaction and information exchange between the system and the user. It realizes the conversion between the internal form of information and the form that humans can receive. It is the connection between the user and the computer established to facilitate the user to use computer resources. That is, the user does not have the authority to directly use computer resources, but the operating system has this authority. The operating system can provide users with interfaces in the form of commands, system calls, graphics, etc. to complete various tasks submitted by users. There are three types of user interfaces, namely command interface: In order to facilitate users to directly or indirectly control their own jobs, the operating system provides users with a command interface. The command interface is the user's use of operating system commands to organize and control the execution of jobs or manage computer systems. Commands are entered on the command input interface, executed by the system in the background, and the results are reflected in the foreground interface or a specific file. The command interface can be further divided into online user interface and offline user interface; program interface: The program interface consists of a set of system call commands, which is the interface provided by the operating system to programmers. Users request the operating system to provide services by using system call commands in the program. Each system call is a subroutine that can complete a specific function. Such as the early UNIX system version and MS-DOS version; Graphical interface: The graphical user interface uses a graphical operating interface, using various icons that are very easy to identify to intuitively and realistically represent the various system functions, various applications and files. Users can complete the operation of corresponding programs and files through the mouse, menus and dialog boxes. The graphical user interface elements include windows, icons, menus and dialog boxes. The basic operations of the graphical user interface elements include menu operations, window operations and dialog box operations. In this embodiment, the user port is a touch screen set on the smart door lock.

[0058] Preferably, before receiving the user's broadcast tone, the method further includes:

[0059] Collect voice data;

[0060] Create a custom sound library based on voice data.

[0061] In order to meet the user's demand for personalized voice broadcast, the smart door lock needs to establish a custom timbre library containing a large number of timbres. In this embodiment, by collecting and processing a variety of voice data, a custom timbre library containing a variety of timbres is established, and the user can select the timbre provided by the smart door lock for voice broadcast, thereby meeting the user's demand for personalized voice broadcast.

[0062] Preferably, a custom timbre library is established based on the voice data, including:

[0063] Preprocessing the speech data;

[0064] Extracting timbre features of speech data;

[0065] Add timbre labels to speech data based on timbre features.

[0066] In this embodiment, the voice data refers to a segment recording human voice, which can be a recording file, a video file, etc. Preprocessing the voice data can make the human voice part clearer and more realistic, which is convenient for subsequent processing of the voice data. In some embodiments, when the voice data is in a high-noise environment, the voice data is made clearer by denoising; the quality of the human voice is improved by reducing the background echo; and the human voice is easier to hear and understand by enhancing the specific frequency range of the audio. After the voice data is preprocessed, the human voice in the voice data is clearer, and the timbre features of the voice data are extracted, and then a timbre label that conforms to the timbre features is added to the voice data. In some embodiments, adding a timbre label to the voice data according to the timbre features can be added manually, that is, judging the voice data by manpower to obtain a timbre label that conforms to the timbre features of the voice data; adding a timbre label to the voice data according to the timbre features can also be added by a program, that is, the voice data is input into the program, and the timbre label that conforms to the timbre features of the voice data is automatically obtained after the program is run, and after the program obtains the result, manual detection is set to ensure the accuracy of the program result.

[0067] Preferably, performing voice broadcasting according to the broadcasting timbre includes:

[0068] Perform speech synthesis on the broadcast tone to obtain the smart door lock broadcast voice;

[0069] Use smart door lock broadcast voice for voice broadcast.

[0070] After the user selects his favorite tone label, the smart door lock only obtains the broadcast tone required by the user, and also needs to use the broadcast tone to broadcast the text content that needs to be voice broadcast when the smart door lock is working. In this embodiment, after the user selects the tone provided by the custom tone library or customizes the specified tone as the broadcast tone, the smart door lock uses speech synthesis to process the broadcast tone to achieve a more natural and vivid voice broadcast effect. In some embodiments, speech synthesis can also be performed on all the tones in the custom tone library when the custom tone library is established. After the user selects his favorite tone label, the smart door lock can obtain the smart door lock broadcast voice obtained after speech synthesis of the tone label corresponding to the user's selected tone from the custom tone library, which can reduce the user's waiting time and improve the user's experience.

[0071] Preferably, the broadcast tone is subjected to speech synthesis to obtain the smart door lock broadcast voice, including:

[0072] Set the output text;

[0073] The output text and broadcast tone are input into the speech synthesis neural network model to obtain the smart door lock broadcast voice.

[0074] In order to meet the user's demand for personalized voice broadcast, it is necessary to meet the user's customized voice broadcast. In this embodiment, different from the above-mentioned advance voice synthesis of all the timbres in the custom timbre library, a pre-built voice synthesis module is installed in the smart door lock, the output text is set, and after waiting for the user to select the timbre label he likes or customize the broadcast timbre he likes, the output text and the broadcast timbre selected by the user are input into the pre-built voice synthesis neural network model to obtain the smart door lock broadcast voice that uses the broadcast timbre to broadcast the output text. The custom timbre library and voice synthesis are applied to the intelligent voice interaction system of the smart door lock, so that the user can freely choose the timbre he likes or customize the timbre he likes for voice broadcast, meeting the user's demand for personalized voice broadcast. In some embodiments, emotions can be added in the process of voice synthesis, and the voice broadcast of the smart door lock is made emotional by processing the intonation, pitch and timbre, making the voice broadcast of the smart door lock more vivid.

[0075] Preferably, the process of establishing the speech synthesis neural network model is as follows:

[0076] Get input text and construct the original sample set;

[0077] Preprocess the original sample set to obtain a training sample set;

[0078] According to the training sample set, a speech synthesis neural network model is trained.

[0079] In this embodiment, the speech synthesis neural network model constructed by training can realize the input of text content and fragments or timbre containing human voice into the neural network model, and output a voice broadcast using the human voice or timbre to read the text content, that is, the text-to-speech broadcast is realized using the specified timbre. The original sample set includes the speech data for building a custom timbre library and the text content of the human voice part of the speech data. Preprocessing is the processing of text, including the regularization of text content, the analysis of text syntax and the segmentation of text content. The main purpose is to convert the input text into corresponding language features. During the training process, spectral features, excitation features, frequency band periodic features and dynamic characteristics are used as acoustic features. The training model includes a duration model based on hidden Markov and an acoustic model based on a deep neural network. For the acoustic model based on a deep neural network, a deep neural network is used to model the mapping relationship between language features and acoustic features. The input text is preprocessed to obtain the corresponding language features, the duration of the text is predicted according to the hidden Markov duration model, the language features are mapped according to the acoustic model based on the deep neural network to obtain the acoustic feature parameters, and finally the voice coder is used to reconstruct the speech waveform to obtain the synthesized speech.

[0080] Example 2

[0081] Provides a custom tone voice broadcast system for smart door locks, see Figure 2 ,include:

[0082] Docking module 100: used to receive the broadcast tone required by the user;

[0083] The announcement module 200 is used for making voice announcements according to the announcement tone;

[0084] Among them, the broadcast tone is obtained through the user interface set on the smart door lock.

[0085] Preferably, see Figure 2 , also includes:

[0086] Collection module 300: used to collect voice data;

[0087] Processing module 400: used to create a custom timbre library based on voice data.

[0088] Example 3

[0089] An electronic device is provided, comprising a processor and a memory, wherein the memory is used to store computer program codes, and the computer program codes include computer instructions. When the processor executes the computer instructions, the electronic device executes the above-mentioned custom tone voice broadcast method applied to a smart door lock.

[0090] Example 4

[0091] A computer-readable storage medium is provided, in which a computer program is stored. The computer program includes program instructions. When the program instructions are executed by a processor of an electronic device, the processor executes the above-mentioned custom tone voice broadcast method applied to a smart door lock.

[0092] This embodiment introduces a user interface on the smart door lock, allowing users to freely choose or customize their favorite timbre for voice broadcast, thereby improving the user experience of using the smart door lock; by collecting and processing a variety of voice data, a custom timbre library containing a variety of timbres is established to meet the user's demand for personalized voice broadcast; the timbre is processed through speech synthesis technology to achieve a more natural and vivid voice broadcast effect.

[0093] In some embodiments, the functions or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the method embodiment above, and its specific implementation may refer to the description of the method embodiment above, and for the sake of brevity, it will not be repeated here. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0094] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital versatile disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0095] A person skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by a computer program to instruct the relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned storage medium includes: a read-only memory (ROM) or a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0096] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A custom tone voice broadcast method applied to smart door locks, characterized in that: include: Receive the broadcast tone required by the user; Perform voice broadcast according to the broadcast tone; Wherein, the broadcast tone is obtained through a user interface set on the smart door lock.

2. According to claim 1, a method for customized tone voice broadcasting applied to smart door locks is characterized in that: Before receiving the user's broadcast tone, the method further includes: Collect voice data; A custom timbre library is established based on the voice data.

3. According to claim 2, a method for customized tone voice broadcasting applied to smart door locks is characterized in that: The step of establishing a custom timbre library according to the voice data comprises: Preprocessing the voice data; Extracting timbre features of the speech data; A timbre label is added to the speech data according to the timbre feature.

4. According to claim 1, a method for customized tone voice broadcasting applied to smart door locks is characterized in that: The voice broadcasting according to the broadcasting timbre comprises: Performing speech synthesis on the broadcast tone to obtain the smart door lock broadcast voice; Use the smart door lock broadcast voice for voice broadcasting.

5. The method for customized tone voice broadcasting applied to smart door locks according to claim 4 is characterized in that: The performing speech synthesis on the broadcast tone to obtain the smart door lock broadcast voice includes: Set the output text; The output text and the broadcast tone are input into a speech synthesis neural network model to obtain the smart door lock broadcast voice.

6. The method for customized tone voice broadcasting applied to smart door locks according to claim 5, characterized in that: The process of establishing the speech synthesis neural network model is as follows: Get input text and construct the original sample set; Preprocessing the original sample set to obtain the training sample set; The speech synthesis neural network model is trained based on the training sample set.

7. A custom tone voice broadcast system applied to smart door locks, characterized in that: include: Docking module: used to receive the broadcast tone required by the user; A broadcast module: used for performing voice broadcast according to the broadcast tone; Wherein, the broadcast tone is obtained through a user interface set on the smart door lock.

8. The voice broadcasting system with a custom timbre according to claim 7, characterized in that: Also includes: Collection module: used to collect voice data; Processing module: used to establish a custom timbre library according to the voice data.

9. An electronic device, characterized in that: It includes a processor and a memory, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor executes the computer instructions, the electronic device executes a custom tone voice broadcast method applied to a smart door lock as described in any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which includes program instructions. When the program instructions are executed by a processor of an electronic device, the processor executes a custom tone voice broadcast method applied to a smart door lock as described in any one of claims 1 to 6.

Images