Newborn intelligent identity recognition system based on voice recognition

Abstract

The invention relates to the technical field of neonatal intelligent identity recognition. The invention relates to a newborn intelligent identity recognition system based on voice recognition. The system comprises an audio database establishment unit, an audio age calculation unit, a newborn audio prediction unit, a prediction error analysis unit and an audio identity recognition unit. The audio database establishment unit is used for collecting historical audio data of newborns, setting a unique identity tag for each newborn and establishing an audio database; after to-be-recognized audio data enters the system, the state determination module recognizes the state, the identity determination module compares the similarity between the predicted audio data and the to-be-recognized audio data, and the identity is judged by combining the error range, so that the identity of the newborn can be quickly and accurately recognized in the complicated personnel flow environment such as hospitals, and safety accidents such as mistaken holding can be prevented.

Description

Technical Field

[0001] The present invention relates to the technical field of neonatal intelligent identity recognition, and specifically, to a neonatal intelligent identity recognition system based on voice recognition. Background Art

[0002] In the medical field, neonatal identity recognition is of great importance. Currently, the adopted methods include traditional bracelet identification, ankle bracelet identification, etc., which can, to a certain extent, initially distinguish the identities of newborns and help medical staff identify the identities of newborns in daily care, examinations, treatments, etc. Currently, bracelet and ankle bracelet identifications are prone to being damaged, falling off, or becoming unclear due to reasons such as neonatal activities, sweating, bathing, etc., resulting in difficult identity recognition. Moreover, these identifications mainly rely on manual visual recognition. When medical staff are busy and nervous at work, misreading and misjudgment are extremely likely to occur, thereby increasing the risk of safety accidents such as taking the wrong newborn, seriously threatening the safety of newborns, and running counter to the purpose of accurately identifying the identities of newborns. In order to reduce this situation, a neonatal intelligent identity recognition system based on voice recognition is proposed. Summary of the Invention

[0003] The purpose of the present invention is to provide a neonatal intelligent identity recognition system based on voice recognition to solve the problems raised in the above background art.

[0004] To achieve the above purpose, a neonatal intelligent identity recognition system based on voice recognition is provided, including an audio database establishment unit, an audio age calculation unit, a neonatal audio prediction unit, a prediction error analysis unit, and an audio identity recognition unit. The audio database establishment unit is used to collect historical audio data of newborns, set a unique identity tag for each newborn, and establish an audio database. The audio age calculation unit is used to obtain the birth date of each newborn, and at the same time obtain the acquisition date of each piece of historical audio data, and calculate the neonatal age for the historical audio data by combining the birth date and the acquisition date. The neonatal audio prediction unit is used to perform status recognition on the historical audio data of each newborn, obtain the status data corresponding to each piece of historical audio data, then extract the historical audio data with the same status data for audio change rate analysis, and predict the audio data of the newborn according to the audio change rate in combination with the historical audio data and the real-time date. The prediction error analysis unit is used to calculate the non-update time for the latest historical audio data and the real-time date of each newborn, and then perform different status error range analysis by combining the non-update time with the average audio change rate of the newborn at different ages. The audio identity recognition unit is used to obtain the audio data to be recognized, perform status recognition on the audio data to be recognized, extract the predicted audio data of the same status of the stored newborns according to the recognition result, compare it in combination with the error range, and perform newborn identity recognition on the audio data to be recognized according to the comparison result.

[0005] As a further improvement of this technical solution, the audio database establishment unit includes an audio collection module and an audio distribution module; The audio collection module is used to collect the historical audio data of newborns, obtain the identity information of newborns at the same time, and set a unique identity label for each newborn according to the identity information; The audio distribution module is used to match the collected historical audio data according to the data source and the newborns, match each piece of historical audio data to the corresponding newborns, and then establish an audio database according to the historical audio data corresponding to each newborn.

[0006] As a further improvement of this technical solution, during the process of collecting historical audio data by the audio collection module, the historical audio data is first preprocessed to remove background noise, and then the continuous audio signal in the audio data is segmented into small audio segments.

[0007] As a further improvement of this technical solution, the audio age calculation unit includes a date acquisition module and an age calculation module; The date acquisition module is used to obtain the birth date of each newborn in the audio database according to the identity information of the newborns, and obtain the acquisition date of each piece of historical audio data at the same time; The age calculation module is used to calculate the difference between the birth date of the newborn and the acquisition date of the historical audio data, so as to obtain the difference time between the date and the birth date, and then use the difference time as the age of the newborn corresponding to the historical audio data.

[0008] As a further improvement of this technical solution, the newborn audio prediction unit includes a status recognition module, an audio change module, and an audio prediction module; The status recognition module is used to perform status recognition on the historical audio data corresponding to each newborn, obtain the status data corresponding to each piece of historical audio data, and classify the historical audio data of each newborn according to the status data; The audio change module is used to extract the historical audio data of the same status data for the newborns in the audio database, then sort the historical audio data according to the corresponding newborn age, and then perform audio change rate analysis on the sorted historical audio data of each status data to obtain the audio change rate of different status data in the different age differences of each newborn; The audio prediction module is used to combine the audio change rate of different state data corresponding to each newborn and the historical audio data with the real-time date for audio data prediction, so as to obtain the predicted audio data corresponding to each newborn.

[0009] As a further improvement of this technical solution, during the prediction process, the audio prediction module performs predictions for different states, so that the predicted audio data includes the predicted audio corresponding to the newborn under different state data.

[0010] As a further improvement of this technical solution, the steps for the audio prediction module to obtain the predicted audio data corresponding to each newborn are as follows: ; where A st，j is the predicted audio of the j-th state data at the real-time, Δz is the audio change rate, LSTM is the time series prediction model, z t ,z t-1 ,z t-2 ,...,z t-n is the historical audio data corresponding to the newborn, n ∈ [0, +∞) and is an integer, D st is the real-time.

[0011] As a further improvement of this technical solution, the prediction error analysis unit includes a time difference module and a range analysis module; The time difference module is used to extract the latest historical audio data of each newborn closest to the real-time date, and at the same time calculate the difference time by combining the acquisition time of the latest historical audio data with the real-time date, so as to obtain the unupdated time corresponding to each newborn; The range analysis module is used to analyze the error range of different states by combining the unupdated time of each newborn with the average audio change rate of different ages, so as to obtain the error range corresponding to the predicted audio data of each newborn in different states; The longer the unupdated time, the larger the error range; The shorter the unupdated time, the smaller the error range.

[0012] As a further improvement of this technical solution, the audio identity recognition unit includes a state determination module and an identity determination module; The state determination module is used to obtain the audio data to be recognized, and then perform state recognition on the audio data to be recognized, so as to obtain the state data corresponding to the newborn in the audio data to be recognized; The identity determination module is used to extract the predicted audio data of the same state data according to the state data obtained by the state determination module, and combine it with the audio data to be recognized for similarity comparison, so as to obtain the similarity between each predicted audio data and the audio data to be recognized; The audio difference between the predicted audio data with the highest similarity value and the audio data to be identified is obtained, and the audio difference is compared with the corresponding error range. When the audio difference exceeds the error range, the audio data to be identified is sent to the audio database as a new newborn for identity setting. Conversely, when the audio difference does not exceed the error range, it is determined that the audio data to be identified and the predicted audio data are the same newborn.

[0013] Compared with the prior art, the present invention has the following beneficial effects: In the intelligent newborn identity recognition system based on voice recognition, after the audio data to be recognized enters the system, the state determination module recognizes the state, the identity determination module compares the similarity between the predicted audio data and the audio data to be recognized, and judges the identity in combination with the error range. In an environment with complex personnel flow such as a hospital, the identity of the newborn can be quickly and accurately identified to prevent safety accidents such as wrong holding. At the same time, the error range is calculated based on the non-updated time and the average audio change rate. The longer the non-updated time is, the larger the error range is, and vice versa. This dynamic adjustment mechanism makes identity recognition more flexible and accurate, and adapts to the changes in the audio characteristics of newborns over time. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is the overall structural principle diagram of the present invention.

[0015] The meaning of each number in the figure is: 10. Audio database establishment unit; 20. Audio age calculation unit 30. Newborn audio prediction unit; 40. Prediction error analysis unit; 50. Audio identity recognition unit. DETAILED DESCRIPTION

[0016] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0017] See also Figure 1 As shown, the purpose of this embodiment is to provide a newborn intelligent identity recognition system based on speech recognition, including an audio database establishment unit 10, an audio age calculation unit 20, a newborn audio prediction unit 30, a prediction error analysis unit 40 and an audio identity recognition unit 50; The audio database establishment unit 10 is used to collect historical audio data of newborns, set a unique identity tag for each newborn, and establish an audio database; The audio database building unit 10 includes an audio collection module and an audio distribution module; The audio collection module is used to collect the historical audio data of newborns, and at the same time obtain the identity information of the newborns, and set a unique identity tag for each newborn according to the identity information; Deploy 4 - 8 microphone arrays in the newborn care area to form a spatial coverage network, and synchronously record audio at a sampling rate of 44.1 kHz and a bit depth of 16 bits, so as to obtain the historical audio data of each newborn; Obtain the basic information of the newborns (name and date of birth) from the hospital HIS system, and generate a unique identifier through the hash algorithm.

[0018] During the process of collecting historical audio data, the audio collection module first pre - processes the historical audio data to remove background noise, and then divides the continuous audio signal in the audio data into small audio segments.

[0019] The audio distribution module is used to match the collected historical audio data with the newborns according to the data source (newborn source), match each segment of historical audio data with the corresponding newborn, and then establish an audio database according to the historical audio data corresponding to each newborn.

[0020] The audio age calculation unit 20 is used to obtain the date of birth of each newborn, and at the same time obtain the acquisition date of each segment of historical audio data, and calculate the age of the newborn for the historical audio data by combining the date of birth and the acquisition date; The audio age calculation unit 20 includes a date acquisition module and an age calculation module; The date acquisition module is used to obtain the date of birth of each newborn in the audio database according to the identity information of the newborn, and at the same time obtain the acquisition date of each segment of historical audio data; Extract the date of birth from the identity information of the newborn, which can retrieve the date of birth of each newborn from the database; Similarly, extract the acquisition date of each segment of historical audio data from the audio database. Each segment of audio has a different timestamp, indicating the date when they were collected or recorded; The age calculation module is used to calculate the difference between the date of birth of the newborn and the acquisition date of the historical audio data, so as to obtain the difference time between the date and the date of birth, and then use the difference time as the age of the newborn corresponding to the historical audio data.

[0021] The age of the newborn = the acquisition date of the audio data - the date of birth of the newborn; Store the calculated difference time as the age annotation of the historical audio data, indicating the age of the newborn corresponding to the audio data at the time of recording.

[0022] The neonatal audio prediction unit 30 is used to identify the status of the historical audio data of each neonate, obtain the status data corresponding to each type of historical audio data, then extract the historical audio data with the same status data for audio change rate analysis, and predict the audio data of the neonate based on the audio change rate in combination with the historical audio data and the real-time date; The neonatal audio prediction unit 30 includes a status recognition module, an audio change module, and an audio prediction module; The status recognition module is used to identify the status of the historical audio data corresponding to each neonate, obtain the status data corresponding to each segment of historical audio data, and classify the historical audio data of each neonate according to the status data. The specific steps are as follows: Status recognition: The status in audio data usually refers to the specific "status" represented by the characteristics of the audio, including emotional status (pain, hunger, sleepiness, etc.), physiological status (whether the neonate is in a wakeful, sleeping, or crying state); Feature extraction: To perform status recognition, features need to be extracted from the audio data. These features can help identify the status of the audio, including Mel Frequency Cepstral Coefficients (used to describe the frequency characteristics of the audio, widely used in speech recognition and sentiment analysis), zero-crossing rate (describing the number of zeros in the signal waveform, which can reflect the "roughness" of the sound), spectral centroid (describing the brightness perception of the audio signal), pitch, tone, and volume change; Status classification: Based on the above features, a machine learning model can be used to perform status recognition. The process is as follows: Step 1, label the audio data of each neonate together with the corresponding status labels to form a training data set. For example, label whether the audio represents crying, wakefulness, or other physiological states; Step 2, extract features from the audio (such as MFCC, zero-crossing rate, etc.). If the feature dimension is too high, dimensionality reduction methods (such as PCA, LDA, etc.) can be used to reduce the complexity of the feature space; Step 3, use a machine learning algorithm (neural network) to classify the status. The input of the model is the features extracted from the audio data, and the output is the corresponding status label; Step 4, use the cross-validation method to evaluate the performance of the model to ensure classification accuracy; Status classification for each neonate: Process the audio data of each neonate, extract features, and use the trained model to classify the status of the audio data. Each audio segment will be assigned a status label, such as: crying, quiet, hungry, wakeful, etc. Then store the audio data of each neonate and the corresponding status labels in the database for subsequent query and analysis.

[0023] The audio change module is used to extract historical audio data of the same status data for newborns in the audio database, then sort the historical audio data according to the corresponding ages of the newborns, and then analyze the audio change rate of the sorted historical audio data for each status data to obtain the audio change rate of different status data in different age differences of each newborn. The specific steps are as follows: Extract historical audio data of the same status data: Extract all audio data from the database according to the identity information of the newborns, screen the data according to the status labels of each audio (such as "crying", "quiet", "hungry", etc.), and then group and store the audio data according to their status (such as "crying"); Sort the audio data according to the age of the newborns: For each audio data, calculate the age of the newborn, sort the historical audio data according to the age of the newborns, and arrange them in ascending order of age; Audio change rate analysis: After sorting the data of each status, next analyze the audio change rate of the status data of each newborn in different age stages. The formula is as follows: ; Among them, Δz is the audio change rate, t is the timestamp, z t is the historical audio data at time t, z t-1 is the historical audio data at time t - 1; For each newborn, perform audio change rate analysis on all status data (such as emotions, languages, etc.).

[0024] The audio prediction module is used to combine the audio change rate of different status data corresponding to each newborn and the historical audio data with the real-time date for audio data prediction, so as to obtain the predicted audio data corresponding to each newborn.

[0025] During the prediction process, the audio prediction module performs predictions on different statuses, so that the predicted audio data includes the predicted audio corresponding to different status data of the newborn. The specific formula is as follows: ; Among them, A st，j is the predicted audio of the jth status data at the real-time time, LSTM is a time series prediction model (long short-term memory network), z t , z t-1 , z t-2 ,..., z t-n are the historical audio data corresponding to the newborn, n ∈ [0, +∞) and is an integer, D st is the real-time time.

[0026] The prediction error analysis unit 40 is used to calculate the unupdated time for the latest historical audio data and the real-time date of each newborn, and then analyze the error range of different states by combining the unupdated time with the average audio change rate of the newborn at different ages; The prediction error analysis unit 40 includes a time difference module and a range analysis module; The time difference module is used to extract the latest historical audio data of each newborn closest to the real-time date, and at the same time calculate the difference time by combining the acquisition time of the latest historical audio data with the real-time date, so as to obtain the unupdated time corresponding to each newborn; The unupdated time refers to the time difference from the time when the last audio data of the newborn was obtained to the current date. The larger this time difference is, the older the update time of the audio data is.

[0027] The range analysis module is used to analyze the error range of different states by combining the unupdated time of each newborn with the average audio change rate of different ages, so as to obtain the error range corresponding to the predicted audio data of each newborn in different states; When the unupdated time is longer, the error range is larger; When the unupdated time is shorter, the error range is smaller. The specific formula is as follows: ; where E is the error range, representing the prediction error of the audio data, and R avg (Δz) is the average audio change rate of different ages, and T wg is the unupdated time; The unupdated time T wg The longer it is, the larger the error range E is, because the audio change rate may change over time.

[0028] The audio identity recognition unit 50 is used to obtain the audio data to be recognized, perform state recognition on the audio data to be recognized, extract the predicted audio data of the same state of the stored newborn according to the recognition result and combine it with the error range for comparison, and perform newborn identity recognition on the audio data to be recognized according to the comparison result.

[0029] The audio identity recognition unit 50 includes a state determination module and an identity determination module; The state determination module is used to obtain the audio data to be recognized, and then perform state recognition on the audio data to be recognized (using the same steps as above for state recognition), so as to obtain the state data corresponding to the newborn in the audio data to be recognized.

[0030] The identity determination module is used to extract the predicted audio data of the same status data according to the status data obtained by the status determination module, combine it with the audio data to be recognized, and perform a similarity comparison to obtain the similarity between each piece of predicted audio data and the audio data to be recognized (using similarity metrics such as cosine similarity, Euclidean distance, etc.). The specific steps for comparing the similarity between the audio data to be recognized and the predicted audio data are as follows: ; Among them, C(Z st , A st，j ) is the similarity between the predicted audio data and the audio data to be recognized, Z st is the audio data to be recognized, 〈Z st , A st，j 〉 is the dot product of the vectors Z st and A st，j , and ||Z st || and ||A st，j || represent the L2 norms of the vectors Z st and A st，j .

[0031] By calculating the similarity, the matching degree between the audio data to be recognized and the predicted audio is obtained, and then it is judged whether they are similar.

[0032] Obtain the audio difference between the predicted audio data with the highest similarity value and the audio data to be recognized, and compare the audio difference with the corresponding error range. When the audio difference exceeds the error range, the audio data to be recognized is sent to the audio database as a new newborn for identity setting. Conversely, when the audio difference does not exceed the error range, it is judged that the audio data to be recognized and the predicted audio data are the same newborn.

[0033] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and the descriptions in the specification are only preferred examples of the present invention and are not used to limit the present invention. Without departing from the spirit and scope of the present invention, the present invention will have various changes and improvements, and these changes and improvements all fall within the scope of the present invention claimed. The scope of protection claimed by the present invention is defined by the appended claims and their equivalents.

Claims

1. A neonatal intelligent identity recognition system based on speech recognition, characterized in that: It includes an audio database establishment unit (10), an audio age calculation unit (20), a neonatal audio prediction unit (30), a prediction error analysis unit (40), and an audio identity recognition unit (50); The audio database establishment unit (10) is used to collect the historical audio data of newborns, set a unique identity tag for each newborn, and establish an audio database; The audio age calculation unit (20) is used to obtain the birth date of each newborn, and at the same time obtain the acquisition date of each piece of historical audio data, and calculate the age of the newborn for the historical audio data by combining the birth date and the acquisition date; The neonatal audio prediction unit (30) is used to perform status recognition on the historical audio data of each newborn, obtain the status data corresponding to each piece of historical audio data, then extract the historical audio data with the same status data for audio change rate analysis, and predict the audio data of the newborn according to the audio change rate, the historical audio data, and the real-time date; The prediction error analysis unit (40) is used to calculate the non-update time for the latest historical audio data and the real-time date of each newborn, and then analyze the error range of different statuses by combining the non-update time with the average audio change rate of the newborn at different ages; The audio identity recognition unit (50) is used to obtain the audio data to be recognized, perform status recognition on the audio data to be recognized, extract the predicted audio data of the existing newborns with the same status according to the recognition result, combine the error range for comparison, and perform neonatal identity recognition on the audio data to be recognized according to the comparison result.

2. The neonatal intelligent identity recognition system based on voice recognition according to claim 1, characterized in that: The audio database establishment unit (10) includes an audio collection module and an audio allocation module; The audio collection module is used to collect the historical audio data of newborns, obtain the identity information of the newborns at the same time, and set a unique identity tag for each newborn according to the identity information; The audio allocation module is used to match the collected historical audio data according to the data source and the newborns, match each piece of historical audio data with the corresponding newborn, and then establish an audio database according to the historical audio data corresponding to each newborn.

3. The neonatal intelligent identity recognition system based on speech recognition according to claim 2, wherein: During the process of collecting historical audio data, the audio collection module first preprocesses the historical audio data to remove background noise, and then divides the continuous audio signal in the audio data into small audio segments.

4. The neonatal intelligent identity recognition system based on speech recognition according to claim 1, characterized in that: The audio age calculation unit (20) includes a date acquisition module and an age calculation module; The date acquisition module is used to obtain the birth date of each newborn in the audio database according to the identity information of the newborn, and at the same time obtain the acquisition date of each piece of historical audio data; The age calculation module is used to calculate the difference between the birth date of the newborn and the acquisition date of the historical audio data, so as to obtain the difference time between the date and the birth date, and then use the difference time as the age of the newborn corresponding to the historical audio data.

5. The neonatal intelligent identity recognition system based on voice recognition according to claim 1, characterized in that: The neonatal audio prediction unit (30) includes a status recognition module, an audio change module, and an audio prediction module; The state recognition module is used to recognize the state of the historical audio data corresponding to each newborn, obtain the state data corresponding to each segment of historical audio data, and classify the historical audio data of each newborn according to the state data; The audio change module is used to extract the historical audio data with the same state data for the newborns in the audio database, then sort the historical audio data according to the age of the corresponding newborns, and then perform an audio change rate analysis on the sorted historical audio data of each state data to obtain the audio change rate of different state data in the different age differences of each newborn; The audio prediction module is used to combine the audio change rates of different state data corresponding to each newborn and the historical audio data with the real-time date for audio data prediction, so as to obtain the predicted audio data corresponding to each newborn.

6. The neonatal intelligent identity recognition system based on voice recognition according to claim 5, characterized in that: During the prediction process, the audio prediction module performs predictions on different states, so that the predicted audio data includes the predicted audio corresponding to different state data of the newborn.

7. The neonatal intelligent identity recognition system based on speech recognition according to claim 5, characterized in that: The steps for the audio prediction module to obtain the predicted audio data corresponding to each newborn are as follows: ； Among them, A st，j is the predicted audio of the j-th state data at the real-time, Δz is the audio change rate, LSTM is the time series prediction model, z t , z t-1 , z t-2 ,..., z t-n are the historical audio data corresponding to the newborn, n ∈ [0, +∞) and is an integer, D st is the real-time.

8. The neonatal intelligent identity recognition system based on speech recognition according to claim 1, characterized in that: The prediction error analysis unit (40) includes a time difference module and a range analysis module; The time difference module is used to extract the latest historical audio data of each newborn closest to the real-time date, and at the same time calculate the difference time by combining the acquisition time of the latest historical audio data with the real-time date, so as to obtain the unupdated time corresponding to each newborn; The range analysis module is used to perform an analysis of the error range of the predicted audio data in different states by combining the unupdated time of each newborn with the average audio change rate of different ages, so as to obtain the error range corresponding to the predicted audio data in different states of each newborn; The longer the unupdated time, the larger the error range; The shorter the unupdated time, the smaller the error range.

9. The neonatal intelligent identity recognition system based on voice recognition according to claim 1, characterized in that: The audio identity recognition unit (50) includes a state determination module and an identity determination module; The state determination module is used to obtain the audio data to be recognized, and then perform state recognition on the audio data to be recognized, so as to obtain the state data corresponding to the newborn in the audio data to be recognized; The identity determination module is used to extract the predicted audio data with the same state data according to the state data obtained by the state determination module, combine it with the audio data to be recognized for similarity comparison, and obtain the similarity between each segment of predicted audio data and the audio data to be recognized; Obtain the audio difference between the predicted audio data with the highest similarity value and the audio data to be recognized, and compare the audio difference with the corresponding error range. When the audio difference exceeds the error range, send the audio data to be recognized as a new newborn to the audio database for identity setting. On the contrary, when the audio difference does not exceed the error range, it is determined that the audio data to be recognized and the predicted audio data are the same newborn.

Images