Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

428 results about "Speech rate" patented technology

Automated video generation

Disclosed systems and methods convert user-supplied textual content into animated videos. Textual input is received and processed to identify narrative elements such as characters, settings, and events. These elements are then transformed into visual scene components. Still images generated based on these components are subsequently animated in line with the narrative context. The system can automatically implement storytelling techniques adapted to incorporate neuroscience principles. The system also synthesizes speech for dialogues or narrations using voice synthesis technology that considers emotional markers, tone, and pace. Generated media and metadata are stored in a data storage system that maintains data integrity and enables efficient retrieval. Users can interact with an export interface to choose video resolution, format, and sharing options. A feedback system employing machine learning algorithms collects and analyzes user feedback for real-time adjustments to the generated animated video.
Owner:RIVERS DORINE

Robot anthropomorphic interaction method based on multi-modal emotion recognition and customized portrait generation

The invention discloses a robot anthropomorphic interaction method based on multi-modal emotion recognition and customized portrait generation. The method comprises the following steps: S1, dynamically fusing multi-modal emotions; the method comprises the following steps: S1, synchronously acquiring voice, visual and text signals through a multi-source heterogeneous sensor, capturing a user voice stream by a high-fidelity microphone array, and extracting acoustic characteristics such as intonation and speed, S2, performing cross-modal reasoning; s3, synchronously generating contents; step S4: style migration; step S5, anthropomorphic voice and expression generation; according to the method, man-machine interaction emotion is analyzed and generated by utilizing a large language model and multi-modal information fusion, the singleness of interaction emotion and the deficiency of emotional sharing ability are avoided, a strong emotion interaction characteristic is achieved, the image of the robot is obtained through a generative technology and can be migrated to any image, the limitation that a specific image is independently made is broken through, and the interaction effect of the robot is improved. The advantage that one robot can be suitable for different scenes is achieved.
Owner:JIANGSU YUNMU ZHIZAO TECH CO LTD

Virtual digital human interaction system based on AI

The invention provides an AI-based virtual digital human interaction system, and relates to the technical field of data processing, and the system is used for obtaining a user feature data set by performing feature extraction on an interaction data set, calculating an audio change rate and speech speed stability, obtaining speech emotion data, calculating syntactic complexity and counting the number of emotion words. Calculating a facial expression symmetry degree; obtaining facial emotion data; calculating body stability and identifying a visual staying area; obtaining attention state data; adjusting tone and speed of the virtual digital person according to the virtual digital person text, optimizing sentence pattern complexity and sentiment words in the virtual digital person text, adjusting changes of eyes, eyebrows and mouth corners of the virtual digital person, and adjusting information display sequence and visual focus guidance. According to the method, the interaction efficiency of the virtual digital human is improved by analyzing the facial expressions and the body actions of the user.
Owner:GANSU YUSU TECH DEV CO LTD

Intelligent accompanying human-type robot based on multi-modal emotion interaction and sensing method

The invention relates to the technical field of robot perception, in particular to an intelligent accompanying human-type robot based on multi-mode emotion interaction and a perception method, and the method comprises the following steps: collecting facial expression and body posture data of a user through a visual perception unit, collecting intonation, speed, volume and keyword data through a voice perception unit, and carrying out the recognition of the speech, speed, volume and keyword data; data preprocessing and feature extraction are carried out; secondly, carrying out time sequence modeling on the extracted visual and voice features based on a recurrent neural network, and generating visual and voice time sequence feature vectors; the method comprises the steps that firstly, time sequence features are extracted, then, a multi-mode fusion model based on an attention mechanism is adopted, the time sequence features are fused into a comprehensive emotion feature vector used for emotion state classification, and finally, personalized interaction content such as voice, expressions and limb actions matched with the emotion state of a user is generated according to an emotion classification result. According to the method, the accuracy of robot emotion perception and the naturalness of man-machine interaction are remarkably improved, and the method is suitable for multi-scene application of education, medical treatment, old-age care and the like.
Owner:BEIJING HAIBAICHUAN TECH CO LTD

AI-driven personalized voice training and pronunciation correction system

The invention provides an AI-driven personalized voice training and pronunciation correction system. The system firstly collects original voice data of a user in a voice training process, and extracts multi-dimensional voice feature vectors including pitch, speed, intonation, formant parameters and corresponding texts; based on the feature vector, recognizing a context tag where the current voice is located, and constructing a pronunciation feature vector of the user; the system further calls a standard pronunciation database according to the context tag, generates a target pronunciation feature vector under the corresponding context, and performs multi-dimensional comparison on the user pronunciation and the target pronunciation to obtain a difference parameter set containing pronunciation parts, speed and emotional differences; finally, the system generates correction suggestions including pronunciation action guidance, intonation adjustment prompts and semantic emotion enhancement instructions, and receives user feedback information to improve the personalized training effect; according to the invention, accurate pronunciation correction under context perception can be realized, and the personalized and intelligent level of voice training is enhanced.
Owner:GUANGZHOU SENJI SOFTWARE TECH CO LTD

Speech synthesis method and device based on hierarchical emotion distribution, equipment and medium

ActiveCN119207372AImprove naturalnessImprove emotional expressionSpeech synthesisSpeech rateTime domain
The invention relates to the technical field of artificial intelligence, and discloses a speech synthesis method based on hierarchical emotional distribution, which comprises the following steps: acquiring audio data and text transcription, segmenting audio into phoneme, word and sentence-level speech units, extracting acoustic characteristics such as pitch, speed and rhythm, generating an emotional distribution vector by using a pre-training model; the method comprises the following steps: processing text transcription to generate text embedded information, combining an emotion distribution vector, the text embedded information and acoustic features, generating rhythm features through a variable converter, generating a Mel-frequency spectrogram by a decoder based on the rhythm features, and converting the Mel-frequency spectrogram into a time domain audio signal by a vocoder and outputting the time domain audio signal. According to the method, the audio data are hierarchically segmented into phonemes, words and sentences, the acoustic features, the emotion distribution vectors and the text embedding information are combined, and the rhythm features are generated through the variable converter, so that fine control over emotion expression is achieved, and the naturalness and emotion expressive force of speech synthesis are remarkably improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Telephone answering system based on AI

The invention discloses an AI-based telephone answering system, and relates to the technical field of telephone answering. Comprising a real-time voice acquisition and preprocessing module, a voice speed detection and prediction module, a self-adaptive ASR dynamic regulation and control module, a refined voice slicing and decoding module, a keyword detection and voice recognition module, a semantic understanding and intention analysis module and an emergency response and scheduling module. And the real-time voice acquisition and preprocessing module is used for acquiring user voice data of the emergency call in real time, establishing a real-time audio stream transmission channel and quickly preprocessing the acquired audio signal. According to the method, the voice features of the user at the high speed are quickly and accurately captured, and the voice segmentation length of the ASR engine is dynamically adjusted, so that each voice segment is clearer and more accurate, cross-segmentation vocabulary segmentation and recognition errors caused by too high speed are avoided, and the user experience is improved. Therefore, omission and misjudgment risks of the emergency information of the user are effectively avoided in an emergency help-seeking scene.
Owner:SHANDONG ZHIQUN INFORMATION TECH CO LTD

Digital human voice generation system based on large language model

The invention relates to the technical field of data processing, and particularly discloses a digital human voice generation system based on a large language model, which is used for solving the existing problems and comprises a semantic analysis module, a voice generation module, a multi-mode synchronization module, a data transmission module and a user feedback module, the semantic analysis module performs semantic analysis and sentiment analysis on voice and text data input by a user by using a large language model, extracts voice information and sentiment metadata for describing context, and dynamically constructs a semantic structure and a sentiment label adaptive to an education scene according to input content based on a metadata automatic derivation technology; through the dynamic time warping algorithm and the educational knowledge graph, semantic and emotion changes are accurately captured, the speech speed and tone are flexibly adjusted, and the naturalness of digital human speech generation and the adaptability of educational scenes are improved.
Owner:YANTAI SEA OF ELECTRONICS SCI & TECH COMPANY +1

Transform speech recognition method, system and device based on multi-modal audio-visual fusion and medium

The invention discloses a transformer speech recognition method, system and device based on multi-modal audio-visual fusion and a medium, and the method comprises the steps: obtaining audio and video data to be processed, the audio and video data comprising paired audio data and video data; extracting audio data features to obtain audio features; extracting video data features to obtain video features; inputting the extracted audio features and the extracted video features into a Transform model, and outputting predicted text information; and the Transform model comprises an encoder, a decoder and a hybrid CTC / attention (China Table Control Code / Attention). According to the method, after an original signal is converted into a feature vector which can be processed by a Transform model, information of audio and video modalities is integrated, and dynamic weight distribution is applied to balance information contribution among different modalities; according to the method, the conversion from voice to text is realized by utilizing an encoder and decoder structure, and meanwhile, the dependency relationship among positions in an input sequence is captured by virtue of a multi-head self-attention mechanism, so that the problem that the expression of voice recognition in a complex environment is limited by noise, accent and speech speed is solved.
Owner:XIJING UNIV

Voice emotion recognition method, device and equipment and readable storage medium

The invention relates to the technical field of voice signal processing, and discloses a voice emotion recognition method, device and equipment and a readable storage medium, and the voice emotion recognition method comprises the steps: obtaining a target voice signal, and executing sampling processing to obtain voice sampling data; extracting a plurality of acoustic features based on the voice sampling data, and constructing initial feature representation; in combination with environment signal-to-noise ratio information, performing channel weighted fusion processing to generate fusion feature representation; inputting the fusion feature representation into a time sequence modeling network, and extracting context information to obtain time sequence abstract features; and executing emotion recognition processing based on the time sequence abstract features to generate a corresponding emotion recognition result. According to the method, the emotion recognition accuracy in a multi-noise environment is improved, the expression ability of fine-grained emotion features such as speech speed changes and rhythm fluctuations is enhanced, the dynamic adaptability to environment changes in the feature fusion process is achieved, and higher recognition stability and environment adaptability are achieved.
Owner:ULTIMATE IOT (HENAN) TECHNOLOGY LTD +1

Video dubbing system and method, electronic equipment and storage medium

The invention provides a video dubbing system and method, electronic equipment and a storage medium. The system comprises a video separation module, a human voice separation module, a voice transcription module, a text translation module, a dubbing module and an audio and video synthesis module. Performing audio-video separation on the audio-video to be dubbed through a video separation module to obtain an original video and an original audio; and separating the original audio based on the human voice separation module to obtain a to-be-dubbed human voice audio and a background audio. And then, based on a voice transcription and translation module, obtaining a translated text segment, and carrying out dubbing and speech speed adjustment on the translated text segment to realize audio and video synthesis. According to the system provided by the embodiment of the invention, the audio and video separation module, the human voice separation module, the voice transfer module, the text translation module, the dubbing module and the audio and video synthesis module are integrated into the video dubbing system, so that the automatic processing of the whole film and television dubbing process is realized, and the dubbing production efficiency and quality are greatly improved; and the labor cost is reduced.
Owner:IOL WUHAN INFORMATION TECH CO LTD

Travel emergency state judgment method and device based on semantic analysis and storage medium

The invention discloses a travel emergency state judgment method and device based on semantic analysis and a storage medium, and relates to the technical field of classification models. Comprising the following steps: extracting speech characteristic parameters such as speech speed, volume, speech signal spectrum entropy and the like by collecting speech data of an independent user with known emotion and target intention, and calculating a speech judgment coefficient; and based on the voice text data, performing voice recognition by using a knowledge perception network model, and generating a danger feature comprehensive vector. And using the vector to train a neural network model, taking the danger feature comprehensive vector as input, and predicting a corresponding emotion and a target intention. And monitoring voice data of the independent user in real time, obtaining a corresponding danger feature comprehensive vector, calculating a comprehensive emergency state judgment index by combining the voice judgment coefficient and the environment data, comparing the index with a risk threshold value, and outputting an emergency state instruction. The method can effectively predict the emergency situation of the user in travel, and provides support for safety emergency.
Owner:HEFEI UNIV

Audio-driven facial animation with adaptive speech rate

In various examples, a technique for audio-driven facial animation with adaptive speech includes determining that a rate of speech associated with an audio segment exceeds a threshold. The technique also includes based at least on the rate of speech exceeding the threshold, upsampling a first set of features associated with the audio segment into a second set of features that is different in size than the first set of features. The technique further includes generating, using one or more machine learning models and based at least on at least a subset of the second set of features, a facial animation output corresponding to the audio segment.
Owner:NVIDIA CORP

Speech cloning system and method fusing rhythm characteristics

The invention discloses a voice cloning system and method fusing rhythm characteristics, belongs to the technical field of voice synthesis and natural language, and is applied to the aspect of fine-grained rhythm control in zero-sample voice synthesis. The implementation method comprises the following steps of: 1, extracting rhythm features and audio features of an audio file, and further respectively acquiring pause features, speed features and tone features in the rhythm features by sequentially adopting transcriptional text inverse coding, syllable-level speed registration quantization and pitch sequence feature splicing modes; 2, fusing the features of the audio files in a manner of discarding feature screening without guidance of a classifier; 3, generating a target Mel spectrogram based on conditional flow matching; generating a target audio file from a to-be-cloned audio file through the trained voice cloning model controlled by the fusion rhythm; compared with the prior art, fine-grained rhythm control of tone and rhythm feature decoupling is realized in zero-sample speech synthesis, so that intonation accuracy based on a context scene is improved.
Owner:BEIJING INST OF TECH

Spoken language pronunciation training correction system based on intelligent equipment

The invention belongs to the technical field of intelligent voice processing, and particularly relates to a spoken language pronunciation training and correcting system based on intelligent equipment, which acquires a user rhythm feature set including pitch change rate, accent intensity, pause duration and intonation contour by acquiring spoken language audio data sent by a user for a target text, and corrects the spoken language pronunciation training and correcting system. The method comprises the following steps: acquiring spoken language audio data, converting the spoken language audio data into a phoneme sequence aligned with target text time, generating a rhythm deviation degree report according to comparison evaluation of a user rhythm feature set and the phoneme sequence, an execution intonation mode, accent distribution, speech stream sound change and speech speed rhythm, and determining the rhythm deviation degree according to a rhythm problem type in the report in combination with user historical learning data. And forming and outputting a correction scheme including a text prompt, a targeted minimum contrast training unit and a listen-and-read simulation task, solving the problem of weak capability of correcting hyper-phoneme in a second language spoken language of an adult, and improving the authentic and fluency of the spoken language, thereby realizing efficient personalized learning.
Owner:HUNAN DIGITAL TECHNOLOGY CO LTD

Call center dialogue sentiment analysis method and system fusing voice and text

The invention provides a call center dialogue sentiment analysis method and system fusing voice and text, and relates to the technical field of voice signal processing, and the method comprises the steps: obtaining a voice signal of a call center and a corresponding transliteration text, extracting intonation, speed, sound intensity and pause sentiment features from the voice signal, meanwhile, deep language analysis is carried out on the transliterated text, and semantic emotion features related to context are extracted; and performing cross-modal correlation analysis on the voice emotion features and the semantic emotion features, and generating a time sequence correction coefficient for feature alignment by constructing a corresponding relation analysis framework between feature sequences. According to the method, language emotion information in voice and text is integrated, more accurate and comprehensive recognition of conversation emotion of the call center is realized, customer satisfaction is improved, and reliable emotion analysis basis is provided for efficiently processing customer appeals.
Owner:SHENZHEN ROADTEL DIGITAL TECH CO LTD

Bath heater switch control method and system based on voice recognition

The invention relates to the technical field of voice recognition, in particular to a bath heater switch control method and system based on voice recognition. The method comprises the following steps: S1, collecting real-time voice when the real-time voice comprises voice in a preset frequency range; s2, acquiring a first curve of the target voice, acquiring a second curve through mean filtering based on the first curve, acquiring a starting time point and an ending time point of the target voice, acquiring voice time periods in the target voice, deleting interval time periods in the voice time periods, and acquiring to-be-recognized voice; s3, extracting voice features and speed of the user, and generating a plurality of reference voices of set control contents; s4, outputting the approximation degree of the to-be-recognized voice and the multiple reference voices through the voice model, and obtaining the recognition result of the to-be-recognized voice; and S5, on-off operation of the bath heater is controlled based on the control content. According to the invention, the problem of low speech recognition precision is solved, and the speech recognition precision is improved.
Owner:JIAXING OUDE HOME FURNISHING CO LTD

Speech translation system based on Bluetooth earphone

The invention discloses a voice translation system based on a Bluetooth headset, which relates to the technical field of voice translation of Bluetooth headsets and comprises a voice acquisition module, a voice speed detection module, a rhythm evaluation module, a voice regulation and control module and a text verification module. The rhythm evaluation module is used for extracting rhythm characteristic information in a user voice signal collected by the Bluetooth earphone in the voice speed fluctuation time period, analyzing the rhythm characteristic information and evaluating the intensity of statement rhythm mutation in user expression in the voice speed fluctuation time period; and the voice regulation and control module is used for selecting and executing a corresponding voice processing strategy according to the evaluation result, and carrying out dynamic regulation and control in the execution process. According to the method, the problem that statement rhythm mutation caused by speech speed fluctuation cannot be dynamically regulated and controlled is solved, intelligent adaptation and whole-process response of a speech processing strategy are realized, structural optimization is performed on a translation result, and translation accuracy and semantic coherence are remarkably improved.
Owner:VISION INTELLIGENCE CO LTD

Voice interaction system and method for customer service based on artificial intelligence

The invention relates to the technical field of voice recognition, in particular to a voice interaction system and method for customer service based on artificial intelligence, and the system comprises a voice input processing module, an intention classification and routing module, a context dynamic adjustment module, a user behavior learning module, a multi-level intention fusion module and a final result module. According to the method, a multi-dimensional feature system is constructed by extracting tone intensity, speech speed frequency and emotional fluctuation amplitude, intention categories, priority weights and confidence scores are generated to realize accurate acquisition of appeals, and dialogue history, context and emotional change dynamic reconstruction path nodes, switching rules and response time sequences are tracked during interaction. Historical behavior mining preference features, habit fusion intention relevance, emergency calculation of an optimal strategy, construction of service steps, resource allocation schemes and execution timelines, adjustment of an interactive interface, a service process and a feedback mechanism according to multi-dimensional analysis, guarantee of differentiated service experience, and improvement of response accuracy and user satisfaction.
Owner:NANJING XIUGUO INTELLIGENT TECH CO LTD

AI-driven video content subtitle synchronous translation method and system

The invention discloses an AI-driven video content subtitle synchronous translation method and system, and relates to the technical field of video subtitle synchronization, the system is combined with a video frame acquisition module and a face and lip action recognition module, and the system can accurately obtain the lip opening and closing vertical distance and opening and closing times of each role. The data are used for calculating the actual speaking speed, and the actual speaking speed is compared with a traditional speed index to obtain a first calibration difference coefficient. According to the method, the timestamps of the subtitles are effectively adjusted, the time deviation caused by the speech speed difference is reduced, the subtitles and the actual speech are more synchronous, and therefore the accuracy of the subtitles and the film watching experience of audiences are improved. The multi-person talking overlapping recognition module can accurately detect and mark the voice overlapping condition. And if the overlapped voice influence factor D exceeds the abnormal threshold F, the system triggers the second correction instruction to further calibrate the subtitle timestamp, so that the synchronization problem caused by voice overlapping is avoided.
Owner:CHONGQING MALYA MEDIA CO LTD

Simultaneous and multimodal rendering of abridged and non-abridged translations

Implementations relate to a multimodal translation application that can provide an abridged version of a translation through an audio interface of a computing device, while simultaneously providing a verbatim textual translation at a display interface of the computing device. The application can provide these different versions of the translation in certain circumstances when, for example, the rate of speech of a person speaking to a user is relatively high compared to a preferred rate of speech of the user. For example, a comparison between phonemes of an original language speech and a translated language speech can be performed to determine whether the ratio satisfies a threshold for providing an audible abridged translation. A determination to provide the abridged translation can additionally or alternatively be based on a determined language of the speaker.
Owner:GOOGLE LLC

Enhanced wireless communication handover management system

To effectively resolve the issue of inappropriate handovers during communication sessions, methods, systems, and machine-readable mediums which utilize speech features captured by microphones in the original wireless peripheral device and / or the wireless peripheral device to which the communication session is to be handed over to determine if a handover should proceed or should be reversed. Speech features refer to the composite attributes of spoken language that encompass both acoustic and linguistic features. Acoustic features characterize the sound properties of speech and include, but are not limited to, timbre, pitch, intonation, speaking rate, articulation, prosody, melody, spectral features, formant frequencies, and the like. Linguistic features pertain to the actual content conveyed, comprising words, phrases, syntax, and semantics. This includes the analysis of words, phrases, syntax, and semantics to understand the context and continuity of the conversation.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Bluetooth earphone AI voice control method and system

The invention relates to the technical field of voice recognition, in particular to a Bluetooth headset AI voice control method and system, and the method comprises the following steps: collecting a voice sample, carrying out the feature extraction of a voice signal through employing a Mel-frequency cepstrum coefficient, and generating voice feature data; and inputting the voice feature data into an acoustic model, and improving the recognition rate of the key instruction words by the acoustic model through learning features to obtain an optimized acoustic model. According to the method, acoustic feature capture is realized through voice signal feature extraction, the recognition accuracy of the key instruction is improved in cooperation with deep learning of acoustic features, the influence of different user speech speeds on the recognition effect is overcome by applying the time alignment technology of voice input, and the stability of the control instruction in different use scenes and speech speed changes is ensured. In addition, the recognition capability of a specific command is further mined and optimized by means of statistical characteristic analysis of voice, and efficient and automatic recognition and extraction of key control commands in continuous speech streams are completed.
Owner:JIANGXI CHANGRONG TECHNOLOGY CO LTD

Facial emotion recognition method and device and storage medium

The invention relates to the technical field of emotion analysis, and particularly discloses a facial emotion recognition method and device and a storage medium, and the method comprises the steps: obtaining audio data and video data, and extracting a facial image from the video data; dividing the facial image into sub-images of different areas, calculating local emotional states of the sub-images, and integrating the local emotional states of all the sub-images to obtain a facial emotional state of the facial image; performing semantic analysis and intonation analysis on the audio data to obtain a voice emotional state; when the facial emotion state is the same as the voice emotion state, the facial emotion state is a result. According to the method, the facial image is divided into different sub-images for recognition, then the recognition results of the sub-images are summarized, the obtained facial emotion is more accurate, then semantic analysis, speech speed analysis and intonation analysis are performed on the audio data to obtain the voice emotion, and then the facial emotion and the voice emotion are compared, so that the accuracy of the facial emotion is ensured.
Owner:ZHE JIANG YUAN YI ZHI NENG KE JI YOU XIAN GONG SI

Intelligent robot speech synthesis method based on deep learning

The invention relates to the technical field of intelligent speech synthesis, and discloses an intelligent robot speech synthesis method based on deep learning, which comprises the following steps: 1, text processing: receiving an input text, and carrying out word segmentation, part-of-speech tagging and phoneme tagging on the text to obtain a text embedding sequence for a subsequent sentiment analysis step; step 2, sentiment analysis: according to the generated text embedding sequence, performing sentiment analysis on the text by using a BERT-based sentiment classification model to obtain text sentiment embedding for multi-modal sentiment fusion; and step 3, receiving visual input, extracting visual emotion embedding through the convolutional neural network, and inputting the visual emotion embedding into multi-modal emotion fusion. Through the deep learning model, voice data can be learned, natural phonemes, intonation and rhythm characteristics in voice can be extracted, a natural and smooth voice synthesis effect is generated, the voice speed, the intonation and the tone quality are close to those of human voice, and the auditory experience of a user is enhanced.
Owner:BEIJING AEROSPACE FLYING EAGLE INTELLIGENT ROBOT TECH CO LTD

Multi-language speech recognition and interaction method of humanoid robot

The invention discloses a multi-language speech recognition and interaction method of a humanoid robot, particularly relates to the technical field of speech recognition and interaction, and effectively separates background noise and target speech signals through a multi-channel high-sensitivity microphone array in combination with an adaptive noise elimination algorithm, thereby improving the speech signal recognition accuracy in a noisy environment and improving the speech recognition efficiency. A speech speed fluctuation abnormal coefficient, an intonation deviation coefficient and a background noise influence coefficient are calculated through deep analysis of speech signals and background noise feature data of a target interaction object, and a sentence segmentation model is adjusted according to habits of speech speeds, intonation, pauses and the like of different speakers, so that the problem of inaccurate sentence segmentation under different users or contexts is avoided; the sentence segmentation adaptation optimization index is generated according to the sentence segmentation adaptation optimization model, whether parameters of the sentence segmentation model need to be adjusted or not is judged by combining a threshold value, real-time response and optimization are achieved, the situation of misjudgment or missed judgment is reduced, and the smoothness and accuracy of overall interaction are improved.
Owner:BEIJING HAIBAICHUAN TECH CO LTD

AI agent personality switching method and device based on NFC identification

The invention relates to the technical field of artificial intelligence and Internet of Things equipment, and discloses an AI (artificial intelligence) agent personality switching method based on NFC (near field communication) identification, which realizes dynamic switching of AI agent personality in a physical mode, and comprises the following steps: S1, an equipment end obtains and decrypts an NFC label signal of an agent; s2, the equipment end obtains an AI virtual role ID corresponding to the intelligent agent according to the decryption information, and sends a request parameter to a cloud server; s3, the cloud server obtains personality configuration of the intelligent agent from a role database of the cloud server according to the request parameters and returns the personality configuration to the equipment end, wherein the personality configuration comprises an image, voice tone, speed, tone, role background, story index information and a knowledge template; and S4, the device side updates and switches the personality state corresponding to the intelligent agent according to the personality configuration, and performs voice interaction with the user according to the current personality state parameter. The invention further discloses an AI agent personality switching device for implementing the AI agent personality switching method.
Owner:SHENZHEN GIEC DIGITAL CO LTD

Teaching quality evaluation method based on teaching robot

The invention discloses a teaching quality evaluation method based on a teaching robot, and relates to the field of artificial intelligence education application, and the method comprises the steps: collecting classroom teaching video data and audio data through a sensor of the teaching robot; performing face recognition according to the classroom teaching video data to obtain student expression data, and performing acoustic feature extraction on the audio data to obtain teacher voice data; sending the student expression data into a pre-trained emotion recognition model to obtain a classroom student attention score, and sending the teacher voice data into a voice evaluation model to obtain a teacher speed score; and establishing a weighted calculation formula based on the classroom student attention score and the teacher speech speed score, and calculating to obtain a classroom teaching quality score. According to the invention, the classroom video and audio data are collected and processed in real time, the student attention score and the teacher speed score are calculated, and weighted fusion is carried out, so that the objective quantitative evaluation of the classroom teaching quality is realized.
Owner:SHANDONG HONGRU SMART EDUCATION TECHNOLOGY CO LTD

Anti-fraud outbound call identification method for cross-number-segment voiceprint tracking

The invention relates to an anti-fraud outbound recognition method for cross-number-segment voiceprint tracking, and the method comprises the steps: introducing a time domain voiceprint adversarial extraction mechanism, and adding an adversarial voice discriminator, an active inhibition device, a channel, and the interference of non-identity factors of language emotion in voiceprint modeling; constructing a speaker constant feature residual channel: taking stable syllable fragments including vowels and gutto vowels in call content as a reference extraction window, and filtering emotion or speech speed driving components; outputting a steady-state voiceprint contour flow as a unique basis for subsequent cross-number identity fusion; designing a dynamic number fusion graph based on the voiceprint steady-state flow; each time of voiceprint appearance is regarded as a single time point node, and all similar historical voiceprints form a serial number merging path; a number time sequence edge weight function is set; the occurrence time interval, the use frequency and the regional jump of the new number and the old number are synthesized, and whether the number belongs to the same user or not is evaluated; and establishing atlas connection between the voiceprint main body node and all number nodes thereof.
Owner:SHIJIAZHUANG LINGYUE TECHNOLOGY CO LTD

Cabin voice interaction method and device and storage medium

The invention discloses a cockpit voice interaction method and device and a storage medium, and belongs to the technical field of vehicle control. The method comprises the steps of collecting sound information of a driver; acquiring a detection result and a control instruction of the elderly driver based on the sound information of the driver, wherein the detection result of the elderly driver is used for indicating whether the driver is an elderly driver; in response to the obtained detection result that the driver is the elderly driver, the vehicle is controlled to start a working mode suitable for the elderly; controlling the vehicle to execute the control instruction; collecting comprehensive noise values inside and outside the vehicle; calculating a broadcast volume and a broadcast speed based on the comprehensive noise value; and broadcasting the execution condition of the control instruction according to the broadcasting volume and the broadcasting speed. The accuracy of instruction recognition and voice broadcast functions of the cabin is improved, voice instructions of old people can be recognized more easily, voice broadcast content can be heard more easily, and therefore driving experience and driving safety are improved.
Owner:CHERY AUTOMOBILE CO LTD