550 results about "Voice assistant" patented technology

The invention discloses an AR glasses control system and method, and belongs to the field of artificial intelligence and AR glasses application, and the method comprises the steps: capturing a user face image, combining a voice assistant, collecting user voiceprint data, and carrying out the matching through a recurrent neural network; constructing a three-dimensional environment model, positioning and marking obstacles and interactive objects, and identifying objects in the environment; the method comprises the following steps of: tracking a gesture, acquiring a key point coordinate by adopting an OpenPose algorithm, identifying a predefined gesture by utilizing a support vector machine, and mapping the gesture into a specific operation instruction; analyzing the user intention based on natural language processing, and calling a corresponding function module according to an analysis result; acquiring a gazing direction of a user by using an eye movement tracking sensor, calculating a screen focus position through an algorithm, and dynamically highlighting options or displaying information according to a gazing point position; through multi-modal data fusion, gestures, voices and fixation point input are analyzed in a unified manner. By accurately understanding the intention of the user, the interaction precision of the AR glasses is improved, and the user experience is optimized.

The invention discloses an intelligent infusion monitoring management system, and relates to the technical field of medical equipment, and the system comprises the steps: collecting patient data, synchronizing the patient data to a central monitoring system through a block chain technology, and generating a personalized infusion scheme; based on a personalized infusion scheme, a medical worker uses a mobile device to carry out identity verification on a patient and obtain medicine information, and a voice assistant function is integrated; the monitoring module is responsible for monitoring vital signs of a patient and the temperature of a ward by using wearable equipment and a temperature sensor, and adjusting a personalized infusion scheme and liquid temperature according to the vital signs and the temperature of the ward; the risk value prediction module is responsible for predicting risk values of blockage and leakage according to the adjusted personalized infusion scheme and the liquid temperature and setting a graded alarm mechanism; patients and family members receive the infusion progress through the intelligent infusion monitor. According to the invention, the block chain technology and the advanced artificial intelligence algorithm are integrated, so that the health data and medicine information of the patient can be efficiently managed and analyzed.

The invention discloses an end-to-end deep counterfeit voice detection system and method, and belongs to the technical field of voice processing. The detection system is divided into a front-end embedded extraction network and a rear-end classification network. And the front-end embedded extraction network adopts a front-end pre-training model to extract global semantic features of different scales of the voice signals, and adopts a feature fusion module to perform deep fusion on the extracted global semantic features of different scales, so that the expression ability of feature embedding is further enhanced. And the rear-end classification network adopts a single-layer long-short-term memory classification network to classify the fusion features, performs joint optimization by using cross entropy loss and center loss, and finally judges whether the voice is real or forged. The method is applied to scenes of voice security, identity authentication, voice assistants and the like, a more accurate and robust deep counterfeit voice detection scheme with good generalization ability can be provided, and the method has important significance for improving the security and credibility of a voice recognition system.

Dialogue state tracking for voice assistants involves correctly tracking intent and entities of a task that a user is performing. A dialogue state, having a tracked intent and one or more tracked entities, can then be used to perform the task. Building a dialogue state tracking system within a voice assistant is not trivial. In some embodiments, a dialogue state tracking system involving one or more large language models can be implemented downstream of a natural language understanding system to produce the tracked intent and the one or more tracked entities. In some embodiments, a dialogue state tracking system involving one or more large language models can be implemented upstream of a natural language understanding system to produce rephrased natural language text, which is in turn processed by the natural language understanding system to produce the tracked intent and the one or more tracked entities.

The invention discloses a multifunctional indoor lighting system based on AI, and provides an intelligent and personalized lighting scheme. The system comprises a human body detection module, a light induction module, an emotion recognition module, a music rhythm module, a central control module, a user interaction module and a communication module. The human body detection module uses an infrared sensor, a camera or a radar to monitor personnel activities in real time and automatically control a light switch. The light sensing module dynamically adjusts the brightness through a photosensitive sensor to ensure optimal illumination; the emotion recognition module analyzes emotion in combination with a camera and an AI algorithm, and automatically adjusts the color and brightness of light; the music rhythm module captures music rhythms through a microphone, so that light changes along with the music rhythms, and atmosphere is created. The central control module integrates sensor data, and utilizes an AI algorithm to accurately adjust the light effect. A user can set a personalized scene through a smart phone APP, a voice assistant or a touch panel. And the communication module adopts a Wi-Fi or 2.4 G wireless technology to realize equipment interconnection and remote control. The system has the advantages of intelligent control, energy conservation, environmental protection, multifunctional integration and the like, is widely suitable for families, offices and entertainment venues, and improves the lighting experience.

An interface display method and a device are described. An original interface may be moved to reserve space for displaying an interface of a first application such as a voice assistant, so that the interface of the first application does not block the original interface. This helps a user interact with the original interface and the interface of the first application. For example, an electronic device displays a first interface. The electronic device detects an operation in which the user indicates to start a first application. The electronic device displays the first interface in a first area of a screen, and displays a second interface in a second area of the screen. The second interface is an interface of the first application, and the first area does not overlap the second area.

There is disclosed a computer-implemented method of training an interactive voice assistant (IVA), including prompting an artificial intelligence (AI) to assume a persona and to seek to fill a service request by a service provider that operates the IVA; receiving, from the AI, a query for the IVA; providing the query to the IVA; receiving, from the IVA, a response to the query; continuing to permit the AI to query the IVA until the AI is satisfied that the IVA has filled the service request or that the IVA is unable to fill the service request; logging the queries and responses between the AI and the IVA; and based on the logging, debugging or improving the IVA.

The disclosure relates to a method and apparatus for processing a voice input. The method includes identifying a first candidate text output from a first list of candidate text outputs, the first list of candidate text outputs being generated based on a voice input being received from a user. The method includes validating a feasibility of executing the first candidate text output based on an analysis of a first contextual data related to the first candidate text output, user-specific data, historical data related to previous validations of the voice assistant device, and one of an execution result or a no-action result corresponding to the first candidate text output. The method includes, based on the feasibility of executing the first candidate text output being validated as not feasible for execution, identifying failure information associated with the first candidate text output.

The invention provides a voice assistant interaction method and electronic equipment, the electronic equipment can determine whether to wake up a voice assistant according to own equipment posture and equipment action, and the equipment posture can be determined by combining measurement data of various sensors of the electronic equipment. For example, measurement data of an IMU, measurement data of an ultrasonic signal, touch information of a capacitive screen or measurement data of a proximity sensor and the like. The probability that the voice assistant is awakened by mistake is lower, and the energy utilization efficiency of the electronic equipment is higher. The pickup method and the feedback method executed by the electronic device can be determined according to the device posture of the electronic device, the voice interaction process of the user is more natural, and the usability of the voice assistant is better.

The invention belongs to the technical field of speech recognition and acoustic modeling, and particularly relates to a high-fidelity end-to-end acoustic modeling method combining speech intelligibility reconstruction and autoregressive feedback optimization, which comprises the following steps of: firstly, establishing an intelligibility loss function based on a human speech intelligibility model; subjective definition features of the voice are reconstructed through a frequency spectrum reconstruction network, intelligibility related features are extracted and embedded in combination with a perceptual weighted filter bank, and the intelligibility related features and Mel frequency spectrum features are input into an acoustic encoder in parallel; based on this, by introducing a voice intelligibility reconstruction and autoregressive feedback mechanism, while the conciseness of an end-to-end voice modeling framework is maintained, systematic improvement of voice sharpness, naturalness and stability is realized, and the method can be widely applied to scenes such as intelligent voice assistants, voice transcription, virtual anchors, voice restoration, cross-language voice generation and the like. And the method has extremely high practical application value and popularization prospect.

The invention discloses a vehicle control method, device and equipment and a computer readable storage medium, and belongs to the technical field of vehicles. The method comprises the following steps: in response to a starting instruction for a voice assistant function configured in a vehicle, determining the running state of the vehicle and the remaining power percentage of the vehicle; under the condition that the running state of the vehicle meets the running requirement and the percentage of the remaining electric quantity of the vehicle is larger than a target threshold value, image acquisition equipment installed in the vehicle is controlled to be started; a first video collected by an image collection device in a first time period is obtained, the first video comprises a first gesture action of a driver and passengers of the vehicle, and the starting time of the first time period is the time for starting the image collection device; determining a first control instruction corresponding to the first gesture action; and controlling a control system corresponding to the first control instruction to execute a control operation corresponding to the first control instruction. According to the method, the use frequency of the voice assistant function is improved, and the vehicle control efficiency is higher.

A method comprising causing a voice assistant and a recommendation engine that are executing in an infotainment system of a vehicle to cooperate in processing a vehicle occupant's acceptance of a recommendation proposed by the recommendation engine by having an interface to enable the recommendation engine to provide recommendation context to the voice assistant to enable the voice assistant to resolve an ambiguity in the occupant's acceptance of the recommendation.

The invention belongs to the technical field of artificial intelligence, and discloses a cerebral palsy child multi-mode rehabilitation training system based on artificial intelligence. The system comprises a data acquisition and preprocessing module, a multi-modal information fusion module, a personalized rehabilitation training suggestion generation module, an interaction and excitation module, a progress tracking and abnormity early warning module, a doctor and parent end APP management module and a system control and management module. According to the invention, when the interaction and excitation module and the multi-modal information fusion module are combined and applied to rehabilitation training of children with cerebral palsy, the training effect can be significantly improved, and accurate evaluation and personalized training can be realized; the child patient can be trained in a more real and attractive environment, meanwhile, the enthusiasm of the child patient is further stimulated through the gamification excitation design, and the training motivation of the child patient is enhanced through real-time feedback encouragement.

The disclosure relates to a method and apparatus for processing a voice input. The method includes identifying a first candidate text output from a first list of candidate text outputs, the first list of candidate text outputs being generated based on a voice input being received from a user. The method includes validating a feasibility of executing the first candidate text output based on an analysis of a first contextual data related to the first candidate text output, user-specific data, historical data related to previous validations of the voice assistant device, and one of an execution result or a no-action result corresponding to the first candidate text output. The method includes, based on the feasibility of executing the first candidate text output being validated as not feasible for execution, identifying failure information associated with the first candidate text output.

Methods, computing systems, and technology for personalizing a user experience in a vehicle. For example, a computing system may be configured to receive a user prompt from a user, wherein the user prompt is input into a voice assistant on-board the vehicle. The computing system may be configured to process the user prompt with a master language model agent. The master language model agent may determine, based on environmental data, one or more intermediate actions responsive to the user prompt. The master language model agent may evaluate, based on the environmental data, whether each intermediate action of the one or more intermediate actions satisfies the user prompt. The computing system may be configured to output one or more command instructions to the voice assistant, wherein the one or more command instructions cause the voice assistant to provide, using one or more human-machine interfaces, a response to the user prompt.

The invention relates to a multi-modal emotion recognition fusion and communication method oriented to real-time human-computer interaction, and aims to solve the problems of asynchronous modal time sequence, non-uniform feature dimension, single fusion mode, high communication delay and the like of an existing emotion recognition system and improve the recognition precision and real-time performance of the system. According to the method, voice, images and physiological signals are synchronously collected through a multi-modal input module, feature alignment is achieved through time sequence interpolation, dynamic time warping and space coordinate mapping, double-domain feature fusion is conducted in combination with a time path network and a space path network, emotional state judgment is completed through a lightweight neural network, and the emotional state recognition accuracy is improved. And outputting six types of basic emotions and confidence coefficients. Meanwhile, a low-delay communication protocol based on UDP clipping extension realizes rapid feedback of emotion data, and in combination with modal priority scheduling, data compression and bandwidth sensing mechanisms, high-efficiency and low-delay transmission is ensured, and the real-time interaction requirement in a weak network environment is met. The method has the advantages of high accuracy, low power consumption, low time delay and flexible deployment, is suitable for various real-time interaction application scenes such as voice assistants, virtual customer service, emotion accompanying and telemedicine, and has wide application value and market prospect.

The invention relates to the technical field of speech synthesis, and particularly discloses a speech synthesis method and system for controllable latent variable modeling based on semantic distillation, and the method comprises the steps: converting a Mel spectrum into continuous latent variable distribution through a speech coding module, generating continuous latent variables through re-parameterization sampling, introducing a self-supervised model for semantic distillation, and carrying out the semantic distillation. According to the method, alignment of latent variables and semantic features is constrained through marginal cosine similarity and distance matrix structure loss, a text encoder maps a phoneme sequence into latent variable distribution, time sequence alignment of a text and the latent variables is achieved in combination with monotonic alignment search, and a decoder reconstructs the latent variables into a Mel spectrum. According to the method, waveform synthesis through a vocoder and total loss function joint optimization reconstruction, KL divergence, distillation, text alignment and confrontation loss are carried out, discrete information loss is avoided through continuous latent variable modeling, semantic consistency and text alignment efficiency are enhanced, the naturalness, coherence and real-time performance of synthesized voice are improved, and the method is suitable for scenes such as voice assistants and virtual anchors.

The invention discloses an air conditioner voice assistant training method and device, a storage medium and a server, and relates to the technical field of air conditioners, and the method comprises the steps that air conditioner voice assistant training data are obtained, and the air conditioner voice assistant training data comprise multiple pieces of initial sample data of an initial protocol format; protocol format adjustment is conducted on initial sample data included in the air conditioner voice assistant training data, and multiple pieces of new sample data with the simplified protocol format are obtained; and training a to-be-trained base model by adopting the multiple pieces of new sample data in the simplified protocol format to obtain an air conditioner voice assistant model which is used as an air conditioner voice assistant. The method can improve the understanding accuracy of the air conditioner voice assistant for the intention expressed by the user voice in the air conditioner scene, reduces the consumed resources during model training, improves the efficiency, and improves the user interaction experience in the air conditioner scene.

The embodiment of the invention provides a dialogue method and electronic equipment, and the method comprises the steps: displaying an interface of a main session in a first application, the main session being a session between a user and a first intelligent assistant provided by the first application; in response to a first operation of the user in the interface of the main session, displaying an interface of at least one independent session in the first application, the at least one independent session including a first independent session, the first independent session being a session between the user and a second intelligent assistant, the second intelligent assistant calls the intelligent dialogue service for the first application aiming at the first scene. According to the dialogue method and the electronic equipment provided by the embodiment of the invention, the use efficiency of the intelligent voice assistant can be improved.

The invention provides a voice assistant awakening method, a vehicle-mounted terminal and a storage medium, and relates to the technical field of voice assistants. According to the method, identity information of a user sending suspected wake-up voice data can be recognized, and an initial wake-up threshold value associated with the identity information of the user and historical wake-up habit data of a voice assistant are searched from a preset database; and adjusting the initial wake-up threshold according to the similarity between the real-time wake-up habit data and the historical wake-up habit data and the noise energy to obtain a real-time wake-up threshold. The real-time wake-up threshold is negatively correlated with the similarity and positively correlated with the noise energy, so that the reliability of the obtained real-time wake-up threshold is high, and the suspected wake-up voice data is evaluated to obtain the target wake-up value; and when the target wake-up value is greater than or equal to the real-time wake-up threshold value, waking up the voice assistant. Because the reliability of the real-time wake-up threshold is high, the wake-up of the voice assistant at the moment does not belong to false wake-up, and the sensitivity of wake-up of the voice assistant is also high.

The invention relates to a display device and a voice assistant awakening method. Comprising the steps that an input voice data stream is acquired, a target voice data stream is determined according to the voice data stream, and the target voice data stream is the voice data stream or is obtained by performing noise reduction on the voice data stream; under the condition that the target voice data stream comprises a wake-up word voice segment, the wake-up word voice segment in the target voice data stream is enhanced, an enhanced wake-up word voice segment is obtained, the wake-up word voice segment is matched with a wake-up word, and the wake-up word is used for waking up a voice assistant; and sending the enhanced wake-up word voice segment to a server corresponding to the voice assistant, the enhanced wake-up word voice segment being used for the server to perform wake-up word verification, and if the wake-up word verification is passed, representing that the voice assistant is successfully awakened. The CPU occupancy rate can be reduced while the wake-up rate is improved.

Example techniques may involve temporary configuration of a media playback system in a place of accommodation, such as a hotel. In particular, the media playback system in a guest's room is configured with one or more settings of the guest's home media playback system. Example settings include user accounts of a various services, such as streaming audio services and / or voice assistant services. Other example settings include artists, albums, audio tracks, audio books, stations, and other audio content that the guest previously designated as a favorite using their home media playback system. When the guest leaves (e.g., checks-out of) of the place of accommodation, these settings are removed from the media playback system in the guest's room.

The invention is suitable for the field of audio processing, and discloses a voice instruction execution method, terminal equipment and a storage medium. The voice instruction execution method comprises the following steps: executing a recognition operation of a voice wake-up instruction; if the voice wake-up instruction is recognized, executing a recognition operation of the voice instruction; if the voice instruction is recognized, an operation instruction corresponding to the voice instruction is executed, and an operation target of the operation instruction comprises the display screen and / or the earphone body. Through introduction of the voice wake-up instruction and detection of the voice instruction, the terminal equipment (earphone cabin) can respond to the voice instruction of the user, thereby realizing a voice interaction function, and improving practicability and flexibility. Moreover, a traditional wireless earphone calls a voice assistant by depending on external equipment such as a mobile phone or a tablet computer, and voice control can be carried out only by manually operating or taking out the equipment by a user. Through the voice instruction execution method, the user can trigger voice recognition only through the wake-up word without taking out external equipment, so that the operation convenience is improved.

The invention discloses a picture book interaction method and a picture book content artificial intelligence generation method and system.The picture book content artificial intelligence generation system comprises picture book application software and a server system, and the picture book application software comprises a picture book interaction AI engine front end SDK and a role playing mode program; the server system comprises a picture book interaction AI engine back-end service system, an interactive picture book media resource library system and a picture book content artificial intelligence generation system, and artificial intelligence processing of voice recognition is changed from a current television voice assistant to the picture book interaction AI engine front-end SDK and the picture book interaction AI engine back-end service system. Therefore, the picture book application software is independent of the artificial intelligence processing capability of the intelligent voice assistant of the existing television (set top box), not only is the adaptive work of the intelligent voice assistant of a television manufacturer reduced, but also the service data security protection of the picture book application software is realized.

The invention discloses an AI voice assistant implementation method and equipment based on a cloud computer terminal and a medium, belongs to the technical field of cloud computers and voice assistants, and aims to solve the technical problems of how to apply an AI voice assistant to the cloud computer terminal and awaken the assistant by customizing an awakening word, fill the blank that the cloud computer terminal does not belong to a voice assistant of the cloud computer terminal and improve the voice assistant implementation efficiency. According to the technical scheme, voice wake-up and interaction based on the Android platform comprises the steps that a background thread decompresses a voice model, a microphone monitoring service is automatically started after decompression is completed, a voice recognition service continuously captures microphone input, and a recognition result is returned in real time; when a preset wake-up word is detected, popping up a floating window to enter an interaction mode, managing text display and recording states in an interaction process, and realizing timeout automatic processing through a delay task; speech recognition and interaction control based on streaming audio; performing asynchronous voice question-answer response; asynchronous speech synthesis and transmission; and playing the audio after the voice synthesis is successful.

The invention discloses an instant intention unlocking system based on facial recognition and voice interaction, and aims at solving the problems that an existing voice assistant depends on wake-up words, interaction is low in efficiency, scene perception is weak, and energy consumption is high. The system adopts a three-layer architecture including a hardware layer (a camera, a microphone, a processor and a storage module), a software layer (a voice recognition engine, a face recognition algorithm, a scene perception module and an authority control module) and a logic layer (an intention fusion judgment module and a task routing and execution module). 'gaze + voice 'is taken as core triggering, and wakeup words are avoided; face recognition is used for confirming identity and watching state, voice recognition is used for analyzing instructions, and an application scene is fused to generate an instant intention triggering model; authority hierarchical management and control are realized, and energy consumption optimization, auxiliary triggering, cross-terminal synchronization and emergency help modules are arranged. Interaction efficiency can be improved, safety and convenience are balanced, energy consumption is reduced, and the method is adaptive to multiple terminals and multiple scenes.

The invention discloses a voice control method and device for communication equipment, electronic equipment and a storage medium, and relates to the technical field of communication or other related fields, and the method comprises the steps: receiving a voice instruction of a target user through a mobile terminal provided with a voice assistant, and analyzing the voice instruction to obtain an equipment execution parameter; generating a device control instruction based on the device execution parameter, and transmitting the device control instruction to the target communication device through a near field communication module on the mobile terminal; an execution feedback result transmitted by the target communication equipment is received by the mobile terminal through the near field communication module, and the execution feedback result is obtained after the target communication equipment executes the equipment control instruction; and the execution feedback result is converted into a voice broadcast result through the voice assistant, and the voice broadcast result is fed back to the target user through a loudspeaker of the mobile terminal. According to the invention, the technical problem that voice control cannot be carried out on traditional communication equipment in the prior art is solved.

The invention discloses a medical voice interaction dynamic privacy protection method and related equipment, and the method comprises the steps: carrying out the voiceprint recognition of a current user in response to a session request, determining the role of the current user based on a voiceprint recognition result, and dynamically authorizing the data access authority of the current user according to a predefined access control strategy; retrieving related historical dialogues and medical knowledge within the boundary of the data access permission, and generating personalized answers; voiceprint monitoring is continuously carried out during the session, and when switching of the current user is detected, a dynamic privacy protection mechanism is triggered; the dynamic privacy protection mechanism dynamically calculates privacy protection intensity based on multiple factors of voiceprint confidence, dialogue keyword sensitivity, dialogue intention sensitivity and a time decay factor, adds adaptive noise to the personalized answer according to the privacy protection intensity, and then outputs the personalized answer. The invention aims to improve the privacy protection capability of the intelligent voice assistant in the medical scene, so that the intelligent voice assistant can adapt to the complex multi-role cooperation requirement of the medical scene, and the dynamically changing session scene can be effectively processed.

The invention discloses a controllable voice generation method and device based on multi-agent dynamic scheduling, and belongs to the technical field of voice synthesis, and the method comprises the steps: constructing a multi-agent voice generation frame comprising a central scheduling module, an identity agent, an emotion agent and an environment agent; a central scheduling module analyzes a user instruction and outputs a structured task plan to drive each agent to generate primary voice output of identity, emotion and environment dimensions, and a cooperation cost matrix between the agents is constructed according to the primary voice output; the optimal execution path of the multiple agents is solved through an optimization algorithm based on the cost matrix, the agents are executed in a cascading mode based on the optimal execution path, and finally sound mixing is completed and high-quality voice is output. According to the method, the naturalness, the semantic consistency and the overall quality of the synthesized voice in a complex scene can be remarkably improved, and the method is suitable for various man-machine interaction application scenes such as intelligent voice assistants, virtual digital humans, immersive entertainment, barrier-free voice services, personalized content creation and the like.

A system, method, and device are provided for configuring a voice assistant feature in portable radios for the rental radio market. The portal receives a request to configure the rental radio with a voice assistant feature as part of a rental registration for the event. The portal obtains access to a customer database. Based on that access, the portal obtains customer deployment context data. Customer environment functions are identified from the customer deployment context data for the event. Voice commands are generated by the portal for the identified customer environment functions. A mapping of voice commands to respective customer environment functions for the event is created and provided for customer verification and, if desired, customization. The portal then programs the portable rental radio(s) with the mapped voice commands to respective customer environment functions to complete the voice assistant configuration. The voice assistant configuration does not rely on natural language processing.