158 results about "Spoken dialog" patented technology

The invention discloses an accurate international communication digital human real-time dialogue method fused with a multi-modal technology. The method comprises the following steps: S1, constructing a digital human image and tone; s2, propagation content generation and problem guidance; s3, semantic analysis and intention clarification based on the real-time voice dialogue; s4, geographic preference modeling and path planning; s5, cross-context propagation content generated based on retrieval enhancement is generated; s6, visually displaying the propagation content; and S7, carrying out digital human-driven multi-language propagation content real-time output and feedback closed-loop optimization. Through accurate utterance expression analysis, accurate international propagation problem recommendation is provided, cross-context propagation content generation based on semantic understanding is realized, digital people with voice features and visual images are constructed, real-time dialogue interaction of users is realized, and user experience is improved. The system can carry out geographic modeling according to the region where the accurate problem is located, language preference and propagation object culture characteristics, and differential propagation path planning is achieved.

The invention relates to the technical field of artificial intelligence and voice dialogue, and discloses a voice interaction method based on retrieval enhancement generation and multi-model collaboration and application thereof. Performing local multi-round intention recognition; performing local RAG retrieval and candidate aggregation; decision making and cloud generation; performing feedback, synthesis and persistence; the invention further provides application of the voice interaction method based on retrieval enhancement generation and multi-model collaboration. According to the method, through local structured intention recognition and RAG retrieval aggregation, in combination with the generation capability of a cloud large model, response timeliness and privacy protection are considered, and the recommendation accuracy and robustness in a multi-round voice interaction scene are remarkably improved; the retrieval redundancy is reduced and the context quality is improved through entity-level combination duplicate removal, rearrangement and fuzzy matching strategies; and the consistency of data updating and the stability of online service are ensured through an offline atom replacement mechanism, so that the terminal user experience is improved, and engineering deployment and expansion are facilitated.

The invention relates to an automatic depression risk assessment method based on a natural language processing technology. The method comprises the following steps: performing selective conversation content interviews with a subject by using a voice conversation function of artificial intelligence; dialogue recording and text data between the patient and artificial intelligence are obtained; performing automatic transcription and speaker separation on the original speech transcription text data, and constructing a structured question and answer dialogue sequence; generating a structured question prompt related to the depressive symptom by using a large language model, and splicing the structured question prompt with the original dialogue content; designing an artificial neural network pre-training language model coding word vector, fusing position coding, a self-attention mechanism, a problem-guided attention mechanism and a bidirectional long short-term memory network, and extracting deep semantic features related to depression risks; finally, continuous depression risk scores are output, correlation verification is carried out on the continuous depression risk scores and standard PHQ-8 scores, and the accuracy, robustness and interpretability of depression risk assessment are effectively improved.

The invention provides a voice dialogue task handover method and device, a server and a system, and the method comprises the steps: obtaining historical dialogue data of a voice dialogue task between a target user and first voice equipment; monitoring sensor data of a plurality of second voice devices of the first voice device in a preset neighborhood range; selecting a target voice device to which the first voice device is to be handed over from the plurality of second voice devices according to the sensor data; and handing over the voice dialogue task from the first voice device to the target voice device according to the historical dialogue data, so that the target voice device continues to perform voice interaction with a target user based on the historical dialogue data. By adopting the scheme of the embodiment, the technical problem that continuous voice interaction can only be carried out on a single voice device in the prior art is solved, and the fluency and intelligence of man-machine interaction are improved.

The invention discloses a robot control system and method based on AI voice, and belongs to the technical field of robot intelligent control. The system comprises a local voice processing module, a dialogue management and context understanding module, an instruction mapping and generating module and a robot communication and control module. The local voice processing module is integrated with a 16 kHz sampling ASR engine, voice-to-text conversion is realized through a 6-layer LSTM network and beam search decoding, and the TTS engine adopts a WaveNet architecture to synthesize voice. A 7 billion parameter large language model is arranged in the dialogue management module, a 32-layer Transform decoder architecture is adopted, 10 rounds of dialogue history is maintained, and intention recognition and entity extraction are achieved through a multi-head self-attention mechanism. And the instruction mapping module performs trajectory planning by adopting quintic polynomial interpolation and quaternion spherical linear interpolation. According to the invention, full-link localization processing is realized, the speech recognition delay is 180 milliseconds, the position error is less than 0.5 mm, and the problems of high delay, high privacy risk and weak complex instruction understanding ability in the prior art are effectively solved.

An interactive care robot according to an embodiment of the present disclosure includes: at least one sensor including a microphone configured to receive voice conversations with a user; a memory configured to store instructions; and a processor operatively connected to the memory and configured to execute the instructions. The processor is configured to: generate conversation history information based on the conversations with the user; generate user information and classify the user information into predetermined categories; set a priority of a care service to be provided to the user based on the classified user information and the conversation history information; and select a care service to be provided to the user based on the set priority and control components of the interactive care robot to perform the selected care service.

The invention provides an exhaustion report generation method and device, electronic equipment and a storage medium, and relates to the technical field of data processing. The method comprises the following steps: acquiring object transaction data of a plurality of candidate objects; performing object identification on the object transaction data based on a preset identification strategy, and screening out at least one target object from the plurality of candidate objects; determining a target exhaustion verbal skill template matched with each target object in the at least one target object; for each target object, initiating a call outbound to the target object based on the target exhaustion call skill template to obtain an exhaustion voice dialogue of the target object; and generating a target exhaustion report of the target object based on the exhaustion voice dialogue. According to the method, full-link automatic customer full-duty investigation can be realized.

The utility model discloses a guest room control system with service reminding and sleep aiding sound effects, and relates to the field of intelligent services. The guest room control system with the service reminding and sleep-aiding sound effects comprises a reminding service module which is arranged on the wall of a guest room and is used for carrying out voice reminding and sending different reminding music at the set time of a user after the customer sets the reminding type and the reminding time; the music playing module is arranged on the wall of the guest room and is used for providing various types of sleep-aiding music for the guest room; the voice conversation module is arranged beside a bedside table of a guest room and is used for voice communication between a worker and a customer; and the control module is arranged at the reception desk of the hotel, and the control module is in communication connection with the reminding service module, the music playing module and the voice conversation module. According to the system, a manager can provide various intelligent services, such as reminding, music and voice communication services, in a guest room for a customer, the individual requirements of the customer are met, and the check-in experience feeling of the customer is improved.

The embodiment of the invention provides a voice dialogue job management method based on a large model, a program product, equipment and a medium, and relates to the technical field of artificial intelligence. In the outbound operation process of a user, the outbound record information of this time is input into a pre-established large model to obtain first outbound operation management information used for indicating next outbound operation or second outbound operation management information used for indicating ending of the outbound operation, and if the first outbound operation management information is obtained, the outbound record information of this time is input into the large model, and the outbound record information of this time is input into the large model. If the first outbound operation management information is obtained, next outbound operation is carried out on the user according to next outbound task information in the first outbound operation management information, and if the second outbound operation management information is obtained, the outbound operation on the user is ended. The large model is utilized to flexibly judge whether to carry out next call-out on the user or not and determine execution details of the next call-out task according to the call-out condition, so that the call-out operation process of the user is flexibly managed, and maximization of service benefits is facilitated.

The invention provides an artificial intelligence AI voice dialogue consultation control system which comprises a base, a machine cabinet is fixed to the upper end face of the base, a consultation host is installed at the top of the machine cabinet, a cleaning structure is arranged in the machine cabinet, a receipt printer and a card reader are installed on the side wall of the front side of the machine cabinet, and the card reader is arranged on the side wall of the front side of the machine cabinet. A code scanner is installed on a transverse table of the machine cabinet, an installation frame is fixedly installed in the machine cabinet, a loudspeaker and a microphone are installed on the installation frame, and a camera is fixed to the front side wall of the top end of the machine cabinet. Through the cleaning structure, the spray pipe, the atomization nozzle, the branch pipe, the liquid supply structure and the push-out air drying structure, the voice conversation consultation terminal can be automatically disinfected and wiped, and dust on the surface of the voice conversation consultation terminal can be cleaned; the problems that in the prior art, cross infection is prone to occurring when multiple persons use the display screen, and the customer experience is affected by dust accumulated on the display screen are solved.

The present disclosure provides a voice dialogue execution method, an electronic device and a storage medium, and relates to the technical field of voice interaction. The specific implementation scheme is: in response to a voice request of a user, generating semantic request information corresponding to the voice request, the semantic request information comprising intention information; determining a target execution domain according to the semantic request information; and generating a dialogue result of the current round of dialogue based on the target execution domain. By using the technical scheme of the present disclosure, the semantic request information containing the intention information can be generated according to the voice request of the user, the target execution domain for executing the current round of dialogue can be determined in the dialogue engine, the dialogue result can be quickly obtained, the efficiency of the dialogue engine in processing the voice request of the user and the flexibility of voice jumping are improved, the threshold for the user to use the multi-round voice dialogue is reduced, and the interactive function is enriched.

This contributes to the realization of a dialogue system that makes it easier for users to obtain the answers they expect. [Solution] The learning system (1) comprises an acquisition means (11) for acquiring driver information relating to the actions of the vehicle driver, a generation means (12) for generating learning data based on the driver information, and a learning means (13) for fine-tuning a base model relating to a dialogue system that performs voice-based dialogue with the driver using the learning data.

The embodiment of the application belongs to the field of artificial intelligence, and relates to a data analysis method based on artificial intelligence, comprising the following steps: acquiring voice dialogue data of a user and an agent in a business conversation process; converting the voice dialogue data into text data, and obtaining dialogue text by converting the text data; performing classification processing on the dialogue text according to a preset rule to obtain a theme label corresponding to the dialogue text; constructing a corresponding directed graph based on the dialogue text and the theme label; and performing similarity analysis processing on the directed graph based on a preset similarity analysis model to generate a similarity result between each directed graph. The application also provides a data analysis device based on artificial intelligence, a computer device and a storage medium. In addition, the application also relates to blockchain technology, and the similarity result can be stored in the blockchain. The application analyzes the similarity relationship of the theme path of the dialogue technique based on the use of the similarity analysis model to quickly and accurately obtain the corresponding similarity result.

The utility model relates to the technical field of monitoring robots, particularly to an old people accompanying robot, including frame, camera subassembly, ultrasonic module and loudspeaker module, all the corners of frame are provided with drive wheel assembly, and frame is provided with power supply battery, and the top of frame is provided with circuit board, camera subassembly sets up in the top of frame, and the front end of frame is provided with steering mechanism, and the output of steering mechanism is provided with connecting plate, and loudspeaker module and ultrasonic module all set up in the front end of connecting plate, and single-chip microcomputer, voice recognition module and WIFI communication module are provided on circuit board. The utility model realizes the function of following or positioning the old people position, can carry out real -time monitoring and identification to the surrounding environment, guarantees the life safety of old people, supports interactive functions such as voice dialogue, reminding broadcast, can realize remote video call, data transmission and remote monitoring, and it is convenient for children or medical staff to understand the old people state at any time.

1. Name of the product in this design: Intelligent Robot. 2. Purpose of this design: for the care of elderly people and children in the family; including voice dialogue, face recognition, multi-party video calls, and family entertainment. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.

A system includes at least one sensor, a means for processing the measurement signal of the sensor and means for communicating measurement results and / or data relating to the measurement results for further processing. The system includes means for producing and capturing audio and the system is configured to determine with the at least one sensor that the safety of a monitored person is endangered and based on the determined endangered safety of the monitored person, to use the means for producing audio to initiate a speech dialog with the monitored person, and to use the means for capturing audio to listen to the reply from the monitored person. Based on the captured audio the system assesses the situation and determines if an action is required, the system being configured to use a large language model for carrying out the speech dialog with the monitored person.

The application discloses a voice dialogue method, system, device and medium, wherein the method inputs a first target voice signal into an audio coding network for signal coding to obtain a first audio coding unit sequence, the first audio coding unit sequence includes a plurality of audio coding units, and each audio coding unit corresponds to an audio frame in the first target voice signal; inputs the first target voice signal and the first audio coding unit sequence into a large language model for disambiguation reasoning to obtain an audio response unit sequence output by the large language model; inputs the audio response unit sequence into an audio decoding network for signal waveform reconstruction to obtain a voice response signal, and performs dialogue response on the first target voice signal of the user according to the voice response signal. The method can effectively improve the response speed of voice dialogue and is beneficial to improving user experience. The application relates to the technical field of voice recognition.

The application discloses a 5G AI router integrating voice dialogue and screen display, obtains a pure voice signal sequence by filtering noise through a microphone array beam forming technology, and adopts a neural network model to analyze and generate an accurate operation intention vector; a dynamic parameter fusion update device list structure is pulled from a distributed network in real time; when the intention vector target device identification and the list position do not match, a clustering algorithm is used to intelligently group and sort the list, and the matching device position index is quickly determined; then, a control parameter is extracted to align the voice requirements through a real-time synchronization mechanism, a synchronous execution command sequence is generated, the user interface is updated, and a network instruction is issued to adjust the device flow, and finally, the network state feedback data after execution is obtained. The application realizes efficient and accurate matching and control of voice instructions and dynamic devices, improves the robustness and response speed of far-field voice interaction, and ensures seamless execution of device operation in a complex network environment.

1. Name of the product in this design: Video doorbell and its main body (R2 Max). 2. Application of this design: This design is used for doorbell calling, voice dialogue, and video visitor detection. 3. The key design feature of this product is its shape. 4. The picture or photo that best illustrates the key design points: Design 1 3D diagram 1. 5. Design 1 is designated as the basic design. 6. Other situations requiring explanation: Designs 2-3 of this patent are partial views, and the appearance shown in the red-covered area in the views is not required to be protected. The design for which protection is sought does not include color.

Embodiments of the present application provide a voice dialogue interaction method, system, electronic device and storage medium. The method comprises: receiving user voice input by a client, generating a general reply text for feeding back the user voice, and a final reply text supplemented with an information keyword of the general reply text; sending at least the final reply text to a voice synthesis service, the voice synthesis service generating a synthesized sound playback address to feed back to the client, and asynchronously splitting the final reply text based on a dialogue label to obtain a first text of the final reply text that needs to call a pre-synthesized voice and remaining text that needs to be synthesized except the first text; the voice synthesis service receiving an audio stream acquisition request initiated by the client based on the synthesized sound playback address, and streaming the pre-synthesized voice and synthesized voice of the remaining text to the client. Embodiments of the present application ensure the accuracy of the dialogue system, reduce the overall time consumption of the dialogue system, and improve the real-time performance of the dialogue system.

This invention relates to the field of voice interaction technology, and more particularly to a voice dialogue system based on a large model, comprising: a feature extraction module for acquiring samples containing multi-turn dialogue information and extracting multi-dimensional features; an alignment and processing module for achieving fine alignment through cross-modal alignment matrices and path search, and calculating a contextual consistency score based on role transition states; a stability calculation module for determining sample stability scores based on a teacher-student model mechanism; an anomaly assessment module for constructing a sample nearest neighbor graph based on semantic embedding vectors, calculating structural anomaly scores and sample retention values, and rescuing correctable samples by supplementing with nearest neighbor information; and a training module for selecting voice dialogue training samples according to sample retention values ​​and training the model. This invention provides high-quality samples for model training through a multi-dimensional quality assessment and data filtering mechanism, improving the accuracy and fluency of voice dialogue.

The invention provides a customer service method, system and device and a readable storage medium, and the method comprises the steps: querying the historical incoming call information of an incoming call number corresponding to a call request according to the call request of a client, so as to determine the habitual language of a customer; further confirming whether the customer service language currently selected by the customer is non-Chinese or not in response to the condition that the queried habitual language is non-Chinese or the habitual language of the customer is not queried; and if the customer service language currently selected by the customer is non-Chinese, acquiring customer voice in real time in a voice conversation process between the client and the corresponding first seat end, and forwarding the customer voice to a third-party voice service engine through the multi-language interaction platform. According to the method, the system, the device and the readable storage medium, the problems of poor communication real-time performance, poor customer experience and poor customer experience caused by incapability of timely identifying whether the conventional language of the customer is Chinese or not due to the fact that translation can be carried out after the customer finishes speaking in the existing customer service method can be solved.

A voice changing method, apparatus and device for a speech dialog in a live-streaming room, and a medium, which relate to the field of network live streaming. The method comprises: in response to a speech speaking event of a speaker user in a live-streaming room, detecting and determining a speech segment in target audio data; on the basis of a preset target pitch value, performing tone-change processing on a segment pitch feature of the speech segment, so as to obtain an optimized pitch feature; on the basis of the optimized pitch feature and a target timbre feature, performing voice-change processing on the speech segment, so as to obtain a voice-changed segment; and replacing a corresponding speech segment in the target audio data with the voice-changed segment, so as to obtain voice-changed audio data, and sending the voice-changed audio data to a receiver user in the live-streaming room. The present application significantly improves the performance of voice changing technology, and solves the problems in the conventional technology in the aspects of real-time performance, personalized services, pitch adjustment naturalness, real timbre restoration, etc.

The invention provides a multi-party dialogue translation method and device, electronic equipment and a storage medium, and belongs to the technical field of voice processing, and the method comprises the steps: obtaining voice dialogue information in a current time window; speaker identity recognition is carried out on the voice dialogue information, and a first speaker in the current time window is selected based on the duration of the voice information; dividing the first voice feature of the first speaker into a first voice feature of a first time period and a first voice feature of a second time period; screening a second voice feature of a first time period from the second voice features of the first speaker in the previous time window, and performing feature fusion on the first voice feature of the first time period and the second voice feature to obtain a first fused voice feature; and performing voice recognition on the first voice feature in the second time period based on the first fused voice feature, and performing dialogue translation. According to the multi-party dialogue translation method and device, the electronic equipment and the storage medium provided by the invention, the continuity of translation results can be improved.

The invention discloses an interaction device and method for realizing dialogue of desktop pets through an AI key. The device comprises an AI key event identification unit, a function state detection unit, a desktop state verification unit, a control traversal unit, an event transmission unit and a session processing unit. When it is detected that the physical AI key is pressed for a long time and the function is in an enabled state, the system judges whether a current foreground is a desktop main interface, whether a desktop mode is a default mode, whether a screen is bright and whether a desktop is static; only when all conditions are met, traversing the desktop view hierarchy to position a target control with a pet identifier, and converting an AI key event into a recording start and stop instruction of the control, so as to realize recording control and voice data acquisition. And after the recording is finished, the system generates a session identifier and selects a local or cloud path to start the voice conversation of the pets according to the privacy policy and the network state. The method has the advantages of mistaken touch prevention, privacy protection, quick response and the like, and the interaction experience of the mobile terminal is improved.

The application discloses an end-to-end voice dialogue system and method based on cross-modal retrieval enhancement, comprising a voice input and feature extraction module, a cross-modal retrieval enhancement module, an end-to-end voice generation module and a voice memory module. Through the system and method process setting, direct mapping and generation from voice to voice can be realized, error accumulation problems caused by modular architecture can be eliminated, and the overall robustness of the system is improved. Through the end-to-end model, the training and deployment process is simplified, the scalability and real-time interaction capability of the system are improved, and the system can be better applied to intelligent customer service and other application scenarios with extremely high requirements for accuracy and efficiency. Through the efficient cross-modal retrieval enhancement generation mode, relevant field professional knowledge can be retrieved from a text knowledge base in real time according to received audio, the accuracy and timeliness of the response information are ensured, direct, efficient and accurate retrieval from voice to text knowledge is realized, and the cognitive ability of the system in the vertical field is enhanced.

1. The name of the design product: input area of voice dialogue graphical user interface of electronic equipment. 2. The use of the design product: an electronic equipment. 3. The design points of the design product: the protected part of the graphical user interface in the electronic equipment. 4. The picture or photo that best shows the design points: design 3 front view. 5. Design 3 is designated as the base design. 6. The use of the graphical user interface: the graphical user interface is used for voice dialogue, and the protected part of the graphical user interface is the input area of the voice dialogue graphical user interface. 7. The human-machine interaction mode of the graphical user interface: in design 1, the user touches or clicks the voice input button in the main view of design 1, the graphical user interface changes from the main view of design 1 to design 1 change state view 1 to display the voice input state, after the user inputs a question or instruction by voice, the graphical user interface changes from design 1 change state view 1 to design 1 change state view 2 to display the response to the question or instruction input by the user; in design 2, the user touches or clicks the voice input button in the main view of design 2, the graphical user interface changes from the main view of design 2 to design 2 change state view 1 to display the voice input state, after the user inputs a question or instruction by voice, the graphical user interface changes from design 2 change state view 1 to design 2 change state view 2 to display the question or instruction input by the user, after the user finishes voice input, the graphical user interface changes from design 2 change state view 2 to design 2 change state view 3 to display the response to the question or instruction input by the user; in design 3, the user touches or clicks the voice input button in the main view of design 3, the graphical user interface changes from the main view of design 3 to design 3 change state view 1 to display the voice input state, after the user inputs a question or instruction by voice, the graphical user interface changes from design 3 change state view 1 to design 3 change state view 2 to display the response to the question or instruction input by the user; in design 4, the user touches or clicks the voice input button in the main view of design 4, the graphical user interface changes from the main view of design 4 to design 4 change state view 1 to display the voice input state, after the user inputs a question or instruction by voice, the graphical user interface changes from design 4 change state view 1 to design 4 change state view 2 to display the question or instruction input by the user, after the user finishes voice input, the graphical user interface changes from design 4 change state view 2 to design 4 change state view 3 to display the response to the question or instruction input by the user; in design 5, the user touches or clicks the voice input button in the main view of design 5, the graphical user interface changes from the main view of design 5 to design 5 change state view 1 to display the voice input state, after the user inputs a question or instruction by voice, the graphical user interface changes from design 5 change state view 1 to design 5 change state view 2 to display the response to the question or instruction input by the user; in design 6, the user touches or clicks the voice input button in the main view of design 6, the graphical user interface changes from the main view of design 6 to design 6 change state view 1 to display the voice input state, after the user inputs a question or instruction by voice, the graphical user interface changes from design 6 change state view 1 to design 6 change state view 2 to display the question or instruction input by the user, after the user finishes voice input, the graphical user interface changes from design 6 change state view 2 to design 6 change state view 3 to display the response to the question or instruction input by the user. 8. Other matters Other matters: The part of the graphical user interface shown by the dotted line in each view of Design 1 to Design 6 does not constitute the part claimed in the design.

1. The name of the design product: network intelligent vision training light music lighting headlamp. 2. The use of the design product: for listening to music, making and receiving calls, intelligent voice dialogue, answering questions, vision training, supplementing light nutrition for eyes, indoor reading lamp lighting, outdoor cycling lighting. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective drawing.

To provide a controller and a personal history creation control program for continuing a conversation without reducing the creation desire of a personal history creation object person.SOLUTION: In a personal history creation system in which a terminal and a voice conversation generation device that is a control device communicate with each other via a network, the voice conversation generation device 16 includes a voice conversation AI that is executed using a predetermined scenario program 50 and an interactive-type generation function execution unit 52 that assists the progress of the scenario program, and receives an answer from a user by providing the user with a question for extracting information related to a specific theme that prompts the user to recall a personal history, and a recall information and summary information storage unit 62 that accumulates a plurality of pieces of recall information of the user acquired by repeating the voice conversation function. The scenario program instructs the interactive-type generating AI executing unit to execute a free conversation that includes at least simple response, sympathy, and synchronization for increasing the amount of speech from the user, and that follows the user who is the conversation partner.SELECTED DRAWING: Figure 3