482 results about "First language" patented technology

The invention provides a multi-mode voice interaction method based on a large model, electronic equipment and a storage medium, and the method comprises the steps: carrying out the voice recognition of the voice data of a first language inputted by a user, and obtaining a first language text; performing language translation on the first language text to translate the first language text into a second language text; performing semantic analysis on the second language text to obtain a semantic analysis result; performing multi-modal knowledge graph construction on the semantic analysis result based on a preset large model to obtain an enhanced semantic understanding result; wherein the multi-modal information related to the second language text is fused in the multi-modal knowledge graph; generating a dialogue strategy of the enhanced semantic understanding result; and performing voice synthesis based on the dialogue strategy to generate reply voice data expressed in the first language. According to the method and the device, multi-language interaction is realized, and meanwhile, various modal information is fused.

Sanitizing data can be a cumbersome task, particularly when the volume of data is large, the content is sensitive, and / or the type of sanitation requires contextual determinations. Sanitizing large amounts of data is tedious and may often require highly trained personnel with clearances and / or other qualifications. In the systems and methods of the present disclosure, language models (LMs) are used to solve these and other technical issues with tools that may allow sanitizing data easily, with high versatility, context awareness, and / or low demand for computational resources. In particular, some of the disclosed systems and methods use a first language model and a second language model (being less resource-intensive than the first language model) to generate sanitized output data with improved efficiency and accuracy. This dual-model approach ensures that sensitive information is handled appropriately while optimizing computer resource usage.

Systems and methods for generating speaker video and audio in multiple languages for videoconferencing are provided. For example, a computing device can access a speaker speech audio signal that includes a speaker speech in a first language, a video of the speaker and a translated speech audio signal of the speaker speech in a second language. The computing device generates, based on the translated speech audio signal, a converted translated speech audio signal that includes a speech in the second language having voice characteristics in the speaker speech. The computing device further generates a lip-synched speaker video based on the video of the speaker and the converted translated speech audio signal. Lip movements in the lip-synched speaker video correspond to the converted translated speech audio signal. The converted translated speech audio signal and the lip-synched speaker video are transmitted to a video conference provider configured to host the video conference.

The present invention provides a data extraction method for entity evaluation. The method is used for extracting target data on the basis of a predefined indicator, and comprises: an underlying data processing step: at least comprising using a first language model to identify identical events in underlying data; and an indicator data extraction step: at least comprising, on the basis of the predefined indicator, using the first language model to extract target data from among the underlying data, wherein a base large model of the first language model comprises a large language model based on a Transformer model architecture, and the first language model is obtained by training on the basis of the base large model. The technology of the present invention can significantly improve the accuracy of data extraction and reduce training costs.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing text-to-speech modeling. In some implementations, a computer device receives input text in a first language to convert to a desired speech in a second language. The computer device receives one or more criteria for modifying the desired speech and converts the input text to a desired text in the second language. The computer device generates audio representations of the desired text in the second language and predicts, for each of the audio representations of the desired text and using the one or more received criteria, a pitch value and a duration value. The computer device generates the desired output speech using the predicted pitch value and the predicted duration value for each of the audio representations and provides the desired speech for output.

A method for generating a first case dataset in a first language. The method includes receiving adverse event data. The method further includes determining case data including general case data and regional case data and providing the case data to a translator computing device to enable display on a user interface including multiple duolingual text fields with a first language text field including at least a portion of the text data in the first language and a second language text field adjacent the first language text field. The method further includes receiving the text data in the second language from a translator computing device. The text data in the second language is received via the second language text fields of the plurality of duolingual text fields. The method further includes generating and outputting the first case dataset including the text data in the first language.

Provided herein are systems, methods, and computer-readable media for improving results from machine learning models. An example method may include obtaining a user input query; generating first logits from a first language model by applying the first language model to the user input query; generating second logits from a second language model by applying the second language model to the user input query; combining the first logits and the second logits; determining probabilities associated with tokens from the combined first logits and second logits; and generating an output token based on the determined one or more probabilities.

Methods, apparatus, and processor-readable storage media for filtering content for automated user interactions using language models are provided herein. An example method includes obtaining a plurality of portions of content based on a query corresponding to one or more topics related to an organization, where the plurality of portions of content is retrieved from at least one content source corresponding to the organization, and configuring a first language model instance to generate a score for each portion of content in the plurality of portions of content based on its relevancy to the query. The method includes filtering the plurality of portions of content based at least in part on one or more filtering criteria and the score generated for each portion, and generating, using a second language model instance, a response to the query, where the response is based on the portions of content resulting from the filtering.

Devices and techniques are generally described for unlearning information from large language models (LLMs). In various examples, a first language model (LM) trained on a first training corpus D may be determined. First data F that is a subset of D may be determined. A first auxiliary LM may be trained using the first training corpus D and a second auxiliary LM may be trained using a second training corpus D / F, where the second training corpus D / F represents the first training corpus D without the first data F. A first text input may be determined. The first LM may be updated based at least in part on a first prediction difference between predictions the first LM and the second auxiliary LM for a first set of inputs and a second prediction difference between the predictions of the first LM and the first auxiliary LM for the first set of inputs.

The invention relates to a training method of a translation model, a text translation method and a training method of a generative model. The method comprises the steps that a training text of a first language is input into an initial translation model, a model output text is obtained, and the model output text comprises a model translation text of a second language; obtaining a format reward corresponding to the model output text based on the format of the model output text, wherein the format reward is used for representing whether the model output text accords with a preset format; obtaining a measurement reward corresponding to the model translation text based on the training text and the model translation text, wherein the measurement reward is used for representing the translation quality of the model translation text; obtaining a target reward according to the format reward and the measurement reward; and training the initial translation model based on the target reward and a preset reinforcement learning algorithm to obtain a target translation model. According to the training method, a format and measurement mixed reward mode is adopted, a guidance signal with rich and effective information is provided for reinforcement learning, and the translation quality of the translation model can be improved.

A method for extracting and processing audio data may include receiving one or more packets of multimedia content. The one or more packets of multimedia content may comprise audio data. The method may further include extracting the audio data from the one or more packets of multimedia content. The audio data may comprise verbal speech in a first language. The method may further include converting the audio data into first text data in the first language based on the verbal speech in the first language. The method may further include providing the first text data to a generative machine-learning model. The generative machine-learning model may have been trained to translate the first text data in the first language to a second language and generate second text data in the second language. The method may further include transmitting, to a user interface, the second text data in the second language.

A method for generating a first case dataset in a first language. The method includes receiving adverse event data. The method further includes determining case data including general case data and regional case data and providing the case data to a translator computing device to enable display on a user interface including multiple duolingual text fields with a first language text field including at least a portion of the text data in the first language and a second language text field adjacent the first language text field. The method further includes receiving the text data in the second language from a translator computing device. The text data in the second language is received via the second language text fields of the plurality of duolingual text fields. The method further includes generating and outputting the first case dataset including the text data in the first language.

Embodiments of the present disclosure disclose a text generation method and apparatus, an electronic device, and a storage medium. The method includes: extracting events from a video to be processed, and determining target video frames corresponding to the events; extracting frame features of the target video frames, and determining event features based on the frame features; concatenating the event features in an extraction order of corresponding events, to generate a prompt text; and generating, by a first language model, a description text of the video to be processed based on the prompt text. By concatenating the event features in the extraction order of the corresponding events to obtain the prompt text, and inputting the prompt text into the first language model, the first language model can be enabled to perceive content and order of different events in the video, which can improve the text generation effect.

The invention discloses a language migration detection method and device, equipment and a storage medium, and relates to the technical field of computers. The method comprises the steps of obtaining a first language source code and a second language migration code, wherein the second language migration code is obtained by migrating the first language source code to a second language environment; analyzing the first language source code to obtain a first abstract syntax tree, and analyzing the second language migration code to obtain a second abstract syntax tree; respectively encoding each first node of the first abstract syntax tree and each second node of the second abstract syntax tree through a pre-trained semantic encoder to obtain a first semantic vector of each first node and a second semantic vector of each second node; and inputting the first semantic vector and the second semantic vector into a pre-trained logic detection model, and determining whether the logic of the first language source code and the logic of the second language migration code are consistent or not through the logic detection model, thereby realizing comprehensive detection of the business logic of the source code and the migration code.

The invention provides an information processing method and device, a model training method and device, equipment, a medium and a product, and relates to the technical field of computers. The public opinion information processing method comprises the steps that on the basis of a first language model, a crawled original language text is coded to obtain an original language vector, on the basis of a second language model, a target language text is coded to obtain a target language vector, the target language text is generated by translating the original language text, and the first language model is a multi-language model; generating a sentence-level first fusion vector and a word-level second fusion vector based on the original language vector and the target language vector; obtaining corresponding theme features and emotion features based on the first fusion vector; performing entity extraction on the second fusion vector to obtain entity features; and generating a public opinion analysis result based on the subject features, the emotion features and the entity features. According to the technical scheme, the public opinion association capture capability is enhanced through multi-feature joint analysis, and the public opinion analysis efficiency and accuracy can be improved.

An AI-based application uses AI models to expeditiously identify a product or service most relevant to an issue input to the application instead of a user navigating a platform or catalogue of products / services. The application prompts a first language model to convert the input description into a structured description of the issue. The application then, for each product / service category, prompts a second language model to identify a product / service most relevant to the structured description within each product / service category. The application then returns an identification of a product / service determined to be most relevant to the issue as represented by the structured description, confidence in the identification, and a reason the product / service was identified.

The invention relates to a speech translation method, device and equipment of an end cloud translation system and a medium, and relates to the technical field of intelligent speech translations, the end cloud translation system comprises an audio receiving end and a cloud, the method is applied to the audio receiving end, and the method comprises the following steps: obtaining a first language audio of the audio receiving end; sending the first language audio to a cloud; and receiving and playing a second language audio, wherein the second language audio is translated by the cloud according to the first language audio and then is sent out. The method can be widely applied to cross-border conference scenes, and the cross-language communication efficiency and experience are improved.

A method of enabling a language model trained in a first language to support a second language includes extending an existing vocabulary of the language model to include additional tokens for text in the second language. The method also includes initializing the additional tokens for text in the second language based on subtokens of tokens for text in the first language from the existing vocabulary. The method further includes training the language model using a mixed language dataset that includes a first language corpus and a second language corpus. In addition, the method includes performing instruction tuning using a dataset that includes (i) instruction and response pairs involving the first language and (ii) instruction and response pairs involving the second language.

To provide high-precision dialogues while suppressing costs.SOLUTION: A processing device: recognizes contents of a user's utterance; generates a prompt text including a list of multiple first language models specialized for understanding intent in multiple predetermined domains and the contents of the utterance; inputs the prompt text into a second language model; identify the first language model with a domain corresponding to the content of the utterance based on the contents of the response obtained from the second language model; and transfers the contents of the utterance to the identified first language model.SELECTED DRAWING: Figure 1

The invention relates to the technical field of image processing, and provides a cartoon image generation method and device, equipment and a storage medium, and the method comprises the steps: obtaining an initial role image corresponding to each role in a novel text; based on a first language sub-model of a preset language model, determining a split text corresponding to at least one split in the novel text; based on a second language sub-model of the language model, according to the split text, determining a split prompt word, a role prompt word and a role distribution position corresponding to the split; based on a first image sub-model of a preset text graph model, according to the initial role image, a role prompt word corresponding to the sub-mirror and a role distribution position, determining a posture of a role in the sub-mirror; and based on a second image sub-model of the text graph model, according to the initial role image corresponding to each role in the sub-mirror, the posture of the role and the sub-mirror cue word, determining a sub-mirror image corresponding to the sub-mirror. The role and the text description in the split image generated through the preset language model and the text graph model are consistent.

The invention provides a simultaneous translation method based on a Bluetooth headset, a mobile terminal and the Bluetooth headset, the method comprises the steps that connection is established between the mobile terminal and the Bluetooth headset, and the headset and a charging bin are connected with the mobile terminal through the Bluetooth technology. Meanwhile, the mobile terminal is connected with an application program of the mobile terminal through a Bluetooth low-power-consumption technology; when the earphone or the charging bin needs to send voice information, acquiring voice transmission authority by preempting a Bluetooth technology link focus of the mobile terminal; the device obtaining the voice transmission authority collects voice information of a first language in real time, transmits the voice information to the mobile terminal, and translates the voice information of the first language into voice information of a target language; and after the translation is completed, the other device grabs the link focus of the mobile terminal to obtain a voice playing permission and plays the voice information of the target language, so that the Bluetooth earphone has a simultaneous translation function.

One or more embodiments of the invention provide a language model-based question and answer method, apparatus and device, and a storage medium. The method comprises the steps of obtaining a to-be-solved question; determining a task type corresponding to the question, and selecting a target first language model corresponding to the task type from at least one first language model; the question is input into the target first language model, a thinking chain reasoning step corresponding to the question is generated through the target first language model, the thinking chain reasoning step and the question are input into a second language model, and the second language model conducts thinking chain reasoning on the basis of the thinking chain reasoning step. Generating an answer corresponding to the question; wherein the number of the model parameters of the first language model is smaller than the number of the model parameters of the second language model. According to the method, the calculation cost and the response delay of the model can be effectively reduced while the generation precision of the model is ensured.

The invention provides a language model fine tuning method and device, electronic equipment and a storage medium, and relates to the field of natural language model processing, and the method comprises the steps: obtaining sample data which comprises a plurality of data with different data qualities; reasoning the sample data for multiple times based on the first language model to generate multiple pieces of result information and multiple pieces of process information; determining a loss weight based on the multiple pieces of result information and the first label of the sample data; on the basis of the multiple pieces of result information, the multiple pieces of process information and a first label of the sample data, determining thinking chain data; and based on the thinking chain data and the loss weight, determining a target loss, and performing fine tuning on the to-be-fine-tuned model based on the target loss to obtain a target language model. According to the method, the quality of the sample data and the logical thinking ability of model reasoning are concerned in the optimization of the to-be-fine-tuned model through the loss weight and the thinking chain data, so that the interpretability and the mathematical ability of the language model are effectively improved, and the error rate of the model is reduced.

The present disclosure describes various methods, systems, and storage medium for training a language model to obtain an iterative Nash policy optimized (INPO) language model. The method includes initializing a first language model by a reference language model; for N-th iteration with N starting from 1 to M, generating a plurality of responses using the N-th language model for each prompt in a plurality of prompts, and constructing a preference dataset using a preference oracle based on the plurality of responses for each prompt, wherein the preference dataset comprises a winning response and a losing response; training the N-th language model to obtain a (N+1)-th language model by minimizing a value of an INPO function for all preference dataset for the plurality of prompts, wherein the INPO function comprises an expectation term, a regularization term, and a modification term; and outputting the (M+1)-th language model.

Devices, systems, and techniques are disclosed that implement the training and deployment of automatic transcription-based translation systems using language models. The techniques include: processing, using a first speech-to-text (S2T) model, an initial input that includes spoken language in a first language to generate a transcription of the spoken language; and processing, using a second S2T model, a second input to generate a translation of the spoken language into a second language. The second input includes at least a representation of the spoken language and the transcription of the spoken language.

A dialogue system, comprising:an input, configured to receive input data from a user, wherein the input data comprises one or more of text data, speech data, image data and motion data; an output, configured to output data to the user; and one or more processors, configured to:obtain information identifying a skill and obtain information identifying a proficiency level of the user for the identified skill from stored proficiency level information; and execute at least one iteration of a coaching session, each iteration comprising performing one or more dialogue interactions, wherein each dialogue interaction comprises:receiving first input data from the user via the input;generating a first language model prompt and providing the first language model prompt to a language model, said first language model prompt comprising the first input data, the information identifying a skill, the information identifying a proficiency level of the user for the identified skill and a request to generate coaching information based on the first input data, the information identifying a skill and the information identifying a proficiency level; and generating first output data based on a first language model response to the first language model prompt and outputting, via the output, the first output data to the user;wherein the at least one iteration of the coaching session further comprises, after the one or more dialogue interactions:generating a second language model prompt and providing the second language model prompt to the language model, said second language model prompt comprising the information identifying a skill, the information identifying a proficiency level of the user for the identified skill, the first input data and the first output data, and a request to generate at least one proficiency update assessment based on the first input data, the first output data, the identified skill and the information identifying a proficiency level; generating second output data based on a second language model response to the second language model prompt and outputting, via the output, the second output data to the user; receiving second input data from the user via the input; determining a revised proficiency level of the user for the identified skill based on the second input data; andupdating the stored proficiency level information based on the revised proficiency level.

An estimation method includes: obtaining a first voice feature group of a plurality of persons who speak a first language; obtaining a second voice feature group of a plurality of persons who speak a second language; obtaining a voice feature of a subject; correcting the voice feature of the subject according to a relationship between the first voice feature group and the second voice feature group; estimating, from the voice feature of the subject that has been corrected, an oral function or a cognitive function of the subject by using an estimation process for an oral function or a cognitive function based on the second language; and outputting a result of estimation of the oral function or the cognitive function of the subject.

A computer-implemented method of controlling an output from a dialogue system, the method comprising:receiving, by way of an input, first input data relating to speech or text provided by a user;selecting a first state from a plurality of states of a deterministic model, at least some states of the plurality of states being associated with a corresponding portion of a language model prompt including an instruction to call a corresponding function;responsive to the first state being associated with a corresponding portion, generating a first language model prompt comprising at least part of the corresponding portion associated with the selected first state;providing the first language model prompt as input to a language model to generate a first language model output;determining whether to execute a function based on the first language model output;responsive to determining to execute a first function based on the first language model output, executing the determined first function to generate a first function output;selecting a second state from the plurality of states based on the first function output;responsive to the second state being associated with a corresponding portion of a language model prompt, generating a second language model prompt comprising at least part of the corresponding portion associated with the selected second state;providing the second language model prompt as input to the language model to generate a second language model output;determining whether to provide an output to the user based on the second language model output; andresponsive to determining to provide an output to the user based on the second language model output, outputting, by way of an output, speech or text to the user.

A translation method is provided, including: encoding to-be-processed text information to obtain a source vector representation sequence, the to-be-processed text information belonging to a first language; obtaining a source context vector corresponding to a first instance according to the source vector representation sequence, the source context vector indicating to-be-processed source content in the to-be-processed text information at the first instance; determining a translation vector according to the source vector representation sequence and the source context vector; and decoding the translation vector and the source context vector, to obtain target information of the first instance, the target information belonging to a second language.