90 results about "Interactive audio" patented technology

The invention discloses a multi-modal sentiment analysis method and device, and relates to the technical field of sentiment analysis, and the method comprises the steps: carrying out the feature extraction and modal alignment of to-be-detected multi-modal sentiment data, and determining an aligned text feature, an aligned video feature and an aligned audio feature; performing feature enhancement on the aligned video features and the aligned audio features based on the aligned text features to generate enhanced video features and enhanced audio features; performing cross-modal cross attention fusion by adopting the aligned text features, the enhanced video features and the enhanced audio features, and constructing interactive text features, interactive video features and interactive audio features; and performing later fusion on the interactive text features, the interactive video features and the interactive audio features, performing emotion prediction, and outputting an emotion analysis result. The feature quality of audio and video modals is improved by adopting an audio and video feature enhancement mechanism, and cross-modal feature interaction and multi-modal late fusion are effectively combined, so that the reliability of multi-modal sentiment analysis is improved on the whole.

The invention relates to the field of voice recognition and analysis, in particular to a voice interaction recognition and analysis method and system based on a Bluetooth headset. The method comprises the following steps: identifying environment audio information of a current wearer based on a Bluetooth earphone; carrying out noise space distribution modeling on the environment audio information of the current wearer, and constructing an environment noise real-time distribution field; carrying out noise distribution change trend analysis on the environment noise real-time distribution field, and carrying out dynamic audio receiving adaptation calculation to obtain an optimal audio adaptation receiving parameter; carrying out real-time interactive audio perception on the wearer according to the optimal audio adaptive receiving parameters, carrying out sound quality detail enhancement processing, and constructing a sound quality detail enhanced audio signal; and performing deep audio semantic analysis and instant semantic ambiguity analysis on the sound quality detail enhanced audio signal, and marking an audio segment of semantic ambiguity. According to the invention, accurate and efficient voice interaction recognition analysis is realized.

The application software of an educational entertainment method / system is provided, to be performed by a computer system having a processor and a memory, which teaches from scratch, how to build a NASCAR race car (“stock car racing”), that complies with the official NASCAR rulebook's rules and guidelines; providing a step-by-step building process, comprised by the specifications and interactive audio-visual images of each one of the car parts, or set of parts, that have to be installed in the car, further including the detailed instructions of the task to be performed at each step. A link is provided to purchase the parts online.

Embodiments are directed to a wearable audio device, such as an earbud. The earbud may be configured to detect input using various sensors and structures. For example, the earbud may be configured to detect gestures, physical manipulations, and so forth performed along or on the earbud. In response to the detected inputs, the earbud may be configured to change various outputs, such as an audio output or a haptic output of the device. The earbud may also include a microphone to register voice commands. In some cases, the microphone may be used to control the earbud using the registered voice command in response to one or more detected gestures or physical manipulations.

Generating audio tracks is provided. The system selects a digital component object having a visual output format. The system determines to convert the digital component object into an audio output format. The system generates text for the digital component object. The system selects, based on context of the digital component object, a digital voice to render the text. The system constructs a baseline audio track of the digital component object with the text rendered by the digital voice. The system generates, based on the digital component object, non-spoken audio cues. The system combines the non-spoken audio cues with the baseline audio form of the digital component object to generate an audio track of the digital component object. The system provides the audio track of the digital component object to the computing device for output via a speaker of the computing device.

The invention discloses a gas stove intelligent control method based on biological recognition and AI learning, and relates to the technical field of data processing. The method comprises the following steps: acquiring original audio data through audio acquisition equipment, extracting a current audio feature from the original audio data, and verifying a user identity according to the current audio feature; if the identity verification is passed, analyzing the current audio features into user text information and storing the user text information; matching context information of the current user text information; inputting the context information and the current user text information into a multi-round dialogue model to generate an operation instruction and / or interactive text information; and converting the interactive text information into interactive audio data through audio output equipment, outputting the interactive audio data, and controlling the gas stove according to the operation instruction. The contextual information and the current user text information are combined to generate the operation instruction and / or the interaction text information, so that the user intention is accurately recognized, intelligent decision making and continuous interaction are achieved, the user experience is improved, and the risk of misoperation is reduced.

Generating audio tracks is provided. The system selects a digital component object having a visual output format. The system determines to convert the digital component object into an audio output format. The system generates text for the digital component object. The system selects, based on context of the digital component object, a digital voice to render the text. The system constructs a baseline audio track of the digital component object with the text rendered by the digital voice. The system generates, based on the digital component object, non-spoken audio cues. The system combines the non-spoken audio cues with the baseline audio form of the digital component object to generate an audio track of the digital component object. The system provides the audio track of the digital component object to the computing device for output via a speaker of the computing device.

The present invention relates to the field of intelligent interaction technology, and discloses a big data driven digital human intelligent interaction method and system, the method comprising: extracting interactive audio and video frame sets in user historical interactive videos, performing image smoothing and image equalization on each video frame in the video frame set to obtain enhanced video frames; identifying interactive texts corresponding to interactive audios; extracting feature time sequence information of enhanced video frames, interactive texts and interactive audios respectively, performing feature interaction on the feature time sequence information to obtain multimodal features; calculating target interactive texts and corresponding target interactive voices according to multimodal features, generating target interactive expressions according to target interactive texts and target interactive voices; constructing interactive videos of target digital humans according to target interactive texts, target interactive voices and target interactive expressions, and using interactive videos to interact with users. The present invention can improve the accuracy of intelligent interaction of digital humans.

Data processing systems and methods comprising: receiving, from a computing device via a network, data packets indicating a request; selecting, based on the request, a digital component object associated with metadata and having a visual output format; determining to convert the digital component object into an audio output format; obtaining, responsive to the determination, text for the digital component object; selecting, based on context of the digital component object, a digital voice to render the text; constructing a baseline audio track of the digital component object with the text rendered by the digital voice; generating, based on the digital component object, non-spoken audio cues and combining them with the baseline audio form of the digital component object to generate an audio track of the digital component object; and providing the audio track of the digital component object to the computing device for output via a speaker of the computing device.

Methods and devices provide physiological movement detection, such as gesture, breathing, cardiac and / or gross body motion, with active sound generation such as for an interactive audio device. The processor may evaluate, via a microphone coupled to the interactive audio device, a sensed audible verbal communication. The processor may control producing, via a speaker coupled to the processor, a sound signal in a user's vicinity. The processor may control sensing, via a microphone coupled to the processor, a reflected sound signal. This reflected sound signal is a reflection of the generated sound signal from the vicinity or user. The processor may process the reflected sound, such as by a demodulation technique, to derive a physiological movement signal. The processor may generate, in response to the sensed audible verbal communication, an output based on an evaluation of the derived physiological movement signal.

The invention discloses a multivariate evaluation method, system and device based on multi-scene education information analysis. The method comprises the following steps: acquiring classroom interaction audio data, after-class voice comment data, roll book image data, non-teaching scene voice data and third-party operation data; through voice preprocessing and image preprocessing, classroom analysis data, after-class analysis data, subject information analysis data and non-teaching scene analysis data are obtained; combining the after-class analysis data and the subject information analysis data to obtain stage feedback data; performing matching analysis on the classroom interaction audio data, the after-class voice comment data and the non-teaching scene voice data, and obtaining behavior analysis data through evaluation analysis; and performing optimization and correction by combining with the third-party operation behavior data, and further obtaining student multivariate evaluation data through multivariate analysis. According to the method, the problem that the evaluation method has defects in comprehensiveness and accuracy is solved, and meanwhile, the manual workload is reduced through automatic evaluation.

The invention provides a Parkinson's disease auxiliary diagnosis method and system based on multi-stage interactive audio-visual fusion, and belongs to the technical field of auxiliary diagnos.The Parkinson's disease auxiliary diagnosis method comprises the steps that image data and audio data of a patient to be diagnosed are obtained, and the image data comprise a dynamic optical flow image and a static apparent image; a multi-scale dynamic and static feature extraction module is adopted to extract dynamic features and static features of the dynamic optical flow image and the static apparent image; inputting the dynamic features and the static features of each scale into a dynamic and static feature fusion module for fusion to obtain video modal features of each scale; a time-frequency attention speech feature extraction module is adopted to extract speech modal features from the audio data; fusing the video modal features of each scale and the voice modal features of the corresponding scale by using a global and local attention fusion module to obtain audio-visual fusion features; and inputting the audio-visual fusion features into a full-connection layer classification network, and outputting a classification result to assist diagnosis.

Automated systems and methods are provided for processing speech, comprising obtaining a digitally-encoded speech representation corresponding to a telecommunication interaction, wherein the digitally-encoded speech representation includes at least one of a voice recording or a transcript derived from audio of the telecommunication interaction; obtaining a digitally-encoded data set corresponding to at least one structured feature of the telecommunication interaction; obtaining a reference set, wherein the reference set includes a set of binary-classified existing satisfaction classifications; obtaining a trained machine learning algorithm, wherein the machine learning algorithm has been trained using a first plurality of reference telecommunication interactions which include user-provided satisfaction scores; extracting a feature set from the digitally-encoded speech representation; and by the machine learning algorithm and based on at least one structured feature and the feature set, generating a predicted satisfaction classification for the telecommunication interaction.

A vehicle includes one or more wireless transceivers configured to establish one or more wireless communications with a mobile device; a plurality of speakers configured to output an audio; and a controller programmed to measure a location of a user carrying the mobile device within a predefined range from the vehicle using the one or more wireless communications, and adjust a volume of the one or more speakers using the location of the user.

The invention provides a vehicle system for interactive audio playback. A vehicle includes: one or more wireless transceivers configured to establish one or more wireless communications with a mobile device; a plurality of speakers configured to output an audio frequency; and a controller programmed to measure a location of a user carrying the mobile device within a predefined range from the vehicle using the one or more wireless communications, and to adjust a volume of one or more speakers using the location of the user.

The present invention discloses an intelligent interactive teaching system and method for English oral language emotion based on deep learning, which relates to the field of speech evaluation. The system includes an environment detection and evaluation module, a threshold comparison module, an audio-video collection and processing module, an optimization module, and a suggestion output module; the English oral language intelligent interactive environment evaluation coefficient obtained in the environment detection and evaluation module is compared with the threshold range and the reference threshold of the image, and the burst loss judgment evaluation coefficient of the English oral language intelligent interactive audio obtained in the audio-video collection and processing module is compared with the threshold. The present invention evaluates the English oral language intelligent interactive audio data input by the user to obtain the burst loss judgment evaluation coefficient of the English oral language intelligent interactive audio, and then outputs text, audio, and visual English oral language error correction suggestions according to the burst loss judgment evaluation coefficient of the English oral language intelligent interactive audio, solving the problem of insufficient accuracy in judging burst loss in the coarticulation change of context in the prior art.

Embodiments are directed to a wearable audio device, such as an earbud. The earbud may be configured to detect input using various sensors and structures. For example, the earbud may be configured to detect gestures, physical manipulations, and so forth performed along or on the earbud. In response to the detected inputs, the earbud may be configured to change various outputs, such as an audio output or a haptic output of the device. The earbud may also include a microphone to register voice commands. In some cases, the microphone may be used to control the earbud using the registered voice command in response to one or more detected gestures or physical manipulations.

To provide a favorable spatial audio for interactive audio environments.SOLUTION: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of multiple sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each sound sources of the multiple sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reflection of the input audio signal in a surface of the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source and further on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.SELECTED DRAWING: Figure 8

1. Name of the product in this design: Interactive Audiovisual Device for English Teaching. 2. Purpose of this design: For use in English teaching. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.

Methods, apparatuses, and computer program products are described for presenting an interactive audio-visual presentation of transaction documents. A method can include receiving a bill associated with a payor and payee, using a textual language processor or the like to identify content fields from the bill and assign markups and / or metadata to content fields, and using the content fields, markups, and / or metadata to generate an audio-visual presentation associated with the bill. This audio-visual presentation can be presented to the payor. The payee may then interact with the audio-visual presentation, for instance by verbal, visual, manual, or textual response. A verbal language processing engine, natural language processing engine, audio-visual language processing engine, or visual-manual language processing engine can be initiated to facilitate interpretation of the payee response and generate a further audio-visual presentation.

A wearable device for wearing by a patient in receipt of medication, comprising components of a medication and patient monitoring unit (MPMU) including: an interactive visual display unit (VDU), an interactive audio platform (AP) and a plurality of sensor units (SUs); and comprising components of an operating unit (OU) including: a processing unit (CPU) and memory, a wireless communication unit (WCU), a power supply unit (PSU) and an energy storage unit (ESU) wherein a plurality of sensor units comprises at least one dehydration sensor unit (DHSU).

Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. A first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the sound source in the virtual environment, and the first intermediate audio signal is associated with a first bus. A second intermediate audio signal is determined. The second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment. The second intermediate audio signal is determined based on a location of the sound source, and further based on an acoustic property of the virtual environment. The second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first and second buses.

The invention discloses a control method of interactive audio middleware, electronic equipment, a medium and a product. The control method comprises the following steps: acquiring demand information input by a user; based on the demand information, obtaining a tool capable of being called in a model context protocol server and tool information corresponding to the tool, and determining a currently called target function and corresponding description information; determining a called target tool and related parameters in the model context protocol server, and initiating a calling request to the target tool through the model context protocol host; and judging the received execution result in combination with the demand information, and sending the execution result to the user through the model context protocol host, or determining a next tool called in the model context protocol server and related parameters corresponding to the next tool. According to the method, intelligent operation is carried out on the Wwise editor through the natural language, the technical threshold of Wwise automatic processing is lowered, and a Wwise operation tool with high universality and reusability is achieved.

The invention discloses an AI dialogue idle state detection method, an AI dialogue system, an AI dialogue device and a storage medium. The method comprises the following steps: collecting audio data in real time and reporting the audio data to a server side; receiving an interactive audio packet replied by the server in response to the audio data, and reading the byte length of the interactive audio packet; in response to the situation that the byte length of the interactive audio packet does not exceed the byte length of the silent audio packet, counting the silent duration of continuously receiving the interactive audio packet which does not exceed the byte length of the silent audio packet; and in response to the silence duration reaching a preset duration threshold, disconnecting the connection with the server side. By means of the mode, whether the equipment end is in the idle state or not can be simply and effectively detected, the equipment end is actively disconnected with the server end in the idle state, unnecessary access to the server end is reduced, service charges are reduced, and service cost and equipment end operation cost are simply and effectively reduced.

An attraction system includes a display that operates to present augmented reality and / or virtual reality (AR / VR) imagery to a guest in an interactive space. The system includes an audio controller that operates an array of speakers that are distributed throughout the interactive space and a controller having one or more processors. The one or more processors are operable to receive data indicative of a state of the guest (e.g., an action, movement, or gesture of the guest, an input received from an input device). The one or more processors are also operable to adjust the AR / VR imagery in response to the state of the guest, and instruct the audio controller to operate the array of the speakers to provide interactive audio based on the state of the guest and such that the interactive audio presents to the guest as though originating from a dynamic portion of the AR / VR imagery.

1. The name of this design product: Wireless screen projector (HDMI). 2. Purpose of this design product: used for wireless interactive audio and video transmission from signal output devices to display devices. 3. The design key point of this appearance design product lies in the shape. 4. The picture or photo that best illustrates the design points: three-dimensional picture.

An autonomous mobile system comprising: a means of achieving mobility, a means of navigating, a means of providing autonomous power, and a means of providing general purpose computing. In some embodiments, the system comprises a base unit capable of sensing its environment and computing navigation instructions to direct the system to move to particular locations and execute functions as directed by a set of programmed instructions. In some embodiments, two or more time-of-flight (TOF) imaging systems are attached to measure distance to objects in the environment, which may in turn be used by the means of navigating. In some embodiments, a coupling exists on the base unit to attach additional structures and mechanisms. These structures may comprise a means for carrying packages or other items, robotic manipulators that can grab and move objects, interactive audio and video displays for telepresence applications, a means for serving food and drink, etc.

Generating audio tracks is provided. The system selects a digital component object having a visual output format. The system determines to convert the digital component object into an audio output format. The system generates text for the digital component object. The system selects, based on context of the digital component object, a digital voice to render the text. The system constructs a baseline audio track of the digital component object with the text rendered by the digital voice. The system generates, based on the digital component object, non-spoken audio cues. The system combines the non-spoken audio cues with the baseline audio form of the digital component object to generate an audio track of the digital component object. The system provides the audio track of the digital component object to the computing device for output via a speaker of the computing device.

The invention provides an intelligent voice interaction method and device based on a big language model, and the method comprises the steps: receiving an interaction instruction sent by a voice interaction end, and interaction audio data corresponding to the interaction instruction, carrying out the tone analysis of the interaction audio data based on the big language model, generating a prediction value segment, and calling a broadcast statement corresponding to the interaction instruction; calling basic information of a binding person set by the corresponding binding end based on the predicted numerical value segment, and performing display customization on the broadcast statement according to the basic information to obtain a display word size; acquiring environmental noise acquired by the acquisition device, and performing broadcast customization adjustment on the character interval duration and the broadcast volume of the broadcast characters in the broadcast statement according to the corresponding basic information and the environmental noise to obtain the customized interval duration and the customized volume of the adjacent broadcast characters; and sending the broadcast statement to a display interface of the voice interaction end for display according to the display word size, and controlling the voice interaction end to play the broadcast statement based on the customized interval duration and the customized volume.