67 results about "Interactive audio" patented technology

The invention discloses a multi-modal sentiment analysis method and device, and relates to the technical field of sentiment analysis, and the method comprises the steps: carrying out the feature extraction and modal alignment of to-be-detected multi-modal sentiment data, and determining an aligned text feature, an aligned video feature and an aligned audio feature; performing feature enhancement on the aligned video features and the aligned audio features based on the aligned text features to generate enhanced video features and enhanced audio features; performing cross-modal cross attention fusion by adopting the aligned text features, the enhanced video features and the enhanced audio features, and constructing interactive text features, interactive video features and interactive audio features; and performing later fusion on the interactive text features, the interactive video features and the interactive audio features, performing emotion prediction, and outputting an emotion analysis result. The feature quality of audio and video modals is improved by adopting an audio and video feature enhancement mechanism, and cross-modal feature interaction and multi-modal late fusion are effectively combined, so that the reliability of multi-modal sentiment analysis is improved on the whole.

The invention relates to the field of voice recognition and analysis, in particular to a voice interaction recognition and analysis method and system based on a Bluetooth headset. The method comprises the following steps: identifying environment audio information of a current wearer based on a Bluetooth earphone; carrying out noise space distribution modeling on the environment audio information of the current wearer, and constructing an environment noise real-time distribution field; carrying out noise distribution change trend analysis on the environment noise real-time distribution field, and carrying out dynamic audio receiving adaptation calculation to obtain an optimal audio adaptation receiving parameter; carrying out real-time interactive audio perception on the wearer according to the optimal audio adaptive receiving parameters, carrying out sound quality detail enhancement processing, and constructing a sound quality detail enhanced audio signal; and performing deep audio semantic analysis and instant semantic ambiguity analysis on the sound quality detail enhanced audio signal, and marking an audio segment of semantic ambiguity. According to the invention, accurate and efficient voice interaction recognition analysis is realized.

The application software of an educational entertainment method / system is provided, to be performed by a computer system having a processor and a memory, which teaches from scratch, how to build a NASCAR race car (“stock car racing”), that complies with the official NASCAR rulebook's rules and guidelines; providing a step-by-step building process, comprised by the specifications and interactive audio-visual images of each one of the car parts, or set of parts, that have to be installed in the car, further including the detailed instructions of the task to be performed at each step. A link is provided to purchase the parts online.

Embodiments are directed to a wearable audio device, such as an earbud. The earbud may be configured to detect input using various sensors and structures. For example, the earbud may be configured to detect gestures, physical manipulations, and so forth performed along or on the earbud. In response to the detected inputs, the earbud may be configured to change various outputs, such as an audio output or a haptic output of the device. The earbud may also include a microphone to register voice commands. In some cases, the microphone may be used to control the earbud using the registered voice command in response to one or more detected gestures or physical manipulations.

Generating audio tracks is provided. The system selects a digital component object having a visual output format. The system determines to convert the digital component object into an audio output format. The system generates text for the digital component object. The system selects, based on context of the digital component object, a digital voice to render the text. The system constructs a baseline audio track of the digital component object with the text rendered by the digital voice. The system generates, based on the digital component object, non-spoken audio cues. The system combines the non-spoken audio cues with the baseline audio form of the digital component object to generate an audio track of the digital component object. The system provides the audio track of the digital component object to the computing device for output via a speaker of the computing device.

Generating audio tracks is provided. The system selects a digital component object having a visual output format. The system determines to convert the digital component object into an audio output format. The system generates text for the digital component object. The system selects, based on context of the digital component object, a digital voice to render the text. The system constructs a baseline audio track of the digital component object with the text rendered by the digital voice. The system generates, based on the digital component object, non-spoken audio cues. The system combines the non-spoken audio cues with the baseline audio form of the digital component object to generate an audio track of the digital component object. The system provides the audio track of the digital component object to the computing device for output via a speaker of the computing device.

The present invention relates to the field of intelligent interaction technology, and discloses a big data driven digital human intelligent interaction method and system, the method comprising: extracting interactive audio and video frame sets in user historical interactive videos, performing image smoothing and image equalization on each video frame in the video frame set to obtain enhanced video frames; identifying interactive texts corresponding to interactive audios; extracting feature time sequence information of enhanced video frames, interactive texts and interactive audios respectively, performing feature interaction on the feature time sequence information to obtain multimodal features; calculating target interactive texts and corresponding target interactive voices according to multimodal features, generating target interactive expressions according to target interactive texts and target interactive voices; constructing interactive videos of target digital humans according to target interactive texts, target interactive voices and target interactive expressions, and using interactive videos to interact with users. The present invention can improve the accuracy of intelligent interaction of digital humans.

The invention discloses a multivariate evaluation method, system and device based on multi-scene education information analysis. The method comprises the following steps: acquiring classroom interaction audio data, after-class voice comment data, roll book image data, non-teaching scene voice data and third-party operation data; through voice preprocessing and image preprocessing, classroom analysis data, after-class analysis data, subject information analysis data and non-teaching scene analysis data are obtained; combining the after-class analysis data and the subject information analysis data to obtain stage feedback data; performing matching analysis on the classroom interaction audio data, the after-class voice comment data and the non-teaching scene voice data, and obtaining behavior analysis data through evaluation analysis; and performing optimization and correction by combining with the third-party operation behavior data, and further obtaining student multivariate evaluation data through multivariate analysis. According to the method, the problem that the evaluation method has defects in comprehensiveness and accuracy is solved, and meanwhile, the manual workload is reduced through automatic evaluation.

The invention provides a Parkinson's disease auxiliary diagnosis method and system based on multi-stage interactive audio-visual fusion, and belongs to the technical field of auxiliary diagnos.The Parkinson's disease auxiliary diagnosis method comprises the steps that image data and audio data of a patient to be diagnosed are obtained, and the image data comprise a dynamic optical flow image and a static apparent image; a multi-scale dynamic and static feature extraction module is adopted to extract dynamic features and static features of the dynamic optical flow image and the static apparent image; inputting the dynamic features and the static features of each scale into a dynamic and static feature fusion module for fusion to obtain video modal features of each scale; a time-frequency attention speech feature extraction module is adopted to extract speech modal features from the audio data; fusing the video modal features of each scale and the voice modal features of the corresponding scale by using a global and local attention fusion module to obtain audio-visual fusion features; and inputting the audio-visual fusion features into a full-connection layer classification network, and outputting a classification result to assist diagnosis.

The invention provides a vehicle system for interactive audio playback. A vehicle includes: one or more wireless transceivers configured to establish one or more wireless communications with a mobile device; a plurality of speakers configured to output an audio frequency; and a controller programmed to measure a location of a user carrying the mobile device within a predefined range from the vehicle using the one or more wireless communications, and to adjust a volume of one or more speakers using the location of the user.

The present invention discloses an intelligent interactive teaching system and method for English oral language emotion based on deep learning, which relates to the field of speech evaluation. The system includes an environment detection and evaluation module, a threshold comparison module, an audio-video collection and processing module, an optimization module, and a suggestion output module; the English oral language intelligent interactive environment evaluation coefficient obtained in the environment detection and evaluation module is compared with the threshold range and the reference threshold of the image, and the burst loss judgment evaluation coefficient of the English oral language intelligent interactive audio obtained in the audio-video collection and processing module is compared with the threshold. The present invention evaluates the English oral language intelligent interactive audio data input by the user to obtain the burst loss judgment evaluation coefficient of the English oral language intelligent interactive audio, and then outputs text, audio, and visual English oral language error correction suggestions according to the burst loss judgment evaluation coefficient of the English oral language intelligent interactive audio, solving the problem of insufficient accuracy in judging burst loss in the coarticulation change of context in the prior art.

Embodiments are directed to a wearable audio device, such as an earbud. The earbud may be configured to detect input using various sensors and structures. For example, the earbud may be configured to detect gestures, physical manipulations, and so forth performed along or on the earbud. In response to the detected inputs, the earbud may be configured to change various outputs, such as an audio output or a haptic output of the device. The earbud may also include a microphone to register voice commands. In some cases, the microphone may be used to control the earbud using the registered voice command in response to one or more detected gestures or physical manipulations.

To provide a favorable spatial audio for interactive audio environments.SOLUTION: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of multiple sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each sound sources of the multiple sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reflection of the input audio signal in a surface of the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source and further on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.SELECTED DRAWING: Figure 8

1. Name of the product in this design: Interactive Audiovisual Device for English Teaching. 2. Purpose of this design: For use in English teaching. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.

Methods, apparatuses, and computer program products are described for presenting an interactive audio-visual presentation of transaction documents. A method can include receiving a bill associated with a payor and payee, using a textual language processor or the like to identify content fields from the bill and assign markups and / or metadata to content fields, and using the content fields, markups, and / or metadata to generate an audio-visual presentation associated with the bill. This audio-visual presentation can be presented to the payor. The payee may then interact with the audio-visual presentation, for instance by verbal, visual, manual, or textual response. A verbal language processing engine, natural language processing engine, audio-visual language processing engine, or visual-manual language processing engine can be initiated to facilitate interpretation of the payee response and generate a further audio-visual presentation.

A wearable device for wearing by a patient in receipt of medication, comprising components of a medication and patient monitoring unit (MPMU) including: an interactive visual display unit (VDU), an interactive audio platform (AP) and a plurality of sensor units (SUs); and comprising components of an operating unit (OU) including: a processing unit (CPU) and memory, a wireless communication unit (WCU), a power supply unit (PSU) and an energy storage unit (ESU) wherein a plurality of sensor units comprises at least one dehydration sensor unit (DHSU).

The invention discloses a control method of interactive audio middleware, electronic equipment, a medium and a product. The control method comprises the following steps: acquiring demand information input by a user; based on the demand information, obtaining a tool capable of being called in a model context protocol server and tool information corresponding to the tool, and determining a currently called target function and corresponding description information; determining a called target tool and related parameters in the model context protocol server, and initiating a calling request to the target tool through the model context protocol host; and judging the received execution result in combination with the demand information, and sending the execution result to the user through the model context protocol host, or determining a next tool called in the model context protocol server and related parameters corresponding to the next tool. According to the method, intelligent operation is carried out on the Wwise editor through the natural language, the technical threshold of Wwise automatic processing is lowered, and a Wwise operation tool with high universality and reusability is achieved.

The invention discloses an AI dialogue idle state detection method, an AI dialogue system, an AI dialogue device and a storage medium. The method comprises the following steps: collecting audio data in real time and reporting the audio data to a server side; receiving an interactive audio packet replied by the server in response to the audio data, and reading the byte length of the interactive audio packet; in response to the situation that the byte length of the interactive audio packet does not exceed the byte length of the silent audio packet, counting the silent duration of continuously receiving the interactive audio packet which does not exceed the byte length of the silent audio packet; and in response to the silence duration reaching a preset duration threshold, disconnecting the connection with the server side. By means of the mode, whether the equipment end is in the idle state or not can be simply and effectively detected, the equipment end is actively disconnected with the server end in the idle state, unnecessary access to the server end is reduced, service charges are reduced, and service cost and equipment end operation cost are simply and effectively reduced.

An attraction system includes a display that operates to present augmented reality and / or virtual reality (AR / VR) imagery to a guest in an interactive space. The system includes an audio controller that operates an array of speakers that are distributed throughout the interactive space and a controller having one or more processors. The one or more processors are operable to receive data indicative of a state of the guest (e.g., an action, movement, or gesture of the guest, an input received from an input device). The one or more processors are also operable to adjust the AR / VR imagery in response to the state of the guest, and instruct the audio controller to operate the array of the speakers to provide interactive audio based on the state of the guest and such that the interactive audio presents to the guest as though originating from a dynamic portion of the AR / VR imagery.

1. The name of this design product: Wireless screen projector (HDMI). 2. Purpose of this design product: used for wireless interactive audio and video transmission from signal output devices to display devices. 3. The design key point of this appearance design product lies in the shape. 4. The picture or photo that best illustrates the design points: three-dimensional picture.

An autonomous mobile system comprising: a means of achieving mobility, a means of navigating, a means of providing autonomous power, and a means of providing general purpose computing. In some embodiments, the system comprises a base unit capable of sensing its environment and computing navigation instructions to direct the system to move to particular locations and execute functions as directed by a set of programmed instructions. In some embodiments, two or more time-of-flight (TOF) imaging systems are attached to measure distance to objects in the environment, which may in turn be used by the means of navigating. In some embodiments, a coupling exists on the base unit to attach additional structures and mechanisms. These structures may comprise a means for carrying packages or other items, robotic manipulators that can grab and move objects, interactive audio and video displays for telepresence applications, a means for serving food and drink, etc.

The invention relates to the technical field of audio equipment, and particularly discloses open type three-dimensional interactive audio equipment which comprises a bearing seat, an interactive audio equipment main body is arranged above the bearing seat, and grooves are formed in the left side and the right side of the interactive audio equipment main body; a first adjusting plate is slidably mounted in the groove, adjusting rods are rotatably mounted at the two ends of the outer side of the first adjusting plate, first connecting rods are rotatably mounted on the inner sides of the lower ends of the adjusting rods, fixed connecting blocks are fixedly mounted at the positions, close to the center, of the circumferential surface of each first connecting rod, and first adjusting rods are rotatably mounted at the lower ends of the fixed connecting blocks; therefore, the situation that the height of children is not enough in the interaction process can be avoided, and in the using process of the structure, the height of the interaction audio equipment main body cannot be adjusted at all, the situation that adults feel uncomfortable during watching is avoided, the situation that the adults hold the children for a long time is avoided, and the interestingness of the children is improved. And the physical strength of adults is saved.

The application belongs to the teaching application field of information technology, and provides a classroom teaching mode analysis system and method based on a large language model, which comprises the following steps: (1) interactive audio extraction in a classroom teaching video; (2) conversion of dialogue audio into interactive text, matching of the text and a voice actor, and output of the interactive text in a dialogue form; (3) construction of an education mode prompt word; and (4) classroom teaching mode analysis, wherein the interactive text in the dialogue form obtained in step (2) is subjected to block coding, and then each block coding vector and the prompt word generated in step (3) are jointly input into a large language model, all output results are fused based on probability and weight, and a final classroom teaching mode analysis result is obtained. The application provides a new approach for classroom teaching video teaching mode analysis, and promotes intelligent understanding of a classroom teaching process.

1. The name of the design product: AI interactive listening machine. 2. The use of the design product: for story listening, AI interaction. 3. The design points of the design product: in the combination of shape and pattern. 4. The picture or photo that best indicates the design points: perspective drawing.

Data processing systems and methods comprising: receiving, from a computing device via a network, data packets indicating a request; selecting, based on the request, a digital component object associated with metadata and having a visual output format; determining to convert the digital component object into an audio output format; obtaining, responsive to the determination, text for the digital component object; selecting, based on context of the digital component object, a digital voice to render the text; constructing a baseline audio track of the digital component object with the text rendered by the digital voice; generating, based on the digital component object, non-spoken audio cues and combining them with the baseline audio form of the digital component object to generate an audio track of the digital component object; and providing the audio track of the digital component object to the computing device for output via a speaker of the computing device.

A system for interacting with an audio stream to obtain lyric information, control playback of the audio stream, and control aspects of the audio stream. In some instances, end users can request that the audio stream play with a lead vocal track or without a lead vocal track. Obtaining lyric information includes receiving via a text to speech module an audio playback of the lyric information.

The invention discloses an interaction method and device based on virtual props, equipment and a storage medium, and belongs to the technical field of computers. The method comprises the steps that in the process of playing the interactive audio, a prompt animation of the interactive audio is displayed based on the aiming position of a virtual prop, and the prompt animation is used for prompting the playing progress of the interactive audio; when the aiming position is the position of the to-be-attacked object, in response to a release operation of the virtual prop, displaying a hit effect matched with the generation moment of the release operation; wherein the hit effects matched with different generation moments are different, and different generation moments correspond to different playing progresses of the interactive audio. Therefore, the interaction interest of the interaction object is improved, and the man-machine interaction rate is improved.

This application discloses an audio interaction method and program product. It includes: obtaining the acoustic feature vector of user-input audio; searching a composite vector database based on the acoustic feature vector to obtain target question-and-answer text that matches semantic feature vectors and sentiment feature vectors; and generating interactive audio based on the target question-and-answer text and the acoustic feature vector of the user-input audio. By retrieving and obtaining question-and-answer text that matches the acoustic feature vector of the user-input audio, and generating interactive audio based on the matched question-and-answer text and acoustic feature vector, the interactive audio can match the user's emotional tone while responding to the user's actual needs (i.e., the needs of semantic feature representation), achieving adaptive response to different user acoustic feature vectors. Furthermore, the analysis and matching of acoustic feature vectors reduces computational resource consumption to a certain extent, accelerates the generation speed of interactive audio, and further improves the user experience.

An autonomous system having mobility, navigation, power, and general purpose computing. In some embodiments, the system comprises a base unit capable of sensing its environment and computing navigation instructions to direct the system to move to particular locations and execute functions as directed by a set of programmed instructions. In some embodiments, two or more sensors, such as 3-D cameras, with a field of view larger than 180° are attached to measure distance to objects in the environment. Cameras may also be used to recognize objects in the environment, and may also be used by the navigation system. In some embodiments, a coupling exists on the base unit to attach additional structures and mechanisms. These structures may be elements such as a means for carrying packages or other items, robotic manipulators to grab and move objects, interactive audio and video displays, or devices for serving food and drink.