15294results about "Sound input/output" patented technology

In some embodiments, an electronic device generates virtual lighting effects while presenting a content item. In some embodiments, an electronic device enhances navigation to a respective playback position of a content item. In some embodiments, an electronic device displays media content in a three-dimensional environment. In some embodiments, an electronic device presents media content in different modes of presentation.

A system for displaying information indicative of driving conditions, to a driver, using a smart ring are disclosed. An exemplary system includes a smart ring with a ring band having a plurality of surfaces including an inner surface, an outer surface, a first side surface, and a second side surface. The system further includes a processor, configured to obtain data from a communication module within the ring band, or from one or more sensors disposed within the ring band. The obtained data are representative of information indicative of one or more driving conditions to be displayed to the driver. The smart ring also includes an electronic ink (e-ink) display disposed on at least one of the plurality of surfaces, and configured to present information indicative of the one or more driving conditions.

Disclosed herein is an audio system that can be customized by the user (including the developer) and that may allow the user to control more than just the sound levels and may allow the user to select more than one of a few pre-determined settings. Disclosed herein is a development platform that allows manufacturers (including the developers) to test various different parameters, settings, algorithms, functions, processes, accessories, and the like. The development platform allows the manufacturer to simulate the performances from possible options for the audio system, and then load the selected option from the development platform to the audio system. Additionally, the development platform that enables the end user to have the same level of control and ability to access, upload, and control plugins on the end user's device(s).

Implementations relate to processing an image of a machine-read-able identifier (e.g., a QR code or other 2D barcode) to extract information that is encoded in the machine-readable identifier, and using the extracted information in automatically populating input fields of a fillable form that is being rendered at an application (e.g., a web browser application) of a computing device. Some implementations convert certain information, extracted from a machine-readable identifier, to a converted format and cause the converted format information to be populated in a corresponding input field in lieu of the certain information in its raw format that is extracted from the machine-readable identifier.

Some examples of the disclosure are directed to systems and methods for displaying and interacting with a representation of a user interface of an electronic device in a three-dimensional environment. While presenting a first user interface, a first electronic device presents a representation of a second user interface of a second electronic device based on display data representing the second user interface. In response to detecting a respective event corresponding to user input, if a gaze of a user of the first electronic device is directed to the representation of the second user interface, the first electronic device causes the second electronic device to perform a first operation directed to the second user interface based on the respective event. Alternatively, if the gaze is directed to the first user interface, the first electronic device performs a second operation directed to the first user interface based on the respective event.

The present disclosure relates to systems, methods, and non-transitory computer-readable media that edit digital images using combinations of speech input and gesture interactions. For instance, in some embodiments, the disclosed systems receive speech input from a client device displaying a digital image within a graphical user interface, the digital image portraying an object. Additionally, the disclosed systems detect, via the graphical user interface, one or more gesture interactions with respect to the object of the digital image. Based on the speech input, the disclosed systems determine an edit for the object of the digital image indicated by the one or more gesture interactions. Further, the disclosed systems modify the object within the digital image using the edit indicated by the one or more gesture interactions.

Provide a system. [Solution] A system including: a means for utilizing generative AI to provide information that serves as an alternative to vision; a means for accessing the AI ​​via a smart device or headset; a means for acquiring environmental information in real time; a means for recognizing surrounding objects and people; and a means for conveying information in the form of voice, audio messages, haptic feedback, etc.

Systems and methods for activity-based device recommendations are disclosed. For example, historical usage data associated with a device may indicate that the device is likely to be associated with a given state at a given time. When the device is not in the anticipated state, a recommendation to transition the device state, for example, may be sent. Additionally, a determination of the activity state associated with the device, such as an active state, an asleep state, and / or an away state may be utilized to determine the recommendation to surface, to determine whether to send a recommendation, and when and / or how to send the recommendation.

An aero-engine augmented reality virtual-real fusion method based on depth prior scene reconstruction comprises the following steps: firstly, collecting data of an aero-engine look-around RGB image and a depth image, calculating a camera frame pose by using an SFM algorithm and obtaining a sparse point cloud, and optimizing the camera pose by using an ICP algorithm and the point cloud converted from the depth image to obtain an aligned prior dense point cloud; gaussian points are initialized based on the priori dense point cloud and the sparse point cloud, and random generation of 3D Gaussian is limited by using the boundary of the dense point cloud as geometric constraint; through the three-dimensional reconstruction of the adjacent multi-view enhancement strategy, the spatial and visual consistency is improved, and an aero-engine model is reconstructed; then understanding the reconstructed aero-engine model based on semantic segmentation, identifying and marking core components, and finally performing virtual-real fusion visualization on the reconstructed aero-engine through augmented reality to guide training, assembling and maintenance operations. According to the invention, rapid high-quality three-dimensional reconstruction and augmented reality virtual-real fusion visualization of the aero-engine are realized.

To enable appropriate response to a user input.SOLUTION: An action control system disclosed herein is configured to: input an instruction to inquire about a travel plan to a sentence generation model as a first prompt to generate a travel plan proposal; input an instruction to make a proxy reservation to the sentence generation model as a second prompt to generate a reservation plan proposal, input an instruction to inquire about items to bring on the travel to the sentence generation model as a third prompt to generate travel possession proposal; input an instruction to inquire about questions during travel to the sentence generation model as a fourth prompt to generate proposed answers; and acquire the generated travel plan proposal, reservation plan proposal, travel possession proposal, and proposed answers as a result of specific processing.SELECTED DRAWING: Figure 2A

Various implementations include audio devices and methods for spatializing audio output based on content. Certain implementations include at least one audio output device for providing an audio output based on data, and at least one controller coupled with the at least one audio output device, the controller configured to, use the data to determine a content type for the audio output from a group of content types, automatically select a spatialization mode for the audio output from a plurality of spatialization modes based on the determined content type, and apply the selected spatialization mode to the audio output.

The invention provides a multi-mode-based man-machine interaction method and system, and relates to the technical field of man-machine interaction. Voice input of a user is received, environment information is collected, facial expressions of the user are captured, and voice features, environment features and facial features are obtained based on the input; utilizing a pre-trained emotion recognition model to generate emotion features of the user, and utilizing a pre-trained user behavior model to generate behavior features according to the current operation information of the user; after the features are obtained, the first weights and the second weights of the features are dynamically adjusted, feature weighted fusion is carried out, and comprehensive features are obtained; the multiple candidate responses are generated based on the comprehensive characteristics, the final response is screened out through a preset scoring mechanism and output, comprehensive understanding of the intention and the emotional state of the user is achieved through comprehensive utilization of multiple data sources, and meanwhile the weight of each characteristic can be dynamically adjusted so that more intelligent and humanized interaction experience can be generated.

A system for remote guidance of medical procedures enables patients to be remotely trained by a healthcare provider on how to perform a medical procedure. The system implements Augmented Reality (AR) technology to enhance the remote training of the patient by the healthcare provider. The system includes a patient interface subsystem, a provider interface subsystem, a patient communication module, and a provider communication module. The patient interface subsystem includes an AR headset that enhances the training of the patient by providing video feed enhanced with AR instructional elements while simultaneously providing intelligent feedback during the training session. The provider interface subsystem allows the healthcare provider to remotely monitor and communicate with the patient and to provide the appropriate guidance to the patient during the training session. The patient communication module and the provider communication module allow for remote communication between the patient and the healthcare provider during the training session.

The invention relates to a personalized healthcare management system and method. The system integrates advanced technologies, immersive technology, and a data exchange platform to provide dynamic, personalized health insights and proactive management in a secure, interactive environment. It employs machine learning techniques to examine health-related data, forecast health risks, and propose preventive actions. The system also provides customised content based on user's progress, comprehension, and evolving health conditions. It combines health data, monitoring devices, and continuous health monitoring, and uses environmental data to forecast and alert users of potential health risks. The system also employs secure data technology for data privacy and security, and a machine learning framework for developing and deploying predictive models.

The invention relates to the technical field of press monitoring, in particular to a digital twinning-based three-dimensional monitoring system for a precision servo press, which comprises a physical layer sensing module for acquiring real-time operating parameters, environment variables and workpiece processing data of the press; the dynamic twin construction module constructs a total-factor digital twin, and simulates a force-heat-deformation coupling effect by using finite element analysis and a multi-body dynamics algorithm based on physical attributes and process parameters; the intelligent analysis center identifies a potential fault mode of the press machine and locates an abnormal source through multi-physics field simulation data in combination with an improved CNN-LSTM model; the three-dimensional visual interaction unit constructs an interactive immersive three-dimensional virtual scene, renders a running state and a processing process in real time, and generates a maintenance strategy; and the self-adaptive regulation and control unit predicts the residual life of the key component and dynamically adjusts parameters according to a maintenance strategy and real-time monitoring data. Therefore, the problems of single monitoring dimension, disjunction of maintenance strategies and the like in the prior art are solved.

The present disclosure generally relates to techniques and interfaces for managing media playback devices. In some embodiments, the techniques include varying a feedback based on movement of a computer system toward or away from an external device. In some embodiments, the techniques include displaying an interface that includes controls for controlling media playback on an external device when the computer system and the external device are playing media. In some embodiments, the techniques include performing operations at a computer system in response to an input having a size that is less than or greater than a size threshold. In some embodiments, the techniques include performing different operations at a computer system when status lights have states that indicate different states of the computer system.

Aspects of the present disclosure provide a quick actions menu in an artificial reality (XR) environment that can be accessed by performing a hand gesture detected by an XR device which, in some implementations, can be detected without the use of controllers. Once the menu is open, the user can move her hand while performing the gesture to highlight a particular quick action and can release the gesture on a highlighted action to select the action. In some implementations, the user can drill down into an action on the menu by highlighting the action, then dragging the gesture off of the action away from the menu. To close the quick actions menu, the user can either A) move the gesture off the menu and release the gesture, B) rotate the wrist, or C) explicitly dismiss the menu, such as by using a voice command detected by the XR device.

The invention provides an AI-based virtual digital human interaction system, and relates to the technical field of data processing, and the system is used for obtaining a user feature data set by performing feature extraction on an interaction data set, calculating an audio change rate and speech speed stability, obtaining speech emotion data, calculating syntactic complexity and counting the number of emotion words. Calculating a facial expression symmetry degree; obtaining facial emotion data; calculating body stability and identifying a visual staying area; obtaining attention state data; adjusting tone and speed of the virtual digital person according to the virtual digital person text, optimizing sentence pattern complexity and sentiment words in the virtual digital person text, adjusting changes of eyes, eyebrows and mouth corners of the virtual digital person, and adjusting information display sequence and visual focus guidance. According to the method, the interaction efficiency of the virtual digital human is improved by analyzing the facial expressions and the body actions of the user.

The present disclosure generally relates to controlling electronic devices. In some examples, the electronic device uses gaze information to activate a digital assistant. In some examples, the electronic device uses gaze information to identify an external device on which to act. In some examples, the electronic device provides an indication that distinguishes between different speakers.

To enable appropriate response to an utterance of a user.SOLUTION: A control system disclosed herein comprises an input unit for receiving user input, a processing unit for performing specific processing using a sentence generation model for generating a sentence according to an input sentence, and an output unit configured to control an action of an electronic device to output a result of the specific processing. The processing unit determines whether or not the user input includes a travel itinerary creation request and, when affirmative, acquires user interest information to acquire a result of the specific processing using an output of the sentence generation model that uses a text instructing creation of a travel itinerary according to the interest information and information obtained from the user input as the input sentence.SELECTED DRAWING: Figure 2A

The invention discloses an emotional understanding and feedback method for a full-duplex interactive question-answering digital person, and the method comprises the steps: S1, arousing interaction: enabling a digital person of a digital person system to enter an interaction state in a human body detection arousing or voice instruction arousing manner by a user; s2, state analysis: the digital human system judges the state of the user in real time by collecting image data and audio data of the user, and identifies and analyzes the direction, emotion and speech content of the user in real time; and S3, feedback output: the digital human system drives the digital human in voice, expression and body movement through a screen in real time according to the analysis result of the direction, emotion and speech content of the user, and feeds back the result to the user in a manner of adding auxiliary characters, images and videos. The method has the advantages that the emotional state of the user is accurately judged through an advanced algorithm, digital human expressions, body actions and voice feedback are driven in real time according to the emotion and speech content of the user, response is made in time, and a real-person-like real-time interaction scene is achieved.

An auditory operating system designed to facilitate context-aware, audio-based user interactions, particularly with artificial intelligence agents or applications. An auditory operating system shell serves as the primary interface, managing and coordinating multiple specialized agents that handle specific domains like music streaming, scheduling, or home automation. Using natural language processing, the auditory operating system shell identifies the appropriate agent or application for a user's command or query and ensures task execution and context preservation across interactions. The auditory operating system shell enforces privacy and stability by controlling agents' and applications' access to data and system privileges. The auditory operating system shell also supports dynamic context management, enabling seamless handoffs between agents when user requests span multiple domains. This auditory operating system shell may reduce the need for users to memorize specific wake words or commands, as the auditory operating system shell may determine the user's intent from speech or contextual cues.

A method includes receiving data indicating a current media playback state of an external media playback device. The method includes, in response to receiving the data and in accordance with a determination that a set of external media playback device control criteria are met, displaying, via the display generation component, a user interface for controlling media playback at the external media playback device that includes one or more selectable user interface objects based on whether the data indicates that the external media playback device is currently performing a media playback operation.

The invention relates to the technical field of audio signal processing, and discloses a high-sampling-rate audio analysis optimization method and system, a storage medium and equipment, and the method comprises the steps: upgrading an FFTW (Fast Fourier Transform) library, and building an optimized memory management mechanism; carrying out adaptive framing processing on the input audio data, and optimizing the data access efficiency by adopting a multi-stage cache system; the calculation precision of the FFT fast Fourier transform is dynamically adjusted, and the calculation of the FFT fast Fourier transform is optimized by pre-calculating and caching an FFTW plan; performing clock synchronization optimization and jitter elimination on the COAX digital audio signal; establishing a multi-dimensional result cache matrix and an intelligent multiplexing decision tree, and reducing repeated operation through intelligent cache prediction and similarity calculation; system performance indexes are monitored in real time, adaptive parameter adjustment is realized based on an optimization objective function, audio quality and system stability are monitored in combination with subjective and objective evaluation mechanisms, repeated operation is remarkably reduced, and calculation resource allocation is optimized on the premise of ensuring sound quality.

The invention discloses an audio stream adaptive decryption method, system and device and a storage medium. The method comprises the following steps: acquiring an MPEG-DASH list file and analyzing the MPEG-DASH list file; the standard DRM interface is initialized; performing feature extraction on the identified audio segmentation information in the audio segmentation mode, and dynamically adjusting a segmentation request and processing logic according to the extracted features to perform adaptive segmentation downloading and preprocessing; extracting the encryption parameter to identify an encryption mark of the target audio stream platform, and selecting a corresponding decryption algorithm according to the encryption mark to decrypt the current audio segment; and performing audio frame reconstruction on the decrypted data to form an updated audio stream, caching the updated audio stream to a preset cache region based on a self-adaptive buffer strategy, and outputting the final audio stream to ensure the continuity of the final audio stream and realize efficient parallel processing of decryption and playing, so that the decryption efficiency is improved, and the user experience is improved. And particularly, in a high-concurrency scene, the user experience is improved.

An example process includes receiving a speech input from a user, obtaining a plurality of tasks based on the speech input, and determining, based on the plurality of tasks, an ordered task list associated with a set of task dependency criteria, wherein each task of the ordered task list includes a respective task dependency criteria. The process further includes displaying a representation of the ordered task list and performing each task of the ordered task list based on the set of task dependency criteria. The process further includes, while performing each task, updating the display of the representation of the ordered task list to indicate completion status of each task of the ordered task list, and displaying at least one graphical object corresponding to a respective task of the ordered task list.

The invention relates to the technical field of interaction systems, in particular to an intelligent control-based nursing board interaction system, which comprises a nursing board, and is characterized in that the nursing board internally comprises a voice recognition and control module integration, a board data interaction and display module, a board function page control module, an intelligent equipment control module and a feedback and interaction module; the voice recognition and control module integration, the billboard data interaction and display module, the billboard function page control module, the intelligent equipment control module and the feedback and interaction module are electrically connected. According to the method, a visual nursing billboard large screen is provided, interaction with the visual nursing billboard large screen is carried out through an API interface, instruction analysis and execution are supported, meanwhile, real-time voice and visual feedback and a multi-mode interaction mode are provided, and the user experience is remarkably improved.