1080 results about "Speech control" patented technology

Disclosed in the present invention are a multi-modal shared teleoperation system and method for a three-arm space robot. The system at least comprises a master-side teleoperation system, a communication module and a slave-side robot system, wherein the master-side teleoperation system at least comprises two force feedback hand controllers, a microphone array and upper computer software, and the slave-side robot system comprises two operating arms each equipped with a gripper at the end, an observation arm having a binocular camera mounted at the end, a vision unit, a force sensor and lower computer software. The method comprises: an operator controlling two operating arms of an extravehicular robot to execute a task, and controlling an observation arm to acquire a better local field of view. In the method, a multi-modal teleoperation method comprising pose control, voice control and force control is fused with autonomous control of a robot by means of a shared control algorithm, and thus, human-robot collaborative control over the position, orientation and contact force of a robotic arm can be realized on the basis of the requirements of the operator, and the robot autonomously executes other relatively simple tasks, thereby reducing the operation burden of operators, and improving the control efficiency.

A multimodal shared telerobotic system and method for a three-arm space robot, the system at least includes a local-site system, a communication module, and a remote-site system, where the local-site system includes two force-feedback haptic devices for left and right hands, a microphone array, and upper computer software; the remote-site system includes two robotic arms provided with end-effectors, an observation arm with a stereo camera installed at an end thereof, two force sensors, a vision unit and lower computer software; an operator can control the two robotic arms of the robot outside a cabin for performing operations, and control the observation arm to obtain a better local view; and a multimodal telerobotic control method of pose control, voice control, and force control is integrated with the robot's autonomous control through a shared control algorithm.

The invention relates to the technical field of vehicle lamp systems, in particular to an intelligent vehicle lamp system based on DLP projection, a control method and a vehicle. The intelligent vehicle lamp system based on DLP projection comprises an optical system, an intelligent control system, an execution module and a power management system, the system collects environment data in real time through a sensor, a central processing unit fuses multi-source information and generates a control instruction through an AI algorithm, and the light source brightness, the irradiation angle and the road surface projection content are dynamically adjusted; meanwhile, voice interaction and remote control are supported, and the self-adaptive lighting and safety warning functions are achieved. Through the intelligent control and DLP projection technology, the vehicle lamp performance is improved, the lighting effect is optimized, and the night driving safety is enhanced; self-adaptive adjustment is realized, and the driving experience is improved; the energy consumption is reduced by more than 30%; the battery life is prolonged; v2X communication is supported, and intelligent early warning is realized; a voice control function is provided, and operation is more convenient and safer; a road surface projection function is added, navigation arrows and warning marks can be displayed, and visual driving assistance is provided.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing text-to-speech modeling. In some implementations, a computer device receives input text in a first language to convert to a desired speech in a second language. The computer device receives one or more criteria for modifying the desired speech and converts the input text to a desired text in the second language. The computer device generates audio representations of the desired text in the second language and predicts, for each of the audio representations of the desired text and using the one or more received criteria, a pitch value and a duration value. The computer device generates the desired output speech using the predicted pitch value and the predicted duration value for each of the audio representations and provides the desired speech for output.

The invention discloses a non-contact operating room intelligent voice control method supporting multi-role voiceprint recognition, and relates to the technical field of voice interaction control, and the method comprises the following steps: S100, collecting full-band noise signals of all high-frequency operation equipment in an operating room in different operation states, extracting harmonic frequency, amplitude and phase features, and carrying out the recognition of the full-band noise signals; and constructing a harmonic noise characteristic database, and establishing and dynamically updating an environmental noise baseline model. According to the invention, through the dynamic environment noise baseline model and personalized voiceprint recognition, frequency spectrum isolation and accurate voice separation of high-frequency operation equipment noise and doctor voiceprint are realized. In combination with space and frequency spectrum dual-domain decoupling and voice integrity detection, and through dual verification of voiceprint identity and non-contact action, it is ensured that an instruction sender is true and effective. And a closed-loop defense mechanism is formed through permission level comparison and context semantic verification, so that error identification and error control are effectively prevented, and the safety, accuracy and continuity of the operation process are guaranteed.

The invention relates to the technical field of bionic humanoid robots, in particular to a multi-expression driving bionic intelligent robot head which comprises an eyebrow movable layer, a cheekbone movable layer, an eye movable layer, an upper lip movable layer and a chin movable layer located below the upper lip movable layer, and the eyebrow movable layer, the cheekbone movable layer, the eye movable layer and the upper lip movable layer are spliced and assembled by hexagonal threaded copper columns through reserved hole positions. The robot head is composed of a shell, an aluminum alloy machining plate frame, a CNC metal part, a steering engine, a rail and a pull wire, and a camera module and a voice control module are arranged in the robot head. The shell can be customized according to different figure facial features, the shell is of a high-precision, compact and adjustable structure, 26 steering engines are integrated in a limited space to control opening and closing of the face including left and right eyeballs, upper and lower eyelids, canthus, eyebrows, cheeks, mouth corners and mouth and actions of lips, and the layered design and control mode of the head of the robot enable the robot to be more intelligent. And the mounting, the dismounting and the maintenance are more convenient.

The invention provides a multi-scene illumination management system integrating voice control and remote monitoring, and relates to the technical field of illumination management, and the system comprises the steps: receiving a scene wake-up instruction collected by a microphone array and a scene switching instruction sent by a remote monitoring terminal; adding priority labels and timestamps to the scene wakeup instruction and the scene switching instruction, and when it is detected that a timestamp difference value between the scene wakeup instruction and the scene switching instruction is smaller than a conflict time threshold value, determining an instruction arbitration coefficient through preemptive priority weights of the scene wakeup instruction and the scene switching instruction, determining an effective instruction according to the instruction arbitration coefficient and all the priority labels; and when the instruction priority of the effective instruction is greater than the instruction priority of the currently executed illumination scene instruction, generating a coverage execution signal, otherwise, generating an instruction discarding signal, further outputting an illumination control signal, and adjusting light parameters of the illumination equipment through the illumination control signal. According to the invention, multi-control-source conflicts in a lighting management system can be eliminated.

Various implementations include approaches for voice control in audio devices. In some cases, a method includes: listening, using at least one audio capture device, for user input to control at least one attribute of an audio device; routing the user input through a machine learning (ML) model to determine a control action for the at least one attribute based on the user input; and causing the determined control action to be performed, wherein the ML model need not have been pre-trained with the user input to determine the control action for the at least one attribute of the audio device.

The invention discloses a large model tool calling method and system based on risk assessment, and the method comprises the following steps: receiving a natural language instruction of a user, and obtaining a calling request of the user based on a large model; generating a risk score based on the user call request; generating a confirmation strategy based on the risk score, the user preference adjustment factor and the emergency degree adjustment factor; executing a corresponding confirmation process based on the confirmation strategy; based on the confirmation process, the controller executes tool calling; by the adoption of the technical scheme, the problem of balance between safety and user experience in tool calling is solved, a safer and more intelligent interaction mechanism is provided for voice control and large language model driven tool calling, a risk self-adaptive confirmation process and a multi-stage confirmation mechanism provide sufficient safety guarantee, and meanwhile the safety of a user is improved. And the user interaction experience is improved to the greatest extent.

The invention provides a voice interaction control method and device of a browser, electronic equipment and a storage medium, and the method comprises the steps: obtaining a voice control instruction input by a user, and determining a target control intention based on the voice control instruction; obtaining a target document object model tree corresponding to the current webpage of the browser; sending the target control intention and the target document object model tree to a server, and receiving at least one control instruction generated by the server based on the target control intention and the target document object model tree; and executing the at least one control instruction, and controlling the webpage to render an interaction result corresponding to the voice control instruction. In this way, the steps of maintaining and developing each website and exhausting all webpage functions to generate the instruction set can be reduced, and the control efficiency of browser voice interaction control can be improved.

The invention relates to a robot autonomous navigation method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring a plurality of sensing data sets from different sensors; wherein the sensing data sets carry the same timestamp; generating a semantic map and a geometric map of the target area according to the sensing data sets; acquiring voice control information, and matching at least one semantic tag in the semantic map according to the voice control information; and generating a navigation path according to the matched semantic tag and the geometric map, and completing an autonomous navigation task of the robot according to the navigation path. The method can improve the autonomous navigation stability of the robot.

The invention relates to an Internet of Things smart home voice terminal control method and system based on a cloud platform, and belongs to the technical field of smart home voice control. The method comprises the following steps: by taking home position data of a user currently performing voice interaction as priori knowledge, performing weight dynamic adjustment on acquired voice data to complete adaptive beam forming processing; feature extraction is carried out on the voice data after beam forming processing, voice features are packaged into an encrypted data packet, and the encrypted data packet is sent to a cloud platform through an optimal transmission path; and constructing an instruction library associated with information on the cloud platform, and matching a device instruction in the instruction library through semantics analyzed by the voice features. According to the method, dual-frequency WiFi positioning and sound source positioning are fused, self-adaptive beam forming is driven by priori knowledge, reverberation elimination and weight dynamic adjustment are combined, and the voice definition and recognition rate under strong noise are remarkably improved; an instruction library is mined and constructed through association rules, and accurate instruction matching is realized by adopting multi-dimensional arbitration.

The invention relates to the technical field of garbage cans, and discloses an intelligent mobile garbage can with voice control and remote control functions and a control method thereof.The intelligent mobile garbage can comprises a garbage can body, a can cover is installed on the top of the garbage can body, and an annular microphone array is installed on the front side of the garbage can body; the garbage can comprises a garbage can body, a TOF camera is installed on the front side of the garbage can body, an ultrasonic sensor is installed outside the garbage can body, a buzzer alarm is installed on the left side of the garbage can body, and a magnetic type charging contact is installed at the bottom of the garbage can body. According to the invention, the sound source orientation precision of + / -5 degrees is realized through the annular microphone array + TDOA algorithm, the instruction recognition rate of 92% or above is still kept in a noise environment in combination with the DPRNN model, the false triggering probability is remarkably reduced, dual identity verification: voiceprint comparison and off-line / on-line instruction analysis dual verification is carried out, illegal user control or pet false triggering is prevented, and the safety of a pet is improved. And the safety is improved by more than 80%.

According to the smart home voice control method and system, the computer equipment and the storage medium provided by the invention, the voice is converted into the characters, the keywords are extracted according to the characters, the first keyword or the second keyword is obtained from the keywords, and the complete control instruction is obtained and formed; the corresponding equipment is executed and operated to perform corresponding actions according to the obtained control instruction, and no response is made when the character data between the first keyword and the second keyword is obtained, so that the keywords in the user voice can be accurately obtained, the corresponding control instruction can be obtained, the instruction is prevented from being interrupted by a dialogue, the recognition accuracy of the user intention is improved, and the user experience is improved. And the actual demand of the user can be better understood. In the embodiment of the invention, the voice data which fails to respond are input into the first model, the processing of the first model is combined with the instruction matching library in the server, and the control instruction set which is converted into the response is performed in the first model, so that the problem of less data in the local instruction matching library can be avoided.

The invention provides a surgical anatomy monitoring method and system based on AR glasses, and relates to the technical field of augmented reality, and the method comprises the steps: obtaining medical knowledge data through augmented reality equipment, and generating a digital data set containing a three-dimensional model, a text and a two-dimensional image; acquiring real-time image data from the surgical site, extracting corresponding anatomical structure data, and generating a three-dimensional model data set; presenting the three-dimensional model data set through augmented reality equipment, and superposing the surgical operation guidance data to generate an interactive display result; and receiving a voice control instruction, adjusting the three-dimensional model data set or the surgical operation guidance data, and generating adjusted display content. According to the method, the shielded organ structure in the image data can be analyzed, a complete anatomical structure is generated by combining database inference, and related information is automatically labeled. According to the system, by integrating medical knowledge, the augmented reality technology and image recognition analysis, visual and accurate visualization assistance is provided for an operation, and the operation precision and the teaching effect are improved.

The invention relates to the technical field of voice recognition and intelligent household electrical appliance control, in particular to an induction cooker control method based on voice recognition, which comprises the following steps: synchronously acquiring a voice signal and a lip motion signal, and generating multi-modal sensing data through timestamp alignment; performing cross-modal anti-noise processing on the data, and outputting a fusion feature tensor fusing acoustic and visual features; semantic analysis and danger instruction recognition are executed, and a risk filtering control instruction containing temperature / fire parameters is generated; calling a thermodynamic dynamic model to calculate a power control parameter based on the instruction parameter; converting a power parameter into a space vector modulation waveform to drive a load circuit, and synchronously collecting the pot bottom temperature; and triggering an anti-noise process and thermodynamic model parameter updating according to the deviation between the actual temperature and the target temperature. Noise interference is reduced through multi-modal signal cross validation, dangerous instructions are intercepted in combination with knowledge graph constraints, the noise suppression capability and the temperature control precision are continuously optimized, and the safety and reliability of voice control in a complex environment are improved.

The invention provides a vehicle-mounted voice control method, device and system, and relates to the technical field of intelligent automobiles, low-power-consumption accurate wakeup is realized through fusion of wearable equipment and a vehicle-mounted sensor, a voice instruction is analyzed in combination with a local-cloud hybrid model, a security level label is given according to the real-time state of a vehicle, and the dangerous operation interception rate is increased. The reinforcement learning dialogue strategy is constructed based on the security level, multi-level interruption and backtracking are supported, and the complex instruction processing efficiency is improved. A safety key instruction is exclusively executed on a real-time system core through a hardware isolation mechanism, microsecond-level response jitter of braking, steering and other operations is achieved, and a full-link safety closed loop is constructed. According to the method, the accuracy and safety of voice interaction are effectively improved, the problems of response delay, decision adventure, unreliable execution and the like of a traditional system are remarkably improved, and the human-vehicle interaction experience and the driving safety level are enhanced.

The invention discloses a voice control-based augmented reality precise transcranial magnetic stimulation system, which comprises augmented reality equipment, a voice recognition and control module and transcranial magnetic stimulation TMS equipment, and is characterized in that a magnetic resonance structure image of a tested head is projected to a real head, precise intracranial intervention sites are visualized, precise placement of a TMS coil is guided online, and the accuracy of the TMS coil is improved. The accuracy of transcranial magnetic stimulation is effectively improved, and the TMS equipment can be controlled through voice to switch a preset stimulation target, a stimulation mode, stimulation duration and the like according to a testee; the operation platform is transferred from a far-end computer screen to a tested actual head, a transcranial magnetic stimulation practitioner only needs to place a coil according to a visual model, the operation difficulty is greatly reduced, dependence on expensive and non-portable existing neural navigation hardware is reduced, and the transcranial magnetic stimulation system has the advantages of being easy and convenient to operate, portable, movable, low in cost, easy to popularize and suitable for popularization and application. And the use efficiency and the application range of the TMS equipment are greatly improved.

The invention provides an XR interaction method, device and equipment based on voice control, and belongs to the technical field of human-computer interaction. The method comprises the following steps: receiving a multi-modal interaction data stream acquired by a multi-modal sensor; recognizing and analyzing a voice signal in the multi-modal interaction data stream to determine a corresponding voice control instruction; wherein the voice control instruction comprises an operation intention and space description; the spatial description is spatial constraint information of the user on the target operation object; determining a corresponding target interaction space area based on the voice control instruction and one or more non-voice behavior information synchronized with the voice signal in the multi-mode interaction data stream; and matching a target operation object corresponding to the voice control instruction according to the information of each operable object in the target interaction space region, and executing an XR interaction operation corresponding to the operation intention according to the target operation object. Therefore, high-precision, high-dynamic-adaptability and high-reliability voice control interaction is realized.

A system can operate a speech-controlled device to perform user engagement detection (UED) processing to detect when speech represented in audio data is directed to the device. For example, the device may extract audio features from the audio data and process these audio features using a classifier to estimate an orientation of the user's head, which may be used as a proxy for user engagement. Thus, if the head orientation is within an engagement zone (which varies based on distance to the user), the device may determine that the user is engaged with the device and perform language processing on input speech. In contrast, if the head orientation is outside of the engagement zone, the device may determine that the user is not engaged and ignore the input speech. To enable additional functionality, the classifier may optionally output a coarse estimate of the head orientation along with the UED determination.

An endoscope with voice control. A data processor for the endoscope obtains voice training data for a specific surgeon, and / or information indicating spoken utterances associated with a surgical procedure for which the endoscope is to be used. Voice utterances signals are received from a surgeon during the surgery. Speech recognition technology decodes the voice utterance signals into commands to control the endoscope, based at least in part on the data obtained from the database, and control commands are issued to implement the decoded voice utterances. Concurrently with the accepting and decoding of voice utterances, the processor accepts and decodes control signals from at least one other input device. The processor issues control commands to components of the endoscope to implement the decoded other input control signals. The voice utterances are accepted, decoded, and executed concurrently with the other input control signals.

The invention discloses a voice control method and device, equipment, a medium and a product. The method comprises the following steps: acquiring first voice information; performing intention recognition based on the first voice information to obtain the target intention; according to the target intention, a target audio playing mode is determined from multiple preset audio playing modes, and the multiple audio playing modes comprise playing through an audio playing assembly in a vehicle cabin and playing through an audio playing assembly outside the vehicle cabin; based on the target intention and the first voice information, determining a target audio responding to the first voice information; and controlling the vehicle to play the target audio according to the target audio playing mode. The accuracy of voice control can be improved.

The invention discloses a voice control method and device for a household electrical appliance, and the method comprises the following steps: S1, collecting a user voice signal, and carrying out the preprocessing of the user voice signal; s2, performing local wake-up detection and local voice recognition on the preprocessed voice signal to obtain a text instruction; s3, performing complexity analysis on the text instruction; s4, based on the result of the complexity analysis, processing the text instruction through a local path or a cloud path to generate a control instruction; and S5, controlling the target household electrical appliance to execute corresponding operation according to the control instruction. According to the invention, the recognition efficiency and the recognition accuracy can be improved; the natural language expression of the user can be converted into accurate equipment linkage operation in combination with voice context information; a simple control instruction is subjected to localization processing, only necessary data are uploaded to the cloud, and the risk of privacy disclosure is reduced; personalized services are provided by binding voiceprint recognition with user preferences.

The invention discloses a vehicle control method and device and a vehicle, and relates to the technical field of vehicle control and voice interaction. The vehicle comprises a vehicle machine screen. The method comprises the following steps: determining an operation object on the vehicle machine screen according to a voice operation instruction input by a user; and when the number of the operation objects is greater than 1, identifying an intention operation object of the voice operation instruction in all the determined operation objects according to the historical operation of the user on the vehicle machine screen and / or the pointing information contained in the voice operation instruction and / or the vehicle machine application where the operation objects are located. According to the method, accurate matching of the voice operation instruction can be achieved, especially under the condition that multiple operation objects exist on the vehicle-mounted terminal screen, the operation object intended by the user can be accurately recognized, and therefore the accuracy and reliability of voice control or voice interaction are improved, and the user has good voice interaction experience.

Systems for voice control of medical devices in a healthcare facility are disclosed herein. The systems employ continuous speech processing software, voice recognition software, natural language processing software, and other software to permit voice control of the medical devices. Systems are also provided for distinguishing which medical device from among multiple medical devices in a patient room is the particular medical device to be controlled by voice input from a caregiver or a patient.

The utility model discloses an intelligent farmland header, which comprises a water and fertilizer integrated irrigation module, a central operation controller connected with the water and fertilizer integrated irrigation module and a voice control module, the voice control module is connected with the central operation controller, and the water and fertilizer integrated irrigation module comprises a liquid conveying pipeline. The liquid conveying pipeline comprises a main pipeline and two branch pipelines arranged in the middle area of the main pipeline in parallel, an inlet of the main pipeline is communicated with a centrifugal filter, one of the two branch pipelines is provided with a second electric control valve and an automatic backflushing laminated filter, and the other branch pipeline is provided with a first electric control valve net type filter; the base is of a rectangular structure, the fertilizer preparation box is arranged at one corner of the base, and the automatic backflushing laminated filter, the electric control box and the fertilizer preparation box are arranged on the same side; the centrifugal filter, the sand accumulation tank and the screen filter are arranged on the rear side of the fertilizer preparation box, the first branch pipeline and the second branch pipeline are arranged on the two sides of the centrifugal filter, the electric cabinet is located on the upper portion of the automatic backflushing laminated filter, and through the arrangement, the intelligence of the head of a farmland is improved.

Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item by the person depicted in the image; receiving voice input associated with the person depicted in the image; in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

The utility model discloses a multifunctional intelligent control fishing reel, and belongs to the technical field of electronic fishing reels. The line wheel comprises a line wheel body, the line wheel body is connected with a line cup and a brake system, the line wheel body is connected with an electric control assembly and an intelligent assembly, the electric control assembly is connected with the intelligent assembly, the electric control assembly is provided with a control unit, an electric control board and a power source, and the intelligent assembly is provided with a voice control system and a key control system. The key control system is electrically connected with the braking system and used for controlling the braking system through key operation. The electronic fishing reel is intelligent, accurate in control and multifunctional, not only has basic functions of a traditional fishing reel, but also expands the function of intelligent control by integrating the intelligent assembly and the electronic control assembly, can adapt to requirements of different environments and fishing skills, meets requirements of fishing enthusiasts for multifunctional fishing gears, and is suitable for popularization and application. And more convenient, efficient and pleasant fishing experience is provided for fishing enthusiasts.

The invention discloses a reinforcement learning driven AI voice Internet of Things intelligent control optimization method, and relates to the technical field of voice control. The method comprises the following steps: acquiring multi-mode signals such as voice and environment through a microphone array and multiple sensors, and forming an input vector through space-time alignment and compression processing; analyzing the voice instruction by using an attention mechanism and a knowledge graph, and converting the voice instruction into an equipment executable parameter; dynamic impedance matching is realized by means of reinforcement learning, and the system energy efficiency is improved; multi-device phase synchronization is completed based on a phase-locked loop technology; predicting equipment faults through vibration modal analysis and transfer learning; meanwhile, the system has the functions of scene perception, energy recovery and safety protection, and can automatically adapt to scenes to recover energy. The control performance of the AI voice Internet of Things is improved, the voice recognition accuracy is improved, the system efficiency is high, the synchronization error of multiple devices is reduced, faults can be early warned 50 hours in advance, the energy recovery efficiency is doubled, the standby power consumption is reduced, and the interactivity, stability and energy saving performance of the devices are enhanced.

The invention relates to the field of voice analysis, in particular to a robot control method based on voice analysis, and the method comprises the steps: obtaining image information in a space region where a target robot is located, determining semantic tags, determining a potential association semantic tag group, and screening out a semantic guiding corpus group for the target robot; when voice control data is received, instruction fuzzy parameters of the voice control data are determined so as to judge instruction fuzzy tendency, optimization is carried out on the voice control data with the instruction fuzzy tendency, specifically, confidence centralized clusters and semantic discrete clusters are determined, semantic expansion is carried out on the semantic discrete clusters, and then an expansion text is obtained; and screening the expanded text based on the semantic oriented corpus group to obtain a confidence instruction text. According to the method, the semantic oriented corpus group is constructed in combination with the image information, the analysis of the voice control data with the instruction fuzzy tendency is guided, the analysis accuracy of the voice control data under the semantic fuzzy condition is improved, and the control instruction recognition precision is ensured.