27 results about "Interactor" patented technology

The invention relates to the technical field of artificial intelligence, particularly provides a digital human interaction method, a server and a storage medium, and aims to solve the problem of how to improve the continuity of digital human interaction. In order to achieve the purpose, the method comprises the steps that in response to selection operation of a user on digital human image elements on an interactive interface, image information of a digital human is generated according to the selected image elements; in response to a selection operation of a user on the content elements of the digital person on the interactive interface, generating a content expression of the digital person according to the selected content elements; associating the image information with the content expression to generate a digital person; and interaction is carried out based on the digital human and an interactor, the interaction comprises calling a knowledge base or a question and answer library in content expression, and controlling a large language model to reasone the answer of the current question based on the called knowledge base or question and answer library and historical answers to obtain the answer of the current question. Based on the method, the answer logicality can be improved, and the interaction process is more coherent.

The invention discloses an audio and video fusion method and device, equipment, a storage medium and a product, and the method comprises the steps: replacing a first audio corresponding to a role in a video with a second audio in response to a selection operation of a user on the role in the video when the video is played; wherein the second audio is generated based on the voice input of the user, or is generated based on the text or audio selected by the user in combination with the timbre of the user. Therefore, in the real-time playing process of the video, the audio of the user is fused into the video in real time, so that a role in the video is avatar as a virtual image of the user, the user obtains immersive interaction experience in the video environment, and the user is converted from an external observer to a participated interactor of a video scene.

The invention provides a multi-modal interaction method and device, and the method comprises the steps: 1, collecting target interaction data which comprises at least two of the eye movement, gesture, voice or physiological data of an interactor; 2, performing feature extraction on the target interaction data to generate feature interaction data; 3, fusing the feature interaction data according to a preset rule to generate a target feature vector; 4, identifying an interaction intention according to the target feature vector; 5, generating an interaction strategy according to the interaction intention and the driving scene; and step 6, executing an interaction instruction according to the interaction strategy. The intelligent level of interaction is improved, manual operation of an interactor is reduced, the operation requirement of the interactor is quickly responded, the distraction risk in the driving process is reduced, and the driving safety is improved.

Embodiments of the present disclosure relate to a method, apparatus, electronic device and product for display of a head-mounted display device. The method comprises obtaining information of a physical object in response to a first area of an interactor of the head-mounted display device intersecting a second area of the physical object in a physical environment. The method further comprises determining a see-through area for see-through display in the head-mounted display device based on the information of the physical object. In addition, the method further comprises see-through displaying at least a portion of the physical object in the see-through area of the head-mounted display device. According to embodiments of the present disclosure, a user is dynamically allowed to see through a partial area selectively, instead of setting a fixed safety area, so that the user can interact freely without being bound by the fixed safety area, which not only gives the user a better immersive experience, but also ensures higher safety.

The utility model discloses a man-machine interaction device, which comprises a supporting base body, a plurality of connecting pieces, a plurality of connecting pieces and a plurality of connecting pieces, and is characterized in that an accommodating space is formed in the supporting base body; the display device is transparent and is used for playing animations; the transmission device is installed on the supporting base body, and at least part of the transmission device is located in the containing space; the interactive operation part is connected with the transmission device and used for transmitting power to the transmission device; the oscillating hammer body is connected with the transmission device; when an interactor operates the interaction operation piece, the oscillating hammer body connected to the transmission device is driven to oscillate, and the oscillating hammer body is displayed through the transparent display device so as to interact with animations in the display device. According to the man-machine interaction device provided by the utility model, a mechanical structure and animations can be combined for interaction, and the interaction effect and the interaction interestingness are enhanced.

1. The name of the design product: multifunctional interaction device. 2. The use of the design product: used as peripheral accessories of smart devices such as computers, tablets, smartphones, digital boards, smart car machines, translation machines, smart televisions, game consoles and smart projectors, to realize touch / writing / drawing interaction, cursor moving / cursor dragging interaction and key interaction. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: design 1 perspective view. 5. Design 1 is designated as the basic design.

A method and apparatus for moving a virtual object, an electronic device, and a storage medium are provided. The method includes: displaying a computer-generated three-dimensional environment; detecting position data of an interactor and determining a first movement vector of the interactor in a world rectangular coordinate system; determining, based on the first movement vector, a second movement vector of the interactor in a local rectangular coordinate system with a user's own position as an origin; determining, based on the second movement vector, a third movement vector of the interactor in a local spherical coordinate system with the user's own position as an origin; determining, based on the third movement vector, a fourth movement vector of a target virtual object in the local spherical coordinate system; and obtaining second coordinates of the target virtual object based on first coordinates of the target virtual object and the fourth movement vector.

The invention discloses a user behavior evaluation method and device applied to intelligence development equipment and the intelligence development equipment, and the method comprises the steps: collecting interaction information between an interactor of the intelligence development equipment and the intelligence development equipment, and the interaction information at least comprises interaction process information and can further comprise interaction result information; and based on the interaction information, determining an evaluation result corresponding to the current interaction behavior of the interactor. Therefore, the method and the device can evaluate the interaction capability of the user without being limited to the interaction result (such as an answer result), are beneficial to improving the evaluation flexibility of the interaction capability of the user, and can also improve the evaluation accuracy and the evaluation reliability of the interaction capability of the user.

The invention relates to a system for remote interaction with a pointing means of an HMI of an aircraft cockpit display system, comprising three layers: - an upper layer (2) in the shape of an inverted V forming a hand rest, comprising: - a touch-sensitive flat surface module configured to interact with the pointing means arranged on a front part of the inverted V; - at least one physical interactor (4) configured to interact with the HMI arranged on a rear part of the inverted V; - two lateral edges (5) set back from the upper surface of the upper layer (2), each provided with at least one physical interactor (6); - an intermediate layer (7) configured to allow a modification of the positioning of the upper layer (2); - a lower layer (8) configured to receive the wired connections for power supply and data exchange. Figure for abstract: [Fig.3]

Apparatus and methods for restricting egress of sensor data from a feature detection process to an interactor process. The sensor data can include audio data, image data, location data, and / or other sensor-based data. The feature detection process is sandboxed to restrict the egress of data from the component. Once the feature detection process determines that a feature has been detected in sensor data, the interactor process can be provided with the sensor data and / or additional sensor data. The sensor data and / or the additional sensor data can be provided directly by an operating system and not via the feature detection process. In some implementations, a notification can be rendered once data is sent to the interactor process. The notification can indicate that the sensor data is being accessed. Rendering of the notification can be suppressed when only the sandboxed feature detection process is accessing the sensor data.

The present invention relates to a genetically controlled nanoscopy contrast-generating unit comprising a metal interactor, wherein the metal interactor is compatible with nanoscopy fixation protocols, nanoscopy post-fixation protocols, and nanoscopy metal staining protocols and wherein the metal interactor is a molecule to which metal ions can bind to or react with. The present invention also relates to a genetically controlled structural element, wherein said genetically controlled structural element organizes the genetically controlled nanoscopy contrast-generating unit. The genetically controlled structural element can be an encapsulin and the genetically controlled nanoscopy contrast-generating unit can be one or two murine metallothionein-3, or three chimeric metallothioneins. The present invention also relates to a genetically controlled scaffold, wherein said genetically controlled scaffold spatially organizes the genetically controlled structural elements. The present invention also relates to the use of such genetically controlled nanoscopy contrast-generating unit, such genetically controlled structural element, and / or such genetically controlled scaffold for nanoscopy detection methods. The present invention also relates to a nanobiomaterial consisting of the isolated genetically controlled structural elements, and / or genetically controlled scaffolds. The present invention also relates to vectors comprising a nucleic acid encoding a genetically controlled nanoscopy contrast-generating unit, a genetically controlled structural element, and / or a genetically controlled scaffold.

The invention discloses a multi-round dialogue process control method and system for visualized verbal skill configuration. The method comprises the following steps: acquiring concurrent session input texts from a plurality of interactors, and generating a unique session instance identifier and an interactor identity tag for each session input text; generating a token set of each interactor according to the session input text, establishing a mapping relationship between a tag and the token set, and updating a token attribution session based on a session relationship mapping table; calculating the session dependence degree among the interactors; determining an operation execution priority of each interactor according to the session dependence degree, and executing conflict resolution; adjusting the response delay and the execution queue of the operation request of each interactor based on the conflict resolution result; and outputting an operation execution log including the token attribution change record and the operation execution priority adjustment. According to the method and the system, the intelligent level and the user experience of a multi-round dialogue system are remarkably improved.

Methods and systems for processing audio information captured by an interactive virtual assistant (IVA). An example method includes: converting sound received by a microphone into electrical signals; generating voiceprints corresponding to voices represented in the electrical signals; distinguishing signals representing background speech and signals representing voice commands directed at the IVA; and based on various signals representing background speech and voice commands, labeling each of the voiceprints with a tag selected from the group consisting of an IVA interactor occupant tag, an IVA non-interactor occupant tag, and a non-occupant tag. The method also includes transmitting, in response to a trigger event, a message with at least one of an estimated number of occupants in a geofenced area corresponding to the IVA and an alert reporting an indication of unlawful activity thereat.

Examples of systems and methods for a haptic controller include a touchscreen including a touchscreen surface, a stencil including one or more openings having customized shapes, and one or more processors. Each customized shape is associated with one of the one or more preloaded shapes. The stencil is attached to the touchscreen surface. The one or more processors are operable to detect a touch event with one of one or more registered interactors on the touchscreen surface, and operate the touchscreen according to the touch event and the one of the one or more registered interactors. Each registered interaction is associated with one of the one or more preloaded shapes.

The invention discloses a multi-mode emotion recognition toy robot interaction system and method. The system comprises a plurality of toy robots arranged in an interaction space, and further comprises a positioning module for acquiring positioning data of the toy robots in the interaction space; the identification module is arranged on each toy robot and is used for acquiring multi-modal interaction data of a target interactor in the interaction space; the data processing module obtains the multi-modal interaction data and the multi-modal instruction data from the toy robot, and the multi-modal interaction data and the multi-modal instruction data are subjected to time sequence alignment to obtain time sequence interaction data; the control module receives the time sequence interaction data and generates a control instruction to each toy robot; and the response module is arranged on each toy robot, and executes the appointed response of the toy robot in the interaction space according to the control instruction until the target interactor reaches the preset interaction area. According to the invention, multi-modal emotion quantitative identification and dynamic response calibration in the toy interaction process are realized.

The utility model discloses a multifunctional interactor relates to electronic equipment peripheral accessory technical field, and it includes the holding type shell, and the holding type shell place is respectively integrated with: touch control interaction module is used for realizing touch, writing and drawing interaction, cursor interaction module is used for realizing the movement and drag interaction of cursor, and button interaction module is used for realizing button interaction. The utility model mainly solves how to provide the problem of the higher degree of integration of multifunctional interactor for intelligent equipment, and the utility model integrates touch control interaction module for realizing touch, writing and drawing interaction, cursor interaction module for realizing the movement and drag interaction of cursor, button interaction module for realizing button interaction, thereby integrates mouse, stylus, remote controller and touchpad and various interactive functions, reduces the volume and weight of peripheral accessory, thereby has good portability, and will not produce the problem of preemption charging resource and signal interference.

The application discloses a medical self-service reporting terminal interactor identity binding method and system based on deep learning, and aims at solving the problem of determining the cause-effect association of touch events and interactors caused by multi-user concurrency, shielding and asynchronous acquisition. The application realizes the high-reliability binding of touch events and unique interactors, automatic maintenance of conversation state and robust anti-interference technical effects by collecting video and touch data with hardware time stamps, unifying the time base and camera-to-screen projection mapping, estimating the human body and hand perception and contact state, constructing event candidate features, and outputting dynamic causal masks from the mask generation network to constrain the attention reasoning and conversation management of the causal Transformer.

The embodiment of the invention provides an interactive device and an intelligent desk, and belongs to the field of interactive equipment. The interactive device is composed of a display screen, a driving circuit board, an interface and a shell. Wherein the driving circuit board is arranged in the shell, and the driving circuit board is used for driving the display screen to display; the display screen is arranged on the shell; and the interface is connected with the driving circuit board. According to the interactive device provided by the invention, the number of internal components is effectively reduced, and the power consumption can be effectively reduced.

The present invention discloses an interactive human-machine collaborative path planning and robotic arm follow-up control system and method, which relates to the technical field of path planning control of medical robots. The control system includes an optical positioning camera, a robotic arm, a patient tracer, an interactor, and a controller; the robotic arm includes a robotic arm main controller, a robotic arm end tracer, and a robotic arm end guide; the interactor includes an interactor tracer; the optical positioning camera is used to obtain the poses of the interactor tracer, the robotic arm end tracer, and the patient tracer in the camera coordinate system; the robotic arm main controller is used to obtain the pose of the end of the robotic arm in the robotic arm base coordinate system; the controller is used to realize the follow-up display of the two-dimensional section of the three-dimensional image with the nail placement position of the interactor according to the real-time position mapping, and control the robotic arm to aim at the nail placement path. The present invention realizes a more intuitive, efficient, and safe non-contact human-machine interaction.

The invention discloses a medical self-service check-in terminal interactor identity binding method and system based on deep learning, and aims to solve the problem of determining causal association between a touch event and an interactor caused by multi-user concurrence, shielding and asynchronous acquisition. According to the invention, video and touch data with hardware timestamps are collected, time base and camera-to-screen projection mapping are unified, human body and hand perception and contact state estimation are carried out, event candidate features are constructed, and attention reasoning and session management are carried out by a dynamic causal mask constraint causal Transform output by a mask generation network. The technical effects of high-reliability binding of the touch event and the unique interactor, automatic session state maintenance and robust anti-interference are achieved.

A robot system includes a multi-joint robot arm including a plurality of joints; a robot controller configured or programmed to control movement of the multi-joint robot arm; an interactor configured to interact with a workpiece; a signal output configured to output a moving amount signal based on a moving amount of the interactor arranged on a distal end part of the multi-joint robot arm at a fixed time period; and an interaction controller configured or programmed to control interaction of the interactor with the workpiece based on the moving signal output by the signal output.

The present invention discloses a human-computer interaction method for arbitrary objects based on deep learning and image processing. First, the MediaPipe model is used to detect the coordinates and coordinate relationships of the interactor's body nodes to determine the interactor's state. Then, according to the different states of the interactor, a saliency and edge detection algorithm or a region growing algorithm is used to determine the potential task target area. Then, the size of the target area is calculated using OpenCV image processing methods and depth image information, and the object's posture is calculated through pixel-to-world coordinate system conversion. Then, the size and fill of the target area are used to determine whether the interactor is holding an object. The position of the interactor's hand, the size of the object, and the size of the robot arm gripper are used to determine whether interaction is possible. Finally, the robot completes the unknown object human-computer interaction task based on the obtained object position and posture. This method realizes the acquisition of the coordinates and posture of unknown objects in the scene, enabling the robot to face any object and perform human-computer interaction operations safely, stably, and accurately without training.

The embodiment of the invention provides a low-power-consumption driving circuit for an interaction device and the interaction device, and belongs to the field of interaction equipment. The low-power-consumption driving circuit comprises a power consumption module, a processing module, a communication module, a clock module, a first power supply IC and a power supply, the power supply output end of the power supply is respectively connected with the first power supply IC and the power supply input end of the communication module; the communication module is electrically connected with the processing module, the clock module and the first power supply IC respectively; the power supply output end of the first power supply IC is also respectively connected with the power supply input ends of the power consumption module and the processing module; the processing module is also connected with the power consumption module; wherein the communication module is used for controlling the first power supply IC to control the power supply of the processing module and the power consumption module and the switching of working modes, so that the power consumption of the interaction device is reduced, and the charging frequency and the maintenance frequency of the interaction device are reduced.

The invention provides a method and device for moving a virtual object, electronic equipment and a storage medium. The method includes displaying, by a display generation component, a computer-generated three-dimensional environment; detecting position data of the interaction device by the input device, and determining a first movement vector of the interaction device in the world rectangular coordinate system based on the position data; based on the first movement vector, determining a second movement vector of the interaction device in a local rectangular coordinate system taking the position of the user as an original point; based on the second movement vector, determining a third movement vector of the interaction device under the earth coordinate system taking the position of the user as an original point; determining a fourth movement vector of the target virtual object in the three-dimensional environment under the earth coordinate system based on the third movement vector; and obtaining a second coordinate of the target virtual object in the earth coordinate system based on the current first coordinate and the fourth movement vector of the target virtual object in the earth coordinate system.

A system for interacting at a distance with a pointing means of an HMI of a viewing system of an aircraft cockpit, including three layers including an upper layer in the shape of an inverted V, which itself acts as a handrest knob, including a module, with a touch-sensitive flat surface, configured to interact with the pointing means arranged on a front portion of the inverted V; at least one physical interactor configured to interact with the HMI arranged on a rear portion of the inverted V; and two lateral edges set back from the upper surface of the upper layer, each provided with at least one physical interactor.

A method and apparatus for moving a virtual object, an electronic device, and a storage medium are provided. The method includes: displaying a computer-generated three-dimensional environment; detecting position data of an interactor and determining a first movement vector of the interactor in a world rectangular coordinate system; determining, based on the first movement vector, a second movement vector of the interactor in a local rectangular coordinate system with a user's own position as an origin; determining, based on the second movement vector, a third movement vector of the interactor in a local spherical coordinate system with the user's own position as an origin; determining, based on the third movement vector, a fourth movement vector of a target virtual object in the local spherical coordinate system; and obtaining second coordinates of the target virtual object based on first coordinates of the target virtual object and the fourth movement vector.

Remote interaction system with a pointing means of an HMI of an aircraft cockpit display system, comprising three layers including an upper layer (2) in the shape of an inverted V itself acting as a hand rest, comprising: - a flat surface module (3) sensitive to touch configured to interact with the pointing means arranged on a front part of the inverted V; - at least one physical interactor (4) configured to interact with the HMI arranged on a rear part of the inverted V; and - two lateral edges (5) set back from the upper surface of the upper layer (2), each provided with at least one physical interactor (6).