108results about How to "Interactive nature" patented technology

The invention discloses a man-machine interactive system and a real-time gesture tracking processing method for the same. The method comprises the following steps of: obtaining image information of user side, executing gesture detection by a gesture detection unit to finish separation of a gesture and a background, and automatically determining a smaller rectangular frame which surrounds the hand as a region of interest in the image information through a vision algorithm; calculating the hand profile state of each frame in a video sequence by a gesture tracking unit; executing validity check on hand actions according to the calculated hand profile state, and determining the gesture action finished by the user; and generating a corresponding gesture action control instruction according to the determined gesture action, and making corresponding feedbacks by a three-dimensional user interface according to the gesture action control instruction. In the system and the method, all or part of gesture actions of the user are sensed so as to finish accurate tracking on the gesture, thus, a real-time robust solution is provided for an effective gesture man-machine interface port based on a common vision sensor.

The invention provides a security protection management method and system based on face features and gait features. The method comprises establishing a user feature database, extracting image data of video frames, extracting user features, determining valid users and invalid users, and the like. On the basis of face identification, the authenticity and the validness of the users are further verified through gaits, and accuracy of identity identification can be provided. The system is realized based on the method and comprises a user feature database model, a video frame image data extraction module, a user feature extraction module, a valid user determining module, a valid user verification module and the like. Through non-contact type face identification and gait identification, convenience is brought to security protection management.

The invention belongs to the technical field of eye movement tracking, and discloses an eye movement interaction method, system and device based on eye movement tracking technology, and the method comprises the steps: setting a passive adsorption gaze cursor or an eye movement interaction intention of a sensing area and predicting an active adsorption gaze cursor to select a target; setting corresponding sensing areas, namely effective clicking areas, for different targets, when the cursor makes contact with or covers the sensing area of a certain target, whether eye movement behaviors such aseye tremor exists or not, detecting whether the glancing distance exceeds a threshold value or not at the same time, and absorbing or highlighting then the target object. A machine learning algorithmis adopted to train the eye movement behavior data of the user, the data is filtered, processed and analyzed, an eye movement behavior rule is trained, and a subjective consciousness eye movement interaction intention model of the user is obtained. Through the method, the stability and accuracy in the eye movement interaction process are improved, and the user experience of eye movement interaction is improved.

The invention discloses a human-computer interaction guiding method and device based on artificial intelligence. The method comprises the following steps that S1, interaction information input by a user is received, and a current topic is determined according to the interaction information; S2, multiple to-be-chosen guiding topics which are related to the current topic are obtained on the basis of a topic graph; S3, user image data of the user are obtained; S4, the guiding topic is chosen from the multiple to-be-chosen guiding topics which are related to the current topic according to the user image data and fed back to the user. According to the human-computer interaction guiding method and device based on the artificial intelligence, the current topic is determined by receiving the interaction information input by the user, the multiple to-be-chosen guiding topics which are related to the current topic are obtained on the basis of the topic graph, and then the guiding topic is chosen from the multiple to-be-chosen guiding topics which are related to the current topic by combining the user image data and fed back to the user, so that the sustainability of human-computer interaction is improved, and the human-computer interaction is more fluent and natural.

The invention discloses a virtual simulation system and method of an antagonistic event with a net based on three-dimensional multi-image display. The system comprises a network connection module, a game logic module, an interaction control module, a physical engine module, a three-dimensional rendering module and a dual-image projection display module, wherein the network connection module comprises a server sub-module and a client sub-module and is used for network communication and data transmission; the game logic module is used for storing game rules, controlling the play of character animation and performing mapping by position; the interaction control module is used for controlling corresponding game characters in a virtual tennis game scene to move and shooting three-dimensional images of different sight points; the physical engine module is used for efficiently and vividly simulating the physical effects of a tennis ball, such as rebound and collision through a physical engine and enabling the game scene to be relatively real and vivid. According to the system, the three-dimensional multi-image display operation can be performed on a same display screen, and the same game scene can be rendered in real time based on different sight angles.

The invention provides a data processing method for robot action expression learning. The method comprises the following steps: a series of actions made by a target in a period of time is captured and recorded; information sets correlated with the series of actions are recognized and recorded synchronously, wherein the information sets are composed of information elements; the recorded actions and the correlated information sets are sorted and are stored in a memory bank of the robot according to a corresponding relationship; when the robot receives an action output instruction, an information set matched with the expressed content in the information sets stored in the memory bank is called to perform an action corresponding to the information set, and a human action expression is simulated. Action expressions are correlated with other information related to language expressions, after simulation training, the robot can perform diverse output, the communication forms are rich and more humane, and the intelligent degree is enhanced more greatly.

The invention relates to the technical field related to machine vision, particularly to a human-computer interaction method based on machine vision, comprising the following steps of: an image obtaining step for continuously acquiring image data through an image acquisition device to update data cache; an image denoising step for reading the data from the data cache, filtering the read data and removing random noise introduced into the image; a feature object extraction step for detecting a feature object in the denoised image, and marking the detected feature object with distinct mark; and astep of gesture identification step for analyzing the motion trail of the feature object extracted by the feature object extraction step, and executing corresponding machine instructions according tothe result of analysis on the motion trail. The human-computer interaction method based on the machine vision provides a complete system solution, so that human can interact with the machine in real time, application limit of the prior touch technology is solved, and the human-machine interaction can be more natural.

The invention discloses an intelligent voice interaction system and method. The system comprises a preprocessing module, a strategy flow module, a central control module, an automatic call-out module,a voice synthesis module, a voice recognition module and a language processing module, wherein the central control module is internally provided with a central control scheduling module for scheduling the strategy flow module, the automatic call-out module and the language processing module. The method comprises the steps of 1-12. According to the method, integrated scheduling of multiple algorithms can be realized, multiple algorithm models are scheduled according to set rules for calculation, and an optimal solution is obtained by integrating calculation results, so that the limitation of blind spot calculation of a single algorithm model is solved, and a complementary effect is achieved; complex answers such as multiple questions, multiple intentions and the like are processed; and thecentral control scheduling module performs preliminary preprocessing before the text is sent to the question calculation model, decomposes questions with multiple intentions into multiple parts through the multi-intention splitting calculation model, then sends the multiple parts to the question calculation model, integrates answer results after obtaining multiple answers, and feeds back the answer results to the client.

The invention provides an interaction method and device based on a vehicle-mounted digital person, and the method comprises the steps: obtaining a video stream, collected by a vehicle-mounted camera,of a person in a vehicle; performing predetermined task processing on at least one frame of image included in the video stream to obtain a task processing result; and according to the task processingresult, displaying a digital person on the vehicle-mounted display equipment or controlling the digital person displayed on the vehicle-mounted display equipment to output interactive feedback information.

The invention relates to information in the technical field of artificial intelligence, and discloses an output control method and device for man-machine conversation, electronic equipment and a storage medium. The method includes the steps that real-time speech processing of audio stream data collected by intelligent equipment is conducted; based on speech processing results, response data to theaudio stream data are determined; execution sequence labels corresponding to the response data are determined; and the intelligent device is controlled to execute the response data according to the execution sequence labels. According to the technical scheme, the control way executing the response data is more flexible, thus the intelligent equipment can execute the response data in a way that isclose to human-nature interaction, and thus the man-machine interaction process is more natural.

The invention provides a man-machine interaction method, device and system based on gesture recognition. The man-machine interaction method based on gesture recognition comprises the steps that a gesture image of a user is acquired; the number of fingers stretched by the user is recognized according to the gesture image; and a corresponding preset control instruction is sent according to the number of the fingers stretched by the user. According to the scheme, the user can control a machine more naturally and conveniently through simple body movement.

The invention belongs to the field of voice wakeup, and discloses a voice wakeup method and device. The voice wakeup method comprises the steps that obtained currently input voice is subjected to voice characteristic extraction; according to the extracted voice characteristics, whether or not wakeup words exist in the currently input voice is determined according to a keyword detection model builtin advance, wherein keywords in the keyword detection model at least comprises preset wakeup words; when it is determined that the wakeup words exit in the currently input voice, whether or not instruction words exist in a preset time threshold value is further judged; the keywords in the keyword detection module at least comprise preset instruction words; the current voice wakeup mode is judgedaccording to whether or not the instruction words exit within the preset time threshold value; corresponding feedback is given according to the voice wakeup mode, and a user interacts with a voice system more naturally.

The invention provides an intelligent electronic device with a built-in microphone. The intelligent electronic portable device performs voice input-based interaction with a user through the followingoperations: processing a sound signal captured by the microphone to judge whether a voice signal exists in the sound signal or not; further judging whether the distance between the intelligent electronic device and the mouth of the user is less than a preset threshold value or not based on the sound signal collected by the microphone in response to the confirmation that the voice signal exists inthe sound signal; and, in response to determining that the distance between the electronic device and the mouth of the user is less than the predetermined threshold, processing the sound signal acquired by the microphone as voice input. The interaction method is suitable for voice input when the user carries the intelligent electronic device, the operation is natural and simple, the voice input steps are simplified, the interaction burden and difficulty are reduced, and the interaction is more natural.

The invention provides electronic equipment provided with a microphone. The electronic equipment is provided with a storage and a central processing unit, a computer executable command is stored in the storage, and when the computer executable command is executed by the central processing unit, the execution comprises the following operation steps that whether or not a sound signal collected by the microphone comprises a voice signal is judged; in response to determination that the sound signal collected by the microphone comprises the voice signal, whether or not a user speaks in a low voiceis judged, that is, the user speaks in a voice lower than the normal volume; in response to a determination that the user speaks in the low voice, the sound signal is taken as a voice for input processing without a wake-up operation. The interaction method is suitable for voice input when the user carries intelligent electronic equipment, the operations are natural and simple, the steps of voice input are simplified, and the interaction burden and difficulty are reduced, so that integration is more natural.

The invention discloses a far-near distance man-machine interactive system based on 3D sight estimation and a far-near distance man-machine interactive method based on 3D sight estimation. The system comprises a depth sensor, a user selection module, a mode judgment module, a sight estimation module, a head orientation estimation module and a robot action control module. The method comprises the following steps: (S1) interaction object selection; (S2) interaction mode judgment; (S3) 3D sight estimation; (S4) head orientation estimation; and (S5) robot action control. According to the system and the method, the man-machine interaction is divided into a far distance mode and a near distance mode according to the actual distance between people and a robot, and the action of the robot is controlled by virtue of the two modes, so that the validity and stability of the man-machine interaction are improved.

The invention provides an application voice control method and system suitable for a virtual reality environment. The method includes: a voice acquisition step: acquiring a voice input command of a user; a voice command recognition step: extracting one or more voice input words from the voice input command of the user, and performing matching to acquire a voice command according to the voice input words; and a control command acquisition step: acquiring a control command associated with the voice command. The application voice control method and system can void the defect that a command input manner is limited due to shortage of hardware input equipment (such as a mouse and a keyboard) in a virtual reality game environment; the feedback speed of acquiring a result by the voice command is greatly improved; a user can control the input time by himself instead of real-time monitoring of input; and interference due to unmeant talk of players and outer sounds.

The invention belongs to the field of human-machine interaction and particularly relates to a multi-channel accurate target positioning method for touch equipment. According to the multi-channel accurate target positioning method, touch input and voice input are used for positioning the target, wherein the touch input is used for providing a possible target object candidate set; the voice input is also used for providing a possible target object candidate set; and the possible target object candidate sets are positioned to an accurate target object by a multi-channel fusion algorithm. According to the multi-channel accurate target positioning method disclosed by the invention, two natural input channels, such as the touch input and the voice input as well as two natural interaction manners are supported; more accurate target positioning can be carried out; and the efficiency of positioning relevant tasks on the touch equipment is increased.

Aspects of the present invention are directed towards a more natural way to interact with an intelligent personal assistant. An intelligent personal assistant comprises a camera that provides images of an area surrounding the assistant. The assistant monitors images provided by the camera to determine when a user is addressing the assistant. When voice input is received after determining that a user is addressing the assistant, the assistant understands that the voice input is intended for the assistant, and acts on the voice input to respond to the user.