635 results about "Interaction technology" patented technology

The invention is applicable to the field of a multi-screen interaction technology and provides a screen synchronization method and a screen synchronization device. The screen synchronization method comprises the following steps of: respectively obtaining a resolution ratio of a first screen of a first terminal and a resolution ratio of a second screen of a second terminal; determining a zooming coefficient and a rotating parameter according to a relation between the resolution ratio of the first screen and the resolution ratio of the second screen; mapping a first coordinate of the first screen to a second coordinate of the second screen according to the determined zooming coefficient and the determined rotating parameter; and setting display data on the second coordinate to displaying data of the first coordinate to enable the second screen to display displaying content of the first screen. A mapping relation of the screen coordinates is subjected to self-adaptive adjustment according to the screen resolution ratios of the two terminals for carrying out synchronous display, so that the synchronous display of the different screens in multi-screen interaction is realized, a user does not need to manually set and the operation efficiency of the multi-screen interaction is greatly improved.

The invention provides an intelligent health management system based on an elder-caring robot; the system comprises an elder-caring robot, a remote terminal and a cloud server; the elder-caring robot comprises a reminder and a detector mutually connected; the reminder starts path planning and mobile functions according to a preset medical solution, searches the elder according to a face recognition technology and a sound source positioning technology, communicates with the elder through a voice interaction technology, and broadcasts prompt contents; the detector monitors an intelligent medicine box opening state on the elder-caring robot, detects the elder complete conditions on the prompt contents through the image identification technology and the voice interaction technology, and synchronizes the detection result onto the cloud server; the cloud server sends the information to the remote terminal, thus returning feedbacks to children or medical personnel. The intelligent health management system can provide complete, professional, intelligent and safe one-stop intelligent health management services, so children can remotely monitor, track and detect elder living conditions in a long term, thus realizing disease types and risk predictions.

The invention discloses a somatosensory-based natural interaction method for a virtual mine. The method comprises the steps of applying a Kinect to acquire gesture signals, depth information and bone point information of a user; carrying out smoothing filtering on images, depth information and bone information of the gesture signals; dividing gesture images by using a depth histogram, applying an eight neighborhood outline tracking algorithm to find out a gesture outline, and identifying static gestures; planning feature matching identification of dynamic gestures by improving dynamic time according to the bone information; triggering corresponding Win32 instruction information by using a gesture identification result, and transmitting the information to a virtual reality engine, respectively mapping the instruction information to the primary keyboard mouse operation of a virtual mining natural interaction system, so as to realize the somatosensory interaction control of the virtual mine. According to the method provided by the invention, the natural efficiency of man-machine interaction can be improved, and the immersion and natural infection represented by the virtual mine can be improved, and the application of the virtual reality and a somatosensory interaction technology can be effectively popularized in coal mines and other fields.

The invention relates to a human-computer interaction technology and discloses an intelligent television interaction method, which is capable of ensuring the television to understand the moods of an user and recommending corresponding resource contents according to the user moods, so that the problem that the interaction way in the conventional technology is still imperfect in the aspect of humanity is solved. The key point of the technical scheme can be summarized as follows: identifying the expression and gestures of the user to judge the current mood of the user; pushing adequate resource information to an intelligent television terminal according to the current mood of the user and generating a corresponding electronic program guide (EPG) menu for the user to choose. Furthermore, the invention also discloses an intelligent television interaction system, which is suitable for the humanized human-computer interaction.

An event interaction method based on a building information model (BIM) comprises the BIM. The BIM is respectively connected with a BIM library and an event triggering definition. The BIM is bound with an event correlation component self-defining model which is correlated with an event data information organization through a connector. The event data information organization comprises event information service and an event information database. The event interaction method has the advantages that by researching the event interaction technology and method in a BIM environment, application of the BIM at an operation and maintenance stage and even application of the BIM to intelligent buildings and intelligent cities are achieved, application range of the BIM is expanded, and the application depth of the BIM is extended.

A method for controlling a four-rotor aircraft system based on the human-computer interaction technology, which belongs to the intelligent flying robot field, is characterized in that a manipulator can control the four-rotor aircraft by gestures. The flight attitude control is accomplished by the cooperative running of the four rotors which are arranged at geometrical vertexes of the four-rotor aircraft with three degrees of freedom being yaw angle, pitch angle and roll angle. The human-computer interaction technology mainly utilizes OpenCV and OpenGL. The system captures depth images of the manipulator hands through a depth camera; the depth images are analyzed and processed by the computer to obtain gesture information and generate control signals corresponding to the gesture information; and then the control signals are sent through a radio communication device to the aircraft for execution, so as to accomplish the mapping from the motion state of the manipulator hands to the motion state of the aircraft and complete the gesture control. With the help of far controlling distance and more visual gesture corresponding relation, the gesture control can be applied to danger experiments and industrial production processes with high execution difficulty.

The invention relates to an iPhone smart phone based robot human-machine interactive system. The system comprises an iPhone console (1), a server (2), a controller (4), a robot (5), a network video module (6) and a CAN bus (3). The system breaks specific complexity and closure of the traditional robot control, various hardware resources such as iPhone smart phone and advanced interactive techniques (such as MULTI-TOUCH, accelerometer and the like) are innovatively combined with robot technology, and high usability human-machine interface (HMI) having novel human motion control analyzing function based on HMM is realized. 3G technology is utilized to access Internet, so as to construct a remote robot control platform with real-time network video feedback, and a high friendly robot human-machine interactive system with carrying convenience, flexible control and no distance restriction is developed.

The invention relates to a voice state detection method suitable for an echo cancellation system. The voice state detection method relates to the field of voice interaction technologies based on an IP network. The voice state detection method comprises the steps of: constructing a support vector machine (SVM) classifier by utilizing noise training samples and voice training samples, wherein signals to be detected are far-end and near-end signals after blocking, carrying out VAD judgment on the block far-end signal by adopting the constructed SVM classifier based on a Gaussian mixture model, stopping updating and filtering of a filter and outputting a near-end voice signal directly if the judgment result is that no voice exists, and carrying out double-end conversation judgment when judging that voice exists at a far end; stopping updating coefficients of the filter when in double-end conversation, and filtering the near-end signal; otherwise, conducting coefficient updating and filtering of the filter according to the far-end signal. The voice state detection method improves accuracy of voice activity detection, prevents a double-end mute state from being misjudged to be a double-end conversation state, and prevents error updating and filtering of the filter without a reference signal.

The present invention provides an unmanned supermarket shopping cart based on an information interaction technology, and an unmanned supermarket intelligent shopping system and method based on an information interaction technology. A customer can add a shopping list on a mobile device in advance to realize location of indoor goods and path planning to save shopping time; automatic code scanning payment at any area in a supermarket can be realized to save time of queuing and settlement at a cashier desk; customer's shopping information can be recorded and analyzed, and goods preference recommendation and preference sale promotion activities are pushed to the customer to improve a customer's shopping experience; and real-time online information interaction between a supermarket and the customer is realized so as to save manpower cost of information transferring personnel (shopping guides and cashiers).

The invention provides an upper limb rehabilitation system and method based on a myoelectric signal and a virtual reality interaction technology. The system comprises a myoelectric signal acquiring and processing part, a virtual reality man-machine interaction part and a muscle function evaluation part, wherein the myoelectric signal acquiring and processing part is composed of a data acquiring module, a signal processing module and a model control module; the virtual reality man-machine interaction part is composed of an upper computer virtual environment module and a force feedback device module; the muscle function evaluation part is composed of a muscular tension quantitative evaluation module and a muscle cooperativeness quantitative evaluation module. According to the rehabilitation method, myoelectric control is used so that a patient subjective intention can be reflected better; a patient keeps initiative in a rehabilitation process by using a virtual reality technology, and the portability, the safety and the effectiveness of rehabilitation trainings are improved. According to the upper limb rehabilitation system and method, an existing clinical rehabilitation evaluation manner can be combined and a muscle function state of the patient is objectively evaluated, so that rehabilitation training standards are provided for the patient and evidences for formulating a therapeutic scheme are provided for rehabilitation doctors.

Disclosed is an android malicious code detection device and method based on dynamic activation and behavior monitoring. According to the device, behaviors of a cellphone terminal automatically installing and starting an application to be detected and automatically activating the application are controlled; meanwhile, during the whole running process of the application, information of the cellphone terminal, such as file access, short message sending, network connection, traffic, system resource usage and hardware resource access, is monitored in real time, malicious behaviors of malicious codes are detected, a detection report is generated and provided for a user, and behaviors of the application under detection are dynamically detected. The device comprises an application behavior dynamic activation module, an application behavior real-time monitoring module and a detection result analysis module. The device and the method have the innovative advantages that all control and interface operations are achieved for the application by a software interaction technology, all application behaviors are dynamically activated, all-function automatic monitoring and detection is achieved for the application on the premise of finishing self-functions, and detection can be comprehensive and complete.

Belonging to the field of naval architecture and ocean engineering, the invention relates to a three dimensional visual simulator system device of ship driving and cabin operation. Based on a distributed mathematical physics platform model and a distributed ship operation principle, the device of the invention comprises six operational modules: (1) a power system mathematical physics equation modeling module, (2) a three dimensional display module, (3) a climate environment change display module, (4) a geographical information environment change display module, (5) a digital glove interactive operation module, and (6) a physical platform simulation operation module. The above modules are integrated into one physical platform, to solve the problem of integration between various modules. Specifically, three dimensional display, the database exchange technology and the digital glove interaction technology are integrated into one platform. Physical operation is used to replace keyboard event response, and scene change is used to replace ship navigation and cabin operation, to achieve the purpose of simulating ship steering and cabin operation.

The invention discloses a speech emotion recognition method based on a multi-scale deep convolution recurrent neural network. The method comprises the steps that (1), three-channel speech spectrum segments are generated; (2), speech spectrum segment features under different scales are extracted by adopting the convolution neural network (CNN); (3), time modeling of a speech spectrum segment sequence under different scales is achieved by adopting a long short-term memory (LSTM), and emotion recognition results of a whole sentence of speech is output; (4), fusions of recognition results obtainedby CNN+LSTM under different scales are achieved by adopting a score level fusion method, and the final speech emotion recognition result is output. By means of the method, natural speech emotion recognition performance under actual environments can be effectively improved, and the method can be applied to the fields of artificial intelligence, robot technologies, natural human-computer interaction technologies and the like.

The invention provides a book interaction method, apparatus, and equipment. The method comprises: a to-be-interacted book, a current page of the to-be-interacted book, a region of interest of a user, and a characteristic of the region of interest of the user can be identified by using an image matching identification technology; according to the identification results, a preloaded interaction labeled file is read, so that an interaction content and an interaction type that correspond to an interaction labeled point corresponding to the region of interest of the user are obtained; and then according to the interaction type, the interaction content is displayed. As long as the information of the interaction book is preloaded, interaction of the to-be-interacted book can be realized by using the method without the need to require whether the to-be-interacted book is a customized book. Therefore, with the method, defects existing in the manufacturing process of customized books in the prior art can be overcome. Moreover, the labor and economic costs of the book interaction technology can be reduced. In addition, the method is suitable for all kinds of books including ordinary books, so that book interaction application universality can be improved.

This invention relates to a kind of video finger positioning system and its orient method which base on finger tip labeled, belongs to virtual reality systemic man-computer interaction technology. This invention includes camera, image picking equipment and calculator. Locating method includes initialization and positioning. Initialization is a calibrating method of via two-dimensional surface mark target, to definite interior parameter of each camera; through camera global calibrating, to definite each camera coordinate relative to one unified world coordinate translation and turning; the positioning stage adopt self-adapting focusing distance, via detecting picture mark point to realize finger locating.

The invention discloses a mental and psychological assessment method based on VR interaction and brain wave and cerebral blood flow monitoring, and relates to the field of medical treatment. The method comprises three parts of a user specific emotion elicitation link based on virtual-real interaction technology, a user psychological data analysis link based on brain wave and cerebral blood flow data real-time monitoring, and a user mental and psychological assessment link. According to the method, according to the doctor or user needs and on the premise of ensuring safety, a virtual-real module is used for providing virtual-real contents of different forms for the user to elicit the specific emotion fluctuation of the user, and brain wave, cerebral blood flow and other psychological data of the user is subjected to comparative analysis with the expected data, so that the feedback effect of the user observing the virtual-real contents is analyzed and obtained, and the mental and psychological assessment of the user is performed by combining with the feedback effect of the user observing a series of virtual-real contents with specific emotion elicitation effects.

The invention relates to a long-distance non-contact luggage volume detection system and a method thereof. The system and the method are used to perform long-distance non-contact hard and soft luggage volume detection in airports, train stations or other scenes. The system comprises a luggage object image acquiring and processing module, a luggage object 3D spatial dimension reconstruction module, a volume calculation module, a luggage placing position prompt module, a feedback module, a camera, and a central processor. The technical problems to be solved in the invention include: automatically identifying a luggage in a detection area under a long-distance space environment; processing the surface geometric characteristics of the luggage after claiming; building a 3D space model; judging whether the luggage is soft or hard; calculating the volume using different algorithms; and feeding the volume detection result and suggestion back to a user through a multi-channel interaction technology. The invention provides a convenient and quick luggage volume self-detection method for passengers, and inconvenience brought by an oversized luggage is avoided.

The invention provides a method and a system for interactive display of a cultivation culture virtual scene. The method comprises the steps of acquiring cultivation knowledge and performing classified storage; respectively establishing a plurality of classified databases and three-dimensional models; respectively forming a correspondence between the plurality of classified databases and a correspondence between the plurality of classified databases and the three-dimensional model; displaying the three-dimensional model with a triggering condition, triggering and playing the cultivation knowledge which corresponds with the triggering condition in the classified database that corresponds with the three-dimensional model; inputting the triggering information for triggering a preset event in the three-dimensional model, and playing the related agricultural knowledge in the classified database which corresponds with the three-dimensional model. The method and the system realizes reproduction of the traditional cultivation scene. Three-dimensional modeling technology is utilized for reproducing an object for obtaining a 3D model and improving a stereo perception, so that the picture is more enriched. Furthermore vividness and trueness which are realized by interaction technology are added, thereby greatly improving interest of audiences, making the audiences understand and search a scene content and improving availability and timeliness of the system.

The invention provides a realization method and realization equipment for an enterprise service bus and a corresponding platform, which relate to an enterprise application system interaction technology and solve the technical problem that the realization method for the enterprise service bus (ESB) in the prior art is excessively heavy for a system. The method provided by the invention mainly comprises that: service-oriented architecture ESB (SOA.ESB) equipment receives a request message which is defined according to a request message protocol from service consumer equipment; the SOA.ESB equipment determines whether the service consumer equipment has security right over requesting or not according to a user identifier carried by the request message; and if the service consumer equipment has the security right over the requesting, the SOA.ESB equipment forwards the request message to corresponding service provider equipment when a message parameter carried by the request message indicates synchronization processing. The method, the equipment and the platform are mainly used for intra-enterprise interaction.

The invention relates to a human-computer interaction technology and discloses a facial recognition control terminal based method. According to the facial recognition control terminal based method, the human-computer interaction can be humanized and convenient and the interaction can be closely combined with the movement and accordingly the interaction can be achieved and meanwhile the head and the neck can be moved. The facial recognition control terminal based method comprises the steps of collecting image data through a camera; preprocessing the collected images; tracking and positioning face organs in the processed images and recognizing the facial positions; extracting related feature images after the normalization processing is performed on the images of the facial positions to form image sequences; utilizing the correlation information between the image sequences to obtain the corresponding image sequence subspace, judging the modes of the sequences and achieving the gesture recognition specific to faces; enabling the result of the facial gesture recognition to be converted into a corresponding control instruction to be sent to a terminal; executing the received control instruction through the terminal and achieving the corresponding action. The facial recognition control terminal based method is suitable for the human-computer interaction between a user and the terminal.

The invention relates to the interaction technology, and especially relates to a real-time voice method and device. The real-time voice method has the steps of when a real-time voice application program is switched to operate on a background, reading the type of an application program executed by the current system; judging whether the application program executed by the current system is a game application program; if the application program executed by the current system is the game application program, generating a floating window corresponding to the real-time voice application program and displaying the floating window on the interface of the game application program for corresponding operations of a user. When the voice application program runs on the background and the game runs on the foreground, the real-time voice floating window is displayed on the game interface, so the user can complete various operations for the real-time voice function through the floating window without quitting the game manually, and convenience is provided for the user.

The invention provides a family affection care system based on an old-age care robot. The system comprises the old-age care robot, a remote terminal and a cloud server. Under the control of a child, the remote terminal sends a go-home-to-see access request to the cloud server through a go-home-to-see request module; a go-home-to-see receiving processing module of the old-age care robot controls the old-age care robot to start an old person seeking function, confirms an old person position through utilization of a voice positioning technology or a face identification technology, then prompts anold person to put through and checks a life condition of the old person through a camera of the old-age care robot; and the go-home-to-see receiving processing module receives character, voice, picture and/or video information sent by the remote terminal and displays the information to the old person and moreover controls the old-age care robot to interact with the old person through utilizationof a voice interaction technology and an image identification technology. According to the system, the interaction is automatically initiated through utilization of the old-age care robot, the child is helped to communicate with the old person effectively through utilization of fragmented time, the life condition of the old person is checked whenever and wherever possible, and the affection company for the old person is realized.

The invention provides a VR video live broadcasting interaction method and device based on an eye tracking technology, and relates to the field of sight interaction technologies, voice interaction technologies and VR video compression coding technologies. An eye watching point is judged through an eyeball tracking technology; a watching point region, namely a region of interest (ROI), is transmitted in a picture compression coding process through high resolution; therefore, the fact that a seen picture is clear enough can be ensured; furthermore, the transmission data size can be greatly reduced; therefore, requirements of VR equipment on hardware can be reduced; simultaneously, the control mode can be switched at any time by utilization of a voice recognition technology; and the interaction mode diversity is increased.

The invention provides a method and a system of remotely controlling a set top box by a cellphone. The cellphone broadcasts, transmits and obtains media access control (MAC) address request information of each set top box in a same local area network; each set top box responds to the MAC address request information which is sent by the cellphone, and returns MAC address information; after the cellphone receives the MAC address information which is returned by each set top box, the cellphone generates a remotely control set top box list of the returned MAC address. Based on local area network interaction technology and MAC address recognition technology, by the adoption of the technical scheme of remote control operation of the set top box of the same local area network by the cellphone, the method and the system provide a remote control operating scheme which is convenient, simple and direct.

The invention relates to an information interaction technology, and provides a television system for video recommendation based on a shaking method, for solving the problem of backward man-machine interaction system and method in the prior art. The television system comprises a remote service end, an intelligent television terminal and a remote controller, wherein the remote service end and the intelligent television terminal are provided with communication modules; the intelligent television terminal is also provided with a display module and a storage module; the remote controller is provided with a triaxial acceleration sensor and a control module; and the triaxial acceleration sensor and the control module are connected. According to the invention, by using the current network communication function of an intelligent television and the sensor in a television remote controller, programs of high relevance can be provided for different users, and the users can obtain the most satisfactory programs by operating fewer steps, therefore, the television system and the control method provided by the invention are applied to an information interaction method based on intelligent television video content recommendation.