Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

27results about How to "Rich interactive experience" patented technology

Environment self-adaptive meta-universe scene sensing system and method

The invention discloses an environment adaptive meta-universe scene perception system and method, and belongs to the technical field of data transmission, and the method specifically comprises the steps: collecting and preprocessing multi-dimensional environment and sensory data in a meta-universe scene in real time through a sensor array, and constructing a full sensory environment data set; radar scanning and depth camera technologies are utilized to accurately obtain three-dimensional information of a physical environment, and a super-reality three-dimensional model is established to simulate a complex ecological system and environment characteristics of the physical world; in combination with real-time full-sensory environment data, an intelligent algorithm is adopted to dynamically adjust meta-universe scene elements, a user behavior prediction technology is introduced, scene layout and an interaction mode are intelligently adjusted according to user history and current states, and user experience is improved; user feedback is collected through VR immersive interaction, a scene perception method is evaluated, and iterative optimization is implemented according to an evaluation result so as to continuously improve the sense of reality and interactivity of the meta-universe scene; and efficient construction and intelligent management of the meta universe scene are realized.
Owner:JIANGXI ZHOUYUYUAN INFORMATION TECHNOLOGY CO LTD

Meeting interaction method and system based on meta universe

The invention discloses a meta universe-based conference interaction method, and relates to the technical field of virtual conferences, and the method comprises the steps: extracting the facial features of participants, comparing the facial features with a pre-established facial feature library, obtaining the unique identity of each participant, and recognizing the identities of the participants; after the identities of the participants are determined, position changes of key body joint points of the participants are detected in real time, and specific actions of the participants are judged by analyzing relative positions and movement tracks between the joint points; the method comprises the following steps: receiving the acoustic characteristics of the participant language, converting the voice signal of the participant into a text, and analyzing the semantics and emotion of the text in combination with natural language processing to obtain the language expression intention of the participant. According to the method and the device, the optimal interaction mode can be dynamically selected from the preset library according to different interaction intentions, and the audio and video parameters and the interface layout are adjusted in real time, so that intelligent interaction in a multi-user scene is realized, the interaction experience of a conference is optimized, and the interaction effect can also be improved.
Owner:新国脉文旅科技有限公司

Visual large screen design system and method based on low codes

The invention provides a visual large screen design system and method based on low codes. The system comprises a large screen page designer subsystem, a large screen content switching subsystem, a component adaptation subsystem, a built-in component reconstruction subsystem and a component interaction subsystem. The large-screen page designer subsystem is used for realizing large-screen page design which is low in coupling, high in expansion and capable of supporting multi-person collaboration; the large-screen content switching subsystem realizes large-screen content switching of a single-page refreshing mechanism; the component adaptation subsystem is used for realizing adaptation of different technical stack components of a third party; the built-in component reconfiguration subsystem supports system built-in component reconfiguration and use; and the component interaction subsystem realizes a flexible component interaction and data communication mechanism. According to the method, new characteristics of collaborative development, a single-page refreshing mechanism, high component expansibility and the like are provided, and a reconstruction mechanism of a built-in component, a third-party component adaptation mechanism, a page container mechanism and a perfect event mechanism are provided, so that high flexibility, high expansibility and high collaboration of visual large-screen page design are realized.
Owner:北京鸿鹄元数科技有限公司

Holographic intelligent system based on digital human model technology and equipment thereof

The invention relates to the technical field of intelligent interaction, and discloses a holographic intelligent system based on a digital human big model technology and equipment thereof, which adopt an intelligent interaction module to realize dynamic interaction with a user, and render a data person through a 2.5 D digital human real-time driving module based on a nerve radiation field, the mouth shape and action of a data person are both matched with the language, a holographic rendering engine is further utilized to render the global situation, the system achieves diversified and high-fidelity user interaction experience and enhances the natural fluency of interaction in combination with holographic intelligent equipment, dynamic interaction achieved and the AI technology, and the system is based on a technical framework of a digital human big model and has the advantages of being high in practicability and easy to popularize. The possibility of expanding more functions of the system is provided, the requirement of the user for diversified interaction experience is met, and the overall user experience is remarkably improved.
Owner:HANGZHOU QINGSHANG NETWORK TECHNOLOGY CO LTD

Visual and auditory cross-modal object material retrieval method and system

The invention provides a visual and auditory cross-modal object material retrieval method and system, and relates to the technical field of artificial intelligence. The visual and auditory cross-modal object material retrieval system comprises a data acquisition unit for acquiring visual images containing objects made of various materials and corresponding audio data; feature extraction: feature extraction is performed on the visual and auditory data, visual features include but are not limited to colors, textures and shapes, and auditory features include but are not limited to spectrum features and time domain features; feature fusion: designing a fusion algorithm, and effectively fusing visual and auditory features to form cross-modal feature representation; and retrieving a model, wherein the model can learn a mapping relationship between the cross-modal features and the material of the object. By combining visual and auditory information, the system can more comprehensively understand the characteristics of the object, the visual information can provide the appearance characteristics of the object, the auditory information can provide the dynamic characteristics about the material of the object, and the fusion is beneficial to improving the accuracy of material identification.
Owner:ANHUI VOCATIONAL COLLEGE OF ELECTRONICS & INFORMATION TECH

Multi-role interaction method and device

The invention provides a multi-role interaction method and device. Multi-role interaction comprises interaction between at least one virtual role and at least two interaction roles. The method comprises the following steps: in response to a creation request of creating multi-role interaction by a user, determining an interaction prompt word; generating a virtual character based on the interaction prompt word; in response to an interaction request of a user for starting multi-role interaction, determining an interaction role, and starting the multi-role interaction; and determining an interaction result between each interaction role and the virtual role based on interaction information and interaction cues generated in multi-role interaction. Therefore, by introducing a mode of interacting a plurality of interaction roles with the same virtual role and determining the interaction result between each interaction role and the virtual role, the role interaction scene and the interaction experience can be enriched, the participation enthusiasm of the user can be improved, and the method is suitable for the interaction scene in which multiple persons participate.
Owner:BEIJING XIYU JIZHI TECH CO LTD

Calculation method for processing touch area of mobile item based on Unreal Engine

The invention provides a calculation method for processing a mobile item touch area based on UnreaIEngine, and relates to the technical field of intelligent interaction systems and self-adaptive computation.The calculation method comprises a touch area processing system, and when the calculation method for processing the mobile item touch area based on UnreaIEngine is achieved, processing, controlling and adjusting are conducted through the touch area processing system. The touch area processing system comprises a viewport information acquisition module, a UI information processing module, a touch area control module, an adaptive spatial perception optimization module, a spatial-temporal dynamic modeling module, a super-resolution touch area reconstruction module, a multichannel optimization coexistence module and a curved screen mistaken touch intelligent protection module. According to the mobile item touch area processing and calculating method based on Unreal Engine, the problems of accuracy and flexibility of viewport information acquisition and UI (User Interface) information processing are effectively solved.
Owner:SHANGHAI YINSHENG INFORMATION TECH CO LTD

Lottery draw processing method and device

PendingCN119295144AAdd funRich interactive experienceCommerceData miningOperations research
The embodiment of the invention provides a lottery drawing processing method and device. The method comprises the following steps: acquiring collected playing method preference data; determining a matched target lottery drawing model from a preset model library according to the playing preference data; wherein the target lottery drawing model has a corresponding winning probability and a prize type; in response to a received lottery drawing operation, determining whether a current participant wins a lottery or not according to the winning probability through the target lottery drawing model; and under the condition of determining that the current participant wins the prize, determining a hit target prize according to the prize type through the target lottery drawing model. The playing method preference data is collected to analyze the playing method preference of the user, and the target lottery drawing model matched with the playing method preference is selected, so that the required lottery drawing playing method is realized by using the lottery drawing model, various combinations of different lottery drawing playing methods and reward mechanisms are supported, diversified interactive experience and reward modes are realized, and the user experience is improved. And the interestingness and competitiveness of participation are increased.
Owner:SHANGHAI HODE INFORMATION TECH CO LTD

A phone holder for handheld tablets

PendingCN122086200APrevent accidental swing backWith self-locking featureDigital data processing detailsTelephone set constructionsMechanical engineeringMobile phone
This invention relates to the field of tablet computer accessories, and more particularly to a mobile phone stand for handheld tablet computers. The stand includes a connecting frame, a concave frame fixedly connected to the back of the connecting frame, and a bottom frame fixedly connected to the bottom of the connecting frame. A guide rod is slidably connected to the top of the connecting frame, and a clamping spring is fixedly connected to the side wall of the guide rod. The other end of the clamping spring is fixedly connected to the top of the connecting frame. The top of the guide rod is fixedly connected to an upper clamping plate. A clamping space is formed between the upper clamping plate and the bottom frame for clamping the tablet computer. This invention utilizes a contact plate rotatably connected to the inner side wall of the concave frame. Rotating the handle drives the contact plate to rotate outward using a worm gear, causing it to form a certain angle with the back of the connecting frame. At this point, the contact plate and the bottom of the concave frame together form a stable support surface. The arc-shaped area at the bottom can contact the tabletop, providing stable support for the stand and facilitating its placement on a table for use. Furthermore, the worm gear mechanism has a self-locking characteristic.
Owner:SHENZHEN JIANHUIDA ELECTRONICS CO LTD

Smart glasses streaming voice dialogue interaction system and method based on large language model

The present application discloses a smart glasses streaming voice dialogue interaction system and method based on a large language model, the system comprising: a data acquisition module for collecting interactive information of user and smart glasses voice dialogue and smart glasses resource status information; a data conversion module for processing interactive information using real-time streaming processing technology and adaptively selecting the corresponding type of interactive information recognition model, converting the recognized content into text information; a data processing module for receiving text information and calculating the comprehensive score according to the preset scoring rules, matching the large language model with different model configurations loaded according to the comprehensive score to perform intent recognition and generate reply text; a data interaction module for converting the generated reply text into voice output; a data feedback module for receiving feedback on user interaction satisfaction to optimize the interactive information recognition model or the large language model. The present application can achieve an efficient, accurate and smooth voice interaction experience.
Owner:NANJING MAGIC GRP INFORMATION TECH CO LTD

Small window linkage method and device, vehicle and computer readable storage medium

The invention discloses a small window linkage method and device, a vehicle and a computer readable storage medium. The small window linkage method comprises the steps that after a preset target application is triggered, a floatable front display window is generated in a preset position area on a vehicle display screen; a preset target application is displayed through the front display window, and the application loaded and displayed by the front display window is independent of the application of the first screen and the application of the second screen; detecting whether the front display window covers the upper layers of other display windows or not; and if yes, setting the window state of other covered display windows as an embedded state, and setting the window state of the front display window as a suspended state. According to the method and the system, collaborative linkage display among multiple screens can be supported, cross-screen and cross-region content movement or switching is realized, and passengers can enjoy richer interactive experience and personalized services through linkage among applications.
Owner:ZHEJIANG GEELY HLDG GRP CO LTD +1

Multi-screen hierarchical display method and device, vehicle and computer readable storage medium

The invention discloses a multi-screen hierarchical display method and device, a vehicle and a computer readable storage medium, the multi-screen hierarchical display method comprises the following steps: detecting whether a vehicle display screen has a plurality of display windows arranged in a laminated manner, the display windows being floatable application windows arranged on the vehicle display screen, the application loaded and displayed by the display window is independent of the application of the first screen and the application of the second screen; if yes, the display priorities of the display windows arranged in a laminated mode are determined, the display levels of the display windows are determined according to the display priorities of the display windows, the higher the display levels are, the closer the display levels are to the top layer, and the highest display level belongs to the top layer arrangement. According to the method and the system, collaborative linkage display among multiple screens can be supported, cross-screen and cross-region content movement or switching is realized, and passengers can enjoy richer interactive experience and personalized services through linkage among applications.
Owner:ZHEJIANG GEELY HLDG GRP CO LTD +1

A non-powered passive toy device and track set toy

PendingCN122321437AVarious ways to playRich interactive experienceSimulationContinuous rotation
This invention provides a passive, non-powered toy device and a track-based toy combination. The passive, non-powered toy device includes: a base with a running track; a roller rotatably mounted on the base, the roller receiving rotational power from external wheels; and a switching mechanism that is connected to the roller and controls the movement of the roller and the movable part. The switching mechanism includes at least three operating modes: continuous rotation mode, delayed stop mode, and immediate stop mode. By incorporating a switching mechanism with continuous rotation, delayed stop, and immediate stop modes, this invention allows users to actively control the movement of the movable part as needed, enriching the toy's playability and interactive experience. The switching mechanism enables switching between different modes via a simple button operation, greatly enhancing the toy's fun and playability.
Owner:SUNSMILE CORP

Interactive content management method and device based on large model and electronic equipment thereof

The invention provides an interactive content management method and device based on a large model and electronic equipment, and relates to the technical field of game interaction.The method comprises the steps that game picture frames of a plurality of users are obtained; wherein the game picture frame comprises user interaction content; performing feature extraction on all the game picture frames through the large model to obtain content feature vectors; wherein the content feature vector comprises an image feature vector and a text feature vector; performing feature fusion on the image feature vector and the text feature vector to obtain a fused feature vector; comparing the fusion feature vectors of different users one by one, and judging whether a target user group exists or not; wherein the target users comprise at least two users in the same plot node; and when the target user group exists, synchronizing the user interaction contents of all target users at the plot node, and displaying the user interaction contents through a game picture frame corresponding to the plot node. According to the invention, the accuracy and efficiency of content management are improved, and the cost and difficulty of manual auditing are reduced.
Owner:SHANG HAI LIAN PU XIN ZHI ZHI NENG KE JI YOU XIAN GONG SI

An ebike computer screen and IOT device

ActiveCN224277418UHigh system integrationReduce wiring spaceCycle equipmentsComputer hardwareMobile apps
This utility model discloses an eBike vehicle infotainment screen and IoT device, including a vehicle housing, a main control board, and a display screen assembly. The main control board integrates a vehicle main control chip, a Bluetooth module, a 4G module, a GPS module, a magnetic compass module, and a vehicle control interface. The Bluetooth module is used for communication with a mobile app, the 4G module is used for connecting to an IoT platform, the GPS module is used for positioning, and the magnetic compass module is used for direction recognition. The display screen assembly is electrically connected to the main control board and is used to display operating parameters such as motor status, battery information, navigation route, and weather. The vehicle control interface is connected to multiple components of the vehicle through control signal lines, enabling unified control of the motor, lights, battery lock, millimeter-wave radar, taillights, vibration motor, horn, fingerprint recognition module, and battery compartment. This utility model features high structural integration, rich functionality, and improves the overall control efficiency of the vehicle and the user interaction experience.
Owner:ZEUS (SHENZHEN) TECH CO LTD

H.265 video playing system

The utility model discloses an H.265 video playing system, which comprises a master control module, a player module and a B / S (Browser / Server) client, the player module is used for receiving an H.265 video stream after a playing task is started, and decoding the H.265 video stream to obtain a YUV video stream; the B / S client is respectively connected with the main control module and the player module, and is used for receiving the YUV video stream and performing video rendering after a playing task is started; and the main control module is used for processing data interaction between a foreground and a background. The video playing system disclosed by the utility model can solve the technical problem that the browser cannot be directly compatible with the H.265 format video.
Owner:HANGZHOU EBOYLAMP ELECTRONICS CO LTD

Gateway device of Internet of Things

The utility model discloses an Internet of Things gateway device, which comprises a controller, and a man-machine interaction module, a memory module, an Ethernet module, a multi-protocol communication module and an expansion interface which are connected with the controller, and is characterized in that the man-machine interaction module comprises a CSI interface used for connecting a camera, and an OLDI interface and an HDMI interface which are used for connecting a display; the multi-protocol communication module comprises a wireless communication module for realizing wireless communication, the expansion interface is used for being connected with various built-in and external equipment, and the controller is used for receiving data from each module and interface and promoting communication among various protocols. Multiple communication protocols and user interface functions are integrated on a single platform, complex system integration work needed by a traditional multi-device solution is simplified, the number of needed devices can be reduced for a user, system complexity is reduced, and development and maintenance cost is reduced.
Owner:SEEED TECH

Small window conversion method and device, vehicle and computer readable storage medium

The invention discloses a small window conversion method and device, a vehicle and a computer readable storage medium, and the method comprises the steps: detecting whether a display region covered by a front display window is displaying a preset target application or not, the preset target application being an application of which the display priority is higher than a preset level; if yes, in the covered display area, the display area where the preset target application is being displayed serves as a key interface, and the key interface is placed on the top layer to be displayed till the preset target application where the key interface is being displayed is terminated. According to the method and the system, collaborative linkage display among multiple screens can be supported, cross-screen and cross-region content movement or switching is realized, and passengers can enjoy richer interactive experience and personalized services through linkage among applications.
Owner:ZHEJIANG GEELY HLDG GRP CO LTD +1

Intelligent interaction method, device and equipment based on digital projection lamp and medium

The invention relates to the technical field of digital projection, and discloses an intelligent interaction method, device and equipment based on a digital projection lamp, and a medium, and the method comprises the steps: collecting and obtaining an input image through a high-definition camera; preprocessing the input image; performing target detection on the input image through a YOLO target detection algorithm, and identifying a content area and an interactive projection area in the input image; carrying out layout area detection on the content area by utilizing an image-text layout detection model so as to identify different types of content areas; according to the category of the content area and the interactive projection area, generating a pixel point control instruction of a micro-LED; according to the pixel point control instruction, the pixel lightening area of the Micro-LED is controlled to generate an interactive graphic pattern and project the interactive graphic pattern to the interactive projection area, the intelligent interaction function of the digital projection lamp is achieved, the digital projection lamp can adapt to changes of the environment and the projection surface for recognition and intelligent adjustment, and the interaction experience is effectively improved and enriched.
Owner:BEIJING DIGITAL LIGHT CHIP TECH CO LTD

Scene state feedback method, in-vehicle infotainment system and storage medium

PendingCN119502834ARich interactive experienceVideo gamesElectric/fluid circuitTouch SensesSimulation
The invention provides a scene state feedback method, an in-vehicle infotainment system and a storage medium. The scene state feedback method comprises the following steps: monitoring a target scene interface to obtain scene state information; generating a corresponding target feedback signal according to the scene state information, and sending the target feedback signal to the vehicle machine equipment; further converting the target feedback signal into a feedback instruction and executing the feedback instruction through the vehicle machine equipment; wherein the vehicle machine equipment at least comprises cabin equipment and handle equipment, and the feedback instructions at least comprise a visual instruction, an auditory instruction, a touch instruction and an olfactory instruction. According to the application, richer and more immersive interaction experience can be provided through multi-dimensional feedback; and handle operation can be expanded to the whole cabin environment, so that more comprehensive interactive experience is provided for users.
Owner:HUIZHOU DESAY SV AUTOMOTIVE

Interactive interface rendering method and device, equipment, medium and program product

PendingCN119559308ASolve the problem of not supporting 3DUI renderingImprove experienceVideo games3D-image renderingData packComputer graphics (images)
The embodiment of the invention provides an interactive interface rendering method and device, equipment, a medium and a program product, and the interactive interface rendering method comprises the steps that in response to a rendering instruction for a target interactive interface, a target interface identifier of the target interactive interface is determined, and the target interactive interface comprises a plurality of target models; a pre-packaged target rendering data packet is queried based on the target interface identifier, the pre-packaged target rendering data packet comprises visual angle information and depth information of the multiple target models, and the visual angle information is used for representing space attribute information of the multiple target models in the display area; the depth information is used for representing depth levels of the multiple target models in the display area; and based on the visual angle information and the depth information, rendering the plurality of target models in the display area. According to the method, a more vivid and natural three-dimensional interactive interface is realized, rich visual effects and interactive experience are provided, higher requirements of players on sense of reality and interactivity are met, and the overall user experience is improved.
Owner:GUANGZHOU SEASUN ENTERTAINMENT NETWORK TECHCO

Intelligent interaction method, device, equipment and medium based on digital projection lamp

ActiveCN119314022BRich interactive experienceElectrical apparatusCharacter and pattern recognition
The present invention relates to the field of digital projection technology, and discloses an intelligent interaction method, device, equipment and medium based on a digital projection lamp. An input image is acquired by a high-definition camera; the input image is preprocessed; a target detection is performed on the input image by a YOLO target detection algorithm to identify a content area and an interactive projection area in the input image; a layout area detection is performed on the content area by using a graphic layout detection model to identify content areas of different categories; a pixel control instruction of a micro light emitting diode Micro-LED is generated according to the category of the content area and the interactive projection area; according to the pixel control instruction, a pixel lighting area of ​​the Micro-LED is controlled to generate an interactive graphic pattern and project it onto the interactive projection area, thereby realizing the intelligent interaction function of the digital projection lamp, being able to adapt to changes in the environment and the projection surface for identification and intelligent adjustment, and effectively improving and enriching the interactive experience.
Owner:BEIJING DIGITAL LIGHT CHIP TECH CO LTD

Three-dimensional book

ActiveCN224183994UDynamic visual effectsAttract attentionToysBooksSoftware engineeringPaper sheet
The utility model provides a three-dimensional book, which can bring dynamic visual effect and rich interactive experience to readers, effectively attract the attention of the readers and greatly stimulate the reading interest of the readers. The three-dimensional book comprises a cover, and the cover comprises a front cover, a spine and a back cover which are connected in sequence; the book block is arranged in the cover, the book block is provided with a plurality of book stickers, and each book sticker is provided with a through hole; the pull page comprises one or more pre-folding units, the pre-folding units are formed by alternately folding paper forwards and backwards for multiple times, the multiple pre-folding units are sequentially connected, and the pull page penetrates through the through holes of the book stickers and is connected with the book stickers respectively. When a reader turns over the book, the pull pages can dynamically change (stretch or compress) along with the movement of the book, so that a dynamic visual effect and rich interactive experience are generated, the attention of the reader is attracted, and the reading interest of the reader is stimulated.
Owner:DONNELLY (GUANGDONG) PRINTING CO LTD

Multi-screen application adaptation method and device, vehicle and computer readable storage medium

The invention discloses a multi-screen application adaptation method and device, a vehicle and a computer readable storage medium, and the method comprises the steps: recognizing user behavior information in a vehicle cabin after a preset target application is triggered based on a preset touch operation, determining a target display mode corresponding to the preset target application according to the user behavior information; and loading and displaying the preset target application through the target display mode. According to the method, the user demand can be identified more accurately, then the application information is accurately displayed on the screen matched with the driving position of the user, application display services are provided for passengers in a targeted mode, and better multi-screen cooperative linkage interaction experience is brought to the user.
Owner:ZHEJIANG GEELY HLDG GRP CO LTD +1

Virtual restoration simulation method and system for cultural relics based on digital twinning

The application relates to the technical field of digital twinning, and discloses a cultural relic virtual restoration simulation method and system based on digital twinning. The method comprises the following steps: a cultural relic digital twinning body is constructed by fusing geometric shapes and physical properties; collision contact between a virtual tool and a model is detected in real time; stress, deformation and reaction force in a contact area are calculated through real-time finite element analysis; the reaction force is decomposed into joint torque of a multi-degree-of-freedom force feedback device and a high-frequency vibration signal, dynamic matching material property characteristic force tactile feedback is provided; and the model physical parameters and geometric shapes are updated according to the stress overrun condition, so that the visual simulation of damage accumulation and fracture is realized. The system comprises a digital twinning construction module, a user interaction interface module, a physical simulation engine module, a force feedback rendering module and a model state updating module. Through the high-frequency closed-loop physical-force sensation coupling mechanism, the application improves the authenticity, immersion and training reliability of virtual restoration.
Owner:NORTHWEST UNIV

Method, device and equipment for customizing search function based on dynamic search container

The invention discloses a method, device and equipment for customizing a search function based on a dynamic search container, and relates to the technical field of browser webpage search, the method comprises the following steps: creating a search container component, and returning corresponding configuration information of a custom search control and a search result control based on current login information; performing layout setting of an area where the search controls are located, distinguishing types and states of the search controls, and storing the search controls in a search container component; and obtaining each search condition in the search control based on the search container component to execute search operation, and dynamically displaying the search result according to the configuration information of the search result control. According to the method and the device, the user can be helped to search required information more quickly and more accurately, and the search efficiency is improved.
Owner:CHINA TRAVEL DIGITAL TECHNOLOGY (SHENZHEN) CO LTD

Fingerprint-based input interaction method and device

The invention provides an input interaction method and device based on fingerprints, and relates to the technical field of man-machine interaction. The method comprises the following steps: acquiring continuous fingerprint frame images when a user uses a fingerprint sensor to perform input interaction with intelligent equipment; performing identity authentication on the user based on the continuous fingerprint frame image and pre-registered user fingerprint information; when the identity authentication of the user is passed, recognizing the action of the touch operation corresponding to each fingerprint sensor according to the change information of the plurality of continuous fingerprint frame images corresponding to each fingerprint sensor in the time sequence; and determining an input interaction instruction matched with the input interaction according to the application scene and the action information of the intelligent equipment. According to the invention, identity authentication and action recognition are carried out on the user, so that the security of the input interaction process of the user is improved. Multiple actions can be recognized based on the change information of the continuous fingerprint frame images in the time sequence, input interaction modes are enriched, and richer, more convenient and more personalized interaction experience is provided for users.
Owner:TSINGHUA UNIVERSITY