21 results about "Attention focus" patented technology

The invention provides an intelligent structured medical record generation method and system based on multi-modal doctor-patient interaction, and the method comprises the steps: collecting dialogue voice in real time, transcribing the dialogue voice into a text sequence, and recognizing a visual attention entity through monitoring the operation of a mouse in an electronic medical record system; a logic demonstration track is constructed based on a historical visual attention entity and a text sequence, and an implicit reward function is reversely derived from the logic demonstration track by using a reverse reinforcement learning algorithm. The function is used for calculating the action return value of each combination of the visual attention entity and the dialogue text, and the highest value combination is selected as an optimal alignment strategy to determine the time sequence causal relationship. And mapping the entity and the text to a medical knowledge graph, extracting a shortest semantic path as an implicit clinical reasoning chain, and generating a structured electronic medical record. According to the method, diagnosis and treatment decision logic is deduced from multi-modal behaviors of doctors through reverse reinforcement learning, and the technical problem that internal causal association between visual attention focuses of doctors and oral contents cannot be established in a traditional method is solved.

The application discloses a subject-driven personalized generation method based on decoupled mask prompt attention fine-tuning, and belongs to the field of deep learning, computer vision and artificial intelligence generated content. A mask prompt decoupling module is designed to decompose the unified text prompt into a text prompt containing only the subject and a text prompt containing only the context. A subject attention focusing module and a context attention adjusting module are introduced, and independent subject feature extraction paths and context semantic adaptation paths are established, respectively. The subject identity learning and the context scene modeling are explicitly separated, and the double constraint loss guided by the mask is used for joint optimization to further prevent feature coupling. Finally, the algorithm effectively preserves the fine appearance features of the subject, significantly enhances the adaptability of the model to novel context instructions, and effectively improves the quality of personalized generation and the flexibility of context editing.

The invention discloses a facial acne identification method and a facial acne identification device based on improved YOLOv5. According to the method, a dynamic deformable convolution enhanced C3 module C3DCNV3 and an SE attention mechanism module are added to a backbone part of a YOLOv5 neural network; a DyHeadBottleneck module is introduced into the head part of the YOLOv5 neural network, and an attention function is converted into sequence attention of three dimensions of scale perception, space perception and task perception. According to the semantic importance of different scale features, the scale perception attention dynamically fuses the features of different scales; the spatial awareness attention focuses on the discrimination ability of different spatial locations. The tasks perceive attention, and feature channels are dynamically switched to assist different tasks; through a dynamic attention mechanism, the feature expression ability of the detector is significantly improved, and the ability to identify acnes of different sizes is enhanced. Therefore, accurate recognition of facial acnes is realized, and the recognition precision and recall rate of small targets in facial acnes are improved.

The application provides a kind of intelligent structured medical record generation method and system based on multimodal doctor-patient interaction, which comprises: real-time acquisition of dialogue voice and transcription into text sequence, while recognizing visual attention entity by listening to mouse operation in electronic medical record system.Based on the history of visual attention entity and text sequence, a logical demonstration track is constructed, and an implicit reward function is derived from it using a reverse reinforcement learning algorithm. Use the function to calculate the action reward value of each combination of visual attention entity and dialogue text, select the highest value combination as the optimal alignment strategy to determine the timing causal relationship. Map the entity and text to the medical knowledge graph, extract the shortest semantic path as the implicit clinical reasoning chain, and generate structured electronic medical record. The application deduces the diagnosis and treatment decision logic from the doctor's multimodal behavior through reverse reinforcement learning, solving the technical problem that traditional methods cannot establish the internal causal relationship between the doctor's visual attention focus and spoken content.

This invention discloses an adaptive adjustment method and system for a virtual environment, relating to the field of virtual reality technology. The method includes: performing background subtraction processing on a target image sequence when a user is experiencing a virtual environment; extracting detailed features from the target image sequence, and identifying key points using target anchor boxes based on the detailed feature information; determining the coordinates of three-dimensional key points based on the target key point information for user action behavior analysis; extracting a user eye image sequence from the target image sequence to determine eyeball image information, and analyzing the gaze direction based on the eyeball image information; analyzing the user's attention focus using image brightness distribution based on the gaze direction information; and adjusting elements of the virtual environment based on the user's action behavior information and user attention focus information. This invention enables more fine-grained virtual environment adjustment, improving the quality and naturalness of the user's immersive experience in the virtual environment.

The application discloses a method, device and electronic equipment for obtaining attention information of an object, the method comprising: displaying a stereoscopic virtual image in a virtual scene, the stereoscopic virtual image being a stereoscopic image corresponding to a virtual object in the virtual scene, the virtual object being a physical object; determining a target object in the stereoscopic virtual image, the target object being present in a display area; and determining an attention focus object in the stereoscopic virtual image based on the target object, the attention focus object belonging to at least part of the stereoscopic virtual image. The application can accurately obtain attention information of a user for a product or other physical object.

The invention discloses a semiconductor valve analysis method and system based on multi-agent cooperation and an attention mechanism, and relates to the technical field of semiconductor equipment test and intelligent analysis, and the method comprises the steps: carrying out the denoising, missing value filling and test condition label matching operation of all-condition test data, and outputting a standardized test data matrix; fusing a multivariate statistical method and a space attention mechanism, and focusing a test data dimension which has obvious influence on the performance of the gas path system; performing dynamic weight distribution on historical data and real-time data of the multiple test items; and other intelligent agents are linked according to user operation feedback to dynamically adjust the attention focusing direction. According to the method, the problem of association fuzziness in traditional test data analysis is solved, and the precision of performance evaluation and prediction of the gas path system is improved.

Implementations of a wristband device may include a breathing guidance portion; a haptic feedback and compression portion; and an armband portion including pneumatic compression elements.

This invention discloses an intelligent control method and system for AR devices. The method specifically includes: determining the coordinates of the user's pupil center and corneal reflection point based on the user's eye image; inputting the pupil center coordinates and corneal reflection point coordinates into a geometric mapping model for matching to obtain the user's gaze direction information; acquiring the image brightness value distribution in the area near the user's gaze point; determining several candidate salience regions based on the image brightness value distribution; determining the user's attention focus by comparing the candidate salience regions with a preset salience region template; and using a head posture tracking algorithm to acquire the user's head posture information in real time, dynamically controlling the camera shooting direction of the AR device based on the head posture information, the user's gaze direction information, and the user's attention focus. This invention achieves precise alignment between AR content and the user's visual focus, significantly improving the immersion and interactive experience of AR applications.

The present invention addresses the problem of making it possible to assist in enhancing attention focus of a user by detecting a decrease in the attention focus.　A determination unit 33 infers whether or not the visual line of the user is directed at a prescribed area, on the basis of determination information detected from the user's action or behavior. On the basis of the inference result, the determination unit 33 further determines whether or not the user is performing a prescribed task. When the user is not performing the prescribed task, an output unit 34 outputs prescribed information to the user. The problem mentioned above is solved thereby.

The application provides a learning guidance method and device, electronic equipment and a storage medium, relates to the technical field of computers, and is used for improving the flexibility of learning guidance and thus improving learning efficiency. The method comprises the following steps: acquiring learning data of a user and a task type currently practiced by the user in the case that the electronic equipment is in a language learning mode, wherein the learning data is used for indicating the current learning state of the user; and outputting a voice prompt according to the task type and the learning data, wherein the task type is one of animation watching, follow-up reading or interactive practice, and the voice prompt is related to an attention focus corresponding to the task type and the current learning state of the user.

The application belongs to the technical field of time prediction, and particularly relates to a time prediction method and device based on different channel attention focusing mechanisms. A scaled household electricity time sequence data vector is input into an MLP to obtain a processed output vector, and a stationary wavelet transform is performed on the output vector; based on high-frequency detail components, Granger causality analysis is performed, inverse Granger transformation is performed on the high-frequency detail components, and reconstructed household electricity time sequence data is obtained; based on low-frequency components and medium-frequency components, the correlation between different channel attentions is calculated, and multiple channels with the strongest dependency are screened; self-attention coupling is used for the channels with strong dependency, and geometric self-attention coupling is used for the channels with weak dependency; the outputs of the self-attention and the geometric self-attention are fused to obtain comprehensive features; the reconstructed frequency domain sequence data and the comprehensive features are inversely transformed again, and a final prediction result is obtained through an FFN.

The application relates to the technical field of network marketing, in particular to an online marketing promotion system and method based on the Internet, which comprises the following steps: real-time monitoring of a first interaction behavior sequence of a user on a browsing interface, wherein the first interaction behavior sequence comprises a cursor moving track, a page scrolling speed and a scrolling direction; prediction of a current attention focus area and a potential migration path of the attention focus of the user through a predefined attention model based on the first interaction behavior sequence; selection of adapted target advertisement content from an advertisement library based on the potential migration path, and control of the target advertisement content to appear at a preset position on the potential migration path. Through the current focus area position and the historical scrolling direction, candidate content blocks that the user may pay attention to next are predicted, and a visual path between the two is taken as a core basis for advertisement delivery, so that the advertisement can be arranged on the path in advance in the process of natural migration of the user's attention, and the effective reach rate of the advertisement is improved.

This invention relates to the field of intelligent educational interaction and discloses an adaptive cognitive guidance method for children's microscopes based on multimodal perception. The method includes: real-time acquisition of sample image sequences and user operation time-series data; extraction of semantic features through image understanding, generation of a spatial attention map through behavioral analysis, and fusion of the two to obtain a feature vector; inputting the feature vector of a continuous time window into a cognitive state inference model, outputting cognitive state labels containing attention focus, exploration intention, and confusion level; based on the target category corresponding to the intention and focus, retrieving popular science materials from a knowledge graph, and dynamically assembling them by a multimodal generator according to the guidance state machine logic into guidance content including highlighted annotations, voice narration, and animation, which is then rendered and presented in real time. This invention achieves intelligent understanding and personalized guidance of children's observation intentions, transforming one-way observation into interactive inquiry-based learning, improving cognitive conversion efficiency and the scientific enlightenment experience.

The invention relates to the technical field of human-computer interaction, in particular to a human attention focus area simulation and page churn rate prediction method and system, and the method comprises the steps: obtaining the visual input content and human-computer interaction information of a user; classifying and identifying the visual input content by using machine vision, and distinguishing at least one of identifiable content and unidentifiable content; simulating at least one attention focus area of a person according to the recognizable and unrecognizable contents, and calculating an attention value of the at least one attention focus area; according to the attention value, the classification result and the man-machine interaction information, the staying time and the display sequence of each attention focus area are calculated; and according to the display sequence, the retention time and the human-computer interaction information of each attention focus area, generating and outputting an attention focus area dynamic change process of the viewer, an attention focus area with relatively long accumulated retention time, an unconcerned attention focus area, an attention focus area which is not understood by the viewer, a page churn rate, viewing time and design suggestions.

The invention relates to an attention focusing aid device (100) comprising a band (1) adapted to surround the forehead and the head (13) of a wearer (12) and comprising: an intermediate recess (3) intended to be arranged in front of the eyes of the wearer; two lobes (4i, 4-) ) surrounding both sides of said intermediate recess for placing against and covering the ears of the wearer and forming two eyeshades adapted to laterally limit the field of view of the wearer; a support strip (5) positioned on the inner surface of the band and located at least above the intermediate recess, the support strip being able to separate the band from the forehead of the wearer, so that said support strip is able to release a forward-facing field of view together with the intermediate recess.

The application belongs to the technical field of automatic driving, and particularly relates to an automatic driving decision method and system with dynamic risk perception and attention focusing and a vehicle. The method predicts the trajectories of surrounding vehicles in real time through a multi-feature Gaussian weighted particle filtering algorithm, combines a vehicle kinematic model and resampling optimization to improve prediction accuracy, constructs a comprehensive evaluation model integrating lateral and longitudinal risks, dynamically quantifies the collision risks of the ego vehicle and surrounding vehicles, inputs the risk values as key state features into a double deep Q network based on an attention mechanism, focuses on key information through a feature attention distribution mechanism, and generates optimal driving decisions in combination with a multi-target reward function. Compared with the prior art, the application solves the problems of insufficient quantification of uncertain factors, incomplete risk evaluation and low decision efficiency of automatic driving in a complex dynamic environment, and significantly improves the risk perception capability and decision safety of the automatic driving vehicle.

The invention discloses a few-sample skeleton action recognition method and system based on a double-attention focus network, and relates to the technical field of action recognition, and the method comprises the steps: inputting skeleton data into a pre-established double-attention focus network model DAFNet, carrying out the spatial-temporal feature extraction through a spatial-temporal diagram convolution network, and obtaining a spatial-temporal feature extraction result; outputting to obtain support sample features and query sample features; performing dynamic optimization adjustment based on a spatial self-attention mechanism and a cross attention mechanism to obtain optimized support sample features and query sample features; calculating the similarity between the support sample features and the query sample features based on the optimized support sample features and query sample features, redistributing sample weights based on the similarity, and obtaining the redistributed support sample features and query sample features based on the sample weights; and respectively calculating a frame-level distance and carrying out dynamic planning to obtain a total distance between the support set and the query set, and taking the total distance as a skeleton action recognition result.

The invention relates to the technical field of audio and video conference collaborative management, in particular to an audio and video conference dynamic collaborative management method and system. An abnormal attention focus screening module in the system is based on conference participating time intervals of expression states recognized by conference participating objects and associated deviation degrees relative to conference contents in the corresponding conference participating time intervals; and dynamically screening the conference abnormal attention focus content corresponding to the current time. According to the invention, a multi-modal sensor and an intelligent algorithm are used for replacing a traditional conference management mode depending on manual subjective judgment, so that the processes of permission migration, focus capture, feedback reminding and the like are automatic, the burden of a host is obviously reduced, and the conference fluency is ensured; according to the method, the expression states of the participants are analyzed in real time and are deeply associated with the conference content, so that the abnormal focus of attention in the conference can be accurately captured, and effective data support is provided for on-site intervention, subsequent discussion and accurate redisk.

The invention relates to the crossing technical field of AR and building model display, and discloses an AR interaction method and system for a building sand table, and the method comprises the following steps: S1, collecting the sight, head posture and physical sand table touch data of a user based on AR equipment and a sensor array; s2, fusing sight line and head posture data, and calculating a three-dimensional attention focus; s3, quantifying regional interests according to focus staying and touch history, and inferring user intentions; s4, generating AR information in response to the intention, and optimizing the layout to minimize visual occlusion; and S5, evaluating the cognitive load of interaction feedback, and adaptively adjusting AR information presentation. Through multi-modal behavior perception and dynamic weight fusion, an intention decision tree and a space optimization algorithm, and in combination with physiological feedback adjustment, AR information accurate layout and cognitive load adaptive control are realized, and the building sand table interaction efficiency is improved.

The class-incremental image classification method based on dual attention visual Transformer network is suitable for the field of computer vision. The method transfers the attention information as knowledge and enhances the semantic knowledge of class-incremental learning. The core is the dual attention mechanism, that is, the dual key learning inter-task attention and intra-task attention are used in each Transformer layer. The inter-task attention can implicitly absorb the knowledge in the previous task, effectively alleviating the catastrophic forgetting, while the intra-task attention focuses on the knowledge of the current task, which can improve the plasticity of the model. By fusing the knowledge obtained by the two attentions, a good balance between stability and plasticity can be achieved. In addition, the invention also proposes a neighbor-invariant loss and an adaptive attention solidification loss. The method solves the stability-plasticity dilemma and the model preference problem caused by sample imbalance to improve the accuracy of class-incremental image classification.