Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

91 results about "Visual impairment" patented technology

Visual impairment, also known as vision impairment or vision loss, is a decreased ability to see to a degree that causes problems not fixable by usual means, such as glasses. Some also include those who have a decreased ability to see because they do not have access to glasses or contact lenses. Visual impairment is often defined as a best corrected visual acuity of worse than either 20/40 or 20/60. The term blindness is used for complete or nearly complete vision loss. Visual impairment may cause people difficulties with normal daily activities such as driving, reading, socializing, and walking.

Anti-dazzle polarized light optical lamp strip and lighting device

The utility model belongs to the technical field of lamps, solves the problem that the glare phenomenon of an LED lamp strip in the prior art causes different degrees of damage to vision, and provides an anti-glare polarized light optical lamp strip and a lighting device. Comprising a dimming part, a light source, a shell and an anti-dazzle layer, the dimming part and the anti-dazzle layer are sequentially installed in an inner cavity of the shell in the height direction of the shell, the light source is installed in the dimming part, the anti-dazzle layer is located on the light emitting direction side of the dimming part, and the dimming part is fixed in the shell in an abutting and clamping mode. And the edge of the anti-dazzle layer is matched with the second clamping part, so that the anti-dazzle layer is clamped in the shell. According to the utility model, the anti-dazzle layer is arranged in the light emitting direction of the lamp strip shell, so that the dazzle influence of a light source on the environment is weakened; meanwhile, the dimming piece is directly arranged between the anti-dazzle layer and the light source, the light source is subjected to secondary optical adjustment by combining the small angle of the light source with the light transmitting piece in a specific shape, various small-angle polarization control is achieved, and the small angle of the light source is achieved.
Owner:SHENZHEN YOUYIXIANG ELECTRONICS CO LTD

Intelligent hospital guide system and method based on AR vision and voice navigation

The invention provides an intelligent hospital guide system and method based on AR vision and voice navigation. The intelligent hospital guide system comprises a user interaction layer, a technical support layer, a data and background layer, a third-party service layer and a hardware dependence layer. According to the intelligent hospital guide system based on AR vision and voice navigation, accurate navigation is achieved, a barrier-free road is guided, through the advanced AR vision navigation technology, the APP provides an accurate and errorless navigation path for a patient, the possibility of navigation errors is greatly reduced, virtuality and reality are seamlessly fused, and the intelligent hospital guide system based on AR vision and voice navigation has the advantages of being high in practicability and the like. The patient can walk on a familiar map in a hospital, and each step is full of confidence; the voice navigation function brings unprecedented convenience to the user, and especially for the visual impairment, the old or the users with inconvenience in hands, the service is as an intimate guide to lead the visual impairment, the old or the users with inconvenience in hands to easily shuttle to all corners of a hospital and enjoy barrier-free medical experience.
Owner:库浩然

Hologram avatar interactive health support device

Even for users who are unfamiliar with smartphones or smartwatches, or those with visual impairments, this system enables personalized health support through interaction between the user and a hologram avatar. [Solution] A health support device comprising a body-worn device worn on the wrist with a biometric information acquisition sensor in contact with the user's skin, a collection means for collecting the acquired biometric information in real time, and a management server connected to the collection means via the cloud. The body-worn device comprises an avatar image generation means, an aerial display means for projecting the avatar image into the air as a 3D hologram, and a selection means for selecting the biometric information to be monitored 24 hours a day using voice commands spoken by the user. The management server comprises a dialogue engine that provides health support by having the avatar image interact with the user in response to changes in the selected biometric information, and the hologram-projected avatar responds visually or audibly in accordance with the biometric information.
Owner:福田博美

A visual impairment drawing auxiliary system based on physiological signals and behavior analysis

The application relates to the field of computer-aided technology and specifically discloses a vision-impaired drawing assistance system based on physiological signals and behavior analysis, aiming to solve the problems of mechanical assistance process and poor interactive experience in the prior art. The system comprises a physiological signal acquisition module for acquiring user concentration and emotion, a drawing behavior perception module for capturing brush pressure and trajectory, a multi-modal data fusion and intention analysis module for fusing data and analyzing creation intention, an adaptive guidance strategy generation module for generating personalized guidance strategies, and a multi-channel feedback execution module for providing voice, tactile and sound feedback. Through the cooperative work of the above modules, the system can realize real-time perception of user state and intention, dynamically adjust multi-sensory assistance guidance, and thus improve the naturalness of interaction and the assistance effect.
Owner:GUANGDONG UNIV OF TECH

Method for producing optical element of user-customized ophthalmic lens for image-generating display device capable of being positioned on head of user

The invention provides a method for producing an optical element of a user-customized ophthalmic lens for an image-generating display device positionable on the head of a user, the method comprising the following steps: A) producing a plurality of substrate stacks (25) of a first variant and a plurality of substrate stacks (25) of a second variant, the substrate stacks (25) of all variants comprise in each case a waveguide (11) having a first side (16) and a second side (17) and a first lens (20) connected to the first side (16), the substrate stacks (25) of the same variant have in each case the same optical property, and the substrate stacks (25) of different variants differ in at least one predetermined optical property; b) producing a customized lens (21) for the user based on the visual impairment of the user and based on the selected substrate stack variants; and C) providing a selected variant of the substrate stack (25) and the produced custom lens (21) in order to be able to connect the produced custom lens (21) with the provided substrate stack (25) in order to produce the ophthalmic lens (3) customized for the user.
Owner:TOOZ TECH GMBH

Image processing method, circuit, visual impairment assistance device, electronic device, and medium

An image processing method, circuit, visual impairment auxiliary device, electronic device, and medium are provided. The method includes: obtaining a to-be-processed image and a reference image of the to-be-processed image, the size of the reference image being smaller than the size of the to-be-processed image; performing compression processing on the to-be-processed image according to the size of the reference image; and determining the image quality of the to-be-processed image according to the to-be-processed image after the compression processing.
Owner:NEXTVPU (SHANGHAI) CO LTD

Tactile floor guidance system for people with visual impairments

Tactile floor guidance system for persons with impaired vision, comprising an arrangement of guidance elements (100) laid on a floor with a tactilely perceptible surface structure (120), wherein the arrangement extends along a predefinable path to guide persons along this path, and wherein the arrangement of guidance elements (100) includes at least one curved guidance element (300) in addition to straight guidance elements (200).
Owner:HEIMANN ROBERT

Artificial intelligence-based models for individually planning refractive eye surgeries for patients.

A computer program is provided that includes an artificial intelligence-based model, wherein the computer program is designed to, when implemented by a computer, use the model to enable the computer to determine information characterizing a treatment plan for said refractive eye surgery based on information characterizing a patient and information characterizing the visual impairment of the patient's eye to be corrected by said refractive eye surgery.
Owner:CARL ZEISS MEDITEC AG

Application operation method and device, electronic equipment and storage medium

The invention discloses an application operation method and device, electronic equipment and a storage medium. The method comprises the steps of determining first operation information according to a first application; determining a first operation instruction, and determining a first operation path according to the first operation instruction and the first operation information; determining a first image; and operating the first application according to the first image, the first operation information and the first operation path. According to the method, the trigger path of the first application is determined according to the first operation information, and the first application is triggered according to the obtained trigger path, so that an object with visual impairment can be assisted to complete the operation on the application; the problem that the hearing of an object with visual impairment is occupied by existing operation software is avoided, the safety of privacy information can be guaranteed, and the safety of the object with visual impairment can also be guaranteed.
Owner:BEIJING SOFTONG INTELLIGENT TECH CO LTD

Safety vision correction glasses

The safety spectacles comprise a spectacle frame main body and an additional spectacle frame, a first frame of the spectacle frame main body can be provided with first lenses for vision correction so as to be suitable for a user with visual defects, and the additional spectacle frame is provided with a second frame, a first extension soft body and a second extension soft body. The additional spectacle frame and the spectacle frame main body are detachably assembled through the insertion matching of the convex part and the through hole, and during the assembly, a first extension soft body and a second extension soft body which extend back to the spectacle frame main body are respectively propped against the edges of the upper extension wall and the lower extension wall of the first frame; the first extension soft body and the second extension soft body can be attached to the upper and lower sides of the eyes of the user, so that the upper and lower sides of the eyes of the user are protected; in addition, the first protective wings are arranged at the positions, close to all the glasses legs, of the first frame, and the first protective wings can protect the left side and the right side of the eyes of the user.
Owner:YUANZHIXING TECHNOLOGY (SHENZHEN) CO LTD

Methods and systems for guiding position adjustment of a passenger with visual impairment in a transportation vehicle

Methods and systems are provided for a transportation vehicle. One method includes determining a visual impairment parameter indicating a degree of visual impairment of a passenger of a passenger seat associated with the seat device, determining a passenger location of the passenger and a location of a target, estimating an initial facing direction toward which the passenger faces, determining a position adjustment parameter indicating a position adjustment to be made by the passenger of the passenger seat to face the target, based on the passenger location, the location of the target, and the initial facing direction, and outputting a position adjustment instruction according to the position adjustment parameter, the position adjustment instruction including at least an audio instruction in response to the visual impairment parameter indicating visual impairment of the passenger.
Owner:PANASONIC AVIONICS CORP

Technical formula and preparation method of medicinal and edible multifunctional anthocyanin health-preserving beverage

The invention relates to a general situation of a product, namely a technical formula and a preparation method of a medicinal and edible multifunctional anthocyanin health-preserving beverage. 2, the invention solves the substantive problems of users, and provides a medicinal and edible formula capable of solving depression and visual impairment; the tea has the effects of regulating three highs, reducing blood pressure, reducing blood fat, reducing blood sugar, treating cardiovascular and cerebrovascular diseases, treating apoplexy, nourishing and protecting liver, treating kidney deficiency, treating mental and physical exhaustion, enhancing intelligence, improving immunity, treating lung cough, treating stomachache, treating mental and physical exhaustion, maintaining beauty and keeping young, resisting aging, having a cell regeneration function, supplementing protein, resisting cancer, diabetes, cancer and the like. And 3, the chronic diseases puzzle the normal life of people for a long time, and the physical and psychological health is in vicious circle. And 4, the problem is solved from the root of the disease, so that the user is not wound and painful by the disease. And 5, the user is helped to change from a chronic disease and sub-healthy state to a healthy state, so that the body and mind keep a healthy and virtuous circle.
Owner:俪鱼生物科技(海南)有限公司 +1

Method for a camera system, and camera system

The present disclosure relates to a method for a camera system, in particular a surround-view camera system, for a vehicle, which has a control device, multiple surround-view cameras, and a display apparatus. The method includes: generating an original image (step I), generating a simulated image of the original image, the simulated image simulating a coloration of the original image resulting from an ascertainable visual impairment, generating a differential image between the original image and the simulated image, determining edges in the differential image, generating a superimposed image by superimposing the original image and the edges of the differential image, and displaying the superimposed image using the display apparatus.
Owner:CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH

Visual rehabilitation training device for hemianopsia

PendingCN121647939AEye exercisersPhysical medicine and rehabilitationVisual rehabilitation
The invention relates to the technical field of medical rehabilitation, in particular to a hemiplegia vision rehabilitation training appliance which comprises a display panel used for playing target patterns and a communication module used for storing a basic training scheme, a mounting shell is detachably connected to the display panel, and an eye tracker used for capturing the eyeball rotation condition of a patient is arranged at the top of the mounting shell; an adjusting cavity is formed in the mounting shell, transparent plates are fixedly connected to the two sides of the adjusting cavity, and a light-transmitting assembly used for changing the light intensity is arranged in the adjusting cavity; the communication module is electrically connected with a control panel used for inputting and storing a basic training scheme, and the control panel is used for obtaining the eye movement condition of the patient based on the eye tracker to adjust the light-transmitting assembly; the visual impairment and rehabilitation condition of the patient can be verified conveniently, and the scheme suitability of the patient in the training process is improved.
Owner:EYE INST OF SHANDONG FIRST MEDICAL UNIV

Satellite point diffusion re-checking multi-point fog and sand multi-effect lens and glasses

The utility model provides a satellite point diffusion re-check multi-point fog-sand multi-effect lens and glasses, and relates to the technical field of lenses, the lens comprises a lens body, at least partial area of the lens body is provided with a point diffusion area, the point diffusion area comprises a transition point diffusion area, a main nucleus point diffusion area and a satellite point diffusion area, the transition point diffusion area is arranged at the inner side, and the main nucleus point diffusion area is arranged at the outer side. The main nuclear point diffusion area and the transition point diffusion area are arranged on the outer side, and the main nuclear point diffusion area and the satellite point diffusion area coincide; the main nuclear point diffusion area comprises a plurality of main nuclear diffusion points, the satellite point diffusion area comprises a plurality of satellite diffusion points, the diameter of the satellite diffusion points is smaller than that of the main nuclear diffusion points, and the satellite diffusion points and the main nuclear diffusion points are arranged in a staggered mode; on one hand, on the basis of ensuring the light transmission of the lens, vision deepening is inhibited in a contrast weakening mode, the effect is remarkable, on the other hand, contrast change transition is gentle and gentle, visual impairment caused by overlarge contrast difference change can be effectively reduced, and the lens is more comfortable to wear.
Owner:BUGASSON MEDICAL TECHNOLOGY (SHANGHAI) CO LTD

Method and systems for reducing the burden of visual impairment

A method for evaluating or improving a visual system of a subject is disclosed. The method comprises the steps of displaying multiple visual stimuli to the subject over a time period, wherein each visual stimulus comprises a motion signal; and receiving subsequent inputs from the subject indicating the subject's perception of a direction of motion of the motion signal in each visual stimulus.
Owner:UNIVERSITY OF ROCHESTER

Automated detection of visual impairment and adjustment of settings for visual impairment

PendingUS20260249180A1OphthalmologyComputer vision
A method, system and computer program product for automated visual setting importation is disclosed. A first application running on a first device requests a vision setting for a second application. A vision setting of the first application running on a first device is determined to correspond to the vision setting for the second application. The vision setting for the second application is then applied to the corresponding vision setting of the first application.
Owner:SONY INTERACTIVE ENTERTAINMENT LLC

Methods and formulations for treating visual impairment

The present invention provides ophthalmic formulations comprising long-acting beta-adrenergic receptor agonist (LABA) compounds, long-acting muscarinic antagonists (LAMA), and combinations thereof. Also provided are methods of treating visual impairment with LABA, LAMA, and combinations thereof.
Owner:JENIVISION INC

An ophthalmic formulation, method of preparation and use

The application relates to an ophthalmic preparation, a preparation method and use. The ophthalmic preparation comprises: a pentetrazol hydrochloride, a buffer and water for injection, wherein the mass / volume ratio of the pentetrazol hydrochloride is 0.001%-2%, and the total concentration of the buffer is less than or equal to 50 mM. The ophthalmic preparation can effectively treat and / or prevent visual impairment eye diseases, and has the advantages of safety, effectiveness, good stability and the like, and is suitable for popularization and application.
Owner:GRAND MEDICAL NUTRITION SCIENCE (WUHAN) CO LTD

An intelligent medication assistance system based on cognitive impairment patients

The application relates to the technical field of medical treatment, in particular to an intelligent medicine auxiliary system based on patients with cognitive impairment. The application comprises a terminal interaction layer, a perception decision layer, a cloud service layer and a user management layer; the perception decision layer comprises an intelligent medicine management module and a personalized adaptation module; the intelligent medicine management module is used for performing multiple reminders, medicine identification verification, medicine taking behavior recording and medicine taking record backtracking according to a preset medicine taking scheme; the personalized adaptation module is used for dynamically adjusting a reminding mode and an interaction strategy according to a cognitive impairment degree and a visual impairment grade of a patient. The application aims to provide an intelligent medicine auxiliary system based on patients with cognitive impairment, so as to realize safe, standardized, intelligent and personalized medicine taking management for patients with cognitive impairment.
Owner:THE SIXTH AFFILIATED HOSPITAL OF SUN YAT SEN UNIV

Authentication method and system for persons with visual impairments

ActiveUS12717886B1Biometric dataEngineering
A method and system of performing an authentication of an identity of a person with visual impairments. The system and method are configured to cause a wearable secondary computing device worn by a guide dog accompanying the person to generate a verification signal. This verification signal can be evaluated to determine whether the verification signal is authentic and / or includes an expected biometric data feature. If the verification signal is deemed to be authentic, the system can verify an identity of the person, and can further be configured to automatically grant the person access to one or more services, features, or information for which the person is authorized.
Owner:UNITED SERVICES AUTOMOBILE ASSOCIATION (USAA)

Intelligent intervention system for preventing and controlling myopia in teenagers based on dynamic axial monitoring

This invention relates to the field of axial length data processing technology, specifically to an intelligent intervention system for myopia prevention and control in adolescents based on dynamic axial length monitoring. The invention uses normally labeled samples of the same sex as reference samples for the samples to be analyzed, obtaining multiple axial length time periods. Based on the axial length distribution of the samples to be analyzed and the reference samples within each axial length time period, the degree of visual impairment for each sample within each axial length time period, and the critical value for the degree of impairment of non-impaired samples, are obtained. Based on the distribution of visual impairment degree and axial length of the samples to be analyzed and impaired samples within each axial length time period, overall similar samples are obtained. Based on the distribution of visual impairment degree of overall similar samples within different axial length time periods, and the critical value for the degree of impairment, dynamic axial length monitoring is performed on the samples to be analyzed. This invention improves the accuracy of dynamic axial length monitoring by accurately analyzing the degree of visual impairment and the critical value for the degree of impairment of the samples.
Owner:GUANGDONG GENERAL HOSPITAL

IGFBP3 protein as cataract marker and its application

ActiveCN119224318BSenses disorderDisease diagnosisTherapeutic effectCataract patient
The present invention discloses an IGFBP3 protein as a cataract marker and its application. The cataract biomarker is IGFBP3 protein, and the expression level of IGFBP3 protein is increased in cataract patients. The IGFBP3 protein provided in this application is used as a cataract marker and its application. When applied in clinical practice, it can achieve early diagnosis of cataracts, which is of great significance for preventing blindness in patients. Through early identification and intervention, visual impairment caused by cataracts can be reduced, thereby improving the quality of life of patients. In addition, the detection of IGFBP3 protein can also help evaluate the progression of the disease and the effect of treatment, and provide an important reference basis for clinical treatment. The introduction of this detection method can not only improve the diagnostic accuracy of cataracts, but also provide patients with more personalized treatment plans, thereby improving the long-term prognosis and quality of life of patients.
Owner:BEIJING INST OF OPHTHALMOLOGY +1

Visually impaired person behavior ability assessment method and system

PendingCN121393901AMedical data miningHealth-index calculationHuman bodyVisual rehabilitation
The invention discloses a visual impaired person behavior ability assessment method and system, and relates to the technical field of visual rehabilitation, and the method comprises the steps: obtaining a dynamic behavior video of a visual impaired person; analyzing the dynamic behavior video by using a human body posture recognition library and a deep learning algorithm, and determining a head rotation direction and rotation times of the visually impaired person; and comparing and analyzing the head rotation direction and the rotation frequency of the visually impaired person with a pre-established standardized reference table, evaluating the actual use effect of the magnifying visual aid or the visual field expanding visual aid worn by the visually impaired person, and generating a personalized rehabilitation scheme according to the actual use effect. According to the method and the system provided by the invention, the visual behavior capability of a low-vision group is reflected more comprehensively and accurately by evaluating the head rotation frequency index of the visually impaired person in dynamic behaviors such as obstacle avoidance and search, so that powerful support is provided for formulating a personalized rehabilitation scheme.
Owner:YANGTZE DELTA REGION INST OF TSINGHUA UNIV ZHEJIANG

Flexible sensor array and preparation method and application thereof

The invention relates to a flexible sensor array and a preparation method and application thereof, and relates to the field of flexible electronics and sensors, the flexible sensor array comprises an electrode layer, a strain isolation layer, a dielectric layer, a bonding layer and a packaging layer which are sequentially laminated; and the strain isolation layer is an elastomer with gradient Young modulus distribution and the like. According to the low-crosstalk and high-sensitivity flexible sensor array based on the gradient modulus isolation layer, collaborative optimization of sensitivity and crosstalk of the flexible sensor array is achieved mainly through arrangement of the strain isolation layer with the gradient modulus and design of the AP parameter of the array area proportion, and the low-crosstalk and high-sensitivity flexible sensor array based on the gradient modulus isolation layer is manufactured. The multi-scene use requirements of high-resolution tactile perception, electronic skin, man-machine interaction, visual impaired assistant education and the like can be met, and the application prospect is wide.
Owner:SICHUAN UNIV

Visual disorder navigation auxiliary system based on artificial intelligence

The invention relates to the technical field of artificial intelligence, in particular to a visual impairment navigation auxiliary system based on artificial intelligence. According to the visual impairment navigation auxiliary system based on artificial intelligence, a sensor module, a control unit, a wireless transmission module, a power supply module and a voice feedback module are integrated in wearing clothes; the control unit is provided with a microprocessor and is used for processing environment data acquired in real time based on a deep learning algorithm, identifying information of obstacles, road signs and pedestrians, generating an environment model, calculating an optimal navigation path and realizing intelligent navigation; transmitting the intelligent navigation information to a voice feedback module, and sending a voice prompt to a user through the voice feedback module. According to the visual impairment navigation auxiliary system based on artificial intelligence, through real-time environment perception and intelligent navigation, the independence and life quality of visual impairment people can be effectively improved, the travel experience of the visual impairment people is effectively improved, and the visual impairment navigation auxiliary system has a wide application prospect.
Owner:INSPUR SOFTWARE TECH CO LTD

Glasses set

Eyeglass set, comprehensive a) a pair of glasses (1) i) with at least one lens (4), ii) with a nose cutout (6) for the nose of a glasses wearer, and iii) with a head-holding device (9) connected to at least one lens (4) for holding the glasses (1) on the head of the wearer, b) a nose support element (2) that can be detachably and magnetically attached to the glasses (1) for supporting the glasses (1) against the nose of the wearer when the nose support element (2) is mounted, and c) a vision correction component (3) that can be magnetically attached to the glasses (1) and which i) has at least one corrective lens (24) for correcting a visual impairment of the spectacle wearer, and ii) has its own nose support (26) to support the glasses (1) against the nose of the wearer of the glasses when the corrective lens (3) is mounted.
Owner:UVEX ARBEITSSCHUTZ

Microcurrent stimulation systems, methods, and devices for treatment of visual impairments

Presented are electrical microcurrent systems for treating ocular diseases, methods for making / using such microcurrent systems, and wearable microcurrent devices for treatment of macular degeneration. A microcurrent system for treating an ocular disease includes a mounting support, e.g., that mounts inside a housing shell of a microcurrent headset unit. Mounted onto the mounting support, e.g., inside the housing shell, are a power source that stores and dispenses electrical power, and a system controller that electrically connects to and controls the electrical output of the power source. A pair of electrically conductive eyecups is attached to the mounting support and electrically connected to the power source to receive therefrom an electrical microcurrent. Each eyecup may be a single-piece structure that includes a pair of terminal rails projecting from respective sides of a longitudinal end of an elongated pedestal. The terminal rails are shaped and sized to contact an eyelid of a user.
Owner:B-21 LLC

Visual disorder dynamic evolution simulation system and method

PendingCN121439243AMedical simulationImage analysisVisual field deficitVisual Disorders
The invention relates to the technical field of visual impairment simulation, in particular to a visual impairment dynamic evolution simulation system and method. Multi-modal medical image data of a patient is collected and subjected to preprocessing and focus positioning, an individual visual pathway fiber bundle is constructed by adopting a deterministic fiber tracking algorithm based on diffusion tensor imaging data, non-rigid registration is performed on the individual fiber bundle and a standard visual pathway template, a local deformation field is calculated, and the focus positioning accuracy is improved. Based on a local deformation field, analyzing a spatial geometrical relationship between a focus mask and each section of nerve fiber to obtain an individualized three-dimensional visual pathway model and an SDI scoring matrix of each section corresponding to the individualized three-dimensional visual pathway model, and judging a damaged pathway section and a typical visual field defect mode matched with the damaged pathway section in degree; according to the method, individualized visual simulation of a patient is realized, a visual dynamic evolution prediction model is constructed by utilizing diffusion Transform, and dynamic evolution of visual impairment is realized.
Owner:SHANGHAI EAST HOSPITAL EAST HOSPITAL TONGJI UNIV SCHOOL OF MEDICINE

Multi-mode sensing integration method based on artificial intelligence large model

PendingCN121980509Aprevent collapseResolve heterogeneous alignmentResource allocationBiological modelsAlgorithmEngineering
The invention discloses a multi-modal communication and inductance integration method based on an artificial intelligence large model. The method comprises the following steps: acquiring target scene data to construct a multi-modal communication and inductance integration data input stream; extracting heterogeneous features based on a modal specific encoder; performing cross-modal dynamic fusion based on a hybrid expert architecture; inputting the fused unified features into a specific output head of the task, and outputting a prediction result of the downstream task; performing multi-task joint training in combination with a task loss function and load balancing loss; the method comprises the following steps: firstly, accurately extracting features and unifying dimensions; secondly, the hybrid expert mechanism flexibly adapts to dynamic environments such as night vision loss and the like while greatly reducing the calculation overhead through a sparse activation strategy, so that the perception robustness is ensured; and finally, in combination with a lightweight wharf solution and a load balancing training strategy, expert collapse is effectively prevented, and high-precision and low-delay diversified general sensing tasks are supported.
Owner:NANJING UNIV