Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

92 results about "Multimodality" patented technology

In its most basic sense, multimodality is a theory of communication and social semiotics. Multimodality describes communication practices in terms of the textual, aural, linguistic, spatial, and visual resources - or modes - used to compose messages. Where media are concerned, multimodality is the use of several modes (media) to create a single artifact. The collection of these modes, or elements, contributes to how multimodality affects different rhetorical situations, or opportunities for increasing an audience's reception of an idea or concept. Everything from the placement of images to the organization of the content creates meaning. This is the result of a shift from isolated text being relied on as the primary source of communication, to the image being utilized more frequently in the digital age. While multimodality as an area of academic study did not gain traction until the twentieth century, all communication, literacy, and composing practices are and always have been multimodal.

Model training and instance segmentation method, device and system and storage medium

ActiveCN108875732AImprove robustnessAddresses issues affected by the multimodal nature of the imageImage analysisCharacter and pattern recognitionDiscriminatorPattern recognition
The embodiment of the invention provides a model training method, device and system and a storage medium. The network training method comprises the steps that a training image and a training image mask are acquired; the training image is input into a front-end model structure in an instance segmentation model to obtain a target region alignment feature map, wherein the target region alignment feature map is a feature map which corresponds to a first target region used for indicating the position of a target object in the training image and is subjected to alignment operation; the target regionalignment feature map is input into a mask generator in the instance segmentation model to obtain a generated segmentation mask corresponding to the target region alignment feature map; a real segmentation mask corresponding to the target region alignment feature map is determined based on the training image mask; and the target region alignment feature map, the generated segmentation mask and the real segmentation mask are utilized to perform adversarial training on the mask generator and a discriminator. Through the method, the problem that the mask generator is influenced by image multimodality can be effectively solved.
Owner:BEIJING KUANGSHI TECH

Statistical modeling and on-line monitoring method based on multimodality collaboration time frame automatic division

The invention discloses a modeling and on-line monitoring method based on multimodality collaboration time frame automatic division, which takes variation of process characteristics in batch shaft and time direction as well as time sequence of time frame running into consideration, and includes the steps of diving all the modalities through collaboration time frame, obtaining a unified time frame division result among different modalities, and building a uniform time frame model for similar process characteristics in each modality to simplify the modeling complexity. According to the invention, based on the result of collaboration time frame division, the relative change among all the modalities is analyzed, a multimodality statistic model based on different fluctuation types is built and applied in on-line monitoring, and the on-line monitoring performance is improved; the method is easy to implement, is successfully applied during the injection molding, not only facilitates the understanding of process characteristic, but also enhances the reliability and confidence level of actual on-line process monitoring, facilitates judging the running state of the industrial process, and timely discovers faults, thereby guaranteeing the safe and reliable running of actual production and the pursuit of high-quality products.
Owner:ZHEJIANG UNIV

Integrated Multimodality Intravascular Imaging System that Combines Optical Coherence Tomography, Ultrasound Imaging, and Acoustic Radiation Force Optical Coherence Elastography

A method of using an integrated intraluminal imaging system includes an optical coherence tomography interferometer (OCT), an ultrasound subsystem (US) and a phase resolved acoustic radiation force optical coherence elastography subsystem (PR-RAF-OCE). The steps include performing OCT to generate a returned optical signal, performing US imaging to generate a returned ultrasound signal, performing PR-ARF-OCE to generate a returned PR-ARF-OCE signal by generating a amplitude modulated ultrasound beam or chirped amplitude modulated ultrasound beam to frequency sweep the acoustic radiation force, measuring the ARF induced tissue displacement using phase resolved OCT method, and the frequency dependence of the PR-ARF-OCE signal, processing the returned optical signal, the returned ultrasound signal and the measured frequency dependence of the returned PR-ARF-OCE optical coherence elastographic signal to quantitatively measure the mechanical properties of the identified tissues with both spectral and spatial resolution using enhanced materials response at mechanically resonant frequencies to distinguish tissues with varying stiffness, to identify tissues with different biomechanical properties and to measure structural and mechanical properties simultaneously.
Owner:RGT UNIV OF CALIFORNIA

Method for three-dimensional registration and brain tissue extraction of individual human brain multimodality medical images

The invention relates to a method for three-dimensional registration and brain tissue extraction of individual human brain multimodality medical images. The method comprises the following steps: reading DICOM medical image data, and converting DICOM format data into NIfTI format data; layering images adopting a nuclear magnetic resonance structure; establishing a mixture gaussian model through an east Asia brain structure template and an east Asia brain tissue probability graph of ICBM, and dividing nuclear magnetic data into a grey matter part, a white matter part and a cerebrospinal fluid part; enabling the registration methods of other modality data and nuclear magnetic structure images to be the same; according to a layering and registration result, removing a skull and other parts outside the skull of each modality, and reserving the structure of parts inside the skull; adding weighting of three tissue probability graphs of the grey matter, the white matter and the cerebrospinal fluid obtained through layering of structure images so as to obtain a brain tissue probability graph, and performing Gaussian kernel smoothness; setting a threshold, applying the threshold to each modality image data after registration and resampling, and removing the cranium and parts outside the cranium; outputting a save result in an NIfTI format. According to the method disclosed by the invention, the registration of various structure images and multiplanar reconstruction images of a tested person can be completed at the same time.
Owner:王雪原 +1

Multimodality automatic updating and replacing background modeling method

The invention discloses a multimodality automatic updating and replacing background modeling method which comprises the following steps: firstly, carrying out modeling of a main background and an auxiliary background, wherein the modeling of the main background is carried out by the following steps: initializing a main background model, modifying the main background model, and updating threshold; and the modeling of the auxiliary background is carried out by the following steps: establishing an alternate auxiliary background sequence, counting classified data, and updating the threshold of the auxiliary background model; and then computing the background to be updated, and determining the background to replace the auxiliary background according to the occurring frequency of the background to be updated. The method of the invention adopts a multimodality updating and replacing design concept, adopts various modalities to form a vector to carry out the modeling of the background, and finishes background adaptation to the change of ambient lighting through continuous updating and replacing among the modalities. The background modeling method of the invention is suitable for an intelligent monitoring system, and adopts a background differential method for detecting a moving target.
Owner:XIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products