Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

246 results about "Multimedia information" patented technology

Video content semantic understanding and text description generation method based on deep learning

The invention discloses a video content semantic understanding and text description generation method based on deep learning, and relates to the technical field of multimedia information processing.The method comprises the steps that the semantic similarity of a text and a video frame is calculated through a CLIP model, related key frames are selected, and features are aggregated; respectively extracting audio, visual and semantic features; aligning different modal features by using self-attention, unifying dimensions of the LSTM, and then splicing and fusing; attention weights are calculated at a video level, a frame level and a channel level, and key information expression is enhanced; swin Transform encodes fusion features, and LSTM (Long Short Term Memory) decodes step by step to generate natural language description; and a text-video index database is constructed, and rapid retrieval is realized based on semantic similarity. According to the method, the mapping relation between the video features and the natural language is learned end to end through the deep learning model, dependence on a fixed template can be eliminated, and semantic description with various sentence patterns and coherent logic is generated.
Owner:CHINA UNIV OF MINING & TECH YINCHUAN COLLEGE

A method, system, medium, device and terminal for monitoring video key frame extraction

The application belongs to the technical field of multimedia information processing, and discloses a kind of monitoring video key frame extraction method, system, medium, equipment and terminal, collect original video stream data, original video stream data is decomposed into image frame set;Image frame set obtained by decomposition is sampled, and the image frame result set obtained by sampling is filtered;The image frame set after filtering is adaptively clustered, and the result after clustering is collected to form a video abstract.In order to better utilize the memory space of storage medium and let the user better quickly browse the general content of original video stream, the application provides a key frame screening algorithm for original video stream by sampling, filtering and clustering.The key frame extraction method of the application screens out similar frames, redundant frames and fuzzy frames in original video stream through key frame screening algorithm for original video data, forms a video abstract storage of a section of original video, thereby greatly reduces the occupied storage space.
Owner:QINGDAO INST OF COMPUTING TECH XIDIAN UNIV

Train fault state detection method and system based on artificial intelligence

The invention discloses a train fault state detection method and system based on artificial intelligence, and relates to the technical field of train fault state detection. The method comprises the steps that multiple types of sensors are arranged at key parts of a train, state data such as temperature, vibration, electricity, energy consumption and noise are collected in real time, local receiving, preprocessing and wireless uploading of the data are achieved by means of a mobile terminal, and a cloud platform conducts multi-dimensional analysis and fault recognition through an artificial intelligence algorithm on the basis of a health assessment model. According to the train fault diagnosis system and method, health indexes and early warning information are generated and pushed to operation and maintenance personnel in real time, the system supports overhaul process recording and multimedia information uploading, information archiving and analysis tracing are achieved, the accuracy and response efficiency of train fault diagnosis are remarkably improved, the operation and maintenance cost is reduced, and the safety and intelligent level of a railway system are enhanced.
Owner:CRRC NANJING PUZHEN CO LTD

Audio depth forgery detection method and device, terminal and storage medium

The invention discloses an audio deep forgery detection method and device, a terminal and a storage medium, and relates to the technical field of multimedia information security and artificial intelligence, and the method comprises the steps: constructing an audio deep forgery detection network model; according to the training set, performing decoupling stage training on an audio deep counterfeiting detection network model, and determining an initial training network model; performing meta-learning on the initial training network model according to the training set, and determining a target training network model; and obtaining a to-be-detected audio, inputting the to-be-detected audio into the target training network model, and determining an audio category corresponding to the to-be-detected audio. According to the method, meta-learning is adopted in the training stage of the audio deep forgery detection network model to force the audio deep forgery detection network model to learn general knowledge with higher generalization, so that the problem of poor detection performance caused by model overfitting in the face of an unknown vocoder and a natural scene in the prior art can be effectively solved.
Owner:SHENZHEN UNIV

Layout-aware multimodal pretraining for multimodal document understanding

Systems and methods for document processing that can process and understand the layout, text size, text style, and multimedia of a document can generate more accurate and informed document representations. The layout of a document paired with text size and style can indicate what portions of a document are possibly more important, and the understanding of that importance can help with understanding of the document. Systems and methods utilizing a hierarchical framework that processes the block-level and the document-level of a document can capitalize on these indicators to generate a better document representation.
Owner:GOOGLE LLC

An intelligent operation and maintenance system based on AI big model and RPA

The present invention relates to an intelligent operation and maintenance system based on an AI big model and RPA, which relates to the field of data processing. The system receives user input information in response to an RPA robot, performs semantic matching through an AI semantic model, and obtains consulting questions; processes the consulting questions through an answer material library, and matches a number of historical answers; performs centralized weight distribution on the several historical answers to obtain a number of centralized weights; processes the consulting questions through a question and answer log, and performs answer frequency weight distribution on the several historical answers to obtain a number of frequency weights; optimizes the several historical answers according to the several centralized weights and the several frequency weights, obtains a target answer, and feeds back the target answer to the RPA robot to reply to the user, thereby solving the technical problems that the intelligent operation and maintenance system is difficult to effectively handle complex and non-standardized user questions, the answer matching algorithm has low adaptability, and the multimedia information processing capability is limited.
Owner:BEIJING ZHONGDIAN HUIZHI TECH CO LTD

Interaction method and apparatus, electronic device and readable medium

Disclosed in the present application are an interaction method and apparatus, an electronic device and a readable medium. The method comprises: in response to a page display operation, displaying a target page, wherein the target page comprises a first region and a second region, the first region being used for displaying multimedia information that corresponds to a first account, and the second region being used for displaying attribute information of at least one recommended object that corresponds to a second account, and resource attribute information that corresponds to a candidate object set; and in response to an interaction operation for the candidate object set, performing preset interaction processing, which corresponds to the interaction operation, on a candidate object in the candidate object set.
Owner:BEIJING YOUZHUJU NETWORK TECH CO LTD

Dynamic display adjusting method and system for multimedia interactive display

The invention relates to the technical field of multimedia information processing, and discloses a dynamic display adjusting method and system for multimedia interactive display, and the method comprises the steps: obtaining user real-time interaction data, user role attributes, content type preferences and historical interaction data, and generating real-time interest distribution points according to the user real-time interaction data, the user role attributes, the content type preferences and the historical interaction data; predicting a user behavior in combination with historical interaction data, and generating a pre-loaded content triggering condition; generating a preloaded content set by integrating the preloaded content triggering condition, the user role attribute and the content type preference; acquiring physical parameters of equipment, and constructing a coordinate matrix and a transformation matrix of cross-equipment content presentation; the content is distributed to the target device through the transformation matrix, and finally the display content is dynamically adjusted according to the real-time interaction data. The problem that in the multimedia interactive display technology, the content cannot be smoothly presented in real time during multi-screen switching is solved, seamless connection of the content during multi-screen switching is achieved, and real-time smoothness of multi-screen switching is ensured.
Owner:SHENZHEN HENGYUN CONSULTING CO LTD

Interaction method and device, equipment and storage medium

The invention provides an interaction method and device, equipment and a storage medium, and relates to the technical field of computers. The method comprises: in response to a preset trigger instruction, displaying multimedia information corresponding to a first media identifier in a media display area of a preset page, and displaying a target object set in an object display area of the preset page, the target object set being determined based on an object corresponding to a candidate media identifier in an identifier aggregation area, and in response to a switching instruction aiming at a candidate media identifier in the identifier aggregation area, determining the candidate media identifier aiming at the switching instruction as a second media identifier, and switching the multimedia information displayed in the media display area from the multimedia information corresponding to the first media identifier to the multimedia information corresponding to the second media identifier. By adopting the technical scheme, the information viewing convenience and the information switching efficiency can be improved.
Owner:BEIJING YOUZHUJU NETWORK TECH CO LTD

Multimedia field label information labeling method based on TSK rule migration

The invention belongs to the field of multimedia information intelligent processing and classification application, and relates to a multimedia field label information labeling method based on TSK rule migration. The method comprises three parts of label set division, rule migration modeling and multi-label classification. The method comprises the following steps: firstly, constructing a label separation mechanism according to label distribution characteristics of multimedia multi-label data, and dividing a label set into conventional labels and scarce labels; secondly, constructing a rule migration TSK fuzzy system; the system comprises a combined If-part and a migration-driven ten-part, not only can realize feature-label reasoning modeling, but also can establish relevance between conventional labels and scarce labels according to label distribution differences. And finally, on the basis of RT-TSK-FS, a multi-label classification method based on rule migration is provided, and sharing and supplement of knowledge among different labels are realized through a rule migration mechanism, so that the prediction performance of multimedia label information is improved.
Owner:WUXI UNIV

Video information hiding method, system, device and medium based on inter-block pairing

The present invention discloses a video information hiding method, system, device, and medium based on inter-block pairing. The method comprises: obtaining encoded H.264 video data and obtaining coefficients of all 4×4 luminance blocks in the H.264 video data; sorting all 4×4 luminance blocks according to the absolute values ​​of their DC coefficients; pairing the AC coefficients from the second to the last digit in adjacent luminance blocks to obtain coefficient pairs; shifting the luminance blocks accordingly based on the coefficient pairs, the data to be embedded, and a two-dimensional histogram transfer map; and placing the embedded 4×4 luminance blocks into the encoded H.264 video data in their original order. The present invention uses inter-block pairing to modify the luminance blocks in the video data according to the embedded data, thereby embedding hidden data and effectively reducing the impact on video quality and the increase in video file size. The present invention can be widely applied in the field of multimedia information security technology.
Owner:SOUTH CHINA UNIV OF TECH

Support resource allocation method and device, electronic equipment and storage medium

The invention relates to the technical field of data processing, in particular to a support resource allocation method and device, electronic equipment and a storage medium, and the method comprises the steps: firstly determining each piece of target multimedia information owned by an information holding object, and determining the total amount of support resources configured for the information holding object in an initial support period; for each piece of target multimedia information, obtaining a first analysis result representing that the historical support resource quantity changes along with the historical support coefficient, and a second analysis result representing that the historical push income changes along with the historical support coefficient; and furthermore, according to the total support resource amount, in combination with each first analysis result and each second analysis result, obtaining a target support resource amount and a target support coefficient corresponding to each piece of target multimedia information when the total push income of each piece of target multimedia information meets a preset condition. In this way, the rationality of supporting resource allocation is improved, and the effective utilization rate of supporting resources is guaranteed.
Owner:BEIJING SOGOU TECHNOLOGY DEVELOPMENT CO LTD

Multimedia data display methods, devices, electronic equipment and storage media

This disclosure provides a method, apparatus, electronic device, and storage medium for displaying multimedia data, belonging to the field of multimedia technology. The method includes: acquiring a multimedia information stream; based on the multimedia information stream, when playing multimedia data in a playback interface, displaying a navigation component in the playback interface according to a display style corresponding to the feature information of the multimedia data, the navigation component being used for playback control. This method matches the display style of the navigation component to the feature information of the multimedia data, so that the navigation component is no longer a uniform, universal form. The presentation of the navigation component is adapted to the characteristics of the multimedia data and dynamically adjusted with the content. This not only ensures the basic implementation of playback control functions but also improves the coordination of the playback interface, balancing ease of operation and immersive viewing, presenting higher quality visual effects, ensuring the overall playback and interactive experience, and improving playback efficiency.
Owner:BEIJING DAJIA INTERNET INFORMATION TECH CO LTD

Multimedia information terminal

ActiveCN310075793SEngineeringData science
1. The name of the design product: multimedia information terminal. 2. The use of the design product: the screen of the multimedia information terminal connected with various host computers. 3. The design points of the design product: the shape. 4. The picture or photo that can best show the design points: the perspective view 2. 5. The bottom surface of the design product is the part that is not easy to see or cannot be seen during use, so the bottom view is omitted.

Smart glasses

1. The name of the design product: smart glasses. 2. The use of the design product: for the wearer to perceive multimedia information, and can be used for navigation by visually impaired people. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view 1.
Owner:吴思源

A multimedia interface generation method, device, equipment and medium

The present disclosure provides a multimedia interface generation method, device, equipment and medium, which realizes one-key generation of a multimedia interface based on a multimedia list screenshot. The method comprises: obtaining a multimedia list screenshot and performing multimedia information identification to obtain related information of a multimedia in the multimedia list screenshot; determining similar multimedia interfaces of the multimedia list screenshot from a multimedia database according to the obtained related information of the multimedia, and obtaining cover information and multimedia description information of each similar multimedia interface; and generating a target multimedia interface according to the cover information and the multimedia description information of the similar multimedia interfaces.
Owner:HANGZHOU NETEASE CLOUD MUSIC TECH CO LTD

Method for classifying multimedia information

The invention provides a method for classifying multimedia information, which comprises the following steps of: processing the multimedia information to be classified through an LFMIL model to obtain a predicted output vector of a label, comparing the predicted output vector of the label with a set classification threshold to obtain a predicted label vector of the multimedia information, and classifying the predicted label vector of the multimedia information through the LFMIL model. And classifying the multimedia information based on the predicted label vector. By constructing the LFMIL model, the feature reasoning information of common tags can be effectively utilized, and the prediction performance of scarce tags is promoted to be improved, so that relatively high classification precision is kept in multi-tag tasks of different multimedia data sets, and the purpose of improving the classification precision is achieved.
Owner:WUXI UNIV

Multimedia console graphical user interface for an electronic device

1. The name of the design product: multimedia control interface of electronic device. 2. The use of the design product: an electronic device. 3. The design points of the design product: in the graphical user interface. 4. The picture or photo that best indicates the design points: design 1 front view. 5. The electronic device is a conventional design, and other views are omitted. 6. Design 1 is designated as the basic design. 7. The use of the graphical user interface: for the play management of multimedia information, the gray blocks in the design interface are replaceable pictures or videos, the X in the design interface represents text and / or numbers and / or letters and / or symbols, the front view of designs 1-6 can manage the play progress by triggering the lower progress bar in the interface, and the front view of designs 7-10 displays the change state diagram corresponding to the design by triggering the lower progress bar in the interface.
Owner:BEIJING ZITIAO NETWORK TECH CO LTD

Information pushing method, apparatus, device, storage medium and product

The application belongs to the technical field of data processing, and discloses an information pushing method, device, equipment, storage medium and product. The application determines the information quantity corresponding to the information pushing event in response to the information pushing event triggered by the terminal equipment, then selects the corresponding to-be-pushed multimedia information from the information cache pool based on the information quantity, the information cache pool is constructed after being layered based on the initial pushing request requested by the information pushing event, and then the to-be-pushed multimedia information is pushed to the terminal equipment. The application can determine the information quantity corresponding to the information pushing event when the user triggers the information pushing event on the terminal equipment, can obtain the information quantity pushed to the terminal equipment, and then selects the to-be-pushed multimedia information from the information cache pool based on the information quantity, so that the to-be-pushed multimedia information pushed to the user can be effectively selected, and the overall information promotion value is improved.
Owner:BEIJING QIHOOD TECHNOLOGY CO LTD

Electronic security code terminal (4G vehicle-mounted multimedia Beidou positioning terminal)

1. The name of the design product: electronic security code terminal (4G vehicle-mounted multimedia Beidou positioning terminal). 2. The use of the design product: for single Beidou real-time satellite positioning, dynamic display of multimedia information such as pictures, two-dimensional codes, and texts, real-time voice broadcast, 4G mobile Internet communication, and vehicle-mounted Internet of Things terminal equipment. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view.
Owner:SICHUAN HUANYU TIANXING TECH CO LTD

Media information processing method and device, electronic equipment and storage medium

The invention provides a media information processing method and device, electronic equipment and a storage medium. The method comprises the following steps: presenting a media information interface, and presenting media information in the media information interface; presenting a moving picture function item corresponding to the media information; in response to a trigger operation for the dynamic picture function item, presenting a dynamic display file including key information of the media information, the dynamic display file being used for dynamically displaying the key information of the media information; in response to a sharing instruction for a target object triggered based on the dynamic display file, sharing the dynamic display file to a client of the target object; according to the media information sharing method and device, the user can be helped to quickly obtain the related content of the media information, meanwhile, the sharing form of the media information is more interesting, the attraction of the media information is improved, and spreading of the media information is facilitated.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

A multimedia information recommendation method and device, and a storage medium

The application discloses a multimedia information recommendation method and device and a storage medium. The method comprises the following steps: acquiring position signaling data of each user in a recommendation area; the user is a user on a terminal covered in the recommendation area; using a preset permanent area model, performing permanent area prediction on each user according to the position signaling data to obtain a permanent area prediction result corresponding to each user; based on the permanent area prediction result, determining a permanent user from each user, and pushing to-be-recommended multimedia information to a terminal corresponding to the permanent user. Through the technical solution, the accuracy and diversity of information recommendation are improved.
Owner:CHINA MOBILE (SUZHOU) SOFTWARE TECH CO LTD +1

Distributed power architecture

The device, method, and system embodiments described in the present disclosure (i.e., the teachings of the present disclosure) enable an authorization circuit having at least one authorization mechanism to cooperate with an access circuit having at least one key mechanism. After successfully authorizing at least one data transmitted from the key mechanism of the access circuit, the authorization circuit is arranged to deliver power having determined characteristics to the access circuit. In at least one embodiment, the authorization circuit is arranged as a circuit coupled to the power infrastructure in a building by wire or wirelessly. In at least one embodiment, the access circuit is arranged as a smart power plug that is arranged to temporarily deliver power to a mobile computing device or other electrically powered device. In some cases, power is delivered only after a user consumes specific multimedia information. In some cases, the delivered power is only delivered for a short period of time and is measured.
Owner:VIDEJI NETWORK CO LTD

Video live broadcast processing method and device, and computer equipment

The invention relates to a live video processing method and device, computer equipment, a storage medium and a computer program product. The method can be applied to an application scene in which a vehicle-mounted terminal, a cloud server or other equipment interacts with a multimedia information platform, and comprises the following steps: displaying a first media work; when the live broadcast room associated with the first media work is in a live broadcast state, displaying first live broadcast prompt information used for entering the live broadcast room and interaction materials corresponding to the live broadcast room; under the condition that a preset display condition is met, displaying key video clips of the live broadcasting room; and in the process of displaying the key video clip or after the display of the key video clip is completed, in response to a trigger operation on the first live broadcast prompt information or the interaction material, displaying live broadcast content of the live broadcast room. By adopting the method, the drainage channels of the live video can be effectively increased, the drainage content is enriched, and the drainage effect of the live video is improved.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Multimedia information processing method and system and medium

The invention relates to the technical field of data processing, in particular to a multimedia information processing method and system and a medium, and the method comprises the steps: obtaining multimedia information data, carrying out the preprocessing operation of the multimedia information data, carrying out the feature extraction and fusion of the preprocessed multimedia information data through a multi-modal fusion model, and carrying out the feature extraction and fusion of the preprocessed multimedia information data; obtaining a multi-modal fusion feature vector; the multi-modal fusion model comprises an image model, an audio model, a video model and an attention mechanism; performing weighted fusion on the image feature vector, the audio feature vector and the video feature vector through an attention mechanism to obtain a multi-modal fusion feature vector; generating a processing result of the multimedia information according to the multi-modal fusion feature vector; according to the invention, the accuracy and robustness of multimedia information processing in a complex scene can be improved.
Owner:GUANGDONG VOCATIONAL & TECHNICAL COLLEGE

Optical fiber extender

The utility model provides an optical fiber extender, which relates to the technical field of optical fiber extension equipment, comprises an SDI (Serial Digital Interface) line equalizer, an RECLOCK and line driver, a power supply module, an SDI video transmission channel, a single-fiber bidirectional optical module, an RS485 signal channel and a TALLY signal channel, and solves the problem that when a common cable is used for long-distance transmission of a higher-speed signal, the power supply module cannot be connected with the SDI video transmission channel. The phenomena of poor output signal quality, easy external interference and the like always occur; meanwhile, the transmission distance is short, the long-distance transmission requirement of occasions such as multimedia information issuing cannot be met, in practical application, a traditional cable is often difficult to support the integrity and stability of high-quality audio and video signals in long-distance transmission due to limitation of physical characteristics and transmission bandwidth of the traditional cable, and according to the research of Smitet al. (2020), the long-distance transmission requirement of the high-quality audio and video signals in the long-distance transmission process cannot be met, and the long-distance transmission requirement of the high-quality audio and video signals in the long-distance transmission process cannot be met. After the transmission distance of the traditional cable exceeds 100 meters, the signal attenuation can reach about 3dB, which has a significant influence on the image quality.
Owner:SHENZHEN SHIJIE OPTOELECTRONICS TECH CO LTD

A visual cryptography security authentication method, device and equipment

This invention discloses a secure authentication method, apparatus, and device for video encryption cards, relating to the field of computer security technology. The method includes: connecting a current video encryption card to a computer and acquiring a digital video signal to be decrypted; wherein the digital signal to be decrypted is obtained by encrypting an original digital video signal using the computer; determining whether the current video encryption card is compatible with the computer; if the result of determining whether the current video encryption card is compatible with the computer is yes, then decrypting the digital video signal to be decrypted using the current video encryption card and obtaining the corresponding original digital video signal. By using the secure authentication method for video encryption cards disclosed in this invention, the computer hardware information used to encrypt video information is recorded on the video encryption card, and the key contains the computer hardware information, enabling the video encryption card to be compatible with the corresponding computer hardware. Encryption / decryption can only be performed under the condition of hardware compatibility, thus improving the information security of processing multimedia information using video encryption cards.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Vertical electronic sign

1. The name of this design product: Vertical electronic signboard. 2. Purpose of this design product: This design product is used for playing and displaying multimedia information. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: Stereoscopic drawing 1.
Owner:徐华强

Multi-screen fusion multi-information source intelligent push playing management method and system

The application discloses a multi-screen fusion multi-information source intelligent push playing management method and system, which is connected with an airport multi-information screen cluster, comprises a data fusion module, a passenger portrait and state tracking module, an information strategy decision engine, a multi-level screen management module, a content generation and distribution module, a distributed screen control module and a man-machine interaction management interface; the data fusion module is used for accessing and processing multi-source heterogeneous data from an airport operation database, a passenger processing system, an indoor positioning system and a real-time passenger flow analysis system, and generating a unified airport real-time state view; the application allows an operator to conveniently make and regularly publish rich media content through a self-produced program template configuration and push module, supports batch management of a device group, planned on-off and state monitoring, perfectly unifies two functions of airport key operation information publishing and daily media content playing, and forms a complete, efficient and reliable multimedia information publishing and management platform.
Owner:SHAMEN ZHAO XIANG ZHINENG SCI & TECH CO LTD