41 results about "Video assisted" patented technology

The invention relates to the technical field of booster station monitoring systems, and discloses a booster station operation and maintenance work video auxiliary monitoring system comprising a three-dimensional perception interaction layer used for collecting equipment state data and providing a man-machine interaction interface and connected with an edge intelligent fusion layer through a wired or wireless transmission channel; and the edge intelligent fusion layer is used for locally analyzing and caching the state data. Through standardized interface interconnection of the three-dimensional perception interaction layer, the edge intelligent fusion layer and the cloud collaborative management layer, a collaborative working mode of data acquisition, local analysis and cloud optimization is formed, the architecture design breaks through the dependence of a traditional scheme on cloud centralized processing, data preprocessing sinks to the edge layer, the network transmission pressure is effectively reduced, and the network performance is improved. The local intelligent analysis capability can still be maintained when the network fluctuates, and compared with the delay problem caused by full data uploading in the prior art, the system response real-time performance and the availability under the network disconnection scene are remarkably improved.

The invention discloses a direct visual field testing device, which relates to the technical field of testing and comprises a video auxiliary device and a marker device, the video auxiliary device realizes three-dimensional positioning and real-time video acquisition of preset eye spots through a height adjusting mechanism, an angle adjusting mechanism and a holder adjusting mechanism; the marker device realizes accurate adjustment and stable positioning of a marker in a test area through a height adjusting rod, a knuckle bearing and laser-assisted positioning; the direct visual field testing device is suitable for accurate measurement of the visual field range of a driver, can efficiently collect and record testing data, has the advantages of being convenient to operate, high in adaptability, high in precision and the like, and is widely applied to the fields of vehicle design, driving training, safety research and the like.

This disclosure describes an interactive augmented reality system for improving surgeon's view and context awareness during laparoscopic and video assisted surgeries. Instead of purely relying on computer vision algorithms for image registration between pre-operation (or intra-operation) images / models and later intra-operation scope images, the system can implement an interactive mechanism where surgeons may provide supervised information in initial calibration phase of the augmented reality function, thus achieving high accuracy in image registration. Besides the initialization phase before operation starts, interaction between surgeon and the system can also happens during the surgery. Specifically, patient tissue might move or deform during surgery, caused by for example cutting. The augmented reality system can re-calibrate during surgery when image registration accuracy deteriorates, by seeking additional supervised labeling from surgeons. The augmented reality system can improve surgeon's view during surgery, by utilizing surgeon's guidance sporadically to achieve high image registration accuracy.

The present invention is an apparatus, device or tool for performing endoscopic (that is, minimally invasive) surgery. An exemplary embodiment of the invention includes a video endoscope whilst in another embodiment of the invention includes an endoscopic surgical tool which, when equipped with one of a suite of endoscopic surgical instruments, can be used by a surgeon to perform surgical procedures inside a body. Another embodiment of the present invention includes a suite of endoscopic surgical instruments designed to work co-operatively with the endoscopic surgical tool. In another embodiment of the present invention, a video-assisted endoscopic surgical tool system is provided. In one embodiment, the system includes the video-assisted endoscopic surgical tool and a suite of at least one endoscopic surgical instrument.

The invention belongs to the technical field of data processing, and particularly discloses an intelligent bellyband for household respiratory rehabilitation and a management system.The intelligent bellyband and management system comprises the following steps that thoracic and abdominal movement data are collected through a flexible sensor array, and the thoracic and abdominal movement data comprise thoracic expansion amplitude, abdominal pressure change and blood oxygen saturation information; constructing an initial multi-mode signal set; according to the initial multi-mode signal set, a recurrent neural network is adopted to extract time sequence features, and dynamic feature representation is obtained and used for follow-up fusion processing; performing priority evaluation on respiratory training quality from the dynamic feature representation, and determining key signal subsets to identify potential deviations; if the key signal subset meets a triggering condition, video auxiliary analysis is carried out; the invention aims to solve the problems of multi-mode signal complexity and inaccurate real-time feedback in respiration data acquisition and analysis.

The invention discloses a shot assembling method based on video auxiliary editing, and relates to the technical field of media asset content creation, and the method comprises the steps: firstly segmenting a video material through employing a transition recognition technology, and obtaining a candidate shot group; secondly, labeling the scene and the motion grammar of the candidate lens group by using a scene recognition model and a motion grammar recognition model to obtain a labeled candidate lens group, and then representing a slice sequence by using a one-hot matrix based on the labeled candidate lens group; and finally, calculating an energy value of the fragment sequence based on an extensible scene motion grammar combination energy model, gradually adjusting and optimizing the fragment sequence by adopting Langevin dynamics, and obtaining an optimal lens assembly sequence to form a fragment. The method and the device can assist video editing of news manuscripts, improve the production efficiency of news videos, improve the timeliness of news release, and improve the video editing efficiency of the news manuscripts. And meanwhile, the quality of the film can be better controlled, the film is ensured to accord with certain audio-visual language knowledge, and the watching experience of audiences is improved.

The invention discloses a video description generation method based on a synthetic text and a global mixed linear expert, and aims to realize high-quality video content automatic description through an innovative model architecture and a data construction strategy. The method is suitable for video auxiliary subtitle systems, education video content abstracts or video content platform intelligent analysis scenes, and high-quality video description texts can be automatically generated. According to the method, through framework innovation, a first whole-network MoE-based Transform framework is realized on a model level, so that a global mixed linear expert model is constructed, and a powerful model basis is constructed for a video description task. According to the model, multi-modal information and diversified content features can be efficiently fused, and good support and expansion capability is provided for subsequent training.

A portable hand-held medical device includes a body having a gun-type formation that includes a barrel. A guide wire device is housed in the body and is configured to advance and retract through the barrel. The guide wire device carries a bundled arrangement including a video system, an illumination system to support the video system, a fluid irrigation line, and a guide wire mechanism. The bundled arrangement is packaged as a unit in an insertion tube. The tip section of the insertion tube incorporates a camera, a light source, and a fluid irrigation port. A catheter is disposed at the end of the barrel, so that during operation the guide wire device passes through the catheter lumen. The combination guide wire device and catheter enter the urinary tract and perform a bladder evacuation process.

The application discloses a system and method for non-invasively upgrading a customer service voice telephone into a video telephone, which comprises a video-assisted client module and a video-assisted server module; the video-assisted client module is non-invasively arranged on a customer service platform and is used as an entrance for a customer service to initiate a request for upgrading a current voice call into a video call and a terminal for the customer service to receive a video call; the video-assisted server module is arranged on an enterprise call center and is used for voice-upgrading a video call, and is connected with an SBC call module of the enterprise call center at an upper end and is connected with a PBX module of the enterprise call center at a lower end; during a voice call process, a call is sent to the PBX module, and a call flow remains unchanged with an original flow of the call center. The application retains an original call center architecture and a voice call flow, realizes a video call function and a scene, and maintains an original customer service usage habit unchanged, and only initiates a video service scene when the customer service triggers actively.

The present application provides a method for extracting a target speech based on the assistance of video information, including: obtaining video information and speech signals using a microphone array system with a camera; the video information includes the spatial orientation information of a potential speaker; using two microphone array elements of different spacings to form multiple groups of array element pairs, dividing the speech signal into multiple frequency bands with continuous frequencies in the frequency domain; estimating the direct reverberation ratio of the target speech in the received signal at each frequency point within the multiple frequency bands in combination with the spatial orientation information of the potential speaker; performing beamforming preprocessing on the frequency domain signal of the speech signal, determining the probability of the existence of the target speech using the energy ratio of the frequency domain signal before and after preprocessing and the direct reverberation ratio of the target speech, and constructing a hybrid MVDR beamformer based on at least the above information. This method combines video-assisted information and uses array signal processing technology to construct a hybrid MVDR beamformer, which can improve the interference suppression effect while extracting the target speech.

A retractor-camera kit for minimally invasive surgery is provided. The kit includes a retractor comprising at least a top blade and a first side blade connected to one another through a hinge, a handle connected to the retractor, and a camera connected to the retractor via a designated holder to provide visualization of a surgical site while avoiding the need for an additional incision for passing an imaging unit therethrough.

The invention discloses a method for assisting early judgment of adolescent idiopathic scoliosis based on a walking video. The method comprises the steps of obtaining two-dimensional key point coordinates of an AIS patient; deriving three-dimensional key point coordinates; calculating a corresponding power spectrum index; and obtaining the disease degree of the AIS patient. The method has the advantages that the AIS patient can conveniently monitor the development condition of the own illness state in real time; an AlphaPose system is adopted, and meanwhile, a DLT method is introduced, so that the capability of estimating coordinates of three-dimensional key points can be enhanced; the MAnE algorithm and the MGE algorithm are adopted, the walking characteristics of the AIS patient can be described from the two dimensions of time and space, and the characteristics of abnormal gaits can be obtained more clearly; a computer technology is applied to data acquisition, mathematics is applied to feature calculation, a doctor can be effectively assisted in AIS early diagnosis, a corresponding treatment scheme is formulated, and therefore the monitoring effect and safety can be improved, and the life quality of an AIS patient can be improved.

The present invention provides a method, system, device and medium for endoscopic video-assisted diagnosis based on edge-cloud collaboration, the method comprising: obtaining an endoscopic video image, performing preprocessing operations and feature extraction operations on the endoscopic video image on edge resources; the preprocessing operations are: white balance adjustment of the endoscopic video image; distortion correction of the endoscopic video image after white balance adjustment; denoising of the endoscopic video image; detecting and enhancing the highlight area in the endoscopic video image; de-motion blurring of the endoscopic video image; feature extraction operations are: feature extraction of the endoscopic video image to obtain its image features; clustering the image features of the endoscopic video image to determine the endoscopic video image as a key frame, and outputting its image features to an inference model located in a central cloud to obtain an inference result. The method rationally utilizes the resources of the edge resources and the central cloud, and avoids wasting central cloud resources to process useless frames.

The present invention is an apparatus, device or tool for performing endoscopic (that is, minimally invasive) surgery. An exemplary embodiment of the invention includes a video endoscope whilst in another embodiment of the invention includes an endoscopic surgical tool which, when equipped with one of a suite of endoscopic surgical instruments, can be used by a surgeon to perform surgical procedures inside a body. Another embodiment of the present invention includes a suite of endoscopic surgical instruments designed to work co-operatively with the endoscopic surgical tool. In another embodiment of the present invention, a video-assisted endoscopic surgical tool system is provided. In one embodiment, the system includes the video-assisted endoscopic surgical tool and a suite of at least one endoscopic surgical instrument.

The application discloses a video auxiliary-based text reconstruction model training method and device, which comprises the following steps: training a to-be-trained text model according to all determined training samples, obtaining a trained text model, and judging whether the trained text model converges; wherein, when the to-be-trained text model is trained, the input content of the feature fusion layer included in the to-be-trained text model comprises a text feature vector corresponding to a sample text in any training sample and a video feature vector corresponding to the sample text and generated in advance; and if yes, the trained text model is determined as a text reconstruction model. It can be seen that the text reconstruction model can be trained with the aid of the video feature vector, which is not only beneficial to the user to quickly produce a video text through the text reconstruction model without repeatedly correcting the video text, but also beneficial to improving the matching degree between the generated video text and the video, thereby meeting the production demand of the user for the video text.

The invention discloses a detection distance adaptive matching method and device of a coaxial laser radar device, a laser of the coaxial laser radar device is connected with a first end of a circulator through a collimator, and a second end of the circulator is connected with a zoom telescope system and a video auxiliary system. The third end of the circulator is connected with a data collecting and processing system through a detector, and the method comprises the steps that initial signal data collected by the zoom telescopic system when the zoom telescopic system is in an initial focal length are received, and the initial signal data comprise initial image data and / or initial echo data; on the basis of the initial signal data, traversing each focal length of the zoom telescopic system by using a hill climbing algorithm, and determining signal data corresponding to each focal length of the zoom telescopic system; determining a target focal length for the target detection object based on the signal data corresponding to each focal length; the detection strategy corresponding to the target detection object is determined based on the target focal length, and the detection precision of the coaxial laser radar can be effectively improved.

This invention relates to the fields of medical auxiliary diagnosis and computer vision technology, specifically to a multimodal video-assisted diagnostic method and system for Parkinson's disease based on Transformer and attention fusion. First, video data of the subject's hand pinching motion and linear back-and-forth walking motion are acquired and a unified sample label is established. Then, video preprocessing is completed through preprocessing, sliding time window segmentation, and data augmentation. Next, the preprocessed temporal image sequence is input into a spatiotemporal modeling network, where a visual Transformer is used to extract frame-level spatial features. A multi-layer long short-term memory network is then combined to capture long-term temporal motion dynamic information. Finally, a modality-level spatiotemporal attention fusion method adaptively learns modality weights and achieves feature fusion. Finally, the fused features are input into a classification network, outputting prediction results for Parkinson's disease patients or healthy controls. This invention comprehensively characterizes the motion features of the disease through multimodal fusion and accurate spatiotemporal modeling, improving diagnostic accuracy and robustness.

An object of a system according to an embodiment is to intuitively assist an elderly person with a video or a sound when the elderly person operates a smartphone.SOLUTION: A system according to an embodiment includes an action pattern learning part, a video assist part, and a voice assist part. The behavior pattern learning unit learns a behavior pattern of the elderly person. The video assist unit assists an operation with a video on the basis of the action pattern learned by the action pattern learning unit. The voice assist unit assists the operation by voice based on the action pattern learned by the action pattern learning unit.SELECTED DRAWING: Figure 1

The invention discloses a system and a method for upgrading a customer service voice call into a video call in a non-intrusive manner. The system comprises a video auxiliary client module and a video auxiliary server module, the video auxiliary client module is arranged on a customer service workbench in a non-intrusive manner and is used as an entrance for a customer service to initiate a request for upgrading a current voice call to a video call and a terminal for the customer service to answer the video call; and the video auxiliary server module is arranged in an enterprise call center and is used for voice upgrading of a video call, the upper end of the video auxiliary server module is connected with an SBC call module of the enterprise call center, the lower end of the video auxiliary server module is connected with a PBX module of the enterprise call center, the call is sent to the PBX module in the voice call process, and the call flow and the original flow of the call center are kept unchanged. According to the invention, the original call center architecture and voice call flow are reserved, the video call function and scene are realized, the original customer service use habit is kept unchanged, and the customer service initiatively triggers only when the video service scene is needed.

A container self-loading and self-unloading video auxiliary guiding system comprises a controller, camera lenses, a duplex-screen all-in-one machine and a cable, the controller is connected with the duplex-screen all-in-one machine, cameras are installed on the two sides of a left grabbing arm of a container, the two sides of a right grabbing arm of the container, a lifting hook of the container and the tail of a vehicle body respectively, and the cameras are connected with the controller respectively. The vehicle-mounted radar is connected with the controller, the controller is provided with a CAN bus and trigger signal interface, a 24VDC power supply interface, an analog signal expansion interface and a CAN bus expansion interface, the duplex screen all-in-one machine is installed in a cab and right faces the top of an operator, and the A screen and the B screen are arranged on the right hand side and the left hand side respectively. The multi-direction camera is used for assisting in a millimeter wave radar mode to achieve multiple information collection, information is transmitted to the duplex-screen all-in-one machine after being gathered and processed, comprehensive information display is achieved, the information is comprehensive and accurate, and the operation efficiency and safety of the vehicle-mounted loading and unloading equipment are improved.

The present invention relates to a tracheostomy tube obturator inserted into the tracheostomy tube so as to close the tracheostomy tube. According to the tracheostomy tube obturator of the present invention, the tracheostomy tube obturator comprises an endoscope, which is inserted into the tracheostomy tube, has a monitor mounted and fixed to the distal end thereof, has a camera module and a lighting module provided at the proximal end thereof, integrally extends from the monitor and is exposed to the proximal end of the obturator, so that, when the tracheostomy tube is replaced, the monitor stably monitors from the insertion point of the neck to the inside of the trachea so as to prevent the tracheostomy tube from entering a false lumen, and prevents damage to surrounding tissue and blood vessels so that fatal accidents due to complications can be prevented.

The invention discloses a short video auxiliary shooting scoring method based on an AI multi-mode model. The short video auxiliary shooting scoring method comprises the following steps: S10, video acquisition; s20, video analysis: performing multi-dimensional fusion analysis on the standardized video data by adopting a vision-audio-semantic multi-modal fusion analysis algorithm to obtain a multi-dimensional fusion analysis result; s30, score generation: according to a multi-dimensional fusion analysis result, calculating by adopting a dynamic weight adaptive algorithm to obtain a comprehensive score of the to-be-analyzed short video; s40, bright spot identification: extracting index data meeting a quantitative excellent standard from a multi-dimensional fusion analysis result, and identifying and summarizing shooting bright spots of the short video by combining content characteristics of the short video; s50, defect identification is carried out; s60, optimization suggestion generation: on the basis of the identified shooting defects, a targeted overall optimization suggestion is generated in combination with the reservation demand of the shooting bright spots; and S70, outputting a result.

The disclosure relates to an AI-enhanced system for video-assisted medical procedures. It offers enhanced depth perception and real-time anatomical highlighting, integrating AI algorithms with existing medical imaging systems. The system includes continuous learning, broad applicability across various procedures, a user-friendly interface, and cloud-based updates, significantly enhancing medical procedural safety, accuracy, and efficiency.

A method includes identifying one or more surgically-related characteristics and correlating the one or more surgically-related characteristics with a surgical instrument layout stored in a database and based on a surgical procedure to be performed. The surgical instrument layout includes a type and quantity of one or more surgical instruments one or more physical dimensions of the one or more surgical instruments, and orientations of the one or more surgical instruments. The method further includes displaying on a display screen the surgical instrument layout; and projecting the surgical instrument layout onto a surgical table.

Method for inspecting sewer lines, in particular for damage assessment, with a crawler (14) movable in a channel (8) with at least one camera module (30) and a camera control unit (15) for recording at least one first video sequence (4) by the camera module (30), the signals of which can be transmitted via a data transmission device (13), preferably a cable, to an inspection vehicle (1) during the inspection and stored there in a first storage module (28) in the inspection vehicle (1), wherein during the recording of the first, potentially faulty video sequence (4) the camera module (30) records an identical, local second video sequence (5) and stores it in a camera-connected second storage module (18), and that in an evaluation phase following the inspection phase the two video sequences (4, 5) are read out in the inspection vehicle (1) and compared with each other,wherein their quality is assessed visually and / or mechanically, and that, depending on the assessment criterion, either time- or frame-dependent replacement of the first potentially faulty video sequence (4) by parts of the second video sequence (5) takes place in order to provide a video sequence free of interference signals and failures.

The invention discloses a video-assisted positioning method and device based on artificial intelligence, equipment and a medium, and relates to the technical field of vehicle positioning, and the method comprises the steps: collecting road video information and correction wheel speed meter information; and inputting the video road information and the correction wheel speed meter information into a deep learning positioning calculation model to obtain vision-assisted positioning information, the deep learning positioning calculation model comprises a double-layer convolutional neural network, a first connection layer, a second connection layer, a convolutional neural network, a pooling layer, a long-short-term memory network and a double-layer long-short-term memory network; judging whether satellite positioning fails or not or whether satellite positioning deviates according to satellite positioning information and the visual auxiliary positioning information; and when satellite positioning failure or satellite positioning deviation is judged, outputting the vision-assisted positioning information. The problem of inaccurate positioning of a single satellite can be solved.

The disclosure provides a kind of self-learning method and system based on non-inductive feedback chemical fault diagnosis, by constructing the operation state perception system of multi-source data fusion, in the setting time window, combined with water quality index change trend, control operation log and equipment operation image constructs non-inductive feedback verification model, realizes the automatic verification and correctness discrimination of preliminary diagnosis result;Further, according to the verification result, the weight of the diagnosis rule node is dynamically adjusted, the secondary diagnosis is triggered for the wrong diagnosis, and the alternative rule path is introduced, while the rule base is scanned regularly for frequency and accuracy, and dynamic optimization operations such as node weight attenuation, redundant path compression and new rule structured insertion are implemented;In addition, the multi-cycle fault mode feature distribution weight dynamic adjustment mechanism and video auxiliary multi-modal consistency verification are introduced, so that the system can adapt to high-frequency and high-risk faults, and enhance the identification ability of physical and chemical coupled faults.

A video-assisted networking platform for networking by users that includes: a host network platform server; a host networking platform software installed on the server and configured for access by the users; and video resumes stored on the server, each authored by one of the users and comprising searchable user-authored content in a format specified by the software. The software is configured such that each video resume can be generated and modified by one of the users. Further, the software is configured such that one of the users can evaluate each video resume based at least in part on its searchable user-authored content. In addition, the software is configured such that each of the video resumes can be authenticated by one of the users. Further, the software is configured with a conversion component capable of converting raw user-authored video content into the searchable content.

Devices, methods, and systems are provided for occluding a collateral flow channel between a target lung compartment and an adjacent lung compartment. A video-assisted thoracoscopic device is inserted into a thoracic cavity of a patient and positioned at a fissure between a target lung compartment and an adjacent lung compartment. A collateral flow channel between the target lung compartment and the adjacent lung compartment is then identified using the video-assisted thoracoscopic device and an agent is injected into the collateral flow channel, thereby reducing the collateral flow channel.