26 results about "Video assisted" patented technology

The invention relates to the technical field of booster station monitoring systems, and discloses a booster station operation and maintenance work video auxiliary monitoring system comprising a three-dimensional perception interaction layer used for collecting equipment state data and providing a man-machine interaction interface and connected with an edge intelligent fusion layer through a wired or wireless transmission channel; and the edge intelligent fusion layer is used for locally analyzing and caching the state data. Through standardized interface interconnection of the three-dimensional perception interaction layer, the edge intelligent fusion layer and the cloud collaborative management layer, a collaborative working mode of data acquisition, local analysis and cloud optimization is formed, the architecture design breaks through the dependence of a traditional scheme on cloud centralized processing, data preprocessing sinks to the edge layer, the network transmission pressure is effectively reduced, and the network performance is improved. The local intelligent analysis capability can still be maintained when the network fluctuates, and compared with the delay problem caused by full data uploading in the prior art, the system response real-time performance and the availability under the network disconnection scene are remarkably improved.

This disclosure describes an interactive augmented reality system for improving surgeon's view and context awareness during laparoscopic and video assisted surgeries. Instead of purely relying on computer vision algorithms for image registration between pre-operation (or intra-operation) images / models and later intra-operation scope images, the system can implement an interactive mechanism where surgeons may provide supervised information in initial calibration phase of the augmented reality function, thus achieving high accuracy in image registration. Besides the initialization phase before operation starts, interaction between surgeon and the system can also happens during the surgery. Specifically, patient tissue might move or deform during surgery, caused by for example cutting. The augmented reality system can re-calibrate during surgery when image registration accuracy deteriorates, by seeking additional supervised labeling from surgeons. The augmented reality system can improve surgeon's view during surgery, by utilizing surgeon's guidance sporadically to achieve high image registration accuracy.

The present invention is an apparatus, device or tool for performing endoscopic (that is, minimally invasive) surgery. An exemplary embodiment of the invention includes a video endoscope whilst in another embodiment of the invention includes an endoscopic surgical tool which, when equipped with one of a suite of endoscopic surgical instruments, can be used by a surgeon to perform surgical procedures inside a body. Another embodiment of the present invention includes a suite of endoscopic surgical instruments designed to work co-operatively with the endoscopic surgical tool. In another embodiment of the present invention, a video-assisted endoscopic surgical tool system is provided. In one embodiment, the system includes the video-assisted endoscopic surgical tool and a suite of at least one endoscopic surgical instrument.

The invention belongs to the technical field of data processing, and particularly discloses an intelligent bellyband for household respiratory rehabilitation and a management system.The intelligent bellyband and management system comprises the following steps that thoracic and abdominal movement data are collected through a flexible sensor array, and the thoracic and abdominal movement data comprise thoracic expansion amplitude, abdominal pressure change and blood oxygen saturation information; constructing an initial multi-mode signal set; according to the initial multi-mode signal set, a recurrent neural network is adopted to extract time sequence features, and dynamic feature representation is obtained and used for follow-up fusion processing; performing priority evaluation on respiratory training quality from the dynamic feature representation, and determining key signal subsets to identify potential deviations; if the key signal subset meets a triggering condition, video auxiliary analysis is carried out; the invention aims to solve the problems of multi-mode signal complexity and inaccurate real-time feedback in respiration data acquisition and analysis.

The invention discloses a video description generation method based on a synthetic text and a global mixed linear expert, and aims to realize high-quality video content automatic description through an innovative model architecture and a data construction strategy. The method is suitable for video auxiliary subtitle systems, education video content abstracts or video content platform intelligent analysis scenes, and high-quality video description texts can be automatically generated. According to the method, through framework innovation, a first whole-network MoE-based Transform framework is realized on a model level, so that a global mixed linear expert model is constructed, and a powerful model basis is constructed for a video description task. According to the model, multi-modal information and diversified content features can be efficiently fused, and good support and expansion capability is provided for subsequent training.

The application discloses a system and method for non-invasively upgrading a customer service voice telephone into a video telephone, which comprises a video-assisted client module and a video-assisted server module; the video-assisted client module is non-invasively arranged on a customer service platform and is used as an entrance for a customer service to initiate a request for upgrading a current voice call into a video call and a terminal for the customer service to receive a video call; the video-assisted server module is arranged on an enterprise call center and is used for voice-upgrading a video call, and is connected with an SBC call module of the enterprise call center at an upper end and is connected with a PBX module of the enterprise call center at a lower end; during a voice call process, a call is sent to the PBX module, and a call flow remains unchanged with an original flow of the call center. The application retains an original call center architecture and a voice call flow, realizes a video call function and a scene, and maintains an original customer service usage habit unchanged, and only initiates a video service scene when the customer service triggers actively.

The present application provides a method for extracting a target speech based on the assistance of video information, including: obtaining video information and speech signals using a microphone array system with a camera; the video information includes the spatial orientation information of a potential speaker; using two microphone array elements of different spacings to form multiple groups of array element pairs, dividing the speech signal into multiple frequency bands with continuous frequencies in the frequency domain; estimating the direct reverberation ratio of the target speech in the received signal at each frequency point within the multiple frequency bands in combination with the spatial orientation information of the potential speaker; performing beamforming preprocessing on the frequency domain signal of the speech signal, determining the probability of the existence of the target speech using the energy ratio of the frequency domain signal before and after preprocessing and the direct reverberation ratio of the target speech, and constructing a hybrid MVDR beamformer based on at least the above information. This method combines video-assisted information and uses array signal processing technology to construct a hybrid MVDR beamformer, which can improve the interference suppression effect while extracting the target speech.

A retractor-camera kit for minimally invasive surgery is provided. The kit includes a retractor comprising at least a top blade and a first side blade connected to one another through a hinge, a handle connected to the retractor, and a camera connected to the retractor via a designated holder to provide visualization of a surgical site while avoiding the need for an additional incision for passing an imaging unit therethrough.

The present invention is an apparatus, device or tool for performing endoscopic (that is, minimally invasive) surgery. An exemplary embodiment of the invention includes a video endoscope whilst in another embodiment of the invention includes an endoscopic surgical tool which, when equipped with one of a suite of endoscopic surgical instruments, can be used by a surgeon to perform surgical procedures inside a body. Another embodiment of the present invention includes a suite of endoscopic surgical instruments designed to work co-operatively with the endoscopic surgical tool. In another embodiment of the present invention, a video-assisted endoscopic surgical tool system is provided. In one embodiment, the system includes the video-assisted endoscopic surgical tool and a suite of at least one endoscopic surgical instrument.

The application discloses a video auxiliary-based text reconstruction model training method and device, which comprises the following steps: training a to-be-trained text model according to all determined training samples, obtaining a trained text model, and judging whether the trained text model converges; wherein, when the to-be-trained text model is trained, the input content of the feature fusion layer included in the to-be-trained text model comprises a text feature vector corresponding to a sample text in any training sample and a video feature vector corresponding to the sample text and generated in advance; and if yes, the trained text model is determined as a text reconstruction model. It can be seen that the text reconstruction model can be trained with the aid of the video feature vector, which is not only beneficial to the user to quickly produce a video text through the text reconstruction model without repeatedly correcting the video text, but also beneficial to improving the matching degree between the generated video text and the video, thereby meeting the production demand of the user for the video text.

This invention relates to the fields of medical auxiliary diagnosis and computer vision technology, specifically to a multimodal video-assisted diagnostic method and system for Parkinson's disease based on Transformer and attention fusion. First, video data of the subject's hand pinching motion and linear back-and-forth walking motion are acquired and a unified sample label is established. Then, video preprocessing is completed through preprocessing, sliding time window segmentation, and data augmentation. Next, the preprocessed temporal image sequence is input into a spatiotemporal modeling network, where a visual Transformer is used to extract frame-level spatial features. A multi-layer long short-term memory network is then combined to capture long-term temporal motion dynamic information. Finally, a modality-level spatiotemporal attention fusion method adaptively learns modality weights and achieves feature fusion. Finally, the fused features are input into a classification network, outputting prediction results for Parkinson's disease patients or healthy controls. This invention comprehensively characterizes the motion features of the disease through multimodal fusion and accurate spatiotemporal modeling, improving diagnostic accuracy and robustness.

An object of a system according to an embodiment is to intuitively assist an elderly person with a video or a sound when the elderly person operates a smartphone.SOLUTION: A system according to an embodiment includes an action pattern learning part, a video assist part, and a voice assist part. The behavior pattern learning unit learns a behavior pattern of the elderly person. The video assist unit assists an operation with a video on the basis of the action pattern learned by the action pattern learning unit. The voice assist unit assists the operation by voice based on the action pattern learned by the action pattern learning unit.SELECTED DRAWING: Figure 1

The present invention relates to a tracheostomy tube obturator inserted into the tracheostomy tube so as to close the tracheostomy tube. According to the tracheostomy tube obturator of the present invention, the tracheostomy tube obturator comprises an endoscope, which is inserted into the tracheostomy tube, has a monitor mounted and fixed to the distal end thereof, has a camera module and a lighting module provided at the proximal end thereof, integrally extends from the monitor and is exposed to the proximal end of the obturator, so that, when the tracheostomy tube is replaced, the monitor stably monitors from the insertion point of the neck to the inside of the trachea so as to prevent the tracheostomy tube from entering a false lumen, and prevents damage to surrounding tissue and blood vessels so that fatal accidents due to complications can be prevented.

The invention discloses a short video auxiliary shooting scoring method based on an AI multi-mode model. The short video auxiliary shooting scoring method comprises the following steps: S10, video acquisition; s20, video analysis: performing multi-dimensional fusion analysis on the standardized video data by adopting a vision-audio-semantic multi-modal fusion analysis algorithm to obtain a multi-dimensional fusion analysis result; s30, score generation: according to a multi-dimensional fusion analysis result, calculating by adopting a dynamic weight adaptive algorithm to obtain a comprehensive score of the to-be-analyzed short video; s40, bright spot identification: extracting index data meeting a quantitative excellent standard from a multi-dimensional fusion analysis result, and identifying and summarizing shooting bright spots of the short video by combining content characteristics of the short video; s50, defect identification is carried out; s60, optimization suggestion generation: on the basis of the identified shooting defects, a targeted overall optimization suggestion is generated in combination with the reservation demand of the shooting bright spots; and S70, outputting a result.

The disclosure relates to an AI-enhanced system for video-assisted medical procedures. It offers enhanced depth perception and real-time anatomical highlighting, integrating AI algorithms with existing medical imaging systems. The system includes continuous learning, broad applicability across various procedures, a user-friendly interface, and cloud-based updates, significantly enhancing medical procedural safety, accuracy, and efficiency.

A method includes identifying one or more surgically-related characteristics and correlating the one or more surgically-related characteristics with a surgical instrument layout stored in a database and based on a surgical procedure to be performed. The surgical instrument layout includes a type and quantity of one or more surgical instruments one or more physical dimensions of the one or more surgical instruments, and orientations of the one or more surgical instruments. The method further includes displaying on a display screen the surgical instrument layout; and projecting the surgical instrument layout onto a surgical table.

Method for inspecting sewer lines, in particular for damage assessment, with a crawler (14) movable in a channel (8) with at least one camera module (30) and a camera control unit (15) for recording at least one first video sequence (4) by the camera module (30), the signals of which can be transmitted via a data transmission device (13), preferably a cable, to an inspection vehicle (1) during the inspection and stored there in a first storage module (28) in the inspection vehicle (1), wherein during the recording of the first, potentially faulty video sequence (4) the camera module (30) records an identical, local second video sequence (5) and stores it in a camera-connected second storage module (18), and that in an evaluation phase following the inspection phase the two video sequences (4, 5) are read out in the inspection vehicle (1) and compared with each other,wherein their quality is assessed visually and / or mechanically, and that, depending on the assessment criterion, either time- or frame-dependent replacement of the first potentially faulty video sequence (4) by parts of the second video sequence (5) takes place in order to provide a video sequence free of interference signals and failures.

The disclosure provides a kind of self-learning method and system based on non-inductive feedback chemical fault diagnosis, by constructing the operation state perception system of multi-source data fusion, in the setting time window, combined with water quality index change trend, control operation log and equipment operation image constructs non-inductive feedback verification model, realizes the automatic verification and correctness discrimination of preliminary diagnosis result;Further, according to the verification result, the weight of the diagnosis rule node is dynamically adjusted, the secondary diagnosis is triggered for the wrong diagnosis, and the alternative rule path is introduced, while the rule base is scanned regularly for frequency and accuracy, and dynamic optimization operations such as node weight attenuation, redundant path compression and new rule structured insertion are implemented;In addition, the multi-cycle fault mode feature distribution weight dynamic adjustment mechanism and video auxiliary multi-modal consistency verification are introduced, so that the system can adapt to high-frequency and high-risk faults, and enhance the identification ability of physical and chemical coupled faults.

A video-assisted networking platform for networking by users that includes: a host network platform server; a host networking platform software installed on the server and configured for access by the users; and video resumes stored on the server, each authored by one of the users and comprising searchable user-authored content in a format specified by the software. The software is configured such that each video resume can be generated and modified by one of the users. Further, the software is configured such that one of the users can evaluate each video resume based at least in part on its searchable user-authored content. In addition, the software is configured such that each of the video resumes can be authenticated by one of the users. Further, the software is configured with a conversion component capable of converting raw user-authored video content into the searchable content.

A system (100) for management of a medical equipment is disclosed A ticketing module (120) receives a ticket via a user interface raised by a first user in response to a failure of the medical equipment. Further, the verification module (130) allows a second user to scan a quick response code embedded on the medical equipment and renders an image of the medical equipment in response to retrieving data of the medical equipment from a database (135). Further, a mapping module (140) maps a workflow with the verified medical equipment using an artificial intelligence model. Furthermore, a processing module (150) guides the second user via the sequence of instructions through a voice-enabled video assistance with respect to the medical equipment. Moreover, the processing module enables the third user to guide the second user in real-time if the medical equipment is not listed in the database thereby resolving the ticket.

This disclosure describes an intra-operative anatomical structure tracking and alerting system for improving surgeon's context awareness during laparoscopic and video-assisted surgeries. During laparoscopic and video-assisted surgeries, a surgeon can mark anatomical structures for the system to track (for example: vessel, nerve, bile duct, triangle of pain in hernia repair, etc.), then continue with the surgery. When the scope moves, such a marked structure may become invisible. The system uses SLAM (Simultaneous Localization and Mapping) to track and recover the precise location of the scope. When the camera moves to an angle where the previously marked structure becomes visible again, the system will redraw the marks to indicate successful tracking of such a structure. Also, if a surgical tool (for example, energy device) comes near the anatomical structure, an alert (for example, sound or visual alert on screen) can be sent to the surgeon for caution.

The invention discloses a tower drum-blade distance measurement and tower sweeping prevention system and method for a wind driven generator. The system adopts millimeter wave radar (optional video assistance) and unit attitude information to perform time synchronization and external parameter calibration, establishes a tower drum curved surface and impeller rotation geometric model, calculates the minimum distance (dmin) and the contact time (TTC) of a blade and a tower drum in real time, and triggers linkage control of sound and light, limited power / limited rotating speed, feathering, emergency shutdown and the like according to a threshold value. The scheme can still stably operate in rainy and foggy days and at night, and is suitable for tower-sweeping-prevention safety control of newly-built and reconstructed units.

The application discloses a direct visual field testing device, and relates to the technical field of testing, which comprises a video auxiliary device and a marker device; the video auxiliary device is provided with a height adjusting mechanism, an angle adjusting mechanism and a holder adjusting mechanism, and realizes three-dimensional positioning of a preset eye point and real-time video acquisition; the marker device is provided with a height adjusting rod, a joint bearing and laser auxiliary positioning, and realizes accurate adjustment and stable positioning of the marker in a testing area; the direct visual field testing device is suitable for accurate measurement of a driver's visual field range, can efficiently collect and record testing data, has the advantages of convenient operation, strong adaptability, high precision and the like, and is widely applied to the fields of vehicle design, driving training and safety research and the like.

The invention relates to a radar flow measurement method based on video assistance. The method comprises the following steps: S1) measuring the vertical distance between the water level radar device and the liquid level by using the water level radar device, and sending the vertical distance value to a visual system with a video acquisition device; s2) acquiring a first water surface flow velocity by using a visual system, and transmitting the first water surface flow velocity to a flow velocity radar device; and S3) a speed measurement interval is set based on the first water surface flow velocity, the flow velocity radar device calculates a Doppler frequency shift interval corresponding to the speed measurement interval, a frequency reflecting the water flow velocity is found in the Doppler frequency shift interval, and the final water surface flow velocity is calculated according to the frequency.

1. The name of the design product: graphical user interface for car video auxiliary of electronic equipment. 2. The use of the design product: for displaying information, running programs, and realizing the graphical user interface of car control audio and video, vehicle panoramic monitoring video, driving obstacle avoidance video, parking auxiliary display and operation. 3. The design points of the design product: the graphical user interface and its interaction process. 4. The picture or photo that best shows the design points: design 1 interface change state figure 1. 5. Design 1 is designated as the basic design. 6. The use of the graphical user interface: in the main view of design 1, click the rightmost video auxiliary icon to enter design 1 interface change state figure 1 and switch to four-quadrant picture mode; in design 1 interface change state figure 1, click the camera icon below to enter design 1 interface change state figure 2 and switch to three-quadrant picture mode with enlarged rear area; in the main view of design 2, click the rightmost video auxiliary icon to enter design 2 interface change state figure 1 and switch to four-quadrant picture mode; in design 2 interface change state figure 1, click the camera icon above to enter design 2 interface change state figure 2 and switch to three-quadrant picture mode with enlarged front area; in the main view of design 3, click the rightmost video auxiliary icon to enter design 3 interface change state figure 1 and switch to four-quadrant picture mode; in design 3 interface change state figure 1, click the camera icon on the right to enter design 3 interface change state figure 2 and switch to three-quadrant picture mode with enlarged right area; in the main view of design 4, click the rightmost video auxiliary icon to enter design 4 interface change state figure 1 and switch to four-quadrant picture mode; in design 4 interface change state figure 1, click the camera icon on the left to enter design 4 interface change state figure 2 and switch to three-quadrant picture mode with enlarged left area. 7. Other notes: The area coated with gray block in each design belongs to the content picture; the content displayed in the area coated with gray block in design 1 interface change state diagram 1 is shown in design 1 usage state reference diagram 1; the content displayed in the area coated with gray block in design 1 interface change state diagram 2 is shown in design 1 usage state reference diagram 2; the content displayed in the area coated with gray block in design 2 interface change state diagram 1 is shown in design 1 usage state reference diagram 1; the content displayed in the area coated with gray block in design 2 interface change state diagram 2 is shown in design 2 usage state reference diagram 3; the content displayed in the area coated with gray block in design 3 interface change state diagram 1 is shown in design 1 usage state reference diagram 1; the content displayed in the area coated with gray block in design 3 interface change state diagram 2 is shown in design 3 usage state reference diagram 4; the content displayed in the area coated with gray block in design 4 interface change state diagram 1 is shown in design 1 usage state reference diagram 1; the content displayed in the area coated with gray block in design 4 interface change state diagram 2 is shown in design 4 usage state reference diagram 5.

This application discloses an operation method for an in-vehicle display system and an in-vehicle display system itself. The operation method includes: the camera hardware interface of the in-vehicle display system receiving video frames from a camera; the camera hardware interface writing the video frames into a hardware buffer and sending a first message to the display hardware unit only through the driver layer, thereby shortening the transmission path of the first message to notify the display hardware unit to read / receive the video frames. The driver layer includes a camera driver and a display driver. This method enables low-latency display of video for driving video assistance functions such as reversing, improving the real-time performance of the in-vehicle display system. This, in turn, enhances driving safety and improves product competitiveness.