16 results about "Video instruction" patented technology

The invention discloses a motion video understanding method and device based on a multi-modal large model, and the method comprises the steps: (1) carrying out the uniform sampling of an inputted motion video, extracting K video frames, and extracting the visual features of each video frame through a visual encoder; (2) mapping the visual features to hidden space dimensions of a large language model through a multi-layer perceptron, and generating mapped visual features; (3) splicing the mapped visual features and the user query into a comprehensive prompt, and inputting a large language model to generate a text response; and (4) adopting a multi-stage training strategy to train the multi-modal large model, wherein the multi-stage training strategy comprises visual language alignment pre-training, video instruction following fine-tuning training and sports knowledge fine-tuning training. According to the method, the key visual information in the video can be effectively extracted, so that the ability of understanding a dynamic complex scene in the motion video is improved, and the time dependency relationship between the video frames is fully utilized, so that the accuracy and efficiency of understanding the motion video are remarkably improved.

The invention relates to the technical field of medical treatment and health information, in particular to a visual interaction-based self-injection success rate evaluation method for elderly diabetics, which comprises the following steps of: constructing an aging-suitable structured video teaching module, presenting an injection process in stages and embedding a standardized question node; a closed loop type Teach-back interaction feedback process is deployed; analyzing the multi-modal behavior data by using a computer vision and natural language processing technology, and extracting key operation parameters and cognitive integrity indexes; establishing a dynamic scoring model, and quantitatively evaluating the self-injection capacity in combination with the link weight and a standard threshold value; and personalized education intervention and post-discharge periodic follow-up visit management are implemented based on an evaluation result. Objective quantification and continuous education of the self-injection skill of the elderly patient are realized, the education effect is improved, and the operation related risk is reduced.

The application discloses an intelligent system capable of realizing individualized makeup teaching and application thereof, and the intelligent system comprises a video library provided with a plurality of classified makeup teaching video items with semantic classification labels, a classified makeup image library composed of a plurality of video frame images from the classified makeup teaching video items in the video library and with corresponding semantic classification labels, a face image acquisition module, a face feature analysis module, an adaptive makeup analysis module, a virtual makeup module and a video teaching module. The application can not only realize customization of individualized makeup, but also ensure that the customized individualized makeup has accurate corresponding teaching videos, and the customized individualized makeup can be effectively implemented, and the customized makeup effect is highly consistent with the learned makeup effect, so that the problem of difference between the actual makeup and the recommended makeup can be avoided, and people can easily and quickly obtain individualized makeup guidance suitable for themselves, and the application has a significant application prospect.

The invention discloses a holographic remote interactive teaching system, and relates to the technical field of teaching systems, and the system comprises an integrated teaching system which comprises a three-dimensional dynamic capturing module, a holographic imaging module, an intelligent interactive processing module and a low-delay communication module. The three-dimensional dynamic capture module is used for collecting three-dimensional holographic data of teachers and students in real time, and the three-dimensional holographic data comprises multi-angle depth images and skeleton joint point data. According to the invention, natural eye contact, body language capture and real-time feedback between teachers and students are realized, a dynamic holographic image with a real space depth is generated, the immersion and interactivity of teaching are effectively improved, the problems of eye contact deficiency and student attention distraction in traditional video teaching are solved, and remote teaching is closer to real classroom experience.

The present application relates to the technical field of video splitting, and particularly relates to a method for English video splitting learning based on a large model. The method acquires teaching text and voice transcription text of a teaching video through ASR and OCR technologies respectively, cuts the text into single sentences, extracts vocabulary and stores it in a difficult vocabulary library, integrates videos in accordance with examination syllabus requirements according to user expected learning level and difficulty quantification indexes, and cuts the video length according to user learning duration requirements; collects user playback records, repetition rates, complete play rates and interactive feedback data, comprehensively evaluates user learning level and video teaching difficulty through a big data model, and dynamically adjusts the video content. The scheme fills the limitations of traditional static splitting methods, effectively reduces knowledge omission and improves learning efficiency through dynamic optimization and personalized customization of teaching content, and provides precise matching teaching resources for learners of different levels, significantly improving learning efficiency.

The application provides a multimodal embodied intelligent robot control method and device, wherein the method comprises: acquiring a current modal instruction, the current modal instruction comprising at least one of a video instruction, a text instruction, a picture instruction and an audio instruction; based on a pre-trained multimodal large model, acquiring a collapsed representation according to the current modal instruction; based on a pre-trained robot imitation learning network, predicting an output target action according to the collapsed representation and a current environment observation; controlling the multimodal embodied intelligent robot to operate according to the target action; wherein the robot imitation learning network is obtained by training and optimizing a training sample set composed of single modal data samples, corresponding environment observation data and real robot actions. The method acquires a collapsed representation by using a pre-trained multimodal large model, and predicts a target action by using the collapsed representation, which avoids the need for multimodal artificial labeled data when training the robot imitation learning network, and can achieve multimodal reasoning effect only by training single modal data, thereby reducing data collection and labeling costs, and improving the reasoning ability of the model.

The application relates to an intelligent online video teaching effect management system which comprises self-adaptive capturing devices, multiple optimization devices, target identifying devices, area storage mechanisms, visual judgment mechanisms and warning triggering mechanisms. The intelligent online video teaching effect management system is compact in structure and simple in operation.

1. The name of the design product: microphone (TT60). 2. The use of the design product: wireless microphone for occasions such as live network, video shooting, program interview, interview recording, video teaching, network meeting, e-sports game, etc. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view.

1. The name of the design product: dance teaching machine. 2. The use of the design product: for dance video teaching. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view 1.

This application discloses an information processing method and apparatus based on interactive commands in an interactive product. Using the method of this application, when the first intent information corresponding to the first interactive video input by the current user does not match the node identifier of at least one candidate plot node, a first prompt message is output to receive a confirmation or denial command input for the first intent information, thus confirming whether the first intent information is correct. This helps improve the user's logical thinking and language expression abilities. When a denial command is received for the first intent information, a second prompt message including the trigger identifier of each of the at least one candidate plot node is output, thereby entering the interactive video teaching process to output the corresponding interactive teaching video to the user. This allows the user to learn and consolidate operational knowledge of interactive commands during the interaction process, which helps improve the user's interactive ability, learning ability, and proactive thinking ability.

A system and method for multi-media instruction authoring is disclosed. The multi-media instruction authoring system and method provide a unified and efficient system that supports the simultaneous creation of instructional media in AR, VR, and video-based media formats by subject matter experts. The multi-media instruction authoring system and method require only a single demonstration of the task by the subject matter expert and does not require any technical expertise of the subject matter expert. The multi-media instruction authoring system and method incorporate a 3D editing interface for free hand, in-headset interaction to create 2D videos from 3D recordings, by exploring novel virtual camera interactions.

1. Name of the product in this design: Microphone (TT40). 2. Application of this design: Microphone for use in online live streaming, video shooting, program interviews, interview recording, video teaching, online meetings, e-sports games, and other occasions. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: a 3D model.

The invention provides a teaching method and device, electronic equipment and a storage medium. The method comprises the steps of collecting a target image of teaching materials; arranging a corresponding teaching audio and video according to the target image; in the teaching audio and video playing process, determining a first position of the current teaching content in the teaching material; and controlling the signal generator to emit the optical signal to the first position. Therefore, according to the scheme, teaching audio and video generation can be carried out on teaching materials in different formats, and the generality of teaching audio and video generation is improved. In the teaching audio and video playing process, the optical signal is transmitted to the first position of the teaching content in the teaching material, so that the teaching intuition is enhanced, and the learning effect is improved.

The vacuum cleaner includes: a vacuum motor configured to draw an airflow through an airflow path of the vacuum cleaner; a dirt separator having a dirt container; a display screen; and a controller configured to control an image displayed on the screen. The dirt container has a closed configuration in which the dirt container can receive dirt separated from the airflow, and an open configuration in which dirt contained therein can be emptied from the dirt container. The controller is configured to display video instructions on the screen.

The invention relates to an interactive teaching method and system, computer equipment and a storage medium, and the interactive teaching method comprises the steps: monitoring a level signal of a photoelectric sensor array on a tool wall in real time, generating a jump edge in response to the level signal of the photoelectric sensor array, and displaying the jump edge on the tool wall; determining a target tool or a target measuring tool according to the jump edge of the level signal; determining a target video corresponding to the target tool or the target measuring tool from video resources according to the target tool or the target measuring tool; and playing the target video and prompting the operation information of the target tool or the target measuring tool through the target video, thereby realizing video teaching and interactive teaching of taking and placing the tool from the tool wall by a user, and improving cognitive competence and learning effect of students.