Method for appearing corresponding learning video in click mode

Abstract

The invention relates to a method for generating a corresponding learning video in a click mode, belongs to the technical field of computer graphics and digital medical treatment, and particularly relates to a learning method and system based on an interactive 3D model. The method comprises the following steps: providing a human body 3D model with a click interaction area; in response to a click operation of a user on a specific part area, displaying a disease option associated with the area; displaying a detail interface containing disease detailed information and a treatment scheme video link according to the selection of the user for the target disease; and finally, responding to link triggering, and playing a corresponding video. According to the system, through accurate collision detection, structured knowledge mapping and modular design, an automatic and coherent process from three-dimensional space positioning to disease knowledge acquisition and then to practical operation video calling is realized.

Description

Technical Field

[0001] This invention relates to the fields of computer graphics and digital medical technology, specifically a method for displaying corresponding learning videos via click. Background Technology

[0002] In medical education, clinical training, and patient outreach, learning about human anatomy and disease-related knowledge is crucial. Traditional teaching methods rely heavily on two-dimensional atlases, textual textbooks, or physical specimens, which suffer from drawbacks such as lack of intuitiveness, poor interactivity, and the inability to dynamically demonstrate the correlation between diseases and treatment plans. While 3D visualization models are increasingly used with the advancement of computer technology, existing 3D anatomy modeling software is largely limited in function, either solely for displaying anatomical structures or providing fixed video playlists. It fails to achieve a deep, intelligent, and seamless connection between specific three-dimensional human body parts, their potential diseases, detailed diagnostic and treatment information for those diseases, and the most practically valuable treatment video tutorials. Learners struggle to efficiently complete the coherent cognitive loop from "recognizing body parts" to "understanding diseases" and then to "learning treatment plans" through a unified and intuitive interactive interface.

[0003] Therefore, there is an urgent need for a method that can use a high-precision 3D human body model as the core of interaction, and guide users to acquire systematic learning content that is precisely matched with their interests through natural click operations, especially the final treatment operation video, thereby greatly improving learning efficiency and immersion. Summary of the Invention

[0004] To address the problems of existing technologies, this invention provides a method for displaying corresponding learning videos via click.

[0005] To solve the above-mentioned technical problems, the present invention is achieved through the following technical solution: Firstly, a method for displaying corresponding learning videos via click, comprising the following steps: S1: Provides a 3D visualization model of a human body part, with one or more interactive part areas pre-defined on the 3D model; S2: In response to the user's selection of any area, display one or more disease options associated with the selected area; S3: In response to the user's confirmation and identification of any target disease in the disease options, display a detailed information interface for the target disease. The detailed information interface shall at least include an access link to a learning video of the treatment plan corresponding to the target disease. S4: In response to the triggering action of the access link, jump to and play the corresponding treatment plan learning video.

[0006] In one specific embodiment of the first aspect, in step S1, the 3D visualization model is capable of switching between displaying different anatomical structure layers, which include at least one or more of the epidermal layer, muscle layer, and bone layer.

[0007] In one specific embodiment of the first aspect, the region includes at least one of the head, shoulder, chest, arm, waist, thigh, calf and foot.

[0008] In one specific implementation of the first aspect, in step S2, one or more disease options associated with the selected site area are displayed, specifically by displaying the disease names in a list format next to the interface of the 3D model or in a floating window.

[0009] In one specific implementation of the first aspect, the access link is presented in the form of a graphical button in the details interface.

[0010] Secondly, a click-based system for displaying corresponding learning videos includes: The model display module is used to display a 3D visualization model of a human body part. The 3D model has one or more preset interactive part areas. The interactive response module is used to respond to the user's selection of a part area and trigger the information display module; The information display module is used to display disease options associated with the selected area, and further, in response to the user's confirmation of the target disease, to display detailed disease information including links to access videos for learning treatment plans; The video redirection module is used to respond to the triggering operation of the access link, call or redirect to the video playback interface to play the corresponding learning video.

[0011] In one specific implementation of the second aspect, the model display module further includes a layer control unit for controlling the 3D visualization model to switch between displaying the outer skin layer, muscle layer, or bone layer.

[0012] Thirdly, a computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the method.

[0013] Fourthly, a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the steps of a method.

[0014] The beneficial effects of this invention are as follows: 1. This invention constructs a progressive learning process that conforms to cognitive logic by dynamically linking an interactive 3D human body model, a structured disease knowledge base, and video resources. Its technical solution automates the entire process from spatial location selection to disease information filtering, detailed content retrieval, and video resource triggering. This process integrates the traditionally separate anatomical structure display, disease text description, and operational video demonstration into a single interactive context. Through precise collision detection and data mapping, it ensures the accuracy and consistency of information retrieval, effectively reducing the cognitive load and operational steps required for users to switch between multiple independent modules or interfaces.

[0015] 2. The modular design of this invention decouples the data layer, logic layer, and presentation layer. Model data, location-disease mapping relationships, disease detail text, and video resources can all be maintained and updated independently, improving the system's maintainability and scalability. Furthermore, by binding abstract disease concepts with specific three-dimensional geometric locations and concrete video tutorials, a stable and reusable knowledge representation and retrieval method is established, providing an efficient and standardized information organization and interaction paradigm for digital medical education tools. Attached Figure Description

[0016] Figure 1 This is a schematic diagram of the system framework of the present invention.

[0017] Figure 2 This is a schematic diagram of the method flow of the present invention.

[0018] Figure 3 This is a schematic diagram of the diagnostic page of the present invention.

[0019] Figure 4 This is a schematic diagram of the second diagnostic page of the present invention. Detailed Implementation

[0020] The technical solutions of the present invention will be clearly and completely described below with reference to the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0021] like Figures 1 to 4 This illustrates a method for displaying corresponding learning videos through a click-based interface.

[0022] Example 1: System Overall Architecture and Data Flow The system of this invention is typically deployed in a server / client architecture, but can also be integrated into a standalone application. The system mainly includes the following logical modules and a database: Model data and rendering engine module: Responsible for storing, loading, and rendering 3D models. Its core includes: Model Database: Stores multiple 3D human body mesh models, including at least: a basic skin model, a muscle system model (usually presented as a semi-transparent or color-separated mesh), and a skeletal system model. Each model file contains vertex data, normal data, texture coordinates, and material information. Models must be prefabricated and calibrated according to standard anatomical poses.

[0023] Region definition data: This is a key data structure that defines interactive regions on the model. It is typically implemented using "collision volume meshes" or "UV map region markers." For example, it defines corresponding 3D spatial regions or model surface texture coordinate regions for precisely anatomically defined regions such as "right supraspinatus muscle," "left femur," and "thoracic vertebrae T5-T8." Each region is associated with a unique region ID (e.g., region_shoulder_R_supraspinatus).

[0024] Rendering engine: Developed based on graphics APIs such as WebGL (e.g., Three.js), OpenGL, or DirectX. It loads models from the model database and determines which model(s) to render based on user instructions (e.g., switching layers) (e.g., rendering translucent muscles and the underlying skeleton simultaneously). Simultaneously, it receives input from the interaction module and performs ray collision detection to determine which area the user clicked.

[0025] Medical Knowledge Base Module: Stores all structured information related to location and disease.

[0026] Location-Disease Relationship Database: A mapping table that associates a location ID with one or more disease IDs. For example, region_shoulder_R_supraspinatus might be associated with disease_rotator_cuff_tear, disease_shoulder_impingement, etc.

[0027] Disease Details Database: Stores detailed information corresponding to each disease ID. Each record includes, but is not limited to, the following fields: disease name, disease overview (definition, epidemiology), etiology and pathology, clinical manifestations, examination procedures (such as "MRI examination", "Neer's sign on physical examination"), diagnostic criteria, treatment principles (conservative treatment, surgical treatment), prognosis, etc.

[0028] Treatment Video Resource Library: Stores or indexes video tutorials for treatment protocols. Each video is associated with a unique video ID and at least one or more disease IDs. Video content may include: demonstrations of rehabilitation training movements, surgical procedure animations, physical examination techniques, brace fitting methods, etc. Videos can be stored locally or linked to and hosted on third-party platforms (such as professional medical video websites).

[0029] Interaction and Logic Control Module: The central hub of the system, handling all user interactions and coordinating the work of various modules.

[0030] The UI management unit manages the creation, updating, and destruction of the graphical user interface (GUI). This includes the layout and rendering of elements such as the 3D view area, 2D control panels, floating windows, and buttons.

[0031] Event handling and logic control unit: This is the "brain" of the invention. It listens for click events from the rendering engine (including the hit part ID), queries the knowledge base module, controls the content displayed by the information display module, and processes click events of interface buttons to trigger video transitions. It maintains the current state of the application (such as the currently selected part, the currently selected disease, the currently displayed layer, etc.).

[0032] Information display module: responsible for presenting text and multimedia information to users in a user-friendly format.

[0033] Text and Multimedia Rendering Unit: Renders text, images, and other content from the disease details database onto specific areas of the interface.

[0034] Video Player Component: An embedded or external video player used to play videos from the treatment video resource library directly within the application interface or by calling the system's default player after the user triggers the link.

[0035] Data flow and logical closed loop: When a user launches the application, the system operates according to the following rigorous process: Step A (Initialization): The rendering engine loads the default display model (such as a muscle layer model) from the model database and combines it with the part region definition data to make the model interactive. The UI management unit draws the complete main interface, including the 3D view area, back button, layer control buttons, etc.

[0036] Step B (Interaction Triggered): The user clicks in the 3D view area. The rendering engine calculates the intersection point through ray casting, queries the part region definition data, obtains the precise part ID, and sends the part ID to the event handling and logic control unit.

[0037] Step C (Logic Processing and Data Query): After receiving the part ID, the event processing and logic control unit immediately queries the part-disease relationship database to obtain a list of disease IDs and their names related to that part.

[0038] Step D (Primary Information Presentation): The logic control unit instructs the UI management unit to render and display the list of disease names obtained in Step C on the side of the interface or in a pop-up floating window.

[0039] Step E (Deep Information Request): The user selects (clicks) a disease from the list. The logic control unit records this disease ID and simultaneously queries the disease details database and treatment video resource library to obtain the complete text details of the disease and the associated video ID (or video URL).

[0040] Step F (Detailed Information and Video Entry Presentation): The logic control unit instruction information display module renders the complete set of text information about the disease in the detailed information area of ​​the interface, and generates a visual button pointing to the video ID, such as "Rotary Cuff Injury Rehabilitation Training Video".

[0041] Step G (Final Learning Content Delivery): The user clicks the video button. The logic control unit captures this click event, retrieves the video resource address from the treatment video resource library based on the video ID, and instructs the video player component to load and play the video. At this point, a complete and seamless learning loop is formed, from "spatial location (3D click)" to "conceptual cognition (disease)" to "theoretical knowledge (details)" and finally to "practical skills (video)". Throughout the process, the user does not need to leave the current application or navigate through complex menus; all operations are completed coherently within the same interface centered on the 3D model.

[0042] Example 2: Detailed technical implementation of 3D models, interactions, and layer switching 1. 3D Model Construction and Loading: Model data originates from high-precision human body scan data or the results of professional anatomical modeling software (such as ZBrush, Maya). Model file formats can be glTF, FBX, OBJ, etc. During system initialization, the rendering engine asynchronously loads three core model files: skin_model.glb (outer skin model); muscles_model.glb (muscle model); skeleton_model.glb (skeleton model); after loading, place them at the same origin in the scene to ensure spatial alignment. By default, the muscle model is visible, while the skin and bone model are invisible.

[0043] 2. Definition of Interactive Areas: This is crucial for achieving precise clicks. We employ an "auxiliary collision mesh" technique. For each detailed area requiring interaction (such as the "supraspinatus muscle," "humeral head," or "L4 / L5 intervertebral disc"), artists or technicians need to create a simplified low-polygon mesh containing only the shape of that area. This mesh is invisible but is used for physical collision detection.

[0044] Data structure: Each auxiliary collider mesh is associated with a data object: javascript { regionId: “region_shoulder_R_supraspinatus”, / / Unique part ID mesh: (THREE.Mesh Object), / / The corresponding Three.js mesh object displayName: "Right supraspinatus muscle", / / Display name parentRegion: “region_shoulder_R” / / Parent region, used for organization. Initialization: All region objects are loaded and added to an invisible layer in the scene (or their material.visible = false), but they participate in the ray intersection test.

[0045] 3. Click interaction detection: When the user clicks on the 3D canvas (triggers a mousedown or click event), the UI management unit obtains the mouse's screen coordinates (x, y).

[0046] Raycasting: The event handling and logic control unit calls the raycasting function of the rendering engine. This function emits a ray from the camera position across screen coordinates (x, y) into the 3D scene.

[0047] Collision detection: The ray is tested for intersection with all visible and invisible region meshes in the scene. Because the region meshes are simplified, the test is very fast.

[0048] Hit determination: The intersection test returns an array of intersecting objects sorted by distance. The logic control unit selects the first intersecting object (closest to the camera) and reads its regionId from its userData property. At this point, the system accurately identifies the anatomical location the user intends to click.

[0049] Technical details: To avoid accidental clicks and improve performance, certain small or densely packed areas (such as small bones in the wrist) can be merged, or a click threshold can be set, requiring the ray to make an angle with the normal of the model surface within a certain range to simulate a "frontal click".

[0050] 4. Switching between layers (anatomical structure layer): The "skin," "muscle," and "skeleton" buttons (or radio button groups) on the interface are created by the UI management unit. These buttons are bound to specific functions of the event handling and logic control unit.

[0051] State management: The logic control unit maintains a state variable currentLayer, which can take the values ​​['skin', 'muscles', 'skeleton'].

[0052] Switching logic: When the user clicks the "Skeleton" button, an event is triggered. The logic control unit sets the currentLayer to 'skeleton' and then sends a command to the rendering engine: javascript / / pseudocode setLayerVisibility('skin', false); setLayerVisibility('muscles', false); setLayerVisibility('skeleton', true); Rendering Feedback: After receiving the instruction, the rendering engine updates the visible property of the corresponding model mesh and redraws the scene. The user immediately sees the switch from muscle view to skeleton view. During this process, the region collider mesh used for interaction remains present and effective, unaffected by the switching of visible layers, ensuring that clicking on the same spatial location will trigger the same body part ID regardless of the anatomical view.

[0053] Example 3: Detailed Technical Implementation of Disease Information Association and Display 1. Mapping and display of body parts to diseases: After the event handling and logic control unit obtains the regionId (such as region_shoulder_R_supraspinatus), it performs the following operations: Data Query: Send a query request to the medical knowledge base module: SELECT diseaseId, diseaseName FROM region_disease_mapping WHERE regionId = ?. The database returns a result set, for example: [('disease_rc_tear', 'rotator cuff tear'), ('disease_impingement', 'subacromial impingement syndrome')].

[0054] UI Generation: The logic control unit passes the result set to the UI management unit and instructs it to generate a floating selection panel. The UI management unit dynamically creates a set of list items ( (Elements or buttons), each item's text content is the name of the disease.

[0055] Technical details: To optimize the user experience, the pop-up position of the panel can be dynamically calculated based on the screen coordinates of the click, avoiding obscuring key areas. The panel should have a semi-transparent background and a clearly defined close button.

[0056] Interaction binding: Bind a click event listener to each list item. When the user clicks "rotator cuff tear", the listener is triggered, and the corresponding diseaseId ('disease_rc_tear') is sent back to the logic control unit.

[0057] 2. Acquisition and display of detailed disease information: After obtaining the diseaseId, the logic control unit enters the deep information acquisition stage.

[0058] Parallel queries: Initiating two queries simultaneously: To query the disease details database: `SELECT * FROM disease_details WHERE diseaseId = ?`. This retrieves the complete disease details object `diseaseDetail`.

[0059] To query the treatment video resource library: SELECT videoId, videoTitle, videoUrl FROM treatment_videos WHERE diseaseId = ?. This may retrieve multiple videos, such as one about "diagnosis" and another about "rehabilitation training".

[0060] Interface Layout and Rendering: After receiving instructions and the diseaseDetail data object from the logic control unit, the UI management unit is responsible for rendering the detailed information interface of the diagram. This interface is typically a panel fixed to the side or bottom, containing: Disease title area: Displays diseaseDetail.name.

[0061] Tabs or scrollable areas: Used to organize large amounts of text information. For example, they can be divided into tabs such as "Overview," "Diagnosis," and "Treatment." The text rendering unit of the information display module populates the content of each field in diseaseDetail into the corresponding HTML elements.

[0062] Video Links Section: This is crucial. For each retrieved video, dynamically generate a prominent button (such as a button with a play icon). The button text can use the videoTitle (e.g., "Rotten Cuff Injury Muscle Strength Test Video"). The button's onClick event is bound to a function that receives either the videoId or videoUrl as a parameter.

[0063] State integrity: At this point, the application's internal state is complete and self-consistent: currentRegionId, currentDiseaseId, currentDiseaseDetail, and relatedVideos. All subsequent operations are based on this state.

[0064] Example 4: Detailed Technical Implementation of Video Triggering and Playback When a user clicks a video button on the interface, such as "Rotac cuff injury related videos," the following process is activated: Event capture: The button click event is captured by the UI management unit and the videoId (e.g., video_rehab_rc_1) is passed to the event handling and logic control unit.

[0065] Resource resolution: The logic control unit requests the final playback address from the treatment video resource library based on the videoId. This could be a relative path (' / videos / rehab_rc_1.mp4'), a streaming protocol address ('rtmp: / / server / ...'), or a third-party platform embed link ('https: / / vimeo.com / embed / xxxxx').

[0066] Playback Decision and Execution: Decision-making: The logic control unit determines the playback method based on the video address type and system configuration. Common methods include: Embedded playback: The instruction UI management unit dynamically creates a modal window or expands a panel area within the current application interface. Then, the video player component of the instruction information display module initializes and loads the video address. The video player component can be an HTML5-based... <video>The tag encapsulation control, or the integration of player kernels such as VLC.

[0067] External redirection: If the video is a third-party link, the logic control unit will open the link in a new tab or browser by calling the interface via window.open(url, '_blank') (in a web environment) or the system browser.

[0068] Execution: The video player component begins buffering and playing the video. The user enters the video learning phase.

[0069] Context preservation: During video playback, the main application interface (3D model, disease information) should remain visible or be easily accessible so that users can refer to relevant anatomical locations and disease text descriptions at any time while watching the video, thus enhancing the learning effect.

[0070] Example 5: Complete User Operation Flow Example The following describes the complete and unbroken logical chain of this invention using a specific user scenario: Launch: The user opens the "Medical Anatomy Learning System" application. The system initializes, displaying a 3D human body model with muscle layers, and layer control buttons are located on the right.

[0071] Exploration: The user is interested in the shoulder structure and clicks on the right shoulder area of ​​the 3D model. (Triggers interaction detection in Example 2) Location: The system uses ray detection to accurately identify that the user clicked on the "right supraspinatus muscle" area (regionId determined).

[0072] Guided selection: The system immediately pops up a floating panel next to the interface, listing diseases related to this area: "rotator cuff tear" and "subacromial impingement syndrome". (Complete the first step of Example 3) Confirm direction: If the user wants to learn about "rotator cuff tear", click this option.

[0073] In-depth learning: The right panel of the system refreshes, displaying detailed text information on the causes, symptoms, examination methods (such as MRI imaging characteristics), and treatment principles of "rotator cuff tear." Simultaneously, two video buttons appear at the bottom of the panel: "Rotator Cuff Injury Diagnosis and Manipulation Video" and "Rotator Cuff Post-operative Rehabilitation Training Video." (Complete step two of Example 3) Skill acquisition: The user clicks on "Rotac cuff surgery rehabilitation training video". (Triggered Example 4) Practical Observation: The system will pop up a player in the current window and begin playing a professional rehabilitation therapist's demonstration of rehabilitation training exercises for various stages after rotator cuff injury surgery. The video may include multi-angle, slow-motion explanations.

[0074] Closed loop and reflection: When watching the video, users can pause at any time to review the text description on the right, or observe the origin, insertion and direction of the rotator cuff muscles in the 3D model, thereby gaining a deeper understanding of the anatomical principles and target muscle groups of each training movement.

[0075] The entire process, from visual positioning (3D model) to concept selection (disease list), to theoretical learning (text details), and then to practical observation (video tutorials), is natural and smooth at every step, with tight logical connections and no redundant steps or context breaks, achieving efficient and immersive self-directed learning.

[0076] Example 6: Computer Equipment Example The present invention can also be implemented as a computer device. This device includes, but is not limited to, at least one processor, at least one memory, an input / output interface, and a communication bus.

[0077] The processor, memory, and I / O interface communicate with each other through a communication bus.

[0078] The processor is used to execute computer program instructions stored in memory to implement the method steps of any of the above embodiments.

[0079] The memory may include high-speed random access memory (RAM) or non-volatile memory (NVM), such as disk storage. The memory stores the operating system and computer program instructions. The operating system may be Windows, Linux, macOS, etc. The computer program instructions contain program code that implements all the steps of the method of this invention.

[0080] I / O interfaces are used to receive user input (such as mouse and touch screen click signals) and output display (such as rendering 3D models and UI interfaces to the display).

[0081] When the device is a mobile terminal or a standalone workstation, all modules and databases can be integrated locally. When the device is a client, the rendering engine, interaction module, and display module may be located locally, while the model database and medical knowledge base may be located on a remote server, communicating data through the network interface in the I / O interface.

[0082] Example 7: Example of a computer-readable storage medium The present invention also relates to a computer-readable storage medium having a computer program stored thereon. When executed by a processor, the program implements the method steps as described in any of the above embodiments. The storage medium can be any tangible medium that contains or stores a program, such as ROM / RAM, magnetic disk, optical disk, USB flash drive, etc.

[0083] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.< / video>

Claims

1. A method for displaying corresponding learning videos via click, characterized in that, Includes the following steps: S1: Provide a 3D visualization model of a human body part, wherein one or more interactive part areas are preset on the 3D model; S2: In response to the user's selection of any of the said site areas, display one or more disease options associated with the selected site area; S3: In response to the user's confirmation and identification operation for any target disease in the disease options, display a detailed information interface for the target disease, the detailed information interface including at least an access link to a learning video of the treatment plan corresponding to the target disease; S4: In response to the triggering operation of the access link, jump to and play the corresponding treatment plan learning video.

2. The method according to claim 1, characterized in that, In step S1, the 3D visualization model can switch to display different anatomical structure layers, which include at least one or more of the epidermal layer, muscle layer, and bone layer.

3. The method according to claim 1, characterized in that, The area includes at least one of the following: head, shoulder, chest, arm, waist, thigh, calf, and foot.

4. The method according to claim 1, characterized in that, In step S2, displaying one or more disease options associated with the selected region specifically involves displaying disease names in a list format next to the interface of the 3D model or in a floating window.

5. The method according to claim 1, characterized in that, The access link is presented as a graphical button in the details interface.

6. A system for displaying corresponding learning videos via click, characterized in that, include: The model display module is used to display a 3D visualization model of a human body part, and the 3D model has one or more interactive part areas preset on it. An interactive response module is used to respond to the user's selection operation on the area and trigger the information display module; The information display module is used to display disease options associated with the selected area, and further, in response to the user's confirmation of the target disease, to display detailed disease information including links to access videos for learning treatment plans; The video redirection module is used to respond to the triggering operation of the access link, call or redirect to the video playback interface to play the corresponding learning video.

7. The system according to claim 6, characterized in that, The model display module also includes a layer control unit, which controls the 3D visualization model to switch between displaying the outer skin layer, muscle layer, or bone layer.

8. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the method as described in any one of claims 1 to 5.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the method as described in any one of claims 1 to 5.

Images