An immersive interaction device and implementation method based on four-dimensional image encoding and literary shot composition

Abstract

The application provides an immersive interaction device based on four-dimensional image coding and literary split screen and an implementation method, and belongs to the technical field of immersive interaction. The immersive interaction device based on four-dimensional image coding and literary split screen comprises a main control processing module, a text analysis and storage module, a three-dimensional imaging rendering module, a multi-dimensional sensing interaction module and a synchronous effective output module. The main control processing module is bidirectionally electrically connected with the text analysis and storage module, the three-dimensional imaging rendering module, the multi-dimensional sensing interaction module and the synchronous effective output module through PCB wiring. The four-dimensional image coding algorithm, the text-driven split screen algorithm and the three-level space triggering mechanism are combined, so that the automatic matching accuracy of the text image is high, the artificial subjective configuration is completely eliminated, the interaction triggering response delay is low, the audio-visual synchronization error is small, the single literary scene is automatically generated with a short time length, artificial modeling is not needed, the three-level space triggering logic hardware recognition precision is high and the error is low.

Description

Technical Field

[0001] This invention belongs to the field of immersive interactive technology, specifically an immersive interactive device and implementation method based on four-dimensional image encoding and literary storyboarding. Background Technology

[0002] Existing immersive literature teaching VR / AR products suffer from three unsolvable technical defects, which are also the core breakthroughs of this invention: 1. No machine-automated analysis capability: The existing scenes are all manually modeled and manually matched with shots. There is no technical logic for automatically deconstructing text into imagery and automatically generating scenes. It belongs to manual graphic design and is not a technical solution.

[0003] 2. General camera logic without specific rules: General VR roaming is fixed-track roaming, which cannot dynamically change the camera speed, camera position height, and lens focal length according to the length of literary sentences, pauses, emotional weight, and narrative rhythm. There is no literature-specific camera scheduling algorithm.

[0004] 3. Interactive triggering lacks hierarchy and hardware linkage: Existing devices simply click on pop-ups, lacking spatial distance-based hierarchical triggering mechanisms and hardware sensors that bind to literary content, resulting in a disconnect between software and hardware.

[0005] 4. Lack of standardized mass-production hardware structure: The devices on the market are all general-purpose VR all-in-one machines, without a modular assembly structure specifically designed for literature teaching, and lack the dual barriers of utility model structural innovation and invention method innovation.

[0006] Therefore, this invention proposes an immersive interactive device and implementation method based on four-dimensional image encoding and literary storyboarding to make up for and improve the shortcomings of the prior art. Summary of the Invention

[0007] To overcome the shortcomings of existing technologies, this invention proposes an immersive interactive device and its implementation method based on four-dimensional image encoding and literary storyboarding.

[0008] To achieve the above objectives, the present invention employs the following technical solution: An immersive interactive device based on four-dimensional image encoding and literary storyboarding includes a main control processing module, a text parsing and storage module, a three-dimensional imaging rendering module, a multi-dimensional sensing interaction module, and a synchronous output module. The main control processing module is bidirectionally electrically connected to the text parsing and storage module, the three-dimensional imaging rendering module, the multi-dimensional sensing interaction module, and the synchronous output module via PCB cables to form a closed-loop hardware control system.

[0009] Preferably, the main control processing module is equipped with an ARM core processor, flash memory storage chips, and timing control circuitry; it is responsible for receiving all sensor signals, running encoding algorithms, outputting video and audio commands, and synchronizing the timing of all modules.

[0010] Preferably, the text parsing and storage module has a built-in solid-state storage hard drive containing a fixed four-dimensional image encoding database and a storyboard template library; it also has a built-in text preprocessing program firmware that independently completes text segmentation, score calculation, and encoding output without relying on the cloud.

[0011] Preferably, the 3D imaging rendering module includes a high-definition LCD display unit, a backlight driving circuit, and a frame rate synchronization chip; it receives main control commands, renders 3D scenes in real time according to the storyboard track parameters, and outputs a fixed frame rate of 60fps with a response delay of ≤0.3s.

[0012] Preferably, the multi-dimensional sensing and interaction module integrates an infrared ranging sensor, a capacitive touch sensor, and a posture gyroscope; it collects user spatial distance, touch action, and viewing angle offset data in real time, and uploads electrical signals to the main control module at a frequency of 10ms.

[0013] Preferably, the synchronous sound output module has a built-in power amplifier circuit, a full-range speaker, and an audio decoding chip; it can accurately synchronize the broadcast according to the shot frame number and spatial distance signal, with an audio-visual synchronization error of ≤0.1s.

[0014] As a preferred embodiment, a method using an immersive interactive device based on four-dimensional image encoding and literary storyboarding is characterized by comprising the following steps: Step 1: Text Firmware Preprocessing and Four-Dimensional Encoding Quantization Calculation After the device is powered on, the main control module calls the built-in firmware of the storage module to perform mechanical word segmentation on the input literary text; calculates the four-dimensional scores of S / T / P / E respectively, converts the natural language into a four-dimensional numerical code array, and outputs structured scene parameter instructions; Step 2: Storyboard Template Matching and Lens Track Parameter Generation The system retrieves the corresponding storyboard template library based on the text genre (quatrain / regulated poem / classical prose / travelogue); based on the four-dimensional encoding score, it automatically calculates: the starting camera position coordinates, camera movement speed, lens focal length parameters, and scene transition timestamps, generating a standardized shot track file that can be recognized by the rendering engine; Step 3: Adaptive Rendering of 3D Scene Parameters The rendering module receives the camera track file and image encoding parameters, automatically matches the scene model, lighting parameters, weather effects, and color parameters; it fixes the number of modeling faces and texture accuracy to complete the lightweight scene construction. The entire process is executed automatically without the need for manual modeling and debugging. Step 4: Frame-level audio-visual content pinpoint binding The system uses the storyboard timestamp as an anchor point to accurately bind the audio reading, explanatory text, and allusion subtitles to the corresponding shot frame, so that wherever the camera moves, wherever the scene cuts, the knowledge points are output synchronously there; Step 5: Real-time spatial detection and signal transmission using hardware sensors The device's infrared sensor continuously detects the physical distance between the user and the screen, the gyroscope detects the viewing angle shift, and the touch sensor detects touch signals; the physical distance signal and action signal are converted into electrical signals and transmitted back to the main control unit in real time. Step Six: Three-level hierarchical trigger logic hardware response The main control module performs a graded determination based on the returned distance electrical signal: Detection distance 80-120cm, execute far-area trigger: output full background audio and display of distant static scene; Detection distance 30-80cm, triggering the middle zone: activate scene dynamic effects and paragraph appreciation audio; When a touch signal is detected at a detection distance of 0-30cm, a near-field trigger is executed: pop up word definitions and highlight text annotations; Step 7: Real-time timing synchronization and closed-loop parameter correction The device records trigger response delay, audio-visual synchronization error, and encoding matching deviation throughout the process, and automatically fine-tunes the next round of scene splitting speed and sensor judgment threshold, forming an adaptive optimization closed loop of hardware and algorithm.

[0015] Preferably, in step one, a machine-readable four-dimensional structured coding library is established, rather than being manually interpreted: Four dimensions: scenery dimension S, time sequence dimension T, people dimension P, and emotion dimension E; Each line of classical Chinese text / poem is segmented and scored by machine (0-100 quantization threshold): - Scenery S: mountains, water, wind, moon, forest, boat, pavilion, steps (matching threshold ≥ 60 triggers scene modeling); - Time sequence T: Morning, Dusk, Autumn, Winter, Night, Sunny, Rainy (triggers scene lighting parameter switching); - Character P: Alone, Guest, Returning, Gazing, Traveling, Drinking (triggers virtual character motion skeletal animation); - Emotion E: Sadness, Expansion, Loneliness, Joy (triggering lens tension parameters, hue saturation parameters); Technical rules: The system uses "single sentence text" as the smallest unit and outputs a four-dimensional encoded array, which serves as the sole driving source for subsequent modeling, storyboarding, and interaction. The entire process is automated and requires no human intervention.

[0016] As a preferred approach, in step two, a unique mathematical mapping relationship for storyboards is designed specifically for literary texts, completely differentiating it from the fixed camera angles of general VR: 1) Sentence length → camera movement speed mapping: short sentences are quickly zoomed in, long sentences are slowly zoomed out; 2) Emotional score E → Lens focal length mapping: High-scoring emotional shots are focused on close-ups, while low-scoring shots are laid out in the distance; 3) Timing label T → Light and shadow frame rate mapping: Reduce color temperature for twilight scenes, reduce exposure for night scenes, and increase brightness for clear scenes; 4) Paragraph structure → Shot sequence template: The four-segment structure of the quatrain corresponds to a fixed shot loop of "long-medium-close-extreme"; Results: Input any classical Chinese poem or text, and the machine will automatically output a unique set of renderable storyboard files, without the need for manual camera adjustments.

[0017] Preferably, in step six, a binding rule between physical space and literary content is established based on hardware infrared ranging and touch sensing: - Distant area (80-120cm): Visual level, triggers background information and author biography audio; - Middle zone (30-80cm): Roaming level, triggering paragraph interpretation and scene dynamic effects; - Near zone (0-30cm): Touch level triggers single-word annotation, word meaning analysis, and detail pop-up.

[0018] Compared with the prior art, the beneficial effects of the present invention are as follows: This invention combines a four-dimensional imagery encoding algorithm, a text-driven scene-sharing algorithm, and a three-level spatial triggering mechanism to achieve high accuracy in automatic text imagery matching, completely eliminating the need for manual subjective configuration, low latency in interactive trigger response, small audio-visual synchronization error, and short automatic generation time for a single literary scene, eliminating the need for manual modeling. The three-level spatial triggering logic has high hardware recognition accuracy and low error, can adapt to all classical poems and narrative texts, has strong universality and adaptability, and can be mass-produced. Attached Figure Description

[0019] The invention will now be further described with reference to the accompanying drawings.

[0020] Figure 1 This is a schematic diagram of the structure of the present invention; The following modules are labeled in the diagram: 1. Main control processing module; 2. Text parsing and storage module; 3. 3D imaging rendering module; 4. Multi-dimensional sensing and interaction module; 5. Synchronous sound effect output module. Detailed Implementation

[0021] To make the technical means, creative features, achieved objectives, and effects of this invention readily understandable, the invention will be further described below in conjunction with the accompanying drawings and specific embodiments. It should be understood that these embodiments are for illustrative purposes only and are not intended to limit the scope of the invention. Furthermore, it should be understood that after reading the teachings of this invention, those skilled in the art can make various modifications or alterations to the invention, and these equivalent forms also fall within the scope defined by this application.

[0022] like Figure 1 As shown, the immersive interactive device based on four-dimensional image encoding and literary storyboarding of the present invention includes a main control processing module 1, a text parsing and storage module 2, a three-dimensional imaging rendering module 3, a multi-dimensional sensing interaction module 4, and a synchronous output module 5. The main control processing module 1 is bidirectionally electrically connected to the text parsing and storage module 2, the three-dimensional imaging rendering module 3, the multi-dimensional sensing interaction module 4, and the synchronous output module 5 via PCB cables to form a closed-loop hardware control system.

[0023] The main control processing module 1 is equipped with an ARM core processor, flash memory storage chips, and timing control circuitry; it is responsible for receiving all sensor signals, running encoding algorithms, outputting video and audio commands, and synchronizing the timing of all modules. The text parsing and storage module 2 has a built-in solid-state storage hard drive containing a fixed four-dimensional image encoding database and a storyboard template library; it also has a built-in text preprocessing program firmware that independently completes text segmentation, score calculation, and encoding output without relying on the cloud. The 3D imaging rendering module 3 includes a high-definition LCD display unit, a backlight driving circuit, and a frame rate synchronization chip; it receives main control commands, renders 3D scenes in real time according to the storyboard track parameters, and outputs a fixed frame rate of 60fps with a response delay of ≤0.3s. The multi-dimensional sensing and interaction module 4 integrates an infrared ranging sensor, a capacitive touch sensor, and a posture gyroscope; it collects user spatial distance, touch action, and viewing angle offset data in real time and uploads electrical signals to the main control module at a frequency of 10ms. The synchronous sound output module 5 has a built-in power amplifier circuit, a full-range speaker, and an audio decoding chip; it can accurately synchronize the broadcast according to the shot frame number and spatial distance signal, with an audio-visual synchronization error of ≤0.1s.

[0024] The method for creating an immersive interactive device based on four-dimensional image encoding and literary storyboarding includes the following steps: Step 1: Text Firmware Preprocessing and Four-Dimensional Encoding Quantization Calculation After the device is powered on, the main control module calls the built-in firmware of the storage module to perform mechanical word segmentation on the input literary text; calculates the four-dimensional scores of S / T / P / E respectively, converts the natural language into a four-dimensional numerical code array, and outputs structured scene parameter instructions; Example: The single-line encoding output of "Quiet Night Thoughts" is: S[moon, window], T[night], P[view], E[lonely], and the corresponding quantified scores are all stored in the memory stack; Step 2: Storyboard Template Matching and Lens Track Parameter Generation The system retrieves the corresponding storyboard template library based on the text genre (quatrain / regulated poem / classical prose / travelogue); based on the four-dimensional encoding score, it automatically calculates: the starting camera position coordinates, camera movement speed, lens focal length parameters, and scene transition timestamps, generating a standardized shot track file that can be recognized by the rendering engine; Step 3: Adaptive Rendering of 3D Scene Parameters The rendering module receives the camera track file and image encoding parameters, automatically matches the scene model, lighting parameters, weather effects, and color parameters; it fixes the number of modeling faces and texture accuracy to complete the lightweight scene construction. The entire process is executed automatically without the need for manual modeling and debugging. Step 4: Frame-level audio-visual content pinpoint binding The system uses the storyboard timestamp as an anchor point to accurately bind the audio reading, explanatory text, and allusion subtitles to the corresponding shot frame, so that wherever the camera moves, wherever the scene cuts, the knowledge points are output synchronously there; Step 5: Real-time spatial detection and signal transmission using hardware sensors The device's infrared sensor continuously detects the physical distance between the user and the screen, the gyroscope detects the viewing angle shift, and the touch sensor detects touch signals; the physical distance signal and action signal are converted into electrical signals and transmitted back to the main control unit in real time. Step Six: Three-level hierarchical trigger logic hardware response The main control module performs a graded determination based on the returned distance electrical signal: Detection distance 80-120cm, execute far-area trigger: output full background audio and display of distant static scene; Detection distance 30-80cm, triggering the middle zone: activate scene dynamic effects and paragraph appreciation audio; When a touch signal is detected at a detection distance of 0-30cm, a near-field trigger is executed: pop up word definitions and highlight text annotations; Step 7: Real-time timing synchronization and closed-loop parameter correction The device records the trigger response delay, audio-visual synchronization error, and encoding matching deviation throughout the process, and automatically fine-tunes the next round of scene splitting speed and sensor judgment threshold, forming an adaptive optimization closed loop of hardware and algorithm; In step one, a machine-readable four-dimensional structured coding library is established, rather than being interpreted manually: Four dimensions: Scenery dimension (S), Time sequence dimension (T), People dimension (P), Emotion dimension (E) Each line of classical Chinese text / poem is segmented and scored by machine (0-100 quantization threshold): - Scenery S: mountains, water, wind, moon, forest, boat, pavilion, steps (matching threshold ≥ 60 triggers scene modeling); - Time sequence T: Morning, Dusk, Autumn, Winter, Night, Sunny, Rainy (triggers scene lighting parameter switching); - Character P: Alone, Guest, Returning, Gazing, Traveling, Drinking (triggers virtual character motion skeletal animation); - Emotion E: Sadness, Expansion, Loneliness, Joy (triggering lens tension parameters, hue saturation parameters); Technical rules: The system uses "single sentence text" as the smallest unit and outputs a four-dimensional encoded array, which serves as the sole driving source for subsequent modeling, storyboarding, and interaction. The entire process is automated and requires no human intervention. In step two, a unique mathematical mapping relationship for storyboards is designed specifically for literary texts, completely differentiating them from the fixed camera angles of general VR: 1) Sentence length → camera movement speed mapping: short sentences are quickly zoomed in, long sentences are slowly zoomed out; 2) Emotional score E → Lens focal length mapping: High-scoring emotional shots are focused on close-ups, while low-scoring shots are laid out in the distance; 3) Timing label T → Light and shadow frame rate mapping: Reduce color temperature for twilight scenes, reduce exposure for night scenes, and increase brightness for clear scenes; 4) Paragraph structure → Shot sequence template: The four-segment structure of the quatrain corresponds to a fixed shot loop of "long-medium-close-extreme"; Results: Input any classical Chinese poem or text, and the machine will automatically output a unique set of renderable storyboard files, without the need for manual camera adjustments; In step six, based on hardware infrared ranging and touch sensing, a binding rule between physical space and literary content is established: - Distant area (80-120cm): Visual level, triggers background information and author biography audio; - Middle zone (30-80cm): Roaming level, triggering paragraph interpretation and scene dynamic effects; - Near zone (0-30cm): Touch level triggers single-word annotation, word meaning analysis, and detail pop-up.

[0025] In the description of this invention, it should be understood that the terms "upper," "side," "inner," etc., indicating orientation or positional relationship are based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the elements referred to must have a specific orientation, or be constructed and operated in a specific orientation. In addition, it should be noted that unless otherwise explicitly specified and limited, the terms "set," "install," "connect," and "link" should be interpreted broadly. For example, they can refer to fixed connections, detachable connections, or integral connections; they can refer to mechanical connections or electrical connections; they can refer to direct connections or indirect connections through an intermediate medium; they can refer to the internal communication of two elements or the interaction relationship between two elements. Unless otherwise explicitly limited, those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0026] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed. The scope of protection of the present invention is defined by the appended claims and their equivalents.

Claims

1. An immersive interactive device based on four-dimensional image encoding and literary storyboarding, characterized in that, It includes a main control processing module (1), a text parsing and storage module (2), a three-dimensional imaging rendering module (3), a multi-dimensional sensing interaction module (4), and a synchronous output module (5). The main control processing module (1) is bidirectionally electrically connected to the text parsing and storage module (2), the three-dimensional imaging rendering module (3), the multi-dimensional sensing interaction module (4), and the synchronous output module (5) via PCB cables to form a closed-loop hardware control system.

2. The immersive interactive device based on four-dimensional image encoding and literary storyboarding as described in claim 1, characterized in that, The main control processing module (1) is equipped with an ARM core processor, flash memory storage particles, and timing control circuit; it is responsible for receiving all sensor signals, running encoding algorithms, outputting screen and audio commands, and synchronizing the timing of all modules.

3. The immersive interactive device based on four-dimensional image encoding and literary storyboarding as described in claim 2, characterized in that, The text parsing and storage module (2) has a built-in solid-state storage hard drive containing a solid four-dimensional image encoding database and a storyboard template library; it also has a built-in text preprocessing program firmware that independently completes text segmentation, score calculation, and encoding output without relying on the cloud.

4. The immersive interactive device based on four-dimensional image encoding and literary storyboarding as described in claim 3, characterized in that, The three-dimensional imaging rendering module (3) includes a high-definition LCD display unit, a backlight driving circuit, and a frame rate synchronization chip; it receives the main control command, renders the 3D scene in real time according to the storyboard track parameters, and outputs a fixed frame rate of 60fps with a response delay of ≤0.3s.

5. An immersive interactive device based on four-dimensional image encoding and literary storyboarding as described in claim 4, characterized in that, The multi-dimensional sensing and interaction module (4) integrates an infrared ranging sensor, a capacitive touch sensor, and an attitude gyroscope; it collects user spatial distance, touch action, and viewing angle offset data in real time and uploads electrical signals to the main control module at a frequency of 10ms.

6. An immersive interactive device based on four-dimensional image encoding and literary storyboarding as described in claim 1, characterized in that, The synchronous sound output module (5) has a built-in power amplifier circuit, a full-range speaker, and an audio decoding chip; it accurately broadcasts according to the lens frame number and spatial distance signal, with an audio-visual synchronization error of ≤0.1s.

7. A method for using an immersive interactive device based on four-dimensional image encoding and literary storyboarding as described in claim 1, characterized in that, Includes the following steps: Step 1: Text Firmware Preprocessing and Four-Dimensional Encoding Quantization Calculation After the device is powered on, the main control module calls the built-in firmware of the storage module to perform mechanical word segmentation on the input literary text; calculates the four-dimensional scores of S / T / P / E respectively, converts the natural language into a four-dimensional numerical code array, and outputs structured scene parameter instructions; Step 2: Storyboard Template Matching and Lens Track Parameter Generation The system retrieves the corresponding storyboard template library based on the text genre (quatrain / regulated poem / classical prose / travelogue); based on the four-dimensional encoding score, it automatically calculates: the starting camera position coordinates, camera movement speed, lens focal length parameters, and scene transition timestamps, generating a standardized shot track file that can be recognized by the rendering engine; Step 3: Adaptive Rendering of 3D Scene Parameters The rendering module receives the camera track file and image encoding parameters, automatically matches the scene model, lighting parameters, weather effects, and color parameters; it fixes the number of modeling faces and texture accuracy to complete the lightweight scene construction. The entire process is executed automatically without the need for manual modeling and debugging. Step 4: Frame-level audio-visual content pinpoint binding The system uses the storyboard timestamp as an anchor point to precisely bind the audio reading, explanatory text, and allusion subtitles to the corresponding shot frames, ensuring that wherever the camera moves, the scene cuts to, and the knowledge points are output synchronously. Step 5: Real-time spatial detection and signal transmission using hardware sensors The device's infrared sensor continuously detects the physical distance between the user and the screen, the gyroscope detects the viewing angle shift, and the touch sensor detects touch signals; the physical distance signal and action signal are converted into electrical signals and transmitted back to the main control unit in real time. Step Six: Three-level hierarchical trigger logic hardware response The main control module performs a graded determination based on the returned distance electrical signal: Detection distance 80-120cm, execute far-area trigger: output full background audio and display of distant static scene; Detection distance 30-80cm, triggering the middle zone: activate scene dynamic effects and paragraph appreciation audio; When a touch signal is detected at a detection distance of 0-30cm, a near-field trigger is executed: pop up word definitions and highlight text annotations; Step 7: Real-time timing synchronization and closed-loop parameter correction The device records trigger response delay, audio-visual synchronization error, and encoding matching deviation throughout the process, and automatically fine-tunes the next round of scene splitting speed and sensor judgment threshold, forming an adaptive optimization closed loop of hardware and algorithm.

8. The method for using an immersive interactive device based on four-dimensional image encoding and literary storyboarding as described in claim 7, characterized in that, In step one, a machine-readable four-dimensional structured coding library is established, rather than being interpreted manually: Four dimensions: scenery dimension S, time sequence dimension T, people dimension P, and emotion dimension E; Each line of classical Chinese text / poem is segmented and scored by machine (0-100 quantization threshold): - Scenery S: mountains, water, wind, moon, forest, boat, pavilion, steps (matching threshold ≥ 60 triggers scene modeling); - Time sequence T: Morning, Dusk, Autumn, Winter, Night, Sunny, Rainy (triggers scene lighting parameter switching); - Character P: Alone, Guest, Returning, Gazing, Traveling, Drinking (triggers virtual character motion skeletal animation); - Emotion E: Sadness, Expansion, Loneliness, Joy (triggering lens tension parameters, hue saturation parameters); Technical rules: The system uses "single sentence text" as the smallest unit and outputs a four-dimensional encoded array, which serves as the sole driving source for subsequent modeling, storyboarding, and interaction. The entire process is automated and requires no human intervention.

9. The method for using an immersive interactive device based on four-dimensional image encoding and literary storyboarding according to claim 7, characterized in that, In step two, a unique mathematical mapping relationship for storyboards is designed specifically for literary texts, completely differentiating them from the fixed camera angles of general VR: 1) Sentence length → camera movement speed mapping: short sentences are quickly zoomed in, long sentences are slowly zoomed out; 2) Emotional score E → Lens focal length mapping: High-scoring emotional shots are focused on close-ups, while low-scoring shots are laid out in the distance; 3) Timing label T → Light and shadow frame rate mapping: Reduce color temperature for twilight scenes, reduce exposure for night scenes, and increase brightness for clear scenes; 4) Paragraph structure → Shot sequence template: The four-stanza structure of the quatrain corresponds to a fixed shot loop of "long-medium-close-extreme"; Results: Input any classical Chinese poem or text, and the machine will automatically output a unique set of renderable storyboard files, without the need for manual camera adjustments.

10. The method for using an immersive interactive device based on four-dimensional image encoding and literary storyboarding according to claim 7, characterized in that, In step six, based on hardware infrared ranging and touch sensing, a binding rule between physical space and literary content is established: - Distant area (80-120cm): Visual level, triggers background information and author biography audio; - Middle zone (30-80cm): Roaming level, triggering paragraph interpretation and scene dynamic effects; - Near zone (0-30cm): Touch level triggers single-word annotation, word meaning analysis, and detail pop-up.

Images