An interactive movie and television production and presentation system and method

Abstract

The application relates to the technical fields of computer multimedia, streaming media playing, artificial intelligence film and television production, and discloses an interactive film and television production and playing system and method. The system comprises a scene grading module, a grading pause control module, a user interaction module, a content generation module and a playing control module. The application divides at least two levels of interactive nodes according to the influence degree of the plot on the main line ending, triggers interactive prompts with corresponding intensity for different nodes, adopts real-person live-action content for core nodes, generates plot branches based on real-person materials by artificial intelligence for non-core nodes, and plays corresponding content according to user selection. The application solves the technical problems of high production cost, small number of plot branches and poor user viewing immersion of traditional interactive dramas, can greatly improve the user interactive experience on the basis of slightly increasing the shooting workload, and is suitable for various film and television forms such as television dramas, films, web dramas and the like.

Description

Technical Field

[0001] This invention relates to the fields of computer multimedia technology, streaming media playback technology, and artificial intelligence film and television production technology. Specifically, it relates to an interactive film and television drama production method, playback system, and computer-readable storage medium, which is applicable to the production and playback of various film and television content formats such as TV series, movies, web series, and micro-dramas. Background Technology

[0002] Interactive films and television dramas, as an important innovative form of traditional linear film and television content, have gained increasing attention and popularity among young users in recent years. Unlike the traditional one-way viewing mode, interactive films and television dramas allow users to make choices during the viewing process, thereby influencing the development of the plot and the final outcome. This immersive interactive experience provides users with a stronger sense of participation and engagement, becoming one of the important directions for innovative development in the film and television industry.

[0003] However, existing interactive films and television dramas primarily employ a live-action production method, which has several drawbacks in practical application. First, production costs are extremely high. Since each choice point requires filming multiple different plot branches, the number of branches grows exponentially. The production cost of a single interactive drama is often 3-5 times that of a linear drama of the same scale, making large-scale production difficult. Second, the user experience suffers from significant flaws. Existing interactive dramas typically use a uniform, forced full-screen pause at all choice points. Frequent pauses disrupt the user's immersion, and the limited number of plot branches restricts the user's choices due to production costs. Third, content reuse is low. All plot branches are independent and fixed, unable to be dynamically adjusted based on user preferences. A large amount of footage can only be used once, resulting in severe resource waste.

[0004] Meanwhile, AI-generated video technology has made significant progress in recent years, with numerous applications in the field of pure AI animated short dramas. However, there is currently no mature technical solution that effectively combines live-action content with AI-generated content for the production of long-form interactive films and television dramas. How to reduce production costs, enrich plot branches, and enhance the user viewing experience while ensuring content quality has become a pressing technical challenge in this field. Summary of the Invention

[0005] Purpose of the invention.

[0006] The purpose of this invention is to overcome the above-mentioned defects of the prior art and provide an interactive film and television drama production and playback system and method. With a slight increase in the amount of shooting work, it can significantly increase the number of plot branches, enhance the user interactive experience and the immersive viewing experience, reduce the production threshold and cost of interactive dramas, increase the reuse rate of film and television content, extend the life cycle of works, enrich the commercial monetization model of interactive film and television dramas, and enhance the commercial value of content.

[0007] To achieve the above objectives, the present invention adopts the following technical solution:

[0008] An interactive film and television drama production and playback system includes a scene classification module, a classification pause control module, a user interaction module, a content generation module, and a playback control module.

[0009] The scene grading module is used to divide the content of a film or television drama into at least two different levels of interactive nodes based on the degree of impact of the plot on the main storyline's ending. Its function is to differentiate plot nodes of varying importance, enabling differentiated interaction strategies. Scene grading can be implemented in various ways, such as two-level division (core level / side plot level), three-level division (core turning point level / side plot supplement level / Easter egg hidden level), four-level division, or more levels. The level names can also use various naming conventions such as A / B / C level, important / general / minor, etc.

[0010] The tiered pause control module is used to trigger pauses or interactive prompts of corresponding intensity at different levels of interaction nodes. Its function is to balance the conflict between user interaction needs and the immersive viewing experience. Pauses or interactive prompts can be implemented in various ways, such as forced full-screen pause, semi-transparent overlay prompts, background floating prompts, device vibration prompts, voice prompts, or combinations of these methods.

[0011] The user interaction module provides at least two different plot development options when paused or prompted. Its function is to receive user selection commands and pass them to the playback control module. User interaction can be implemented through various input methods such as touch clicks, remote control buttons, voice input, and gesture recognition. The selection options can be presented in various forms such as text buttons, graphic cards, and option lists.

[0012] The content generation module is used to generate story branches for core-level nodes using live-action footage, while non-core-level nodes are generated by artificial intelligence based on live-action footage. Its purpose is to significantly reduce production costs and increase the number of story branches while maintaining the quality of the core storyline. The AI-generated story branches based on live-action footage can be achieved through various technologies such as dialogue text generation, character expression transfer, motion completion, scene extension, shot splicing, and speech synthesis.

[0013] The playback control module is used to jump to and play corresponding live-action content or AI-generated story branches based on the user's selection instructions. Its function is to achieve a smooth transition between different story branches. Playback control can be implemented using technologies such as pre-loading caching, intelligent pre-reading, and seamless splicing to ensure that the switching process is free of black screens and stuttering.

[0014] Furthermore, the scene grading module divides interactive nodes into three levels: core turning point level, side plot supplement level, and hidden Easter egg level. Core turning point level nodes have a decisive impact on the main storyline ending, side plot supplement level nodes affect the development of secondary plots, and hidden Easter egg level nodes provide additional interesting content.

[0015] Furthermore, the pause or interaction prompts triggered by the tiered pause control module include at least two of the following: forced full-screen pause, semi-transparent overlay prompt, and background floating prompt. Core transitional nodes trigger forced full-screen pause, supplementary branch nodes trigger semi-transparent overlay prompts, and hidden easter egg nodes trigger background floating prompts.

[0016] Furthermore, in the content generation module, the artificial intelligence-generated plot branches based on real-life footage include at least one of the following methods: dialogue text generation, character expression transfer, action completion, scene extension, and shot splicing. Live-action content accounts for 10%-40% of the total runtime of the film / television series, while AI-generated plot branches account for 60%-90% of the total runtime.

[0017] Furthermore, the playback control module supports seamless switching between different story branches, with no black screens or stuttering during the switching process. The system also includes a user preference recording module, used to record the user's historical selection commands and adjust the generation logic of subsequent story branches based on these commands.

[0018] Furthermore, the user interaction module supports at least one input method among touch, remote control, voice, and gesture to receive user selection commands.

[0019] An interactive method for producing and playing films and television dramas includes the following steps: S1: Divide the content of film and television dramas into at least two different levels of interactive nodes based on the degree of influence of the plot on the main storyline ending; S2: Trigger pauses or interactive prompts of corresponding strengths at different levels of interactive nodes; S3: Provide at least two different story paths when paused or prompted; S4: Core level nodes use live-action content, while non-core level nodes are generated by artificial intelligence based on live-action footage to create story branches. S5: Receives the user's selection command, jumps to and plays the corresponding live-action content or AI-generated plot branch.

[0020] Furthermore, in step S1, the interactive nodes are divided into three levels: core turning point level, side supplement level, and hidden easter egg level; in step S2, forced full-screen pause, semi-transparent overlay prompt, and background floating prompt are triggered for interactive nodes of different levels respectively.

[0021] Beneficial effects

[0022] Significant cost and efficiency advantages are achieved. This invention employs a hybrid production model combining live-action filming and AI-generated content. Only 10%-40% of the core storyline needs to be filmed, while the remaining 60%-90% of the subplots are generated by AI based on live-action footage. This reduces production costs by 60%-80% and shortens the production cycle to one-third of traditional fully live-action interactive dramas. This significantly lowers the production threshold for interactive films and television dramas, making large-scale mass production of interactive dramas possible.

[0023] The user experience is significantly improved. This invention employs a tiered pause mechanism, triggering interactive prompts of varying intensity based on the importance of plot points, effectively resolving the conflict between interactive needs and immersive viewing. Forced pauses at core plot points ensure users don't miss crucial choices, while lighter prompts at secondary plot points avoid disrupting the viewing rhythm. Simultaneously, AI-generated plot technology offers virtually unlimited plot branching possibilities, greatly enriching the user's choices.

[0024] Content reuse is significantly improved. In this invention, live-action footage can be reused to generate multiple different storylines, enabling multiple uses from a single shoot. Simultaneously, AI-powered content generation capabilities allow for real-time updates and expansions of the storyline based on user feedback and market demands, effectively extending the lifespan of the work. The same set of live-action footage can generate various versions of interactive content, greatly enhancing the value of the content asset.

[0025] The commercial value is comprehensively enhanced. This invention opens up multiple new commercial monetization models for interactive films and television dramas. Based on user preference recording and AI dynamic generation capabilities, it enables various innovative business models such as personalized plot customization, dynamic advertising placement, and virtual item purchases. Every choice made by the user can become an entry point for commercial monetization, significantly improving the commercial value and profitability of interactive films and television dramas. Attached Figure Description

[0027] Figure 1 Overall architecture diagram of the interactive film and television drama production and playback system of the present invention.

[0028] Figure 2 Flowchart of the interactive film and television drama production and playback method of the present invention Figure 3A schematic diagram of the hierarchical structure of three-level interactive nodes in one embodiment of the present invention. Figure 4 : A schematic diagram of an interface with three different intensities of interactive prompts in one embodiment of the present invention Figure 5 Flowchart of the present invention: A hybrid model of live actors and AI to generate story branches. Attached image labels: 1-Scene grading module; 2-Graded pause control module; 3-User interaction module; 4-Content generation module; 5-Playback control module; 6-User preference recording module; 11-Scene grading step; 12-Graded pause trigger step; 13-User interaction selection step; 14-Content generation step; 15-Playback control jump step; 141-Live-action shooting branch; 142-AI-generated branch; 21-Core turning point node; 22-Supplementary branch node; 23-Hidden easter egg node; 31-Forced full-screen pause interface; 32-Semi-transparent overlay prompt interface; 33-Background floating prompt interface; 41-Live-action material collection; 42-Material processing and annotation; 43-Core branch live-action shooting editing; 44-Non-core branch AI generation; 45-Content quality review; 46-Branch content storage; 47-Playback scheduling; 441 - Dialogue generation; 442 - Facial expression transfer; 443 - Motion completion; 444 - Scene extension; 445 - Camera stitching. Detailed Implementation

[0029] This example uses a suspenseful mystery film or television drama as an example. The plot involves the protagonist investigating a serial murder case as a detective. Different choices made by the user at key points will lead to different investigation directions, clue acquisition, and final outcomes.

[0030] Step 1: Scene Classification. This embodiment divides the interactive nodes of the entire drama into three levels: 5 core turning point nodes, which determine the final direction of the case investigation and the identity of the real culprit; 15 side plot supplement nodes, which affect the acquisition of clues and witness relationships; and 30 hidden Easter egg nodes, which provide additional background stories and interesting content. Core turning point nodes include key plot points that determine the main storyline's ending, such as suspect identification, acquisition of key evidence, and the final showdown; side plot supplement nodes include nodes that affect the development of secondary plots, such as questioning witnesses, investigating the scene, and analyzing clues; and hidden Easter egg nodes include interesting content such as character interactions and environmental exploration unrelated to the case.

[0031] Step 2: Tiered Pause Trigger. Different interactive prompt strategies are adopted for nodes of different levels: Core turning point level nodes trigger a forced full-screen pause, the playback is completely paused and the selection interface is displayed in the center; Subsidiary level nodes trigger a semi-transparent overlay prompt, the playback continues in a silent state, and the selection interface is overlaid on the screen in a semi-transparent form; Easter egg hidden level nodes trigger a background floating prompt, the playback continues normally, and only a small floating prompt icon is displayed in the corner of the screen, allowing the user to choose whether to participate in the interaction.

[0032] Step 3: User Interaction. Each interaction node offers 2-4 different plot development options, presented as graphic cards with brief descriptions and preview icons. The user interaction module supports multiple input methods: remote control buttons on smart TVs, touch clicks on mobile devices, and mouse clicks on PCs. It also supports innovative interaction methods such as voice commands and gesture recognition. After a user makes a selection, the system immediately provides feedback and proceeds to the corresponding plot branch.

[0033] Step 4: Content Generation. All plot branches at core turning points are filmed entirely with live-action footage to ensure high-quality performance and visual effects for key scenes. The main plot of supplementary side story nodes is filmed entirely with live-action footage, while secondary branches and dialogues are generated by AI based on live-action footage. All content at hidden easter egg nodes is generated by AI based on live-action footage. AI generation methods primarily include: dialogue text generation to create different dialogues, character facial expression transfer to generate different emotional responses, motion completion to expand character action sequences, scene extension to generate different environmental backgrounds, and shot splicing to combine different shot fragments. In this embodiment, live-action content accounts for approximately 30% of the total runtime, and AI-generated content accounts for approximately 70%.

[0034] Step 5: Playback and Interaction Flow. After the user starts playback, the system progresses linearly according to the storyline. Upon reaching the first interaction node, an interactive prompt of corresponding intensity is triggered based on the node's level. After the user views the options and makes a selection, the playback control module immediately jumps to the corresponding storyline branch for playback. The system employs pre-loading caching technology, pre-reading the beginning content of all possible branches before the user makes a selection, ensuring a seamless transition without black screens or stuttering. Every selection made by the user is recorded in the user preferences module for subsequent personalized recommendations and storyline adjustments.

[0035] The beneficial effects of this embodiment are that, through a three-tier rating mechanism and a hybrid production mode combining live-action and AI, the quality of the core suspense plot is maintained while significantly increasing the number of plot branches. Users can experience dozens of different plot development paths, and the production cost is only about 30% of that of a traditional fully live-action interactive drama. The tiered pause mechanism effectively balances interactive needs with viewing immersion, avoiding the disruption to the viewing experience caused by frequent pauses.

[0036] This example uses an urban romance drama as an example. The plot is about a female protagonist facing a choice between love and career during graduation season. Different choices made by the user will lead the female protagonist to different life paths, resulting in different love endings and career development.

[0037] Step 1: Scene Classification. This embodiment employs a two-level classification mechanism: 8 core choice-level nodes that determine the female protagonist's major life choices and final outcome; and 25 detailed interaction-level nodes that influence character relationships and emotional development. Core choice-level nodes include key nodes that determine the main storyline's direction, such as career direction choices, timing of confessions, and handling of major misunderstandings; detailed interaction-level nodes include detailed nodes that enrich character relationships, such as daily dialogue choices, gift choices, and date location choices.

[0038] Step 2: Tiered Pause Triggering. This embodiment employs a differentiated combination of prompts: core selection-level nodes trigger a semi-transparent full-screen prompt, blurring the playback screen and presenting the selection interface in a soft, semi-transparent manner to avoid an overly abrupt pause; detailed interactive nodes trigger floating bubble prompts, with selection options appearing as speech bubbles next to the characters, seamlessly integrating with the scene. This tiered prompting method better suits the romantic atmosphere of a love story, minimizing interruptions to the viewing experience.

[0039] Step 3: User Interaction. Each interaction node offers 2-3 options that match the character's personality, presented as speech bubbles or emotion tags. In addition to supporting standard touch and remote control input, the user interaction module features optimized voice interaction. Users can directly speak their selections, and the system executes the corresponding operation through voice recognition, further enhancing the sense of immersion.

[0040] Step 4: Content Generation. All ending branches at the core selection level are filmed with live actors to ensure the performance quality of key emotional scenes; detailed interactive levels are primarily generated by artificial intelligence based on live-action footage. The AI ​​generation method focuses on motion completion and scene generation: motion completion technology is used to generate different interactive actions between characters, such as hugging, holding hands, and eye contact, representing different levels of intimacy; scene generation technology is used to generate different dating scenes and living environments, such as cafes, parks, and homes. In this embodiment, live-action content accounts for approximately 25% of the total duration, and AI-generated content accounts for approximately 75%.

[0041] Step 5: Playback and Interaction Flow. Once the user begins watching, the plot unfolds naturally. When interactive points are reached, choices are presented in a way that aligns with the plot's atmosphere. After the user makes a choice, the system smoothly transitions to the corresponding plot branch. The user preference recording module continuously records the user's choice tendencies, such as whether the user prioritizes career or love, or which personality type they prefer, and dynamically adjusts the direction of subsequent plot branches accordingly, providing a more personalized viewing experience.

[0042] The beneficial effects of this embodiment are that it optimizes the rating mechanism and interaction format for the characteristics of romance dramas, and uses a gentler prompting method to maintain the emotional continuity of the romance drama. Artificial intelligence generation technology greatly enriches the possibilities of character interaction, allowing users to experience rich and nuanced emotional development paths, while significantly reducing production costs. The personalized recommendation mechanism ensures that each user receives a tailor-made viewing experience.

Claims

1. An interactive film and television drama production and playback system, characterized in that, include: The scene classification module is used to divide the content of film and television dramas into at least two different levels of interactive nodes based on the degree of influence of the plot on the main storyline ending; The tiered pause control module is used to trigger pauses or interactive prompts of corresponding strengths at different levels of interactive nodes. The user interaction module provides at least two different plot development options when paused or prompted. The content generation module is used to use live-action content for core-level nodes, while non-core-level nodes are generated by artificial intelligence based on live-action footage to create story branches. The playback control module is used to jump to and play corresponding live-action content or AI-generated story branches based on the user's selection instructions.

2. The system according to claim 1, characterized in that, The scene classification module divides interactive nodes into three levels: core turning point level, side story supplement level, and hidden Easter egg level.

3. The system according to claim 1, characterized in that, The pause or interaction prompts triggered by the tiered pause control module include at least two of the following: forced full-screen pause, semi-transparent overlay prompt, and background floating prompt.

4. The system according to claim 1, characterized in that, In the content generation module, the artificial intelligence generates plot branches based on real-person materials in at least one of the following ways: dialogue text generation, character expression transfer, action completion, scene extension, and shot splicing.

5. The system according to claim 1, characterized in that, The live-action content accounts for 10%-40% of the total length of the film and television drama, while the plot branches generated by artificial intelligence account for 60%-90% of the total length.

6. The system according to claim 1, characterized in that, The playback control module supports seamless switching between different story branches, with no black screen or lag during the switching process.

7. The system according to claim 1, characterized in that, It also includes a user preference recording module, which records the user's historical selection instructions and adjusts the generation logic of subsequent plot branches based on the historical selection instructions.

8. The system according to claim 1, characterized in that, The user interaction module supports at least one input method among touch, remote control, voice, and gesture to receive user selection commands.

9. An interactive method for producing and playing films and television dramas, characterized in that, Includes the following steps: S1: Divide the content of film and television dramas into at least two different levels of interactive nodes based on the degree of influence of the plot on the main storyline ending; S2: Trigger pauses or interactive prompts of corresponding strengths at different levels of interactive nodes; S3: Provide at least two different story paths when paused or prompted; S4: Core level nodes use live-action content, while non-core level nodes are generated by artificial intelligence based on live-action footage to create story branches. S5: Receives the user's selection command, jumps to and plays the corresponding live-action content or AI-generated plot branch.

10. The method according to claim 9, characterized in that, In step S1, the interactive nodes are divided into three levels: core turning point level, side supplement level, and hidden easter egg level; in step S2, the interactive nodes of different levels are triggered to trigger forced full-screen pause, semi-transparent overlay prompt, and background floating prompt respectively.

Images