43 results about "Storyboard" patented technology

The invention discloses a multi-modal large model-based multimedia file generation method, and relates to the technical field of education content generation. Task alignment and evidence readiness, question analysis and question solving trajectory diagram construction, compiling into a unified instruction of a split white board and a parastyle, controlled generation, co-optimization in generation, posterior judgment, traceable release and learning write-back are sequentially completed; according to the scheme, a problem solving track graph is used as a unique true source, a semantic structure which can do a problem is mapped into a shot, blackboard writing and oral playing, and a suitable age target and a cognitive load are synchronously constrained; in the generation stage, the fact and safety scores are calculated according to the shot, local regeneration is triggered, and rework of the whole section is reduced; source credentials are written before publishing, and learning conditions are written back in combination with watching and evaluation, so that a correct, right-age, traceable and self-evolutionary closed loop is formed. And unified numbering, continuous input processing and output are realized, fixed-point backspacing and sampling inspection are supported, uncertainty and cost are reduced, and convenience is brought to campus distribution and home check verification.

The present application discloses a method and apparatus for generating a dynamic video, an electronic device, and a storage medium. The method comprises: acquiring a textual script of a storyboard; performing semantic expansion on the textual script by means of a large language model to obtain a plurality of scene descriptions, and generating storyboard still images corresponding to the scene descriptions; using a fusion inpainting model to perform inpainting processing on a target storyboard still image selected from the plurality of storyboard still images; generating a mask image of a dynamic area on the target storyboard still image selected by a user; by means of an image-to-video model, using feature information of the target storyboard still image and the mask image to generate a dynamic video of the storyboard according to image generation prompt information; performing video post-processing on the dynamic video; generating audio generation prompt information on the basis of a theme and style of the dynamic video, and generating a current video-based audio according to the audio generation prompt information by means of an audio generation model; and adding the current video-based audio to the dynamic video of the storyboard to obtain a final dynamic video of the storyboard.

A computer implemented method for generating video content based on natural language input is disclosed. The method includes receiving a natural language instruction describing one or more desired characteristics of a video. A structured script file comprising at least one story beat is generated using a natural language processing engine. A storyboard comprising one or more storyboard frames is created based on the structured script file. One or more virtual components are generated based on the storyboard. An intermediate video sequence comprising a visual component and an auditory component is created using virtual components and the storyboard. The intermediate video sequence is then refined to produce a modified video sequence by applying one or more post-processing effects.

To provide a system for easily converting text of a blog into a cartoon form.SOLUTION: A system includes a reception part, a generation part, a generation part including a character generation part and a background generation part, and an output part. The reception part inputs a text of a blog. The generation unit analyzes the text input by the reception unit and generates a storyboard. The generation unit including the character generation unit and the background generation unit generates the character and the background based on the storyboard generated by the generation unit. The output unit outputs the comic-style blog content generated by the generation unit.SELECTED DRAWING: Figure 1

A collaborative content generation system uses machine learning to generate a script and content depicting the performance of the script. A director may use the system to generate the script and optionally, may involve one or more collaborators who perform portions of the script. The system may use machine learning to generate or modify a script, a storyboard to visualize the story, a narrator (e.g., the narrator's voice), characters, music, sound effects, etc. A director may assign portions of the script to certain collaborators and select which of their recordings are interleaved into the final collaborative interleaved content series. The collaborators may independently perform their portions and provide clips of their performances to the system, which may then interleave the clips to produce the finalized content.

This invention proposes a method, system, and computer device for generating text-based videos, relating to the technical field of video processing. The method includes: acquiring user input parameters; generating anchor point prompts and anchor point character diagrams based on the user input parameters; evaluating the anchor point character diagrams until they pass evaluation; extracting information from the anchor point prompts to obtain a storyboard; evaluating the storyboards until they pass evaluation; generating audio and storyboard video based on the storyboards; evaluating the storyboard video until it passes evaluation; post-processing the storyboard video to obtain a post-processed video; and combining the post-processed video with the audio to generate a target video. This invention effectively provides a closed-loop evaluation node for text-based video generation, improving the quality of generated text-based videos.

A system is provided.SOLUTION: A system, comprising: means for receiving a plurality of pieces of prompt information input by a user; means for analyzing the prompt information; means for selecting a generation algorithm based on a result of the analysis; means for generating a storyboard using the selected generation algorithm; means for returning the generated storyboard to the user; and means for displaying and editing the returned storyboard.SELECTED DRAWING: Figure 1

This image is used to display a shooting plan such as a storyboard when shooting with a camera.

The present invention relates to a system supporting so that an AI system may analyze a storyboard and shot information, automatically generate development difficulty and development period information for each asset, and register same in a data management system, and a terminal device may identify the registered result. When an animation production system generates and transmits shots and asset information on the basis of the storyboard, the AI system analyzes the shots and the asset information to derive an asset list, the difficulty, and period information for each shot, and the data management system automatically registers and manages the corresponding information, so that the overall production process can be reviewed by means of the terminal device.

In various examples, generative AI-based systems and applications may be used to automatically transform basic storylines into comprehensive storyboards, as well as to automatically generate animatics based on the storyboards. For instance, input data (e.g., text, audio, etc.) representing a storyline may be obtained and analyzed using one or more AI models. The AI model(s) may segment the storyline into a plurality of scenes and generate storyboard frames for one or more of the scenes. In some examples, the AI model(s) may generate or otherwise determine scene descriptions, cinematographic details, and / or visual representations (e.g., images) for each of the scene(s), and this information may be included or otherwise used to generate the storyboard frames corresponding to each of those scene(s). Additionally, in some examples, the AI model(s) may perform extrapolation to generate intermediate scenes / storyboard frames to create animatics.

This invention discloses an automated short drama creation and partial editing method based on a multi-agent collaborative mechanism, specifically relating to the field of short drama creation and editing technology. The method involves: acquiring natural language commands input by the user; generating a structured script containing plot tension parameters and node verification information through an agent; dynamically determining the character feature fusion weights based on the plot tension parameters and generating storyboards by combining preset character reference images to maintain character consistency; generating audio based on the structured script and extracting timestamp information from the vocal units; constraining video generation with audio duration and applying lip-sync enhancement processing to the video frame intervals corresponding to the timestamp information; and, upon receiving an editing command, triggering partial regeneration or reusing existing materials based on the comparison results between the target modification node and the corresponding node verification information in the structured script to synthesize the final video.

Features described herein generally relate to content production. Particularly, the present disclosure relates to facilitating video generation. Using machine-learning models, a storyboard can be generated from an inspirational video, video attributes can be determined for the storyboard, editing scores and actions can be determined for candidate videos, candidate videos can be edited based on the editing scores and actions, and the edited candidate videos can be combined to generate a video.

The application discloses a video generation method and device based on a data portrait and a storage medium, and belongs to the technical field of data processing. The method comprises the following steps: aggregating multi-source data of a target object from a data source, constructing a data portrait of the target object, inputting the data portrait into a story generation model, and generating a storyboard, wherein the storyboard comprises at least two scenes arranged based on a time axis, a scene is associated with a scene description, a side speech script and / or an emotional label, at least two media generation engines are called in parallel according to the emotional label and the scene description of the scene in the storyboard, voice dubbing, background music, animation materials and / or stylized materials are generated, and the generated voice dubbing, background music, animation materials and stylized materials are combined into a personalized video of the target object according to the time axis of the storyboard. The application combines the generated various materials into the personalized video of the target object based on the storyboard, and improves the overall coordination between various video generation scenes.

Systems and methods for producing a forensic storyboard that includes visual details of a criminal case. A forensic storyboard may be created from data within a forensic database. The forensic storyboard may be provided to a user through an interactive database. A user may be able to revise the forensic storyboard through the interactive webpage. A forensic storyboard may be output to a standalone file. A forensic storyboard may be used by an investigator to communicate details of a forensic investigation to superiors, colleagues, partners, other agencies, prosecutors, or judges.

The embodiment of the invention provides an image processing method and device, equipment, a computer readable storage medium and a product. The method comprises the steps of obtaining a to-be-processed image; performing content identification operation on the to-be-processed image through a preset image identification algorithm to obtain text description information corresponding to the to-be-processed image; generating at least one associated image associated with the content of the to-be-processed image based on the text description information; and splicing the to-be-processed image and the at least one associated image to obtain a target image. Therefore, the image processing mode of the to-be-processed image can be enriched, in addition, due to the fact that the association relation exists between the at least one associated image and the to-be-processed image, after the to-be-processed image and the at least one associated image are spliced, the target image can present the effect similar to a movie story board, and the image quality of the target image is improved.

A collaborative content generation system uses machine learning to generate a script and content depicting the performance of the script. A director may use the system to generate the script and optionally, may involve one or more collaborators who perform portions of the script. The system may use machine learning to generate or modify a script, a storyboard to visualize the story, a narrator (e.g., the narrator's voice), characters, music, sound effects, etc. A director may assign portions of the script to certain collaborators and select which of their recordings are interleaved into the final collaborative interleaved content series. The collaborators may independently perform their portions and provide clips of their performances to the system, which may then interleave the clips to produce the finalized content.

Embodiments of the present disclosure provide a video script generation method and apparatus, an electronic device, and a storage medium. User input data is acquired and the user input data includes a video requirement parameter, and the video requirement parameter at least represents a video content feature of a video to be generated. A pre-trained large language model processes the user input data to generate first script data, and the first script data includes at least two scene description texts for the video to be generated, and the scene description texts are used to describe image content under a video storyboard in a target video.

The invention discloses an oil and gas geological data association display method, and relates to the field of geological data display, and the method comprises the steps: accessing multi-source heterogeneous original oil and gas geological data, and carrying out the preprocessing, so as to obtain a multi-source data set; on the basis of the dynamic production data flow updated in real time, on-line dynamic correction is carried out on interpolation and constraint of the multi-source data set, and a three-dimensional active geological model is generated; inputting the three-dimensional active geological model into a geological physics engine, encoding an internal action relationship among different geological attributes into a linkage rule capable of being driven bidirectionally, and performing remodeling, symbiosis and evolution on static parameters and dynamic parameters in the three-dimensional active geological model in a self-consistent feedback loop to generate a unified geological coupling field; and loading the unified geological coupling field into a three-dimensional graphic rendering engine, and creating and rendering a basic three-dimensional visual scene. According to the method, interaction support is provided for the story board, and the composite document is output, so that real-time correction and multi-physical field coupling dynamic display of multi-source data are realized.

An object of the system according to the embodiment is to efficiently integrate and support each process of animation production.SOLUTION: A system according to an embodiment includes a storyboard creation tool, a character design tool, and an animation production tool. The storyboard creation tool creates an animated storyboard. The character design tool designs an animated character. The animation production tool produces animation.SELECTED DRAWING: Figure 1

The utility model discloses a children's picture book magnetic type replaceable story panel, including picture book base body, the rear side of picture book base body is equipped with the storage groove, the inside installation of storage groove has the support part, the rear side of picture book base body inner wall is equipped with the magnetic attraction board, the outside of support part inner wall and located the front side of magnetic attraction board is equipped with the mounting groove, the top of mounting groove inner wall penetrates picture book base body. The utility model discloses a cooperation of magnetic attraction adsorption piece, backboard and magnetic attraction board, has the advantage that the story panel is replaced, the storyboard is placed in the front side of backboard, and then the magnetic attraction adsorption piece is placed in the front side of the storyboard, at this moment, the magnetic attraction adsorption piece is adsorbed in the front side of the storyboard under the cooperation of the magnetic attraction board, the magnetic attraction adsorption piece is positioned to the storyboard, when replacing the storyboard subsequently, the magnetic attraction adsorption piece is taken down, the existing storyboard is taken away and then the new storyboard is replaced, and the magnetic attraction adsorption piece is positioned to the storyboard again.

We provide the system. [Solution] An input means for receiving the genre, theme, and related characteristics of content from the user, An analysis method that analyzes received information and compares it with past content, A generation method for generating new scripts while referencing past content, A means of creating storyboards based on the generated script, A means of sending the generated script and storyboard to the user, A means of regenerating the script and storyboards based on user feedback, A system that includes this.

This application provides a simulation testing method, apparatus, electronic device, computer-readable storage medium, and computer program product for autonomous driving. The method includes: performing static analysis on a simulated driving scene to obtain static information of scene elements; performing dynamic analysis on the simulated driving scene to obtain dynamic information of scene elements; determining a predefined file structure conforming to the simulator file format; wherein the predefined file structure defines entity nodes and storyboards; mapping the static information of scene elements to node descriptions of entity nodes in the predefined file structure, and mapping the dynamic information of scene elements to story descriptions of storyboards in the predefined file structure, to obtain a scene description file based on the predefined file structure; and importing the scene description file into a simulator for simulation testing. This application improves the simplicity and success rate of simulation testing.

This invention discloses a method, system, device, and medium for video content reproduction based on AI information perception. The method specifically includes: performing frame sequence analysis on the original video, combining audio features for multimodal fusion, and outputting a set of segmented video clips; dynamically selecting keyframes based on the video clip set according to content complexity to obtain a keyframe sequence; generating a script description with causal logic based on the keyframe sequence to obtain a structured script and action description text; combining the structured script, action description text, and a user preference model to generate a personalized image sequence; and using motion fidelity metrics for motion control and optimization based on the personalized image sequence and the action information of the original video to synthesize a target video. This invention achieves the maximum preservation of the original video's storyboard, plot, and actions when the main body of the video is changed, generating a target video with high visual consistency and narrative coherence.

An object of the system according to the embodiment is to effectively convey morally contents that a parent wants to teach a child.SOLUTION: A system includes a reception unit, a generation unit, a feedback unit, and a language conversion unit. The reception unit receives an input of a theme, a character, and a role. The generation unit analyzes the information received by the reception unit and generates a storyboard and a scenario according to the theme. The feedback unit extracts and feeds back a moral message obtained by the child based on the storyboard and the scenario generated by the generation unit. The language conversion unit converts the generated comic into a plurality of languages.SELECTED DRAWING: Figure 1

This invention relates to a method, apparatus, computer device, and storage medium for generating animation, comprising the following modules and their uses: a storyboard acquisition module for acquiring individual storyboards and arranging them sequentially; an identification module for identifying individuals with closed curves as units and determining these units as background units or non-background units; a background enhancement module for layering the initial storyboard drafts according to the order of the initial storyboard drafts in a one-to-one correspondence with background units, and completing the background units in each storyboard; a background creation module for generating animated GIFs of background units based on the changing trends between the background units of two input storyboards; a non-background creation module for generating the final animated GIFs of non-background units; an animation generation module for generating the final animation based on the work results of the background creation module and the non-background creation module; and an interactive display module for human-computer interaction with staff.

The invention discloses a method for editing various systems with different aspect ratios on the same screen in nonlinear editing. The method comprises the following steps: step 1, setting the width and height of an editing system; step 2, creating a playback window; step 3, creating a story board and a story board track; step 4, editing a story board; 5, rendering to generate an image; step 6, outputting the image to each system playback window; and step 7, outputting the video file. According to the method, the user can edit and output in different aspect ratio systems at the same time, the requirements of various terminal users on display equipment with different aspect ratios are met, the editing time is shortened, the working efficiency is improved, the user can operate editing objects uniformly while editing, and the user experience is improved. And the user can watch whether the images with different aspect ratio systems meet the content consistency or not at the same time.

A collaborative content generation system uses machine learning to generate a script and content depicting the performance of the script. A director may use the system to generate the script and optionally, may involve one or more collaborators who perform portions of the script. The system may use machine learning to generate or modify a script, a storyboard to visualize the story, a narrator (e.g., the narrator's voice), characters, music, sound effects, etc. A director may assign portions of the script to certain collaborators and select which of their recordings are interleaved into the final collaborative interleaved content series. The collaborators may independently perform their portions and provide clips of their performances to the system, which may then interleave the clips to produce the finalized content.

This image is for creating and editing storyboards. You can easily create storyboards by selecting a character's pose in the selection area, placing it in the drawing area, and setting the character's size, color, etc.

A non-transitory, computer readable medium storing instructions that, when executed by a processor, cause the processor to receive, via a graphical user interface (GUI), a first input indicative of a request to generate a storyboard including one or more visualizations associated with operation of one or more industrial automation systems, wherein the request identifies first and second data from one or more data sources, retrieve the first and second data from the one or more data sources, generate a first dataset based on the first data retrieved from the one or more data sources, generate a second dataset based on the first data retrieved from the one or more data sources, and generate for display via the GUI, the storyboard based on the first dataset and the second dataset.

We provide the system. [Solution] Information processing means for users to select and upload image and video information, An analysis means that receives uploaded image and video information and performs face recognition and object detection, A generation means that rearranges materials and generates a storyboard according to a style template selected through the information processing means, Based on the results obtained by the aforementioned analysis means, an effect-adding means for adding dynamic video effects, A means for compositing background music and outputting the final video, A system that includes this.