33 results about "Digital content creation" patented technology

The described system and method include rules and requirements for the creation of fake digital content, as well as ways to create the fake digital content (including creating original fake digital content and manipulating true digital content to make fake digital content). Also, the system and method provide a means to introduce the fake digital content into a process to recognize and analyze digital content in order to train that process to identify fake digital content. Furthermore, the system and method provide and a way to collect the results of the evaluation process and feed that back into the system and method for additional cycles (if needed).

The invention provides a multi-modal large model-based content generation method and system, and belongs to the technical field of digital content creation and dissemination, and the method comprises the steps: firstly building a demand association network comprising a user demand node, a content element node and a scene form node, and marking the association strength; constructing a multi-modal element coupling pool comprising a text description unit, a visual display unit and a semantic association unit on the basis, enabling the multi-modal element coupling pool to form mapping with demand association network nodes, calling a multi-modal large model to carry out situational mapping processing on the multi-modal element coupling pool, and generating an initial content framework set; and performing element collaborative optimization on the initial content framework set to obtain an optimized content framework conforming to content element node constraints, generating a target content set according to the optimized content framework, and pushing the target content set to a content distribution node to complete propagation, thereby efficiently generating and accurately propagating the multi-modal content.

The invention provides a zero sample video relighting method based on Fourier domain prior guidance. According to the method, the illumination effect reconstruction and adjustment of any video can be efficiently and naturally realized without carrying out additional training on a specific scene or an illumination condition. Specifically, by designing a Fourier domain prior guidance mechanism, the amplitude and phase information of an input video are decoupled, and the amplitude is used as explicit illumination prior to guide a diffusion model to realize the consistency of inter-frame illumination in the generation process. Meanwhile, in combination with low-frequency content guidance and high-frequency structure constraint, the retention capability of video content details and structure textures is effectively improved on the basis of keeping the overall illumination continuity. The method has the advantages of high generalization, natural illumination reconstruction, high structural detail fidelity and the like, and can be widely applied to the fields of movie and television special effects, virtual reality, digital content creation and the like. Experimental results show that the method is superior to existing similar technologies in the aspects of illumination consistency, time sequence smoothness, visual subjective evaluation and the like, and excellent comprehensive performance and practical application value are shown.

The application provides a content generation method and system based on a multi-modal large model, belonging to the technical field of digital content creation and dissemination. First, a demand association network containing user demand nodes, content element nodes and scene form nodes is established, and the association strength is labeled. Based on this, a multi-modal element coupling pool containing text description units, visual display units and semantic association units is constructed, which is mapped with the demand association network nodes. A multi-modal large model is called to perform situational mapping processing on the multi-modal element coupling pool, generating an initial content framework set. The initial content framework set is optimized in terms of element coordination, obtaining an optimized content framework that meets the constraints of the content element nodes. According to the optimized content framework, a target content set is generated and pushed to the content distribution node for dissemination, thereby efficiently generating and accurately disseminating multi-modal content.

The invention relates to the technical field of digital content production, and discloses an interactive digital content production system based on a Transform architecture. According to the system, text, image and audio data of original digital content are acquired through a content feature extraction module, cross-modal feature alignment is performed by using a multi-head attention mechanism, and content feature tensors with space-time relevance are generated; the dynamic weight distribution module calculates relative importance scores of different modal features based on the tensor, and adopts a gating mechanism to perform dynamic weight fusion to form content semantic enhancement representation; the interaction intention analysis module performs space-time coding matching on the enhanced representation and the user operation instruction stream, and analyzes an intention distribution matrix of user operation on the content dimension; a hierarchical decoding generation module constructs a multi-scale content generation path in a Transform decoder according to the intention distribution matrix; and the real-time rendering engine module loads implicit representation output by the path, so that efficient and intelligent digital content creation is realized.

The technology relates to an artificial intelligence (AI) driven tool that can enhance existing digital video components and simplify and automate the creation of new digital video components. The techniques include a digital video component creation tool that generates a digital video component using existing material, an out-of-picture tool that may add an out-of-picture generated from text to the video component, and a video component evaluation tool that may evaluate whether the video component conforms to an attribute associated with an optimal practice of a video creative.

The invention relates to a multi-stage AI cooperation and closed-loop self-healing video-to-script conversion method, and relates to the digital content creation cross technical field, the method comprises the following steps: obtaining a resource identifier ordered set of a series of videos, the resource identifier ordered set comprises a plurality of identifiers arranged in order, and each identifier corresponds to a video resource; based on the resource identifier ordered set, a preset first AI service model and a preset second AI service model, a first version script set is generated, the first AI service model represents a model with multi-mode video understanding and script generation capabilities, and the second AI service model represents a model with logic induction and information integration capabilities; creating a script verification object for each script in the first version script set, and performing closed-loop intelligent proofreading on each script verification object to generate a target script set. Through multi-stage AI cooperation and closed-loop self-healing, the technical effect of accurate, efficient and logically coherent video-to-script conversion is realized.

A data processing system implements receiving, via an application services platform, a automatically monitoring changes to an interactive canvas of a digital content creation application being executed on a client device, wherein the digital content includes any of text, audio, video, or structured file, determining, based on the monitored changes, that a change to the interactive canvas corresponds to a trigger condition for a task, generating a prompt based on the trigger condition and the function in the task, transmitting the prompt to a largescale language generative model, generating a transformed digital content, and transmitting the transformed digital content to the client device to be displayed on a user interface of the client device.

Methods, systems, and apparatus, including computer-readable storage media for generating model-generated digital content from prompts built using a combination of a base object description and targeting parameters for an intended audience. The digital content, once generated, can be served to a target audience indicated by the targeting parameters. A system implementing the methods described herein can generate content for various different audiences, indicated by different combinations of targeting parameters available on a campaign management platform serving the content. When the content is no longer being served the system can cause the digital content to be deleted or otherwise discarded. Instead of storing the content, the system can save the prompt and re-process the prompt through the model to re-generate the content. The system can further index prompts for later querying, so that the system can avoid generating new prompts over using stored prompts for content generation.

The invention relates to the technical field of digital content creation, and discloses an operation rollback method and device for digital content creation, equipment and a medium. The operation rollback method for digital content creation comprises the following steps: obtaining an operation record executed by a user on a target object; and converting the operation history log into a structured operation history log to realize the operation history log. The log records the type of each operation event, the identifier of an acted object and specific parameters in detail. When a user initiates a call request, the target operation event corresponding to the request can be positioned from the log, and the operation indicated by the user is executed according to the event. According to the method and the device, the operation history is structured into a callable data record, so that the flexible utilization of the history operation is realized, and an effective way is provided for solving the problems of limited operation rollback, difficulty in parameter multiplexing and the like in the prior art.

Methods, systems, and apparatus, including computer readable storage media, for generating digital content generated based on hints and other inputs. The prompt may be, for example, an input for modifying digital content associated with an existing activity. The hint may include a natural language input. The natural language cues may include, for example, topics, information related to upcoming events, topics of activities, etc. Other inputs may also include information associated with the style of the activity creator. The information associated with the style of the activity creator may be in an embedded form. A system implementing a method described herein may generate digital content of a modified activity based on received input received from the activity. The generated digital content may be in the form of text, image, or the like.

Methods, systems, and apparatus, including computer-readable storage media for generating model-generated digital content from prompts built using a combination of a base object description and targeting parameters for an intended audience. The digital content, once generated, can be served to a target audience indicated by the targeting parameters. A system implementing the methods described herein can generate content for various different audiences, indicated by different combinations of targeting parameters available on a campaign management platform serving the content. When the content is no longer being served the system can cause the digital content to be deleted or otherwise discarded. Instead of storing the content, the system can save the prompt and re-process the prompt through the model to re-generate the content. The system can further index prompts for later querying, so that the system can avoid generating new prompts over using stored prompts for content generation.

The invention discloses a digital content creation file management system, method and device and a storage medium, and the system comprises a data layer which communicates with a database, a file system and an external system, and stores and reads file versions and task information; the business logic layer is used for carrying out file management on the digital content creation file; wherein the file management comprises version control, file uploading, file downloading and cross-platform adaptation; the interface layer is used for providing a cross-platform graphical user interface so as to obtain interactive operation of a user; wherein the interface layer is provided with a dynamic menu unit, an information display unit and a version list unit; the plug-in layer is used for providing an adaptive plug-in for the digital content creation file management platform; and the interface layer is used for providing a unified API interface. According to the digital content creation file management system, the multi-layer digital content creation file management system is constructed, and the functions of all layers are effectively integrated, so that many problems of an existing management mode are effectively solved, and the overall management effect of the digital content creation file is improved.

In various examples, override-based data change propagation for distributed collaborative content creation platforms is provided. An override layer may be generated that comprises a representation of a sequence of override primitives that may be applied against a baseline universal scene description (USD) scene definition layer to render an updated / current version of the scene. A digital content creation application may record edits as modifications (overrides) to scene definition primitives are applied. A CCA may propagate the edits to other CCAs at other client nodes subscribed to the CCCP by sending a new layer message to the server of the CCCP, instructing the server to add the override layer to the scene graph of a root USD file. Other CCAs subscribed to the root USD file receive a message from the server that indicates that the new override layer has been added, and may selectively apply propagated override primitives.

The invention discloses a multi-role digital man-cast guest generation method and system based on multi-modal AI. The method comprises the steps that input multi-modal information is converted into text information, semantic understanding is carried out, key information is extracted, and a structured outline and node content are designed; performing digital person role setting and distribution, and generating a dialogue script by combining the structured outline and the node content with the digital person role setting; performing interaction point design and script optimization on the dialogue script, and generating a digital human role mouth shape video according to the dialogue script and role setting; performing scene design and synthesis according to the digital human role mouth shape video and the dialogue script; performing audio-visual synchronization and special effect processing; and finally rendering all the elements to generate a complete multi-role digital people-playing guest video, and outputting a file with a specified format and resolution according to user requirements. According to the method, the full-process automation from multi-source heterogeneous data input to multi-role interactive video output is realized, and the digital content creation efficiency and quality are remarkably improved.

The present invention relates to a digital copyright creation module that creates a digital copyright of digital content created using generative AI, and a digital content distribution apparatus and method using the same, and the digital content distribution apparatus includes a digital content creation management unit; and a digital content distribution management unit.

The application discloses a method and device for displaying progress, an electronic device and a computer readable storage medium. The method comprises: creating a sub-thread in response to a main thread of digital content creation software executing a repetitive task, wherein the sub-thread comprises a progress query function; calling the query function to query a current execution progress of the repetitive task in the main thread; sending a progress drawing instruction containing the current execution progress to the main thread through the sub-thread; and receiving the progress drawing instruction through the main thread to generate a progress identifier in an interface of the digital content creation software to represent the current execution progress. The method provided by the application can intuitively display the script execution progress of the repetitive task on the interface of the digital content creation software, and facilitate the user to accurately control the progress of the repetitive task execution.

Several examples demonstrate override-based data change propagation for distributed collaborative content creation platforms. An override layer can be created, comprising a representation of a sequence of override primitives that can be applied to a universal baseline scene description / scene definition (USD) layer to render an updated / current version of the scene. A digital content creation application can record edits while modifications (overrides) are applied to scene definition primitives. A CCA can propagate the edits to other CCAs on other client nodes subscribed to the CCCP by sending a new-layer message to the CCCP server, instructing the server to add the override layer to the scene graph of a USD root file.Other CCAs that subscribe to the USD root file receive a message from the server indicating that the new override layer has been added and can selectively apply propagated override primitives.

The application discloses a multi-role digital human podcast generation method and system based on multi-modal AI, which comprises the following steps: converting input multi-modal information into text information, performing semantic understanding and extracting key information, designing a structured outline and node content; performing digital human role setting and distribution, combining the structured outline and node content with the digital human role setting to generate a dialogue script; designing interaction points and optimizing the script according to the dialogue script and the role setting, generating a digital human role lip movement video; designing and synthesizing a scene according to the digital human role lip movement video and the dialogue script; performing audio-visual synchronization and special effect processing; finally rendering all elements to generate a complete multi-role digital human podcast video, and outputting a file with a specified format and resolution according to user requirements. The application realizes full-process automation from multi-source heterogeneous data input to multi-role interactive video output, and significantly improves the efficiency and quality of digital content creation.

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating dynamic digital content in privacy preserving ways are described. In one aspect, a method includes receiving, by a trusted server and from multiple content platforms, digital component data for digital components. The server received, from each content platform, dynamic content selection logic for selecting discrete content elements for digital components of the content platform. The server selects, from digital components for which digital component data is stored in a digital component repository, candidate digital components based at least on user data included in a digital component request. For each candidate digital component, the server executes the dynamic content selection logic of the content platform that provided the digital component data for the candidate digital component, the executing resulting in selection of a particular layout and a particular subset of content elements for the digital component.

A system for determining forgery or falsification of a digital content using a WebAssembly-based blockchain platform including a blockchain network, includes a client device configured to provide an original digital content to a relay server; the relay server configured to generate a hash for the original digital content provided from the client device and transmit the hash to a blockchain network; and a plurality of nodes configured to perform mining on a block including a transaction generated by distribution of a smart contract for the original digital content to distribute the mined block on the network, and perform comparison and verification between the smart contract for the original digital content included in the mined block and a smart contract for a digital content created using the original digital content, on a WebAssembly virtual machine.

The invention discloses an online resource automatic design generation method driven by a convolutional neural network, and belongs to the technical field of man-machine interaction and cooperative operation, and the method comprises the following steps: S1, data collection: collecting multiple types of design data as a training basis; s2, data preprocessing: carrying out cleaning and structured processing on the original data; s3, constructing a convolutional neural network model; s4, designing a generation process: realizing automatic design based on model output; s5, feedback improvement; s6, performing model evaluation and multi-dimensional verification; s7, performing multi-modal input fusion and semantic alignment; S8, performing dynamic resource optimization and hardware adaptation; s9, performing compliance examination and ethical constraint embedding; and S10, performing collaborative creation and version evolution management. Through technical innovation and engineering closed-loop design, the core problems of data splitting, equipment dependence, compliance risk and the like in the field of automatic design are solved, and an efficient, safe and sustainable intelligent solution is provided for digital content creation.

The application discloses a kind of digital person generation method and system based on multidimensional matching, method supports the input mode of text description or figure picture two alternatives, by constructing dynamic personification label library, it is combined with background recognition, multidimensional intelligent matching algorithm of age dimension judgment, linkage sound library and action library, then based on big model generation digital person video.The application realizes the accurate matching of digital person characteristics and scene, age, label attribute, solves the technical problems of low matching degree of sound, action and character label, scene in the existing digital person generation process, insufficient degree of personalization, improves the intelligent level and personalization level of digital person generation, and can be widely applied in digital content creation, virtual interaction and other fields.

The present disclosure relates to systems and methods for group-watching video streams. In one aspect the disclosed systems and methods may generate a multi-panel display of the viewers during viewing of the video streams. In another aspect, the systems and methods may capture and create one or more digital asset from viewer-generated content, such as a physical reaction, captured during the to the video stream. The system may generate the digital assets for subsequent use on social media.

Methods, apparatus and data stream are provided to encode a 3D scene comprising a scene description that allows a digital content creation device or a rendering device to seamlessly stitch accessories on characters of the 3D scene. The scene description comprises a node tree for objects like characters and for accessories. Accessory nodes comprise a mesh and key points. The scene description is encoded in a data stream. When an accessory is to be stitched to a character, corresponding key points of the object are retrieved and aligned with the key points of the accessory.

The application discloses a kind of movie-level animation video generation system and method based on multimodal fusion, it is related to artificial intelligence and digital content creation technical field.The system includes six big core modules of multimodal input, multimodal feature coding, audio feature processing, DiT main network, high-definition rendering, video synthesis and output;Method flow is to collect text, character ID, shot, style, audio and other multimodal input information, after feature coding, audio processing and feature fusion, time series modeling is carried out by DiT main network, video features are generated by combining depth perception, character consistency maintenance, film panning control technology, and then high-definition rendering, film and picture synchronization are completed to output movie-level animation video.The present application effectively solves the problems of character drift, lack of 3D space feeling, poor audio-visual synchronization, stiff panning and low image quality in existing AI video generation, realizes permanent locking of characters, real 3D depth perception, accurate audio-visual synchronization and 4K high-definition image output, and the overall system can be deployed at industrial level, suitable for commercial scenarios such as animation production and film creation.

In various examples, coverage-based data change propagation for a distributed collaborative content creation platform is provided. An overlay layer may be generated that includes a representation of a series of overlay primitives that may be applied to a baseline Universal Scene Description (USD) scene definition layer to render an update / current version of the scene. The digital content creation application may record edits when applying modifications (overlays) to the scene definition primitives. A content creation application CCA may propagate the edit to other content creation application CCA at other client nodes subscribing to a collaborative content creation platform CCCP by sending a new layer message to a server of the collaborative content creation platform CCCP instructing the server to add the overlay into a scene graph of a root USD file. Other content creation application CCA subscribing to the root USD file receives a message from a server indicating that a new overlay layer has been added, and may selectively apply propagated overlay primitives.

According to the virtual scene dynamic adaptation system and method based on space calculation, the medium, the program product and the terminal, the space description information of the target physical space is collected through the scanning device, the virtual scene is constructed through the three-dimensional digital content creation tool, and the space description information of the virtual scene is obtained; based on the space description information of the target physical space and the space description information of the virtual scene, adopting a visual editing tool to carry out space adaptation so as to obtain the space description information of the virtual scene after space adaptation; repositioning the digital content information of the virtual scene according to the spatial description information of the virtual scene after spatial adaptation to obtain the digital content information of the repositioned virtual scene; and carrying out visual display on the digital content information of the repositioned virtual scene in the target physical space. According to the application, accurate mapping and dynamic adaptation of the physical space and the virtual scene can be realized, and immersive virtual reality experience is provided for a user.

Some aspects relate to technologies for dynamically generating digital content for events using event data and content intent descriptors. In some aspects, when a content server identifies an event for digital content creation, the content server provides data to a user device that is based on event data for the event and a content intent descriptor. The user device generates a prompt using the received data and provides the prompt to a generative model on the user device, causing the generative model to generate a digital content item using the prompt as input. The user device then presents the digital content item.

The embodiment of the invention provides a content creation method and device, electronic equipment and a computer storage medium. The content creation method comprises the following steps: displaying a creation interface through digital content creation software; receiving a creation triggering operation in the creation interface, calling the content creation model to execute a content creation task matched with the received creation triggering operation, and obtaining a content creation result; the content creation model is an artificial intelligence model used for executing a content creation task; and updating the creation interface based on the content creation result. According to the embodiment of the invention, the efficiency and quality of content creation can be improved.