Method and apparatus for content authoring

Through the content creation tools deployed at the operating system level, the problem of inconvenience of users in assisted content creation in AI system is solved, convenient AI model interaction and content insertion in multiple editing applications is achieved, and the efficiency of content creation is improved and Compliance.

CN119096245APending Publication Date: 2024-12-06BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202480002195.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-06
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

When users use AI systems to assist content creation, they need to frequently switch browsers or special AI applications and edit applications, which leads to inconvenience in operation and need to write complex prompt words to obtain answer content in different styles.

Method used

Provides a content creation tool that is deployed at the operating system level and can be used in multiple editing applications, displays interface elements for interaction with generative models, receives user prompt words, obtains generated answer content, and inserts them into Currently editing application.

Benefits of technology

It simplifies the interaction process between users and AI systems, improves the convenience and efficiency of content creation, reduces the amount of user input, and improves the compliance of content through recommendation prompt word templates.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119096245A_ABST
    Figure CN119096245A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a content creation method and device, electronic equipment, a medium and a computer program product. The method comprises the steps that when a user executes editing operation in a target application, interface elements of a content creation tool used for interacting with a generative model are displayed; based on a user prompt word received on the interface element, obtaining answer content generated by the generative model; and inserting the answer content into the target application. In this way, the convenience and efficiency of content creation by a user using an AI tool are significantly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technology, and more particularly, to methods, devices, electronic devices, media, and computer program products for content creation. Background Art

[0002] Artificial intelligence generated content (AIGC) refers to any content created or generated by an AI system with or without human guidance. With advances in natural language processing (NLP), machine learning, and deep learning algorithms, AI is now able to generate various types of content, including text, images, videos, music, and more. Summary of the invention

[0003] To achieve AI-assisted content creation, users usually access an AI system with a generative model (for example, via a browser or using a dedicated application). Users ask questions to the AI ​​system and obtain answers to help it create content. The inconvenience of this method is that the user needs to switch back and forth between the browser or application that provides the answer content and the editing application that is creating the content, for example, copying the answer content into the editing application to complete the creation, or copying a piece of text from the editing application to ask questions to the AI ​​system.

[0004] In view of this, methods, devices, electronic devices, computer-readable storage media and program products for content creation are provided, which can help users interact with AI systems more conveniently to help them create content.

[0005] According to a first aspect of the present disclosure, a method for content creation is provided, comprising displaying an interface element of a content creation tool for interacting with a generative model while a user performs an editing operation within a target application; obtaining answer content generated by the generative model based on a user prompt word received on the interface element; and inserting the answer content into the target application.

[0006] According to a second aspect of the present disclosure, there is provided an apparatus for content creation, comprising: a display unit configured to display an interface element of a content creation tool for interacting with a generative model while a user performs an editing operation within a target application; a content acquisition unit configured to acquire answer content generated by the generative model based on a user prompt word received on the interface element; and a content insertion unit configured to insert the answer content into the target application.

[0007] According to a third aspect of the present disclosure, an electronic device is provided, comprising: one or more processors; and a memory for storing one or more programs, wherein the one or more programs are executed by the one or more processors so that the one or more processors implement the method described in the first aspect of the present disclosure.

[0008] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method according to the first aspect of the present disclosure is implemented.

[0009] According to a fifth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the method according to the first aspect of the present disclosure.

[0010] This Summary is provided to introduce a selection of concepts in a simplified form that are further described in the Detailed Description below. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other objects, features and advantages of the present disclosure will become more apparent through a more detailed description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, wherein like reference numerals generally represent like components throughout the exemplary embodiments of the present disclosure.

[0012] Figure 1 A block diagram showing a computing device capable of implementing various implementations of the present disclosure is shown;

[0013] Figure 2 A schematic flow chart of a method for content creation according to an embodiment of the present disclosure is shown;

[0014] FIG. 3A to FIG. 3C An exemplary user interface diagram for content creation using a content creation tool according to an embodiment of the present disclosure is shown;

[0015] FIG. 4A to FIG. 4I An exemplary user interface diagram showing content creation using a content creation tool according to an embodiment of the present disclosure; and

[0016] Figure 5 A schematic block diagram of an apparatus for content creation according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0017] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0018] The present disclosure will now be discussed with reference to several example implementations. It should be understood that these implementations are discussed only to enable those skilled in the art to better understand and thus implement the present disclosure, rather than implying any limitation on the scope of the present disclosure.

[0019] As used herein, the term "including" and its variations are to be interpreted as open-ended terms meaning "including but not limited to". The term "based on" is to be interpreted as "based at least in part on". The terms "an implementation" and "an implementation" are to be interpreted as "at least one implementation". The term "another implementation" is to be interpreted as "at least one other implementation". The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included below. It should be noted that any numerical values ​​or numbers used in the present disclosure are exemplary and are in no way intended to limit the scope of the present disclosure.

[0020] Traditionally, in order to achieve AI-assisted content creation, users access AI systems through browsers or use special AI applications. Users provide prompt words to the AI ​​system and request the AI ​​system to generate answer content to help them create content. Users usually create content in specific editing applications. To do this, they need to switch back and forth between the browser or AI application and the editing application, for example, copying the answer content into the editing application to complete the creation, or copying a text from the editing application to ask questions to the AI ​​system. On the other hand, users may expect to obtain answer content of different styles under different editing applications, which requires users to write more complex prompt words for the AI ​​system. These problems have brought many inconveniences to users using AI systems for content creation.

[0021] In view of this, an embodiment of the present disclosure provides a content creation tool that can be used across multiple editing applications to interact with an AI model, which is deployed in an operating system and associated with multiple editing applications. When a user performs an editing operation in a given editing application, the content creation tool can be activated and displayed (for example, displayed in a floating window on the upper layer of the current editing application). After receiving the prompt word entered by the user in the tool, the answer generated by the AI ​​model is obtained and presented to the user. The user can confirm the insertion of the content in the content creation tool (for example, click or touch the control on the floating window), thereby inserting the content generated by the AI ​​model as a whole into the current editing application.

[0022] The following references Figures 1 to 5 Detailed description of implementation details of the embodiments of the present disclosure.

[0023] Figure 1 1 is a block diagram of a computing device 100 capable of implementing multiple implementations of the present disclosure. It should be understood that Figure 1 The computing device 100 shown is merely exemplary and should not be construed as limiting the functionality and scope of the implementations described in the present disclosure. Figure 1 As shown, components of computing device 100 may include, but are not limited to, one or more processors or processing units 110 , memory 120 , storage device 130 , one or more communication units 140 , one or more input devices 150 , and one or more output devices 160 .

[0024] In some implementations, the computing device 100 can be implemented as various user terminals with computing capabilities. User terminals are such as any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, sites, units, devices, multimedia computers, multimedia tablets, Internet nodes, communicators, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. It is also foreseeable that the computing device 100 can support any type of interface for the user (such as "wearable" circuits, etc.).

[0025] Processing unit 110 may be a real or virtual processor and may be capable of performing various processes according to a program stored in memory 120. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to increase the parallel processing capabilities of computing device 100. Processing unit 110 may also be referred to as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, a controller, or a microcontroller.

[0026] The computing device 100 typically includes multiple computer storage media. Such media can be any available media accessible to the computing device 100, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 120 can be a volatile memory (such as a register, a cache, a random access memory (RAM)), a non-volatile memory (such as a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The memory 120 may include a content creation tool 122 implemented as a program module, and the content creation tool 122 may be configured to execute the content creation method described herein or implement a program module of a corresponding content creation device. The content creation tool 122 can be accessed and run by the processing unit 110 to implement the corresponding function.

[0027] Storage device 130 may be a removable or non-removable medium and may include machine-readable media that can be used to store information and / or data and can be accessed within computing device 100. Computing device 100 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 1 As shown in , a disk drive for reading or writing from a removable, nonvolatile disk and an optical drive for reading or writing from a removable, nonvolatile optical disk can be provided. In these cases, each drive can be connected to a bus (not shown) by one or more data media interfaces.

[0028] The communication unit 140 enables communication with another computing device via a communication medium. Additionally, the functions of the components of the computing device 100 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Therefore, the computing device 100 can operate in a networked environment using a logical connection with one or more other servers, a personal computer (PC), or another general network node.

[0029] Input device 150 may be one or more various input devices, such as a mouse, keyboard, tracking ball, voice input device, etc. Output device 160 may be one or more output devices, such as a display, a speaker, a printer, etc. Computing device 100 may also communicate with one or more external devices (not shown) through communication unit 140 as needed, such as storage devices, display devices, etc., communicate with one or more devices that allow a user to interact with computing device 100, or communicate with any device that allows computing device 100 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0030] In some implementations, in addition to being integrated on a single device, some or all of the various components of the computing device 100 can also be set in the form of a cloud computing architecture. In a cloud computing architecture, these components can be remotely arranged and can work together to implement the functions described in the present disclosure. In some implementations, cloud computing provides computing, software, data access and storage services, which do not require end users to know the physical location or configuration of the system or hardware that provides these services. In various implementations, cloud computing uses appropriate protocols to provide services through a wide area network (such as the Internet). For example, a cloud computing provider provides applications through a wide area network, and they can be accessed through a web browser or any other computing component. The software or components of the cloud computing architecture and the corresponding data can be stored on a server at a remote location. The computing resources in a cloud computing environment can be merged at a remote data center location or they can be dispersed. Cloud computing infrastructure can provide services through a shared data center, even if they appear as a single access point for users. Therefore, the components and functions described herein can be provided from a service provider at a remote location using a cloud computing architecture. Alternatively, they can also be provided from a traditional server, or they can be installed on a client device directly or otherwise.

[0031] Using the content creation tool 122, the computing device 100 can assist the user in content creation according to various implementations of the present disclosure. The content creation tool 122 can be implemented at the level of the operating system of the computing device 100, and is associated with different editing applications, including but not limited to text editing applications, graphic applications, video applications, etc., so that it can be called within these editing applications. The content creation tool 122 can be configured to provide interaction with an AI system with a generative model, for example, providing the prompt word 170 input by the user to the AI ​​system to obtain the answer content generated by the AI ​​system. The content creation tool 122 can also be configured to provide interaction with the user, for example, receiving user input (such as a prompt word), presenting the answer content 180 generated by the AI ​​system to the user, and receiving a user's instruction to insert the answer content into the current editing application, etc. In some implementations, the content creation tool 122 can also provide an interface for users to edit or modify AI-generated content. It should be noted that the AI ​​system can be implemented in the cloud (for example, a server or a cluster), so that the content creation tool 122 of the computing device 100 accesses the AI ​​system via a network. In some implementations, some AI systems may also be implemented locally on the computing device 100 .

[0032] Figure 2 2 is a schematic flow chart of a method 200 for content creation according to an embodiment of the present disclosure. The method 200 may be performed by, for example, Figure 1 More specifically, the method 200 may be implemented by the computing device 100 shown in FIG. Figure 1 It should be understood that the method 200 may also include additional actions not shown and / or may omit the actions shown, and the scope of the present disclosure is not limited in this respect. For ease of description, refer to Figure 3A Method 200 is described with reference to the interface diagrams shown in FIG. 3F .

[0033] like Figure 2 As shown, in box 210, while the user performs an editing operation within the target application, an interface element of a content creation tool for interacting with a generative model is displayed. In this article, a generative model is a machine learning model that generates new data instances based on the probability distribution of training data, including but not limited to text, images, videos, audio, or music. The target application is any application that can have an editing function, such as a text editing application, a graphic application, a video or audio application, and the editing operation can include creating text content, audio content, video content, image content, etc. The following takes the creation of text content as an example to explain the details of the embodiments of the present disclosure, but it should be understood that the embodiments of the present disclosure are also applicable to other types of creation.

[0034] The content creation tool can be deployed at the operating system level and associated with multiple applications installed in the operating system. For example, the content creation tool can be associated with an application with editing and creation capabilities in a user-manual or pre-configured manner. Thus, when the user creates content in these applications, the content creation tool can be called or enabled. In some embodiments, the user can also manually set the application scope of the content creation tool, for example, limit its use in one or some applications, or globally stop using the content creation tool.

[0035] Figure 3A An exemplary interface 300 of a target application currently being used by a user is shown. As shown in the figure, the interface 300 includes a toolbar area 301 and an editing area 302 of the target application. It can be understood that Figure 3A The interface 300 shown is merely exemplary, and the interface of the target application may be different therefrom, for example, it may not necessarily include the toolbar area 301 , or may include more interface elements.

[0036] When the user intends to input content (e.g., text, image, video, audio, etc.) in the target application, the interface element 303 of the content creation tool is displayed. The interface element 303 includes at least an input box for inputting a prompt word. The user can enter the prompt word in the input box, hoping to use the generative model to create content. In some embodiments, when the user selects existing content in the target application, this indicates that the user may want to generate information associated with the selected content, and the interface element 303 of the content creation tool can be displayed.

[0037] In block 220, based on the user prompt word received on the interface element, the answer content generated by the generative model is obtained. Figure 3B As shown, the user can input a prompt word 304 and select "Submit", then the prompt word in the input box will be provided to the generative model, and the generative model will generate the answer content.

[0038] The content creation tool provides the prompt word to the generative model, for example, via a network to a cluster or agent running the generative model. The generative model can generate answer content based on the prompt word. In some embodiments, the generative model can also generate answer content in combination with the user's context or historical information. Then, the generative model provides the answer content to the content creation tool.

[0039] At block 230, the answer content is inserted into the target application. Figure 3C As shown, the answer content 305 is inserted into the editing area 302 of the target application. In some embodiments, the answer content 305 can be directly inserted into the target application, that is, after the user submits the prompt word, the answer content 305 is directly inserted into the target application without other operations. In some embodiments, the user can give an insertion instruction and manually insert the answer content into the target application. In some embodiments, the answer content can be displayed in an interface element or other window so that the user can preview the answer content and edit it as needed. Then, the user can give an insertion instruction, for example, click or touch the insert button on the instruction interface to insert the answer content into the target application. In some embodiments, the answer content can be inserted into the comment box of the target application. For example, when the content creation tool is triggered by selecting existing content, the answer content can be inserted into the comment box corresponding to the selected content.

[0040] The following combination FIG. 4A to FIG. 4I The exemplary user interface diagram shown in FIG. 1 is used to describe more embodiments of the present disclosure. Figure 4A As shown, the interface 400 includes a toolbar area 401 and an editing area 402 of the target application. It can be understood that Figure 3A The interface 300 shown is merely exemplary, and the interface of the target application may be different therefrom, for example, it may not necessarily include the toolbar area 301 , or may include more interface elements.

[0041] In some embodiments, if the user is intending to enter text content or media content in the target application, an icon or toolbar for calling the content creation tool can be displayed. For example, in response to the user activating the input box in the target application, an icon 410 for calling the content creation tool is displayed so that the user can select it to trigger its use. Alternatively, the content creation tool can be loaded into the toolbar 401 and triggered for use by manual selection by the user. Additionally or alternatively, if the user selects text or media content in the target application, this means that the user may want to query or generate related content, and an icon or toolbar 410 for calling the content creation tool can also be displayed at this time.

[0042] In response to the user selecting icon 410, one or more functional menu items of the content creation tool are displayed. Figure 4B As shown, when the user clicks, touches, or hovers the cursor over icon 410, a menu item 420 of "Help me write" or "Real-time translation" is displayed. "Help me write" means using a generative model to generate creative content, for example, the user requests the model to generate more information on a certain topic, and "Real-time translation" means using a generative model to generate corresponding translation content as the user enters text in the target application. Figures 4C-4H An exemplary "help me write" function is described, and an exemplary "real-time translation" function is described with reference to FIG3F . It can be understood that the content creation tool can have more functions and is not limited thereto.

[0043] If the user selects either the "Help me write" function or the "Implement translation" function, the interface elements of the content creation tool may be displayed, and the interface elements may be displayed on the layer of the target application in the form of a hanging window. Figure 4C The interface element 430 is shown after the user selects the “Help me write” function, including an input area 432 and a template recommendation area 433 .

[0044] In certain embodiments, prompt words template can be used to generate prompt words provided to the model. Specifically, the prompt words template to be used can be determined, and user prompt words are added to the prompt words template to obtain prompt words for the generative model. Then, by providing the resulting prompt words to the generative model, the answer content generated by the generative model is obtained. In this way, the user does not need to manually input all prompt words, but only needs to input the theme of his / her expectation in the partially completed template. Doing so can reduce the user input amount on the one hand, and on the other hand, using the prompt words template can have the content that is more in line with the user's expectation.

[0045] As mentioned above, the content creation tool may be associated with multiple editing applications, and different types of editing applications may have different content creation features. In some embodiments, multiple recommended prompt word templates 434 may be displayed, each prompt word template being associated with an editing application. Figure 4C As shown, template 1 associated with application 1, target 2 associated with application 2, and template 3 associated with application 3 are shown on interface element 430. The user can select a template to use.

[0046] In some embodiments, the recommended prompt word template can also be determined based on the category label of the target application currently in use. Each category label can be mapped to one or more prompt word templates. For example, the template of an office application can be a template for generating table content, the target of a graphic application can be a template for generating a combination of pictures and text, and so on. In some implementations, the category label can be divided into several layers, i.e., primary labels, secondary labels, etc., and each layer of labels is mapped to one or more templates.

[0047] refer to Figure 4D In response to the user manually selecting Template 1 or the content creation tool automatically selecting Template 1 associated with the current target application (ie, Application 1), the fixed prompt word of the template is automatically filled in the input area 432. Figure 4D As shown, the content of Template 1 is: Help me write a video script about Application 1 on [Topic], with each sentence being attractive and output in a table format. "At this point, the user only needs to manually fill in the content of [Topic]. Then, the user selects "Submit", and the complete prompt words are input into the generative model, and accordingly, the content creation tool obtains the answer content generated by it.

[0048] Figure 4E An interface for submitting prompt words and obtaining answer content is shown, including an input area 432, which prompts the user whether to continue creating, a content area 440, which shows the answer content generated by the generative model, and an operation area, including "Insert" 442, "Copy", "Regenerate", "Adjust", etc.

[0049] When the user clicks or touches "Insert" 442, the answer content in the content area 340 will be completely inserted into the target application. In some embodiments, the user can also click or touch "Adjust" to edit the answer content, and then click "Insert" to insert the edited content into the target application. In some embodiments, the answer content can be inserted into the editable area of ​​the target application. Figure 4FAs shown, the content 450 generated by the model is inserted into the editable area 402 of the target application. Optionally, when the user triggers the content creation tool by selecting existing content, the answer content can also be inserted into the comment box of the corresponding content.

[0050] In some embodiments, the display location of the answer content can also be determined based on whether the target application has the ability to edit the generated answer content, that is, directly inserting it into the target application or displaying it in a floating window. If the target application has the ability to edit the answer content, the answer content can be directly inserted into the target application; if the target application does not have the ability to edit the answer content, the answer content is displayed in a floating window. Taking the image format as an example, if the current application has image editing capabilities and the generated content includes images, the generated content can be displayed directly because the user can edit it directly within the current application. Figure 4G As shown, the image 460 generated by the model is directly inserted into the target application. If the current application is a consumer application, it may not have editing capabilities, so it is necessary to display a floating layer first for the user to make secondary modifications and edits, and then display it in the interface of the current application after confirmation. Figure 4H As shown, the image 460 generated by the model is displayed in a floating window 470, which also includes a control 462 for inserting the image into the target application and a control 464 for editing the image, etc. The floating window 470 can be embedded in the interface element 430 of the content creation tool, or can be a separate floating window.

[0051] Fig. 4I The following is an interface diagram of using a generative model to create real-time content according to an embodiment of the present disclosure. Figure 4B When you select the "Real-time Translation" menu item in the interface shown, the interface elements of the content creation tool are presented as Fig. 4I In this case, the answer content generated by the generative model can be displayed in real time in the content area 490 of the interface element 430 based on the user input 480 (i.e., the prompt word) in the target application. It can be understood that the "real-time translation" menu item corresponds to a hidden prompt word template, which triggers the generative model to provide real-time translation content for the user input 480.

[0052] Figure 5 FIG. 5 shows a schematic block diagram of a device 500 for content creation according to an embodiment of the present disclosure. The device 500 may be composed of Figure 1 The computing device 100 shown in FIG. Figure 5 As shown, the apparatus 500 includes a display unit 510 , a content acquisition unit 520 , and a content insertion unit 530 .

[0053] The display unit 510 is configured to display an interface element of a content creation tool for interacting with a generative model during a user performing an editing operation in a target application. The content acquisition unit 520 is configured to acquire answer content generated by the generative model based on a user prompt word received on the interface element. The content insertion unit 530 is configured to insert the answer content into the target application.

[0054] It should be noted that the reference Figures 1 to 4I Further actions or steps described can be Figure 5 For example, the device 500 may include more modules or units to implement the actions or steps described above, or Figure 5 Some of the units or modules shown may be further configured to implement the actions or steps described above, which will not be repeated here.

[0055] References Figures 1 to 5 The technical solution of using a generative model to help users create content in an embodiment of the present disclosure is described. Compared with the traditional method, the advantage of the proposed technical solution is that the user can call up the window of the content creation tool at any time in various editing applications of the operating system, and use this tool to conveniently insert the content generated by the model into the editing application. In some embodiments, a creation template is automatically recommended in the window based on the user's current editing application. After the user selects a suitable creation template or directly describes the content he wants to create, the generative model generates the creation content, and the user can insert it into the application with one click. In this way, the convenience and efficiency of users using AI tools to create content are significantly improved.

[0056] Some example implementations of the present disclosure are listed below.

[0057] In a first aspect, a method for content creation is provided, comprising: displaying an interface element of a content creation tool for interacting with a generative model during a user performing an editing operation in a target application; acquiring answer content generated by the generative model based on a user prompt word received on the interface element; and inserting the answer content into the target application.

[0058] In some embodiments, the content creation tool is deployed at the level of an operating system, and the operating system is installed with a plurality of applications, and the content creation tool is callable in the plurality of applications.

[0059] In some embodiments, obtaining answer content generated by the generative model includes: determining a prompt word template to be used; adding the user prompt word to the prompt word template to obtain a prompt word for the generative model; and obtaining the answer content generated by the generative model by providing the prompt word to the generative model.

[0060] In some embodiments, determining the prompt word template to be used includes: based on the category label of the target application, determining a prompt word template associated with the category label as a recommended prompt word template.

[0061] In some embodiments, determining the prompt word template to be used includes: displaying multiple prompt word templates, the multiple prompt word templates including prompt word templates respectively associated with multiple target applications; and determining one of the multiple prompt word templates as the prompt word template to be used based on user selection.

[0062] In some embodiments, displaying an interface element of a content creation tool for interacting with a generative model includes: in response to the user intending to enter text or media content within a target application, or in response to the user selecting text or media content within the target application, displaying an icon or toolbar for invoking the content creation tool; and displaying the interface element based on user input to the icon or toolbar, the interface element comprising a hanging window.

[0063] In some embodiments, the interface element includes at least one of the following: an input area for inputting a prompt word; a content area for displaying the answer content generated by the generative model; a toolbar for editing the answer content; and a control for inserting the answer content as a whole into the target application.

[0064] In some embodiments, inserting the answer content into the target application also includes: determining whether the target application has the ability to edit the answer content; in response to determining that the target application has the ability to edit the answer content, inserting the answer content directly into the target application; and in response to determining that the target application does not have the ability to edit the answer content, displaying the answer content in a floating window.

[0065] In some embodiments, obtaining the answer content generated by the generative model includes: displaying the answer content in the content area in real time based on user input in the target application.

[0066] In some embodiments, inserting the answer content into the target application includes: in response to receiving an insertion instruction, inserting the answer content into the target application, or in response to obtaining the answer content, directly inserting the answer content into the target application.

[0067] In some embodiments, inserting the answer content into the target application includes: inserting the answer content into an editable area or a comment box of the target application.

[0068] In some embodiments, the method further comprises: limiting usage of the content creation tool in the target application or operating system.

[0069] In a second aspect, a device for content creation is provided. The device includes: a display unit configured to display an interface element of a content creation tool for interacting with a generative model during a user performing an editing operation in a target application; a content acquisition unit configured to acquire answer content generated by the generative model based on a user prompt word received on the interface element; and a content insertion unit configured to insert the answer content into the target application.

[0070] In a third aspect, an electronic device is provided. The electronic device includes: at least one processor; at least one memory, the at least one memory is coupled to the at least one processor and stores instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, enable the electronic device to: display an interface element of a content creation tool for interacting with a generative model during a user performing an editing operation in a target application; obtain answer content generated by the generative model based on a user prompt word received on the interface element; and insert the answer content into the target application.

[0071] In a fourth aspect, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium includes machine-executable instructions, and when the machine-executable instructions are executed by a device, the device performs the method of the first aspect.

[0072] In a fifth aspect, the present disclosure provides a computer program product, which is tangibly stored in a non-transitory computer storage medium and includes machine executable instructions, which, when executed by a device, cause the device to perform the method of the first aspect above.

[0073] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip systems (SOCs), load programmable logic devices (CPLDs), and the like.

[0074] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0075] In the context of the present disclosure, a machine-readable medium may be a non-transient tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0076] In addition, although each operation is described in a specific order, this should be understood as requiring such operation to be performed in the specific order shown or in a sequential order, or requiring that all illustrated operations should be performed to obtain the desired result. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Certain features described in the context of a separate implementation can also be implemented in a single implementation in combination. On the contrary, the various features described in the context of a single implementation can also be implemented in multiple implementations individually or in any suitable sub-combination.

[0077] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A method for content creation, comprising: During an editing operation performed by a user within the target application, displaying an interface element of a content authoring tool for interacting with the generative model; Based on the user prompt word received on the interface element, obtaining the answer content generated by the generative model; as well as The answer content is inserted into the target application.

2. The method according to claim 1, wherein: The content creation tool is deployed at the level of an operating system, and the operating system is installed with a plurality of applications, and the content creation tool is callable in the plurality of applications.

3. The method according to claim 1, wherein: Obtaining the answer content generated by the generative model includes: Determine the prompt word template to be used; Adding the user prompt word to the prompt word template to obtain a prompt word for the generative model; and By providing the prompt word to the generative model, the answer content generated by the generative model is obtained.

4. The method according to claim 3, wherein determining the prompt word template to be used comprises: Based on the category label of the target application, a prompt word template associated with the category label is determined as a recommended prompt word template.

5. The method according to claim 3, wherein determining the prompt word template to be used comprises: displaying a plurality of prompt word templates, wherein the plurality of prompt word templates include prompt word templates respectively associated with a plurality of target applications; as well as Based on the user selection, one of the plurality of prompt word templates is determined as the prompt word template to be used.

6. The method according to claim 1, wherein: The interface elements that expose the content authoring tools used to interact with the generative model include: In response to the user intending to input text or media content in the target application, or in response to the user selecting text or media content in the target application, displaying an icon or toolbar for invoking the content creation tool; and Based on user input to the icon or toolbar, the interface element is displayed, and the interface element includes a hanging window.

7. The method according to claim 1, wherein the interface element comprises at least one of the following: An input area for inputting a prompt word; A content area for displaying the answer content generated by the generative model; A toolbar for editing the content of the answer; as well as A control for causing the answer content to be inserted as a whole into the target application.

8. The method according to claim 7, wherein inserting the answer content into the target application further comprises: Determining whether the target application has the capability of editing the answer content; In response to determining that the target application has the capability to edit the answer content, inserting the answer content directly into the target application; as well as In response to determining that the target application does not have the capability to edit the answer content, displaying the answer content in a floating window.

9. The method according to claim 7, wherein obtaining the answer content generated by the generative model comprises: Based on the user input in the target application, the answer content is displayed in the content area in real time.

10. The method according to claim 1, wherein: Inserting the answer content into the target application comprises: In response to receiving the insertion instruction, inserting the answer content into the target application, or In response to acquiring the answer content, the answer content is directly inserted into the target application.

11. The method according to claim 1, wherein: Inserting the answer content into the target application comprises: The answer content is inserted into the editable area or comment box of the target application.

12. The method according to claim 1, further comprising: The use of the content creation tool in the target application or operating system is restricted in a configurable manner.

13. A device for content creation, comprising: a display unit configured to display an interface element of a content creation tool for interacting with a generative model during an editing operation performed by a user in a target application; a content acquisition unit, configured to acquire answer content generated by the generative model based on a user prompt word received on the interface element; as well as The content inserting unit is configured to insert the answer content into the target application in response to receiving an inserting instruction on the interface element.

14. An electronic device, comprising: one or more processors; as well as A memory for storing one or more programs, wherein the one or more programs are executed by the one or more processors so that the one or more processors implement the method according to any one of claims 1-11.

15. A computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method according to any one of claims 1 to 12.

16. A computer program product comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 12.

Citation Information

Cited By

  • Media content processing method and device, equipment, storage medium and program product

    CN121284345A

  • Content generation method and device, electronic equipment and storage medium

    CN121350208A