Object processing method, device, electronic device and readable storage medium

Abstract

The present application discloses an object processing method, device, electronic device and readable storage medium, which belongs to the field of artificial intelligence technology. The method includes: receiving a first input to an AI interactive interface; the first input corresponds to a first object; in response to the first input, performing content publishing processing on the first object through an AI model; and displaying the content publishing processing result of the first object on the content publishing interface.

Description

Technical Field

[0001] The present application belongs to the field of artificial intelligence technology, and specifically relates to an object processing method, device, electronic device and readable storage medium. Background Art

[0002] With the continuous advancement of electronic device technology, various social applications are increasingly used on electronic devices, and users are increasingly relying on social platforms to share content.

[0003] In the related art, when a user needs to publish content on a social platform, for example, when a user needs to publish graphic content, the user needs to manually open the social application, select a picture on the content publishing interface of the social application, edit the text, and then publish the picture to the social platform, which makes the entire content publishing process cumbersome and time-consuming, resulting in low content publishing efficiency. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide an object processing method, device, electronic device and readable storage medium, which can improve the efficiency of content publishing.

[0005] In a first aspect, an embodiment of the present application provides an object processing method, the method comprising: receiving a first input to an AI interactive interface; the first input corresponds to a first object; in response to the first input, performing content publishing processing on the first object through an AI model; and displaying the content publishing processing result of the first object on the content publishing interface.

[0006] In a second aspect, an embodiment of the present application provides an object processing device, which includes: a receiving module, a processing module and a display module, wherein: the above-mentioned receiving module is used to receive a first input to an AI interactive interface; the first input corresponds to a first object; the above-mentioned processing module is used to perform content publishing processing on the first object through an AI model in response to the first input received by the above-mentioned receiving module; the above-mentioned display module is used to display the content publishing processing result of the first object on the content publishing interface.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, the electronic device receives a first input to the AI ​​interactive interface, the first input corresponds to a first object, and in response to the first input, performs content publishing processing on the first object through the AI ​​model, and displays the content publishing processing result of the first object on the content publishing interface. Through this method, the electronic device can intelligently perform content publishing processing on the first object through the AI ​​model, without the need for the user to manually publish content, thereby improving content publishing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A flowchart of an object processing method provided in an embodiment of the present application;

[0013] Figure 2A One of the interface schematic diagrams used by the object processing method provided in the embodiment of the present application;

[0014] Figure 2B The second schematic diagram of the interface used by the object processing method provided in the embodiment of the present application;

[0015] Figure 3 The third schematic diagram of the interface used by the object processing method provided in the embodiment of the present application;

[0016] Figure 4 A fourth schematic diagram of an interface used by the object processing method provided in an embodiment of the present application;

[0017] Figure 5 A fifth schematic diagram of an interface used by the object processing method provided in an embodiment of the present application;

[0018] Figure 6 A sixth schematic diagram of an interface used by the object processing method provided in an embodiment of the present application;

[0019] Figure 7 A schematic diagram of the structure of an object processing device provided in an embodiment of the present application;

[0020] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0021] Fig. 9A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0023] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0024] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0025] The object processing method provided in the embodiment of the present application can be applied to the scenario of publishing graphic and text content on a social platform.

[0026] For the scenario of publishing graphic content on a social platform, assuming that the user wants to publish the photos taken during the trip on the social platform, the user needs to first open the social application in the electronic device, and then click the "Content Release" option in the social application to enter the content release interface of the social application, and then add the pictures and edit the text that he wants to publish on the social platform in the content release interface, and finally click the "OK" option to complete the release of the graphic content. In an embodiment of the present application, the user can select the pictures he wants to publish on the social platform in the AI ​​interactive interface, and enter the content release instruction "Please describe this picture and publish it on the social platform", and the electronic device inputs the content release instruction into the artificial intelligence model, performs content release processing on the picture through the artificial intelligence model, and displays the content release processing result of the picture on the content release interface, so that the content release processing result can be quickly released on the content release interface. In this way, the electronic device can automatically perform content release processing and display the content release processing result through the artificial intelligence model according to the pictures and instructions entered by the user, without the user manually selecting the images and related information to be published in the content release interface, thereby simplifying the steps of the entire content release process, thereby improving the efficiency of content release.

[0027] In the embodiment of the present application, assuming that the user wants to plan a trip, the user can input multiple destination scenic spots pictures and related text materials (such as text descriptions in travel guides), and enter the content publishing instruction "Generate a travel guide for scenic spots" in the AI ​​interactive interface. The electronic device inputs the content publishing instruction into the AI ​​model, and the AI ​​model uses the AI ​​recognition processing (picture, document, recognition) function to identify the iconic scenic spot elements in the picture, and extract and summarize the key information from the text materials, such as the special activities of each scenic spot, the best time to visit, etc. Then, a travel guide is generated in combination with the graphic information, and the travel guide is automatically published to the social platform.

[0028] In an embodiment of the present application, assuming that a user wants to organize travel memories, the user inputs travel photos and casually recorded text notes in the AI ​​interactive interface, and the electronic device can classify and organize them through the AI ​​model, grouping photos of similar scenes or the same location, and extract metadata such as geographic information and time information in the photos through image and text separation technology, and combine it with the description of feelings in the text notes to generate a complete travel memoir-style long article for the circle of friends or make it into a beautiful picture story collection to share on social platforms, so that users can share travel experiences and memories with friends.

[0029] In an embodiment of the present application, assuming that a user wants to share restaurant dishes, the user takes pictures of the dishes and menu information while dining in the restaurant. The user can enter the dish pictures and menu information in the AI ​​interactive interface and enter the content publishing instruction "Generate food sharing and publish on social platform". The electronic device uses the AI ​​model to analyze the color and ingredient composition of the dish pictures, and combines the dish name, price, and ingredient introduction text on the menu to generate interesting food review copy, such as "Today I tried [dish name] from [restaurant name], the fresh [ingredients] are paired with the unique [sauce], it is delicious and the price is very affordable." The food review copy is automatically published to the social platform.

[0030] In an embodiment of the present application, assuming that a user wants to share gourmet cooking, the user can input pictures of the steps in the cooking process and the corresponding recipe text into the AI ​​interactive interface. The AI ​​model identifies elements such as the food processing steps and cooking utensils in the pictures, and combines the cooking skills in the recipe text to generate a detailed cooking process sharing copy, such as "Today I will challenge [dish name] at home, from the preliminary processing of the ingredients, such as [description corresponding to the picture of the specific processing steps], to the control of the heat when cooking in the pot [combined with text instructions], step by step to achieve deliciousness, come and try it!" Then post it on the social platform to exchange cooking experiences with food lovers.

[0031] In the embodiment of the present application, assuming that the user wants to organize and share learning materials, the user can enter a picture of learning materials containing text and charts in the AI ​​interactive interface. The electronic device uses the AI ​​model to perform OCR recognition on the text in the picture, and analyzes and understands it in combination with the content of the chart, extracts key knowledge points through image and text separation, and uses the large model to summarize them into concise and easy-to-understand learning points, and then adds appropriate guiding copy, such as "Today's study [subject name] knowledge point summary: [summary content], let's learn and improve together!" Automatically publish to social platforms to share learning experiences or help classmates learn together.

[0032] In the embodiment of the present application, assuming that the user wants to optimize and share study notes, the user can enter pictures of handwritten notes and reference materials in the form of electronic documents in the AI ​​interactive interface. The electronic device uses the AI ​​model to perform text recognition and content integration, highlight the key content in the notes, and improve the note content with supplementary information in the reference materials, generate logically clear and rich study notes, and publish them on social platforms for sharing, so that you can review yourself and communicate with your classmates about study methods and materials.

[0033] The object processing method provided in the embodiment of the present application is not only applicable to personal daily sharing, but also can be applied to the fields of commercial promotion, news dissemination, etc. For example, enterprises can use this function to quickly publish product pictures and related descriptions to social platforms for promotion, and media workers can quickly share news pictures and descriptions.

[0034] The object processing method provided in the embodiment of the present application may be executed by an object processing device, which may be an electronic device, or a functional module or functional entity in the electronic device. The object processing method provided in the embodiment of the present application is described below by taking the electronic device executing the object processing method as an example.

[0035] The object processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0036] Figure 1 A flowchart of the object processing method provided in the embodiment of the present application is shown in FIG. Figure 1 As shown, the object processing method may include the following steps 201 to 203:

[0037] Step 201: The electronic device receives a first input to the AI ​​interaction interface.

[0038] The first input may correspond to the first object. In other embodiments, the first input may correspond to the first object and a content publishing instruction, and the content publishing instruction is used to instruct to publish the first object on a specific social platform.

[0039] In some embodiments of the present application, the AI ​​interaction interface may be a user interface for displaying information and receiving user instructions. Exemplarily, the AI ​​interaction interface may be an AI conversation interface or an AI conversation window.

[0040] It should be noted that electronic devices can use artificial intelligence (AI) technology to understand and respond to user input in the AI ​​interaction interface.

[0041] In some embodiments of the present application, the first input may be any feasible input such as touch input, voice input, gesture input, etc. For example, the touch input may be click input, long press input, sliding input, etc., which is not limited in the embodiments of the present application.

[0042] Exemplarily, the first input may be an input for selecting and sending a first object in the AI ​​interaction interface, or may be an input for inputting a content publishing instruction in the AI ​​interaction interface.

[0043] In some embodiments of the present application, the first object may include at least one of the following: a picture, a video, an audio, a document, etc.

[0044] In some embodiments of the present application, the content publishing instruction is used to trigger the execution of a content publishing operation on a content publishing platform based on the first object. Exemplarily, the content publishing platform may be a social media platform, a blog, a website, etc. Exemplarily, the social media platform may be a social media platform of a social application, and the website may be a shopping website, etc.

[0045] In some embodiments of the present application, the electronic device displays an AI interaction interface, and after receiving a first input from a user to the AI ​​interaction interface, obtains a first object and a content publishing instruction according to input information of the first input.

[0046] For example, Figure 2A As shown, when the AI ​​conversation window 21a is displayed, when the user uploads picture 1 in the AI ​​conversation window 21a and enters the content publishing instruction "Please describe this picture and publish it to the social platform", the electronic device obtains the picture and content publishing instruction entered by the user, so as to perform corresponding processing operations based on the picture and content publishing instruction in the subsequent process.

[0047] For example, Figure 2B As shown, when the AI ​​conversation window 21b is displayed, when the user uploads a long news image 2 containing pictures and text in the AI ​​conversation window 21b, and enters a content publishing instruction of "add text and publish on social platform", the electronic device obtains the long news image and the content publishing instruction.

[0048] In some embodiments of the present application, after obtaining the first object and content publishing instruction input by the user, the electronic device can transmit the first object and content publishing instruction to an artificial intelligence (AI) model to perform a content publishing operation based on the first object and content publishing instruction through the AI ​​model.

[0049] Exemplarily, the above-mentioned AI model may be a large AI model such as CLIP or ViLT.

[0050] It should be noted that CLIP, which stands for Contrastive Language-Image Pre-training, is translated as contrastive language-image pre-training. The CLIP model contains an image encoder and a text encoder, which can be used in scenarios such as image description generation and cross-modal retrieval; ViLT, which stands for Vision-and-Language Transformer Without Convolution or Region Supervision, is a multimodal model that integrates visual and language information. It can process image and text data and achieve cross-modal understanding and generation. It can be used in scenarios such as image description generation and visual question answering.

[0051] It should be noted that the AI ​​big model is an intelligent program that has the ability to understand user commands, process texts and images, and interact with other applications.

[0052] In an embodiment of the present application, the electronic device automatically executes tasks requested by the user through the AI ​​big model, such as polishing the input text, optimizing the image, etc., and performs further operations according to the user's wishes, such as displaying on the content publishing interface, publishing to a social platform, etc.

[0053] Exemplarily, in combination with the above example, when a user uploads a long news image containing pictures and text in the AI ​​conversation interface, and enters the content publishing instruction of "add text and publish on social platform", the electronic device obtains the long news image and content publishing instruction, and inputs the long news image and content publishing instruction into the AI ​​model for subsequent content publishing operations.

[0054] Step 202: In response to a first input, the electronic device performs content publishing processing on a first object corresponding to the first input through an AI model.

[0055] In some embodiments of the present application, the electronic device may perform relevant content publishing processing operations on the first object through an AI model to obtain a content publishing processing result, that is, content to be published, so as to publish the content to be published.

[0056] In some embodiments of the present application, the electronic device may analyze the content publishing instruction through an AI model, perform relevant content publishing processing operations on the first object according to the analysis results, obtain the content publishing processing result, that is, the content to be published, and publish the content to be published.

[0057] In some embodiments of the present application, the above-mentioned content publishing processing may be performing text processing, editing processing, polishing processing, etc. on the first object.

[0058] Exemplarily, taking the above-mentioned first object as a picture as an example, after the user sends Picture 1 in the AI ​​conversation window and enters the content publishing instruction "Describe this picture and publish the picture and text to the social platform", the electronic device uses the AI ​​model to process the picture with text to obtain the text description information of the picture, so as to conveniently and efficiently obtain the text description information of Picture 1, thereby being able to efficiently publish Picture 1 and the text description information of Picture 1 to the social platform.

[0059] As another example, taking the first object as a picture, after the user sends Picture 1 in the AI ​​conversation window and enters the content publishing instruction "Please polish this picture and publish it to the social platform", the electronic device polishes the picture 1 through the AI ​​model to publish the polished picture to the social platform.

[0060] As another example, taking the first object as a video, after the user sends video 2 in the AI ​​conversation window and enters the content publishing instruction "Describe the video and publish the video to the social platform" and obtains video 2, the electronic device generates a description information of video 2 through the AI ​​model, and automatically publishes video 2 and the description information of video 2 to the social platform.

[0061] As another example, taking the first object mentioned above as a document, after the user sends video 2 in the AI ​​conversation window and enters the content publishing instruction "summarize the central theme of the document and publish the central theme and the document to the social platform" and obtains document 3, the electronic device extracts the central theme of document 3 through the AI ​​model, and automatically publishes the central theme and document 3 to the social platform.

[0062] In an embodiment of the present application, the electronic device can automatically generate appropriate text, select appropriate image display formats, process images or texts, etc. through an AI model based on instructions given by the user, without the need for the user to manually open applications, add content, etc., and automatically call the content publishing function through the AI ​​model to publish the determined text, images and content to be published to the social platform according to predetermined formats and rules. In this way, the entire process mechanism of publishing content is optimized, the speed of content publishing is improved, the waiting time is reduced, and a smooth and efficient content processing and publishing experience is provided to users.

[0063] Step 203: The electronic device displays the content publishing processing result of the first object on the content publishing interface.

[0064] In some embodiments of the present application, the above-mentioned content publishing interface is used for users to input or edit files to be published. Exemplarily, the content publishing interface may include multiple elements, such as a text box, a picture upload button, a publish button, etc. Exemplarily, the above-mentioned content publishing interface may be a content publishing interface of an application such as a social application or a multimedia application. For example, the content publishing interface may be a publishing interface of a friend circle of a social application.

[0065] In some embodiments of the present application, taking the case where the first object is an image and the content publishing processing result includes the image and text description information of the image, after the electronic device obtains the text description information corresponding to the image through the AI ​​model, it can display the text description information in the text area of ​​the content publishing interface and display the image in the image display area of ​​the content publishing interface.

[0066] In the object processing method provided in the embodiment of the present application, the electronic device receives a first input to the AI ​​interactive interface, the first input corresponds to the first object, and in response to the first input, performs content publishing processing on the first object through the AI ​​model, and displays the content publishing processing result of the first object on the content publishing interface. Through this method, the electronic device can intelligently perform content publishing processing on the first object through the AI ​​model, without the need for the user to manually publish content, thereby improving the efficiency of content publishing.

[0067] In some embodiments of the present application, the first object is an image, and the step 202 may include the following steps 202a. In combination with the step 202a, the step 203 may include the following steps 203a:

[0068] Step 202a: In response to the first input, the electronic device processes the image with text through the AI ​​model to obtain text description information.

[0069] Step 203a: The electronic device displays the image and text description information on the content publishing interface.

[0070] In some embodiments of the present application, the electronic device may perform content recognition on an image through an AI model, and generate text description information corresponding to the image based on the content of the image.

[0071] For example, the electronic device begins to analyze the image using the AI ​​model using image recognition technology. First, the main elements in the image are identified through image recognition technology, then the background elements are analyzed, and then, based on the natural language processing capability of the AI ​​model, the main elements and background elements obtained from the analysis are converted into natural language text descriptions.

[0072] For example, the electronic device detects a subject such as a person or a sea of ​​flowers in a picture through an AI model, and analyzes background elements such as the color of the background and whether there are buildings through the AI ​​model. Then, the AI ​​model determines the overall atmosphere of the picture, such as whether it is cheerful or peaceful. Then, based on the natural language processing capability of the AI ​​model, the analyzed information is converted into a natural language text description: "In a colorful sea of ​​flowers, there is a girl with a bright smile. She is wearing a white dress, and the breeze blows gently, bringing a peaceful and beautiful atmosphere." In this process, the big model will refer to the existing language data and semantic understanding rules to organize fluent, accurate and emotional sentences.

[0073] In the embodiment of the present application, the electronic device quickly generates description information based on the picture information input by the user through the AI ​​model, and the user does not need to manually perform tedious tasks such as image content analysis and copywriting, which greatly saves time and improves the speed of information sharing. In addition, the electronic device can more accurately describe the picture information through advanced image recognition and natural language processing technology, avoiding the problem of inaccurate information transmission caused by the user's subjective understanding or insufficient language expression ability. For example, for some complex picture scenes, each element can also be accurately identified and clearly described.

[0074] In some embodiments of the present application, the electronic device may display the text description information in a text area of ​​the content publishing interface, and display the image in an image display area of ​​the content publishing interface.

[0075] For example, in combination with the above Figure 2A , when the conversation interface 21a is displayed, when the user uploads the picture 1 in the conversation interface 21a and inputs the content publishing instruction "please describe this picture and publish it to the social platform", as shown in FIG. Figure 3 As shown, the electronic device outputs and displays the description information 22 of the picture in the conversation interface 22, and displays prompt information in the conversation interface 22, the prompt information is used to prompt that it will jump to the content publishing interface, such as Figure 4 As shown, the electronic device calls the application interaction interface of the social application, displays the content publishing interface 24, and displays the picture 1 and the description information of the picture 1 in the picture display area and the text display area respectively.

[0076] In some embodiments of the present application, after obtaining user confirmation, the electronic device can automatically call the application interaction interface through the AI ​​model, start the social application, use pre-set automation scripts or system permissions to simulate the user's manual operation process, and publish the image and the corresponding text description information of the image to the social platform.

[0077] In an embodiment of the present application, the electronic device uses artificial intelligence algorithms and models to analyze and operate on elements and features in a picture, such as identifying elements such as people, objects, backgrounds, etc. in the picture, and performs semantic understanding, grammatical analysis, information extraction and other operations on the text content of the document to achieve the purpose of extracting key information, etc., and can automatically execute content publishing for pictures and picture description information through AI models, reduce user manual operations, and thus improve content publishing efficiency.

[0078] In some embodiments of the present application, the electronic device may process an image through an AI model, extract description information of the image, and then perform content publishing operations on the processed image and the description information of the image.

[0079] For example, after inputting photos taken during travel, the electronic device can use the AI ​​model to perform operations on the pictures, such as stylizing and removing passers-by, and then automatically publish the processed pictures to the social platform.

[0080] In an embodiment of the present application, the electronic device can perform image recognition processing through an AI model, and can also generate text based on the content of the image, and then automatically publish the content, reducing the steps of manual operation by the user, greatly improving the efficiency of information processing and sharing. Allow users to complete the entire process from content creation to publishing in a shorter time, meeting people's needs for instant sharing and efficient operation in modern fast-paced life. At the same time, improve the user's interactive experience in image and text processing and social sharing. It eliminates the need for users to frequently switch between multiple applications and functions, reducing operational complexity and fatigue. In this way, the AI ​​model accurately understands user needs, provides accurate image and text processing, image and text description, and publishing services, and increases the user's pleasure and satisfaction in using electronic devices to publish content.

[0081] In some embodiments of the present application, the long image may be a screenshot of screen content such as an application page or an application interface.

[0082] Exemplarily, the above-mentioned long image may include but is not limited to at least one of the following: a long image of social media, an email or message screenshot, a web search result screenshot, an online form or questionnaire screenshot, a game interface screenshot, a video or music playback interface screenshot, etc., which is not limited to the embodiments of the present application.

[0083] In some embodiments of the present application, the long image includes picture content and text content.

[0084] In some embodiments of the present application, the electronic device can use an AI model to identify text content and picture content in a long image, and use image segmentation technology to crop at least one image in the long image, and then use image analysis, optical character recognition (OCR) and semantic understanding technology to identify text information in at least one image to obtain text description information corresponding to the at least one image.

[0085] For example, taking a long image as a news long image, after the user submits the news long image and the content publishing instruction "match text and publish on social platforms" in the AI ​​interactive interface, the electronic device obtains the news long image and the content publishing instruction, and transmits the news long image and the content publishing instruction to the AI ​​model, and then uses the image segmentation technology through the AI ​​model, combined with the image and text separation technology, to identify the image area boundary in the long image, and accurately cut out the image part by analyzing the pixel distribution, color difference and other features. At the same time, AI recognition processing is performed on the cropped image, including identifying the subject and background elements in the image, etc., to prepare for the subsequent text description, and the layout and color features of the image in the news long image are recognized by the AI ​​model, and the image is extracted for recognition processing, and the natural language processing capability of the AI ​​model is used to generate text description information about the image. For example, assuming that it is recognized that the long news image includes Picture 1 and Picture 2, the electronic device can identify Picture 1 and Picture 2 through the AI ​​model to obtain the description information of Picture 1 and Picture 2. Specifically, the content of Picture 1 is an introduction to mobile phones, and the text description information of the picture is "The autumn breeze brings coolness, and we usher in the harvest season of technology and innovation. In this colorful autumn, Company A lives up to expectations and once again leads the trend, launching the highly anticipated i series and newly designed products." The content of Picture 2 is an introduction to headphones, and the text description information of the picture is "Redefining the future of wireless headphones, lightweight design, excellent sound quality, and unprecedented active noise reduction function, allowing you to immerse yourself in your own music world in any environment." The above description clearly explains information such as the picture subject, behavior, and atmosphere.

[0086] In some embodiments of the present application, the electronic device may display the at least two images in a picture display area of ​​the content publishing interface, and display text description information of the at least two images in a text display area of ​​the content publishing interface.

[0087] In some embodiments of the present application, the first object includes an image and text; illustratively, the step 202 may include the following step 202c, and in combination with the step 202c, the step 203 may include the following step 203c:

[0088] Step 202c: In response to the first input, the electronic device processes the image based on the text using an AI model to obtain text description information.

[0089] Step 203c: The electronic device displays the image and the text description information on the content publishing interface.

[0090] In some embodiments of the present application, when an electronic device uses an AI model to caption an image, it can generate text description information for the image in combination with the text input by the user to obtain text description information that is more accurate and in line with the user's intention.

[0091] For example, a user can input an image and keywords describing the image in the AI ​​interactive interface, and the AI ​​model can use the keywords to generate more accurate text description information.

[0092] In an embodiment of the present application, the AI ​​model can combine the image content and the keywords entered by the user to generate text description information of the image, thereby being able to generate more accurate text description information that conforms to the user's intentions under the guidance of the keywords provided by the user.

[0093] In some embodiments of the present application, the object processing method provided in the embodiments of the present application may further include the following steps 204 and 205:

[0094] Step 204: The electronic device receives a second input to the content publishing interface.

[0095] Step 205: The electronic device updates the content publishing processing result in response to the second input.

[0096] In some embodiments of the present application, the second input may be any feasible input such as a user's touch input, voice input, gesture input, etc. For example, the touch input may be a click input, a long press input, a sliding input, etc., which is not limited in the embodiments of the present application.

[0097] In some embodiments of the present application, the second input may be an input for editing text description information or editing a picture.

[0098] Exemplarily, the user can adjust the image position, delete the image, add the image, zoom the image, modify the text description information, etc. Furthermore, the second input is input such as dragging, zooming, rotating, adjusting the spacing and alignment between images, etc.

[0099] Exemplarily, the electronic device may adjust layout attributes such as position, size, and arrangement of at least two images in the content publishing interface according to the second input.

[0100] In some embodiments of the present application, the first object includes an image, and the content publishing processing result includes text description information; illustratively, the step 202 may include the following steps A1 and A2:

[0101] Step A1: The electronic device performs key information extraction processing on the text content in the image through the AI ​​model to obtain the key information of the text content, and performs image recognition on the image content in the image through the AI ​​model to obtain description information of the image content.

[0102] Step A2: The electronic device performs information fusion processing on the key information and the description information through the AI ​​model to obtain text description information.

[0103] In some embodiments of the present application, the electronic device can recognize the image and text in the image (such as a long image) respectively to obtain the description information of the image and the key information of the text.

[0104] In some embodiments of the present application, the electronic device can use an AI model to identify text content and picture content in a long image, and use image segmentation technology to crop at least one image in the long image, and then use image analysis, optical character recognition (OCR) and semantic understanding technology to identify text information in at least one image to obtain text description information corresponding to the at least one image.

[0105] In some embodiments of the present application, the electronic device can use an AI model and optical character recognition technology to extract the text portion of a long image, and then extract the core ideas, that is, the key information of the text content, through semantic analysis and text summary algorithms.

[0106] For example, taking a long image as a news long image, after the user submits the news long image and the content publishing instruction "match text and publish on social platforms", the electronic device obtains the news long image and the content publishing instruction, and transmits the news long image and the content publishing instruction to the AI ​​model, and then uses the image segmentation technology through the AI ​​model, combined with the image and text separation technology, to identify the image area boundary in the long image, and accurately cut out the image part by analyzing the pixel distribution, color difference and other features. At the same time, AI recognition processing is performed on the cropped image, including identifying the subject and background elements in the image, etc., to prepare for the subsequent text description, and the AI ​​model uses image analysis, OCR and semantic understanding technology to identify the image and text elements in the news long image, and extracts the image for recognition processing and text analysis by analyzing the pixel, layout and color features, to ensure that the elements are complete and accurate, to facilitate the subsequent information integration, and to provide a basis for processing the long image, so as to achieve efficient use of graphic information.

[0107] Next, the electronic device generates text description information about the content of the image based on the image recognition results using the natural language processing capabilities of the AI ​​model. For example, assuming that the news long image is identified to include two images 1 and 2, where images 1 and 2 contain text, the electronic device can use the AI ​​model to identify images 1 and 2 to obtain description information of images 1 and 2. Specifically, the content of image 1 is an introduction to mobile phones, and the text description information of the image is "The autumn breeze brings coolness, and we usher in the harvest season of technology and innovation. In this colorful autumn, Company A lives up to expectations and once again leads the trend, launching the highly anticipated i series and newly designed products", and the content of image 2 is an introduction to headphones, and the text description information of the image is "Redefining the future of wireless headphones, lightweight design, excellent sound quality, and unprecedented active noise reduction function, allowing you to immerse yourself in your own music world in any environment", the above description clearly explains the image subject, behavior, atmosphere and other information.

[0108] In addition, the electronic device uses optical character recognition (OCR) technology to extract the text part in the long image (extract text), and then extracts the core idea from the long news image through semantic analysis and text summarization algorithm: "i products are not just a new generation, they are the perfect combination of intelligence and aesthetics. Equipped with the latest chip, it is faster and more powerful; the camera is upgraded to capture every wonderful moment of life; and there is a new operating system that brings a smoother and smarter user experience." The core ideas are then summarized and polished to make them more concise and in line with the style of social platform copywriting, that is, the key information of the text content in the long image is generated.

[0109] In some embodiments of the present application, the electronic device may fuse or splice the text description information corresponding to at least one image and the key information of the text in the long image through an AI model to generate text description information.

[0110] Exemplarily, in combination with the above example, the electronic device can merge the text description information of the above picture content with the key information of the text content in the long picture image, merge the text description information of the picture information and the key information of the long picture text content together to obtain text description information, and use natural language processing technology to summarize and optimize the text information, remove redundant information, adjust the sentence structure and expression, and form a complete and refined social platform copy. The obtained text can be "The autumn breeze brings coolness, and we usher in the harvest season of science and technology and innovation. In this colorful autumn, Company A lived up to expectations and once again led the trend, launching the highly anticipated i series and newly designed products. i products are not just a new generation, it is a perfect combination of intelligence and aesthetics. Equipped with the latest chip, faster speed and more powerful performance; the camera is upgraded to capture every wonderful moment of life; and there is a new operating system to bring a smoother and smarter user experience. Redefining the future of wireless headphones, lightweight design, excellent sound quality, and unprecedented active noise reduction function, allowing you to immerse yourself in your own music world in any environment.", that is, text description information.

[0111] For example, in combination with the above Figure 2B , when the conversation interface 21b is displayed, when the user uploads a long image in the conversation interface 21b and enters the content publishing instruction "post on social platform with text", Figure 5 As shown, the electronic device obtains a long image and a content publishing instruction input by a user, outputs fusion information of the description information of at least one image content in the long image and the key information of the text in the long image, that is, text description information 25, and then displays the image and text description information on the content publishing interface to publish the image and text description information to the social platform.

[0112] In some embodiments of the present application, the first object includes an image and text; the electronic device can process the image with text to obtain descriptive information of the image and extract key information of the text, and then fuse the text description information corresponding to the image and the key information of the text to generate text description information.

[0113] For example, assuming that the user inputs multiple pictures of learning materials, study note documents, and the content publishing instruction "Organize and share learning materials", the electronic device can use the AI ​​model to perform OCR recognition on the text in the learning material pictures, obtain the descriptive information of the learning material pictures, and analyze and understand it, extract key knowledge points (i.e., key information of the text) through image and text separation, and then use the AI ​​model to summarize the descriptive information of the learning material pictures and the key information of the text into concise and easy-to-understand learning points, and then add appropriate guiding copy, such as "Today's learning [subject name] knowledge point summary: [summary content], let's learn and improve together!", and then automatically publish the shared learning experience.

[0114] In the embodiment of the present application, the electronic device organically integrates the originally scattered AI recognition and processing functions with the social platform publishing functions, realizing a one-stop service from content processing to publishing. For example, when the user issues an instruction, the AI ​​assistant can quickly process the image, use the image and text separation technology to optimize the image and text display effect, generate appropriate text descriptions, and then automatically control the electronic device to open the social application to complete the content publishing, thereby improving the efficiency of content publishing.

[0115] In some embodiments of the present application, after the above step 203, the object processing method provided in the embodiment of the present application may further include the following steps 206 and 207:

[0116] Step 206: The electronic device receives a third input to the content publishing interface.

[0117] Step 207: The electronic device publishes the content publishing processing result in response to the third input.

[0118] In some embodiments of the present application, the third input may be any feasible input such as a user's touch input, voice input, gesture input, etc. For example, the touch input may be a click input, a long press input, a sliding input, etc., which is not limited in the embodiments of the present application.

[0119] For example, in combination with the above Figure 3 After the user sends the picture and content publishing instruction in the AI ​​conversation window, the electronic device outputs and displays the description information 22 of the picture in the conversation interface 22, and then displays a prompt message in the conversation interface 22, which is used to prompt that the user is about to jump to the content publishing interface, such as Figure 4 As shown, the electronic device calls the application interaction interface of the social application, displays the content publishing interface 24, and displays the picture 1 and the description information of the picture 1 in the picture display area and the text display area respectively. Then, after the user clicks the "Publish" option on the content publishing interface, the electronic device publishes the picture 1 and the description information of the picture 1 to the social platform, completing the publishing of the graphic and text content.

[0120] For example, in combination with the above Figure 5 , the electronic device obtains the long image and content publishing instruction input by the user, and outputs the fusion information of the description information of at least one image content in the long image and the key information of the text in the long image, that is, the first content 25, such as Figure 6 As shown, the electronic device calls the application interaction interface of the social application, displays the content publishing interface 26, and displays the pictures 1 to 6 in the picture display area, and displays the generated first content in the text display area. Then, after the user clicks the "Publish" option on the content publishing interface, the electronic device publishes the pictures 1 to 6 and the first content to the social platform, completing the publishing of the graphic and text content.

[0121] In the embodiment of the present application, by displaying the picture description information and the prompt information of the upcoming jump in the conversation interface, a more intuitive user interface is provided, the transparency of the operation is improved, and the uncertainty and confusion in the operation process are reduced. On the other hand, the electronic device realizes the rapid release of graphic content by automatically calling the application interaction interface of the social application, which greatly shortens the time from the user selecting content to publishing content and improves the efficiency of content publishing.

[0122] It should be noted that the process of the above embodiment is not only applicable to the release of pictures and description information, but also applicable to the release of other types of content (such as video, audio, etc.).

[0123] In some embodiments of the present application, the electronic device may publish at least one picture to a social platform based on the layout of the at least one picture in the content publishing interface, and publish the text description information corresponding to the picture to the social platform together.

[0124] Exemplarily, assuming that the picture display area of ​​the content publishing interface displays Picture 1 and Picture 2 from left to right, and the text area includes description information of Picture 1 and description information of Picture 2, the user can drag Picture 1 to the right, and after dragging Picture 1 to the right side of Picture 2, the electronic device exchanges the display positions of Picture 1 and Picture 2. After the user clicks the "Publish" option in the content publishing interface, the electronic device publishes Picture 1 and Picture 2 to the social platform according to the layout of Picture 1 and Picture 2 in the content publishing interface, and sends the description information of Picture 1 and Picture 2 to the social platform together.

[0125] In an embodiment of the present application, the electronic device provides a more intuitive and flexible user interaction method, allowing users to more flexibly edit and preview published content through operations on the content publishing interface, thereby enabling users to customize the layout of published content according to their preferences and needs, ensuring that the final published content meets the user's expectations and improving the flexibility of content publishing.

[0126] In some embodiments of the present application, the electronic device may automatically publish at least one image and the first text to a social platform through an AI model.

[0127] In the embodiment of the present application, the electronic device can quickly extract key pictures and text information from complex long news pictures through the AI ​​model, and effectively integrate them, so that users do not need to manually separate and process information, saving a lot of time and energy, improving the efficiency of information dissemination, and accurately understand the meaning of pictures and texts through advanced image recognition and text processing technology. The generated descriptions and summaries can accurately present the core content of news events, avoiding deviations and misunderstandings in information transmission. Finally, after completing the processing of pictures and texts through the AI ​​mode, the social application is automatically started to simulate user operations to enter the content publishing interface. Fill the cropped pictures and summarized texts into the corresponding positions, adjust the layout according to the set format requirements, and finally click the publish button to complete the content publishing.

[0128] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application are not limited to this.

[0129] The object processing method provided in the embodiment of the present application can be executed by an object processing device. In the embodiment of the present application, the object processing device provided in the embodiment of the present application is described by taking the object processing method executed by the object processing device as an example.

[0130] Figure 7 A schematic diagram of the structure of an object processing device provided in an embodiment of the present application is shown in FIG. Figure 7 As shown, the object processing device 600 may include a receiving module 601, a processing module 602 and a display module 603, wherein: the above-mentioned receiving module 601 is used to receive a first input to the AI ​​interactive interface; the first input corresponds to the first object; the above-mentioned processing module 602 is used to respond to the first input received by the above-mentioned receiving module 601, and perform content publishing processing on the first object through the AI ​​model; the above-mentioned display module 603 is used to display the content publishing processing result of the first object on the content publishing interface.

[0131] In some embodiments of the present application, the first object is an image; the processing module is specifically used to respond to the first input received by the receiving module, perform text processing on the image through an AI model to obtain text description information; the display module is specifically used to display the image and text description information on the content publishing interface.

[0132] In some embodiments of the present application, the first object is a long image; the processing module is specifically used to respond to the first input received by the receiving module, perform screenshot processing on the long image through the AI ​​model to obtain at least two images, and perform text processing on the at least two images through the AI ​​model to obtain text description information; the display module is specifically used to display the at least two images and text description information on the content publishing interface.

[0133] In some embodiments of the present application, the first object includes an image and text; the processing module is specifically used to respond to the first input, perform text processing on the image based on the text through an AI model to obtain text description information; the display module is specifically used to display the image and the text description information on the content publishing interface.

[0134] In some embodiments of the present application, the above-mentioned receiving module is also used to receive a second input to the above-mentioned content publishing interface; the above-mentioned display module is also used to update the above-mentioned content publishing processing result in response to the above-mentioned second input received by the above-mentioned receiving module.

[0135] In some embodiments of the present application, the first object includes an image, and the content publishing processing result includes text description information; the processing module is specifically used to perform key information extraction processing on the text content in the image through the AI ​​model to obtain the key information of the text content, and perform image recognition on the image content in the image through the AI ​​model to obtain the description information of the image content; the processing module is specifically used to perform information fusion processing on the key information and the description information through the AI ​​model to obtain the text description information.

[0136] In some embodiments of the present application, the above-mentioned receiving module is also used to receive a third input to the above-mentioned content publishing interface after the content publishing processing result of the above-mentioned first object is displayed on the content publishing interface; the above-mentioned processing module is also used to publish the above-mentioned content publishing processing result in response to the above-mentioned third input received by the above-mentioned receiving module.

[0137] The object processing device provided in the embodiment of the present application receives a first input to the AI ​​interactive interface, the first input corresponds to a first object, and in response to the first input, performs content publishing processing on the first object through the AI ​​model, and displays the content publishing processing result of the first object on the content publishing interface. The method uses the AI ​​model to intelligently perform content publishing processing on the first object, without the need for the user to manually publish content, thereby improving content publishing efficiency.

[0138] The object processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0139] The object processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0140] The object processing device provided in the embodiment of the present application can implement each process implemented in the above-mentioned object processing method embodiment, and will not be described again here to avoid repetition.

[0141] Alternatively, if Figure 8 As shown, an embodiment of the present application also provides an electronic device 700, including a processor 701 and a memory 702, wherein the memory 702 stores programs or instructions that can be executed on the processor 701, and when the program or instructions are executed by the processor 701, the various steps of the above-mentioned object processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

[0142] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0143] Fig. 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0144] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0145] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0146] Among them, the above-mentioned processor 110 is used to obtain the first object input by the user; the above-mentioned processor 110 is used to perform a content publishing operation based on the first object according to the content publishing instruction obtained by the processor 110 through the artificial intelligence AI model.

[0147] In some embodiments of the present application, the processor 110 is specifically used to: identify the user intent corresponding to the content publishing instruction through the AI ​​model; and perform a content publishing operation based on the first object according to the user intent.

[0148] In some embodiments of the present application, the first object is an image; the processor 110 is specifically used to: perform content recognition on the image according to the user intention; generate text description information corresponding to the image based on the content of the image; and perform content publishing operations on the text description information and the image.

[0149] In some embodiments of the present application, the display unit 106 is used to display a content publishing interface before performing a content publishing operation on the text description information and the image, and to display the text description information and the image on the content publishing interface; the user input unit 107 is used to receive a first input from a user on the content publishing interface displayed by the display unit 106; the processor 110 is specifically used to perform a content publishing operation on the text description information and the image in the content publishing interface in response to the first input.

[0150] In some embodiments of the present application, the above-mentioned image includes at least two images; the above-mentioned user input unit 107 is also used to receive a second input from the user on the above-mentioned content publishing interface after displaying the above-mentioned text description information and the above-mentioned image on the above-mentioned content publishing interface; the processor 110 is used to update the layout of the above-mentioned at least two images in the above-mentioned content publishing interface in response to the above-mentioned second input received by the above-mentioned user input unit 107; the above-mentioned processor 110 is specifically used to respond to the above-mentioned first input received by the above-mentioned user input unit 107, according to the layout of the above-mentioned at least two images in the above-mentioned content publishing interface, to perform a content publishing operation on the above-mentioned at least two images, and to perform a content publishing operation on the above-mentioned text description information.

[0151] In some embodiments of the present application, the first object is a long image; the processor 110 is specifically used to: identify key information of the text content in the long image according to the user intention, extract at least one image in the long image, and generate text description information corresponding to the at least one image; fuse the text description information corresponding to the at least one image with the key information to generate a first text; and perform content publishing operations on the at least one image and the first text.

[0152] In some embodiments of the present application, the display unit 106 is used to display a content publishing interface before performing a content publishing operation on the at least one image and the second text, and display the at least one image and the second text on the content publishing interface; the user input unit 107 is also used to receive a third input from a user on the content publishing interface displayed by the display unit 106; the processor 110 is specifically used to perform a content publishing operation on the first text and the at least one image in the content publishing interface in response to the third input received by the user input unit 107.

[0153] In some embodiments of the present application, the first object includes an image and text; the processor 110 is specifically used to generate text description information corresponding to the image and extract key information of the text according to the user intention; the processor 110 is specifically used to fuse the text description information corresponding to the image and the key information of the text to generate a second text; the processor 110 is specifically used to perform content publishing operations on the image and the second text.

[0154] The electronic device provided in the embodiment of the present application obtains a first object input by a user, and performs a content publishing operation based on the first object according to the content publishing instruction through an artificial intelligence model. Through this method, the first object is intelligently processed for content publishing through an AI model, and the user does not need to manually publish the content, thereby improving the efficiency of content publishing.

[0155] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0156] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0157] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0158] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned object processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0159] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0160] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned object processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0161] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0162] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above object processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0163] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0164] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0165] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An object processing method, characterized in that: The method comprises: Receiving a first input to the AI ​​interaction interface; the first input corresponds to a first object; In response to the first input, performing content publishing processing on the first object through the AI ​​model; The content publishing processing result of the first object is displayed on the content publishing interface.

2. The method according to claim 1, characterized in that The first object is an image; In response to the first input, performing content publishing processing on the first object through the AI ​​model includes: In response to the first input, the image is processed with text by an AI model to obtain text description information; The displaying the content publishing processing result of the first object on the content publishing interface includes: The image and the text description information are displayed on the content publishing interface.

3. The method according to claim 1, characterized in that The first object is a long image; In response to the first input, performing content publishing processing on the first object through the AI ​​model includes: In response to the first input, the long image is processed by the AI ​​model to obtain at least two images, and the at least two images are processed by the AI ​​model to obtain text description information; The displaying the content publishing processing result of the first object on the content publishing interface includes: The at least two images and the text description information are displayed on the content publishing interface.

4. The method according to claim 1, characterized in that: The first object includes an image and a text; In response to the first input, performing content publishing processing on the first object through the AI ​​model includes: In response to the first input, the image is processed with text based on the text by an AI model to obtain text description information; The displaying the content publishing processing result of the first object on the content publishing interface includes: The image and the text description information are displayed on the content publishing interface.

5. The method according to claim 1, characterized in that: The method further comprises: receiving a second input to the content publishing interface; In response to the second input, the content publishing processing result is updated.

6. The method according to claim 1, characterized in that The first object includes an image, and the content publishing processing result includes text description information; The performing content publishing processing on the first object by using the AI ​​model includes: Performing key information extraction processing on the text content in the image through the AI ​​model to obtain key information of the text content, and performing image recognition on the image content in the image through the AI ​​model to obtain description information of the image content; The key information and the description information are fused by the AI ​​model to obtain the text description information.

7. The method according to claim 1, characterized in that After displaying the content publishing processing result of the first object on the content publishing interface, the method further includes: Receiving a third input to the content publishing interface; In response to the third input, the content publishing process result is published.

8. An object processing device, characterized in that: The device comprises: a receiving module, a processing module and a display module, wherein: The receiving module is used to receive a first input to the AI ​​interaction interface; the first input corresponds to a first object; The processing module is configured to perform content publishing processing on the first object through an AI model in response to the first input received by the receiving module; The display module is used to display the content publishing processing result of the first object on the content publishing interface.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the object processing method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the object processing method according to any one of claims 1 to 7 are implemented.

Images