Resource processing method, device, electronic device and storage medium
By identifying the AR image and target processing methods that match the initial resource, the initial resource is processed, and the problems of low efficiency and poor effect caused by user manual selection of image features are solved, achieving a more efficient and interactive resource processing effect .
Patent Information
- Application Number
- CN202011066156.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-30
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2040-09-30
AI Technical Summary
In the prior art, users need to manually select image features, resulting in low resource processing efficiency, low interactivity and fun, and low matching between image features and initial images, resulting in poor target image effects.
By acquiring the initial resources, identifying the matching augmented reality AR image and target processing methods, using this information to process the initial resources, and generating the target resources.
It improves the efficiency of resource processing and the efficiency of human-computer interaction, enhances the interactivity and fun of resource processing, and enhances the user's sense of creation and the viscosity of content products.
Smart Images

Figure CN112084041B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a resource processing method, device, electronic device and storage medium. Background Art
[0002] With the rapid development of computer technology, electronic devices such as smart phones are also developing continuously, and mobile photosensitive chips are also constantly improving. More and more users are accustomed to processing resources through electronic devices, and the resources are either images or videos.
[0003] In the related art, taking the resource as an image as an example, a user captures an image through an electronic device (e.g., a smart phone) to obtain an initial image. The user manually selects image features, such as image filters and image special effects. The electronic device superimposes the image features selected by the user on the initial image to obtain a target image.
[0004] However, the above-mentioned resource processing method requires users to manually select image features, which makes the resource processing efficiency low, the interactivity and interest are relatively low, and it is difficult for users to improve their sense of creation and the viscosity of content products; and the image features are determined based on the user's subjective consciousness, resulting in a low match between the determined image features and the initial image, making the effect of the determined target image poor and the efficiency of human-computer interaction low. Summary of the invention
[0005] The embodiments of the present application provide a resource processing method, device, electronic device and storage medium, which can be used to solve the problems in the related technology. The technical solution is as follows:
[0006] On the one hand, an embodiment of the present application provides a resource processing method, the method comprising:
[0007] Acquire an initial resource to be processed, where the initial resource is any one of an image and a video;
[0008] Identify the initial resource to obtain an augmented reality (AR) image that matches the initial resource;
[0009] Determining a target processing method that matches the initial resources;
[0010] The initial resource is processed according to the AR image and the target processing method to obtain the target resource.
[0011] In a possible implementation, identifying the initial resource to obtain an augmented reality (AR) image matching the initial resource includes:
[0012] Identify the initial resource and obtain key information corresponding to the initial resource;
[0013] Based on the key information corresponding to the initial resource, an AR image matching the initial resource is determined.
[0014] In a possible implementation manner, determining the AR image matching the initial resource based on the key information corresponding to the initial resource includes:
[0015] Inputting key information corresponding to the initial resource into a target pattern recognition model, wherein the target pattern recognition model is used to determine an AR image matching the initial resource;
[0016] Based on the output result of the target pattern recognition model, an AR image matching the initial resource is determined.
[0017] In a possible implementation, before inputting the key information corresponding to the initial resource into the target pattern recognition model, the method further includes:
[0018] Acquire at least one key information and an AR image corresponding to each key information;
[0019] Based on the at least one key information and the AR images corresponding to each key information, an initial pattern recognition model is trained to obtain the target pattern recognition model.
[0020] In a possible implementation manner, determining a target processing mode that matches the initial resource includes:
[0021] Get multiple reference processing methods;
[0022] Determining the matching degree between the initial resource and the multiple reference processing modes respectively;
[0023] According to the matching degree, a target processing method matching the initial resource is determined from among the multiple reference processing methods.
[0024] In a possible implementation, determining, according to the matching degree, a target processing mode that matches the initial resource from among the multiple reference processing modes includes:
[0025] According to the matching degree, determining a reference processing method whose matching degree meets the target requirement among the multiple reference processing methods;
[0026] Demonstrate reference processing methods that meet the target requirements for the matching degree;
[0027] In response to receiving a confirmation instruction for the reference processing method whose matching degree meets the target requirement, determining the reference processing method whose matching degree meets the target requirement as the target processing method matching the initial resource;
[0028] In response to receiving a switch instruction for the reference processing mode whose matching degree meets the target requirement, the reference processing mode after switching is determined as the target processing mode matching the initial resource.
[0029] In a possible implementation, before obtaining the initial resource to be processed, the method further includes:
[0030] Displaying a resource acquisition page, wherein the resource acquisition page displays a plurality of guidance actions, wherein the guidance actions are used to instruct a target user to obtain resources corresponding to the guidance actions;
[0031] The obtaining of the initial resource to be processed includes:
[0032] In response to receiving a selection instruction of a target guiding action among the multiple guiding actions, initial resources corresponding to the target guiding action are collected.
[0033] In a possible implementation, before obtaining the initial resource to be processed, the method further includes:
[0034] Displaying reference resources in a resource library, wherein the resource library stores a plurality of reference resources;
[0035] The obtaining of the initial resource to be processed includes:
[0036] In response to receiving a selection instruction for any reference resource in the resource library, the selected reference resource is determined as an initial resource to be processed.
[0037] In a possible implementation manner, before the initial resource is processed according to the AR image and the target processing mode to obtain the target resource, the method further includes:
[0038] Acquire text information corresponding to the initial resource;
[0039] Processing the text information to obtain audio data corresponding to the text information;
[0040] The processing of the initial resource according to the AR image and the target processing mode to obtain the target resource includes:
[0041] Processing the initial resource according to the AR image and the target processing method to obtain a first resource;
[0042] The audio data and the first resource are synthesized to obtain the target resource.
[0043] On the other hand, an embodiment of the present application provides a resource processing device, the device comprising:
[0044] An acquisition module, used for acquiring an initial resource to be processed, wherein the initial resource is any one of an image and a video;
[0045] An identification module, used to identify the initial resource and obtain an augmented reality (AR) image matching the initial resource;
[0046] A determination module, used to determine a target processing method that matches the initial resource;
[0047] A processing module is used to process the initial resource according to the AR image and the target processing method to obtain the target resource.
[0048] In a possible implementation, the identification module is used to identify the initial resource to obtain key information corresponding to the initial resource; and determine an AR image matching the initial resource based on the key information corresponding to the initial resource.
[0049] In a possible implementation, the recognition module is used to input key information corresponding to the initial resource into a target pattern recognition model, and the target pattern recognition model is used to determine an AR image that matches the initial resource; based on an output result of the target pattern recognition model, determine an AR image that matches the initial resource.
[0050] In a possible implementation, the acquisition module is further used to acquire at least one key information and an AR image corresponding to each key information;
[0051] The device also includes:
[0052] The training module is used to train the initial pattern recognition model based on the at least one key information and the AR image corresponding to each key information to obtain the target pattern recognition model.
[0053] In a possible implementation, the determination module is used to obtain multiple reference processing methods; determine the matching degree between the initial resource and the multiple reference processing methods respectively; and determine the target processing method that matches the initial resource among the multiple reference processing methods based on the matching degree.
[0054] In one possible implementation, the determination module is used to determine, according to the matching degree, a reference processing method whose matching degree meets the target requirements among the multiple reference processing methods; display the reference processing method whose matching degree meets the target requirements; in response to receiving a confirmation instruction for the reference processing method whose matching degree meets the target requirements, determine the reference processing method whose matching degree meets the target requirements as the target processing method that matches the initial resources; in response to receiving a switching instruction for the reference processing method whose matching degree meets the target requirements, determine the reference processing method after switching as the target processing method that matches the initial resources.
[0055] In a possible implementation manner, the device further includes:
[0056] A display module, used to display a resource acquisition page, wherein the resource acquisition page displays a plurality of guidance actions, wherein the guidance actions are used to instruct a target user to obtain resources corresponding to the guidance actions;
[0057] The acquisition module is used for collecting initial resources corresponding to the target guidance action in response to receiving a selection instruction of the target guidance action among the multiple guidance actions.
[0058] In a possible implementation, the display module is further used to display reference resources in a resource library, where a plurality of reference resources are stored;
[0059] The acquisition module is used to, in response to receiving a selection instruction of any reference resource in the resource library, determine the selected reference resource as the initial resource to be processed.
[0060] In a possible implementation, the acquisition module is further used to acquire text information corresponding to the initial resource;
[0061] The processing module is further used to process the text information to obtain audio data corresponding to the text information;
[0062] The processing module is used to process the initial resource according to the AR image and the target processing method to obtain a first resource; and synthesize the audio data and the first resource to obtain the target resource.
[0063] On the other hand, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement any of the resource processing methods described above.
[0064] On the other hand, an embodiment of the present application further provides a computer-readable storage medium, in which at least one program code is stored. The at least one program code is loaded and executed by a processor to implement any of the resource processing methods described above.
[0065] On the other hand, an embodiment of the present application further provides a computer program or a computer program product, wherein the computer program or the computer program product stores at least one computer instruction, and the at least one computer instruction is loaded and executed by a processor to implement any of the resource processing methods described above.
[0066] The technical solution provided by the embodiments of the present application brings at least the following beneficial effects:
[0067] The technical solution provided in the embodiment of the present application is based on the initial resources, and determines the AR image and target processing method that matches the initial resources, so that the determined AR image and target processing method have a higher matching degree with the initial resources; the initial resources are processed according to the AR image and target processing method to obtain the target resources, so that the effect of the target resources is better, which can improve the efficiency of resource processing, improve the efficiency of human-computer interaction, and also improve the interactivity and fun of resource processing, enhance the user's sense of creativity, and thus improve user stickiness. BRIEF DESCRIPTION OF THE DRAWINGS
[0068] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0069] Figure 1 It is a schematic diagram of an implementation environment of a resource processing method provided in an embodiment of the present application;
[0070] Figure 2 is a flow chart of a resource processing method provided by an embodiment of the present application;
[0071] Figure 3 is a schematic diagram of a resource acquisition page provided in an embodiment of the present application;
[0072] Figure 4 It is a schematic diagram showing the prompt content of a guiding action provided in an embodiment of the present application;
[0073] Figure 5 It is a schematic diagram showing the prompt content of a guiding action provided in an embodiment of the present application;
[0074] Figure 6is a flow chart of a resource processing method provided by an embodiment of the present application;
[0075] Figure 7 is a flow chart of a resource processing method provided by an embodiment of the present application;
[0076] Figure 8 is a structural diagram of a resource processing device provided in an embodiment of the present application;
[0077] Fig. 9 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;
[0078] Fig.10 It is a structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0079] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.
[0080] Augmented reality (AR) images are two-dimensional or three-dimensional virtual information generated by means of three-dimensional display technology, interactive technology, multiple sensing technologies, computer vision technology and multimedia technology. This virtual information can be integrated into the real environment that the user wants to experience. The purpose is to enhance the user's understanding of the real environment by integrating computer-generated virtual information with the real environment.
[0081] Figure 1 is a schematic diagram of an implementation environment of a resource processing method provided in an embodiment of the present application, such as Figure 1 As shown, the implementation environment includes: an electronic device 101 and a server 102 .
[0082] The electronic device 101 may be at least one of a smart phone, a game console, a desktop computer, a tablet computer, an e-book reader, an MP4 (Moving Picture Experts Group Audio Layer IV) player, and a laptop computer. The electronic device 101 is used to execute the resource processing method provided in the embodiment of the present application.
[0083] The electronic device 101 may generally refer to one of a plurality of electronic devices, and this embodiment is only illustrated by the electronic device 101. Those skilled in the art may know that the number of the electronic devices 101 may be more or less. For example, the electronic device 101 may be only one, or the number of the electronic devices 101 may be dozens or hundreds, or more. The embodiment of the present application does not limit the number and type of electronic devices.
[0084] The server 102 is a single server or a server cluster consisting of multiple servers. The server 102 may be at least one of a cloud computing platform and a virtualization center, which is not limited in the embodiments of the present application. The server 102 is communicatively connected to the electronic device 101 via a wired network or a wireless network. A plurality of AR images are stored in the server 102, and the server 102 is used to determine an AR image that matches the initial resource among the plurality of AR images. The server 102 is also used to send an AR image that matches the initial resource to the electronic device 101. Of course, the server 102 may also include other functional servers to provide more comprehensive and diversified services.
[0085] Based on the above implementation environment, the present application embodiment provides a resource processing method. Figure 2 As an example, the flowchart of a resource processing method provided in the embodiment of the present application is shown in FIG. Figure 1 The electronic device 101 in the embodiment is executed. Figure 2 As shown, the method comprises the following steps:
[0086] In step 201, an initial resource to be processed is obtained, where the initial resource is any one of an image and a video.
[0087] In a possible implementation, an application for resource processing is installed and run in the electronic device, and the application is an application of any type, and the embodiment of the present application does not limit the type of the application. Exemplarily, the application is an image processing application. For example, when a user posts a comment in an electronic device, a resource can be added to the comment, and the resource is any one of an image or a video. In response to the user adding a resource in the comment, the electronic device uses the resource as an initial resource to be processed and processes the initial resource using the image processing application.
[0088] In a possible implementation, before the electronic device acquires the initial resource to be processed, the electronic device displays a resource acquisition page, which displays multiple guidance actions. The guidance actions are used to instruct the target user to acquire the resource corresponding to the guidance action, that is, the guidance action is used to instruct the camera device of the electronic device to capture the resource corresponding to the guidance action. Figure 3 The diagram is a schematic diagram of a resource acquisition page provided by an embodiment of the present application. Figure 3In the resource acquisition page, guidance action 1, guidance action 2, guidance action 3, guidance action 4, guidance action 5 and guidance action 6 are displayed. The guidance action is used to guide the target user to perform the same action as the guidance action, or the guidance action is used to guide the target user to obtain resources. In response to the target user selecting a certain guidance action, the display interface of the electronic device displays the prompt content of the guidance action. The prompt content of the guidance action is text prompt content, or voice prompt content, or action outline prompt. The embodiment of the present application does not limit the form of the prompt content of the guidance action.
[0089] When the target user selects a guidance action 1 among the multiple guidance actions in the resource acquisition page, and the prompt content of the guidance action 1 is a text prompt content, the text prompt content corresponding to the guidance action 1 is displayed on the display interface of the electronic device, such as Figure 4 The figure shows a schematic diagram of displaying prompt content of a guiding action provided by an embodiment of the present application. Figure 4 In the display interface, the text prompt content corresponding to the guiding action 1 is displayed: nod to switch hair color.
[0090] When the target user selects guidance action 2 among the multiple guidance actions in the resource acquisition page, and the prompt content of guidance action 2 is voice prompt content, the microphone of the electronic device plays the voice prompt content corresponding to guidance action 2. Exemplarily, the voice prompt content is: nod to change hair color.
[0091] When the target user selects the guiding action 3 among the multiple guiding actions in the resource acquisition page, and the prompt content of the guiding action 3 is an action outline prompt, the action outline corresponding to the guiding action 3 is displayed on the display interface of the electronic device, such as Figure 5 The figure shows a schematic diagram of displaying prompt content of a guiding action provided by an embodiment of the present application. Figure 5 In the example, the action outline corresponding to the guiding action 3 is displayed on the display interface, such as Figure 5 The action outline is shown as a circle, and within the circle there is a prompt of the action outline: please place the photographed object within the circle.
[0092] It should be noted that the prompt content of the guiding action can also be in other forms. The embodiments of the present application only use text prompt content, voice prompt content and action outline prompt as examples, and are not intended to limit the present application.
[0093] In a possible implementation, the electronic device has the following two implementations to obtain the initial resources to be processed.
[0094] Implementation method 1: in response to receiving a selection instruction of a target guiding action among multiple guiding actions, collecting initial resources corresponding to the target guiding action.
[0095] In a possible implementation, when the target user selects a certain guidance action from among multiple guidance actions, the electronic device determines the guidance action selected by the target user as the target guidance action. The electronic device obtains the prompt content of the target guidance action and displays or plays the prompt content so that the target user can make a resource corresponding to the prompt content according to the prompt content. The electronic device uses a camera device to collect the resource corresponding to the target guidance action and determines the resource as the initial resource to be processed.
[0096] Implementation method 2: in response to receiving a selection instruction of a reference resource in a resource library, determining the reference resource as an initial resource to be processed.
[0097] In a possible implementation, a resource library (e.g., a picture library) of an electronic device stores a plurality of reference resources, and the electronic device displays the reference resources in the resource library in response to a target user's instruction to click on the resource library, so that the target user can view the reference resources in the resource library. The target user selects a reference resource in the resource library, and the electronic device determines the selected reference resource as the initial resource to be processed in response to the target user's selection instruction.
[0098] In a possible implementation, when the target user wants to modify the initial resource, he or she may click on the resource library and reselect a reference resource in the resource library. The electronic device determines the reference resource reselected by the target user as the initial resource to be processed.
[0099] It should be noted that any of the above implementation methods can be selected to obtain the initial resources to be processed, and the embodiment of the present application does not limit the method for obtaining the initial resources.
[0100] In step 202, the initial resource is identified to obtain an AR image matching the initial resource.
[0101] In a possible implementation, the initial resource is an image or a video, and the embodiment of the present application is described by taking the initial resource being an image as an example. When the initial resource is a video, the electronic device intercepts the video into multiple images, and processes each frame of the video in accordance with the processing method of the initial resource being an image.
[0102] In a possible implementation, identifying the initial resource and obtaining an AR image matching the initial resource includes the following steps 2021 to 2022.
[0103] Step 2021: Identify the initial resources and obtain key information corresponding to the initial resources.
[0104] In a possible implementation, the electronic device identifies the initial resource, obtains the characteristics of the initial resource, searches for key information matching the characteristics in a feature library based on the characteristics of the initial resource, and determines the key information as the key information corresponding to the initial resource.
[0105] For example, the initial resource is an image of Beijing roast duck. The electronic device identifies the initial resource and obtains the feature of the initial resource as roast duck. Based on the feature, the key information matching the feature is searched in the feature library as follows: ruddy color, tender meat, mellow taste, fat but not greasy, lingering fragrance, and good color and taste. That is, the key information corresponding to the initial resource is obtained.
[0106] In one possible implementation, after the electronic device identifies the initial resource, it determines that the initial resource includes at least two features. Then, according to the features included in the initial resource, the initial resource is divided into multiple sub-resources, each sub-resource has one and only one feature, and then the key information corresponding to each sub-resource is searched from the feature library to obtain the key information of each sub-resource, and the key information of each sub-resource is merged into the key information corresponding to the initial resource.
[0107] Step 2022: Based on the key information corresponding to the initial resource, determine an AR image that matches the initial resource.
[0108] In a possible implementation, based on the key information corresponding to the initial resource, the process of determining the AR image matching the initial resource is as follows:
[0109] The key information corresponding to the initial resource is input into the target pattern recognition model, and the target pattern recognition model is used to determine the AR image matching the initial resource. Based on the output result of the target pattern recognition model, the AR image matching the initial resource is determined.
[0110] In a possible implementation, before inputting the key information corresponding to the initial resource into the target pattern recognition model, the target pattern recognition model needs to be trained. The training process of the target pattern recognition model is as follows:
[0111] Obtain at least one key information and an AR image corresponding to each key information; based on the at least one key information and the AR image corresponding to each key information, train an initial pattern recognition model to obtain a target pattern recognition model. Among them, the at least one key information obtained by the electronic device is the key information uploaded by the user, or the key information obtained by the electronic device from the browser, which is not limited in the embodiment of the present application. The AR image corresponding to each key information is the AR image determined by the user based on the key information.
[0112] The initial pattern recognition model is also called the pattern classification model. The initial pattern recognition model includes a supervised classification model and an unsupervised classification model. The main difference between the two is whether the category of the sample is known in advance. The embodiment of the present application adopts a supervised classification model, that is, the AR image corresponding to each key information is known in advance, so that the accuracy of the target pattern recognition model obtained by training is higher.
[0113] It should be noted that the initial pattern recognition model can be any type of pattern recognition model, and the embodiment of the present application does not limit the type of the initial pattern recognition model. For example, the initial pattern recognition model is a review item recognition model.
[0114] Exemplarily, the key information corresponding to the initial resource is: tender meat. The key information is input into the target pattern recognition model, and the AR image matching the initial resource is: cute meatballs.
[0115] In step 203, a target processing mode matching the initial resource is determined.
[0116] Among them, the target processing methods include but are not limited to filters, special effects, and transition methods.
[0117] In a possible implementation, determining a target processing method that matches the initial resources includes the following steps 2031 to 2032 .
[0118] Step 2031: Obtain multiple reference processing methods.
[0119] In a possible implementation, multiple reference processing methods are stored in the electronic device, each of which includes but is not limited to filters, special effects, and transition methods. Each reference processing method corresponds to one or more resource types. For example, the reference processing method includes a delicious filter, a heart-shaped special effect, and a transition method of gradual in and gradual out, and the resource types corresponding to the reference processing method are food and characters.
[0120] Step 2032: Determine the matching degree between the initial resource and the multiple reference processing modes.
[0121] In one possible implementation, the electronic device identifies the initial resource, obtains the resource type of the initial resource, and based on the resource type of the initial resource, calculates the matching degree between the resource type of the initial resource and multiple reference processing methods, that is, determines the matching degree between the initial resource and multiple reference processing methods.
[0122] Step 2033: Determine a target processing method that matches the initial resource from a plurality of reference processing methods according to the matching degree.
[0123] In one possible implementation, the electronic device determines, based on the degree of match, a reference processing method whose degree of match meets the target requirement among multiple reference resources. The reference processing method that meets the target requirement is the reference processing method with the highest degree of match, or the reference processing method that meets the target requirement is a reference processing method whose degree of match is within the target number of bits. The embodiment of the present application does not limit the target requirement. Among them, the target number of bits is set based on experience, or adjusted according to the actual implementation scenario. The embodiment of the present application does not limit the value of the target number of bits. For example, the target number of bits is 3, and for another example, the target number of bits is 5.
[0124] In a possible implementation, the electronic device can also display the reference processing method whose matching degree meets the target requirements for the target user to view. When the display time of the reference processing method whose matching degree meets the target requirements exceeds the target time length, the electronic device receives the target user's confirmation instruction for the reference processing method whose matching degree meets the target requirements by default, and determines the reference processing method whose matching degree meets the target requirements as the target processing method that matches the initial resources. Among them, the target time length is set based on experience, or adjusted according to the actual implementation scenario, and the embodiment of the present application does not limit the value of the target time length. For example, the target time length is 10 seconds, and for another example, the target time length is 15 seconds.
[0125] In response to the electronic device receiving a switching instruction for the reference processing method whose matching degree meets the target requirements, that is, when the electronic device receives a confirmation instruction from the target user for other reference processing methods, the reference processing method after switching is determined as the target processing method that matches the initial resources.
[0126] Exemplarily, according to the matching degree, the reference processing method with the highest matching degree is obtained as follows: filter is delicious filter, special effect is firework special effect, and transition method is zooming and advancing. After the electronic device displays the reference processing method with the highest matching degree, if no switching instruction is received within the target time length, the electronic device determines that the reference processing method with the highest matching degree is the target processing method that matches the initial resource.
[0127] It should be noted that step 202 may be performed first to determine the AR image that matches the initial resource, and then step 203 may be performed to determine the target processing method that matches the initial resource; or step 203 may be performed first to determine the target processing method that matches the initial resource, and then step 202 may be performed to determine the AR image that matches the initial resource. The embodiment of the present application is only described by first determining the AR image that matches the initial resource, and then determining the target processing method that matches the initial resource, and is not intended to limit the order of determining the AR image that matches the initial resource and the target processing method that matches the initial resource.
[0128] In step 204, the initial resource is processed according to the AR image and the target processing method to obtain the target resource.
[0129] In one possible implementation, based on the AR image matching the initial resource determined in step 202 and the target processing method matching the initial resource determined in step 203, the initial resource is processed to obtain a target resource, which includes both the initial resource and the AR image and target processing method matching the initial resource.
[0130] In one possible implementation, some resources have corresponding text information, and some resources do not have corresponding text information. The electronic device stores the text information corresponding to the resources and the correspondence between the text information corresponding to the resources and the resource identifier. The resource identifier is the resource name, or is an identifier that can uniquely represent the resource. The embodiment of the present application does not limit the resource identifier. The electronic device can also obtain the text information corresponding to the initial resource. For example, when the initial resource is a picture or video carried in the comment, the text information corresponding to the initial resource is the comment content. For another example, when the initial resource is a picture or video of a product to be published by the target user, the text information is the product description information edited by the target user.
[0131] The electronic device determines whether the initial resource has corresponding text information based on the resource identifier of the initial resource, and in response to the initial resource having corresponding text information, obtains the text information corresponding to the resource identifier, that is, the electronic device obtains the text information corresponding to the initial resource. The electronic device processes the text information to obtain audio data corresponding to the text information. The processing process can be text-to-speech, so that audio data can be obtained, and other processing methods can also be used, as long as the audio data corresponding to the text information can be obtained. The embodiment of the present application does not limit the processing method.
[0132] In a possible implementation, the electronic device may also obtain the target resource based on the AR image matching the initial resource, the target processing method, and the audio data corresponding to the initial resource. The process is as follows:
[0133] According to the AR image and the target processing method, the initial resource is processed to obtain the first resource; the audio data and the first resource are synthesized to obtain the target resource.
[0134] In a possible implementation, the initial resource is processed according to the AR image and the target processing method to obtain the first resource, which includes both the initial resource and the AR image and the target processing method that match the initial resource. The audio data corresponding to the initial resource is synthesized with the first resource to obtain the target resource, which includes the initial resource, the AR image that matches the initial resource, the target processing method, and the audio data corresponding to the initial resource, so that the obtained target resource is more vivid.
[0135] The above method determines the AR image and target processing method that match the initial resources based on the initial resources, so that the determined AR image and target processing method have a higher matching degree with the initial resources; the initial resources are processed according to the AR image and target processing method to obtain the target resources, so that the effect of the target resources is better, the efficiency of resource processing is improved, the efficiency of human-computer interaction is improved, and the interactivity and fun of resource processing can be improved, the user's sense of creativity is enhanced, and then the user stickiness is improved.
[0136] Figure 6 The flowchart of a resource processing method provided by an embodiment of the present application is shown. The method can be Figure 1 The interaction process between the electronic device 101 and the server 102 is implemented. Figure 6 As shown, the method comprises the following steps:
[0137] In step 601, the electronic device obtains an initial resource to be processed, where the initial resource is either an image or a video.
[0138] In a possible implementation, the process of the electronic device acquiring the initial resources to be processed is consistent with the process in the above step 201, which will not be described in detail here.
[0139] In step 602, the electronic device identifies the initial resource and obtains key information corresponding to the initial resource.
[0140] In a possible implementation, the process in which the electronic device identifies the initial resource and obtains the key information corresponding to the initial resource is consistent with the process in the above step 202, which will not be repeated here.
[0141] In step 603, the electronic device sends key information corresponding to the initial resource to the server.
[0142] In a possible implementation, after the electronic device obtains the key information corresponding to the initial resource, the key information is sent to the server, and the server determines the AR image matching the initial resource based on the key information. The electronic device may also send the key information corresponding to the initial resource to the server after receiving the acquisition request sent by the server. The embodiment of the present application does not limit the timing of sending the key information corresponding to the initial resource.
[0143] In step 604, the server receives key information corresponding to the initial resource, and determines an AR image matching the initial resource based on the key information corresponding to the initial resource.
[0144] In a possible implementation, the process in which the server determines the AR image matching the initial resource is consistent with the process in step 202 above, which is not described again herein.
[0145] In step 605 , the server sends the AR image matching the initial resource to the electronic device.
[0146] In a possible implementation manner, after the server obtains the AR image matching the initial resource, the server sends the AR image to the electronic device.
[0147] In step 606, the electronic device receives an AR image matching the initial resource sent by the server, and the electronic device determines a target processing method matching the initial resource.
[0148] In a possible implementation, the process of the electronic device determining the target processing mode matching the initial resources is consistent with the process in the above step 203, which will not be described in detail here.
[0149] In step 607, the electronic device obtains text information corresponding to the initial resource, processes the text information, and obtains audio data corresponding to the text information.
[0150] In a possible implementation, the process of the electronic device acquiring the text information corresponding to the initial resource and the process of the electronic device processing the text information to obtain the audio data corresponding to the text information are consistent with the process in the above step 204 and will not be repeated here.
[0151] In step 608, the electronic device processes the initial resource based on the AR image matching the initial resource, the target processing method, and the audio data corresponding to the initial resource to obtain the target resource.
[0152] In a possible implementation, the process in which the electronic device processes the initial resource based on the AR image matching the initial resource, the target processing method and the audio data corresponding to the initial resource is consistent with the process of the above-mentioned step 204, which is not repeated here.
[0153] In step 609, the electronic device displays the target initial resource.
[0154] In a possible implementation, after the electronic device processes the initial resource to obtain the target resource, the target resource is displayed on a display interface of the electronic device so that a target user can view the target resource.
[0155] The above method determines the AR image and target processing method that match the initial resources based on the initial resources, so that the determined AR image and target processing method have a higher matching degree with the initial resources; the initial resources are processed according to the AR image and target processing method to obtain the target resources, so that the effect of the target resources is better, which can improve the efficiency of resource processing, improve the efficiency of human-computer interaction, and also improve the interactivity and fun of resource processing, enhance the user's sense of creativity, and thus enhance user stickiness.
[0156] Moreover, when processing the initial resources, the method provided in the embodiment of the present application also takes into account the text information corresponding to the initial resources, converts the text information into audio data, and processes the initial resources based on the audio data, the AR image matching the initial resources, and the target processing method matching the initial resources to obtain the target resources, so that the obtained target resources are more vivid.
[0157] Figure 7 The flowchart of a resource processing method provided by an embodiment of the present application is shown in Figure 7 You can choose to obtain the initial resources by acquisition or by acquisition. When the initial resources are obtained by acquisition, the target guidance action is displayed on the display interface, and the camera device obtains the initial resources corresponding to the target guidance action. When the initial resources are obtained by acquisition, the target user selects a reference resource in the resource library, and the electronic device determines the selected reference resource in the resource library as the initial resource. Based on the initial resources, determine the AR image that matches the initial resources and the target processing method that matches the initial resources. Based on the AR image and the target processing method, process the initial resources to obtain the target resources.
[0158] Figure 8 FIG. 1 is a schematic diagram of a resource processing device provided in an embodiment of the present application. Figure 8 As shown, the device comprises:
[0159] An acquisition module 801 is used to acquire an initial resource to be processed, where the initial resource is any one of an image and a video;
[0160] An identification module 802 is used to identify the initial resource and obtain an augmented reality (AR) image matching the initial resource;
[0161] A determination module 803 is used to determine a target processing method that matches the initial resource;
[0162] The processing module 804 is used to process the initial resource according to the AR image and the target processing method to obtain the target resource.
[0163] In a possible implementation, the identification module 802 is used to identify the initial resource and obtain key information corresponding to the initial resource; and determine an AR image matching the initial resource based on the key information corresponding to the initial resource.
[0164] In one possible implementation, the recognition module 802 is used to input key information corresponding to the initial resource into a target pattern recognition model, and the target pattern recognition model is used to determine an AR image that matches the initial resource; based on an output result of the target pattern recognition model, determine an AR image that matches the initial resource.
[0165] In a possible implementation, the acquisition module 801 is further configured to acquire at least one key information and an AR image corresponding to each key information;
[0166] The device also includes:
[0167] The training module is used to train the initial pattern recognition model based on the at least one key information and the AR images corresponding to each key information to obtain a target pattern recognition model.
[0168] In one possible implementation, the determination module 803 is used to obtain multiple reference processing methods; determine the matching degree between the initial resource and the multiple reference processing methods respectively; and determine the target processing method that matches the initial resource among the multiple reference processing methods based on the matching degree.
[0169] In one possible implementation, the determination module 803 is used to determine, according to the matching degree, a reference processing method whose matching degree meets the target requirements among the multiple reference processing methods; display the reference processing method whose matching degree meets the target requirements; in response to receiving a confirmation instruction for the reference processing method whose matching degree meets the target requirements, determine the reference processing method whose matching degree meets the target requirements as the target processing method that matches the initial resource; in response to receiving a switching instruction for the reference processing method whose matching degree meets the target requirements, determine the reference processing method after switching as the target processing method that matches the initial resource.
[0170] In a possible implementation, the device further includes:
[0171] A display module, used to display a resource acquisition page, where the resource acquisition page displays a plurality of guidance actions, where the guidance actions are used to instruct a target user to obtain a resource corresponding to the guidance action;
[0172] The acquisition module 801 is used for acquiring initial resources corresponding to the target guidance action in response to receiving a selection instruction of the target guidance action among the multiple guidance actions.
[0173] In a possible implementation, the display module is further used to display reference resources in a resource library, where a plurality of reference resources are stored;
[0174] The acquisition module 801 is configured to, in response to receiving a selection instruction of any reference resource in the resource library, determine the selected reference resource as an initial resource to be processed.
[0175] In a possible implementation, the acquisition module 801 is further used to acquire text information corresponding to the initial resource;
[0176] The processing module 804 is further used to process the text information to obtain audio data corresponding to the text information;
[0177] The processing module 804 is used to process the initial resource according to the AR image and the target processing method to obtain a first resource; and synthesize the audio data and the first resource to obtain the target resource.
[0178] Based on the initial resources, the above-mentioned device determines the AR image and target processing method that matches the initial resources, so that the determined AR image and target processing method have a higher matching degree with the initial resources; the initial resources are processed according to the AR image and target processing method to obtain the target resources, so that the effect of the target resources is better, which can improve the efficiency of resource processing, improve the efficiency of human-computer interaction, and also improve the interactivity and fun of resource processing, enhance the user's sense of creativity, and thus improve user stickiness.
[0179] It should be noted that: the resource processing device provided in the above embodiment only uses the division of the above functional modules as an example when performing resource processing. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the resource processing device is divided into different functional modules to complete all or part of the functions described above. In addition, the resource processing device provided in the above embodiment and the resource processing method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.
[0180] Fig. 9900 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 900 may be: a smart phone, a tablet computer, an MP3 (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer 3) player, an MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer 4) player, a laptop computer or a desktop computer. The electronic device 900 may also be referred to as a user device, a portable electronic device, a laptop electronic device, a desktop electronic device, or other names.
[0181] Typically, the electronic device 900 includes: one or more processors 901 and one or more memories 902 .
[0182] The processor 901 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 901 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 901 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 901 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 901 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.
[0183] The memory 902 may include one or more computer-readable storage media, which may be non-transitory. The memory 902 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 902 is used to store at least one instruction, which is used to be executed by the processor 901 to implement the resource processing method provided in the method embodiment of the present application.
[0184] In some embodiments, the electronic device 900 may further optionally include: a peripheral device interface 903 and at least one peripheral device. The processor 901, the memory 902 and the peripheral device interface 903 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 903 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 904, a display screen 905, a camera assembly 906, an audio circuit 907, a positioning assembly 908 and a power supply 909.
[0185] The peripheral device interface 903 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 901 and the memory 902. In some embodiments, the processor 901, the memory 902, and the peripheral device interface 903 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 901, the memory 902, and the peripheral device interface 903 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.
[0186] The radio frequency circuit 904 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 904 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency circuit 904 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 904 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 904 can communicate with other electronic devices through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 904 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.
[0187] The display screen 905 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 905 is a touch display screen, the display screen 905 also has the ability to collect touch signals on the surface or above the surface of the display screen 905. The touch signal can be input to the processor 901 as a control signal for processing. At this time, the display screen 905 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 905 can be one, and the front panel of the electronic device 900 is set; in other embodiments, the display screen 905 can be at least two, which are respectively set on different surfaces of the electronic device 900 or are folded; in some embodiments, the display screen 905 can be a flexible display screen, which is set on the curved surface or folded surface of the electronic device 900. Even, the display screen 905 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 905 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).
[0188] The camera assembly 906 is used to capture images or videos. Optionally, the camera assembly 906 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the electronic device, and the rear camera is arranged on the back of the electronic device. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 906 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.
[0189] The audio circuit 907 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 901 for processing, or input them into the radio frequency circuit 904 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the electronic device 900. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 901 or the radio frequency circuit 904 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 907 may also include a headphone jack.
[0190] Positioning component 908 is used to locate the current geographic location of electronic device 900 to implement navigation or LBS (Location Based Service). Positioning component 908 can be a positioning component based on the US GPS (Global Positioning System), China's Beidou system, Russia's Grenas system or the European Union's Galileo system.
[0191] The power supply 909 is used to power various components in the electronic device 900. The power supply 909 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 909 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.
[0192] In some embodiments, the electronic device 900 further includes one or more sensors 910 , including but not limited to: an acceleration sensor 911 , a gyroscope sensor 912 , a pressure sensor 911 , a fingerprint sensor 914 , an optical sensor 915 , and a proximity sensor 916 .
[0193] The acceleration sensor 911 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the electronic device 900. For example, the acceleration sensor 911 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 901 can control the display screen 905 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 911. The acceleration sensor 911 can also be used for collecting game or user motion data.
[0194] The gyro sensor 912 can detect the body direction and rotation angle of the electronic device 900, and the gyro sensor 912 can cooperate with the acceleration sensor 911 to collect the user's 3D actions on the electronic device 900. The processor 901 can implement the following functions based on the data collected by the gyro sensor 912: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.
[0195] The pressure sensor 911 can be set on the side frame of the electronic device 900 and / or the lower layer of the display screen 905. When the pressure sensor 911 is set on the side frame of the electronic device 900, it can detect the user's holding signal of the electronic device 900, and the processor 901 performs left and right hand recognition or shortcut operations according to the holding signal collected by the pressure sensor 911. When the pressure sensor 911 is set on the lower layer of the display screen 905, the processor 901 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 905. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
[0196] The fingerprint sensor 914 is used to collect the user's fingerprint, and the processor 901 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 914, or the fingerprint sensor 914 identifies the user's identity based on the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 901 authorizes the user to perform relevant sensitive operations, which include unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 914 can be set on the front, back, or side of the electronic device 900. When a physical button or a manufacturer logo is set on the electronic device 900, the fingerprint sensor 914 can be integrated with the physical button or the manufacturer logo.
[0197] The optical sensor 915 is used to collect the ambient light intensity. In one embodiment, the processor 901 can control the display brightness of the display screen 905 according to the ambient light intensity collected by the optical sensor 915. Specifically, when the ambient light intensity is high, the display brightness of the display screen 905 is increased; when the ambient light intensity is low, the display brightness of the display screen 905 is reduced. In another embodiment, the processor 901 can also dynamically adjust the shooting parameters of the camera component 906 according to the ambient light intensity collected by the optical sensor 915.
[0198] The proximity sensor 916, also called a distance sensor, is usually disposed on the front panel of the electronic device 900. The proximity sensor 916 is used to collect the distance between the user and the front of the electronic device 900. In one embodiment, when the proximity sensor 916 detects that the distance between the user and the front of the electronic device 900 is gradually decreasing, the processor 901 controls the display screen 905 to switch from the screen-on state to the screen-off state; when the proximity sensor 916 detects that the distance between the user and the front of the electronic device 900 is gradually increasing, the processor 901 controls the display screen 905 to switch from the screen-off state to the screen-on state.
[0199] Those skilled in the art will understand that Fig. 9 The structure shown in the figure does not constitute a limitation on the electronic device 900, and may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.
[0200] Fig.10 It is a structural diagram of a server provided in an embodiment of the present application. The server 1000 may have relatively large differences due to different configurations or performances, and may include one or more processors (Central Processing Units, CPU) 1001 and one or more memories 1002, wherein the one or more memories 1002 store at least one program instruction, and the at least one program instruction is loaded and executed by the one or more processors 1001 to implement the resource processing methods provided in the above-mentioned various method embodiments. Of course, the server 1000 may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output. The server 1000 may also include other components for implementing device functions, which will not be described in detail here.
[0201] In an exemplary embodiment, a computer-readable storage medium is further provided, in which at least one program code is stored. The at least one program code is loaded and executed by a processor to implement any of the above-mentioned resource processing methods.
[0202] Optionally, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.
[0203] In an exemplary embodiment, a computer program or a computer program product is further provided. The computer program or the computer program product stores at least one computer instruction, and the at least one computer instruction is loaded and executed by a processor to implement any of the above-mentioned resource processing methods.
[0204] It should be understood that the "plurality" mentioned in this article refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.
[0205] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0206] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.
Claims
1. A resource processing method, characterized in that: The method comprises: Acquire an initial resource to be processed, where the initial resource is any one of an image and a video; Identify the initial resource to obtain an augmented reality (AR) image that matches the initial resource; Determining a target processing method that matches the initial resources; Processing the initial resource according to the AR image and the target processing method to obtain a target resource; The identifying the initial resource to obtain an augmented reality (AR) image matching the initial resource includes: Identify the initial resource and obtain key information corresponding to the initial resource; Determining an AR image matching the initial resource based on the key information corresponding to the initial resource; The determining, based on the key information corresponding to the initial resource, an AR image matching the initial resource includes: Inputting key information corresponding to the initial resource into a target pattern recognition model, wherein the target pattern recognition model is used to determine an AR image matching the initial resource; Determining an AR image matching the initial resource based on an output result of the target pattern recognition model; The determining of a target processing mode matching the initial resource includes: Get multiple reference processing methods; Determining the matching degree between the initial resource and the multiple reference processing modes respectively; According to the matching degree, a target processing method matching the initial resource is determined from among the multiple reference processing methods.
2. The method according to claim 1, characterized in that Before inputting the key information corresponding to the initial resource into the target pattern recognition model, the method further includes: Acquire at least one key information and an AR image corresponding to each key information; Based on the at least one key information and the AR images corresponding to each key information, an initial pattern recognition model is trained to obtain the target pattern recognition model.
3. The method according to claim 1, characterized in that Determining a target processing method that matches the initial resource from among the multiple reference processing methods according to the matching degree includes: According to the matching degree, determining a reference processing method whose matching degree meets the target requirement from among the multiple reference processing methods; and displaying the reference processing method whose matching degree meets the target requirement; In response to receiving a confirmation instruction for the reference processing method whose matching degree meets the target requirement, determining the reference processing method whose matching degree meets the target requirement as the target processing method matching the initial resource; In response to receiving a switch instruction for the reference processing mode whose matching degree meets the target requirement, the reference processing mode after switching is determined as the target processing mode matching the initial resource.
4. The method according to any one of claims 1 to 3, characterized in that: Before obtaining the initial resource to be processed, the method further includes: Displaying a resource acquisition page, wherein the resource acquisition page displays a plurality of guidance actions, wherein the guidance actions are used to instruct a target user to obtain resources corresponding to the guidance actions; The obtaining of the initial resource to be processed includes: In response to receiving a selection instruction of a target guiding action among the multiple guiding actions, initial resources corresponding to the target guiding action are collected.
5. The method according to any one of claims 1 to 3, characterized in that: Before obtaining the initial resource to be processed, the method further includes: Displaying reference resources in a resource library, wherein the resource library stores a plurality of reference resources; The obtaining of the initial resource to be processed includes: In response to receiving a selection instruction for any reference resource in the resource library, the selected reference resource is determined as an initial resource to be processed.
6. The method according to any one of claims 1 to 3, characterized in that: Before the initial resource is processed according to the AR image and the target processing mode to obtain the target resource, the method further includes: Acquire text information corresponding to the initial resource; Processing the text information to obtain audio data corresponding to the text information; The processing of the initial resource according to the AR image and the target processing mode to obtain the target resource includes: Processing the initial resource according to the AR image and the target processing method to obtain a first resource; The audio data and the first resource are synthesized to obtain the target resource.
7. A resource processing device, characterized in that: The device comprises: An acquisition module, used for acquiring an initial resource to be processed, wherein the initial resource is any one of an image and a video; An identification module is used to identify the initial resource and obtain an augmented reality (AR) image that matches the initial resource; a determination module is used to determine a target processing method that matches the initial resource; A processing module, configured to process the initial resource according to the AR image and the target processing method to obtain a target resource; The identifying the initial resource to obtain an augmented reality (AR) image matching the initial resource includes: Identify the initial resource and obtain key information corresponding to the initial resource; Determining an AR image matching the initial resource based on the key information corresponding to the initial resource; The determining, based on the key information corresponding to the initial resource, an AR image matching the initial resource includes: Inputting key information corresponding to the initial resource into a target pattern recognition model, wherein the target pattern recognition model is used to determine an AR image matching the initial resource; Determining an AR image matching the initial resource based on an output result of the target pattern recognition model; The determining of a target processing mode matching the initial resource includes: Get multiple reference processing methods; Determining the matching degree between the initial resource and the multiple reference processing modes respectively; According to the matching degree, a target processing method matching the initial resource is determined from among the multiple reference processing methods.
8. An electronic device, characterized in that: The electronic device includes a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the resource processing method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program code, and the at least one program code is loaded and executed by a processor to implement the resource processing method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Group search method and electronic equipment
CN111079030A
Certificate information collection method and device, electronic equipment and storage medium
CN111539794A