Image processing method and device, electronic equipment and storage medium

Abstract

The present disclosure relates to an image processing method and device, electronic equipment and storage medium, comprising: pre-constructing a plurality of element corresponding parameter sets of an object, the parameter set comprising a plurality of element style corresponding attribute parameters of the corresponding element; in the case of receiving a first processing instruction for the object, obtaining a plurality of first element styles corresponding to each first element, the first element belonging to the plurality of elements; in the plurality of element corresponding parameter sets, extracting a target attribute parameter corresponding to each first element style; configuring each target attribute parameter in a single material ball; and generating a first image corresponding to the object based on the single material ball. The present disclosure can realize the generation of a first image containing multiple elements for an object through a single material ball, which can reduce memory occupation and improve image processing performance.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to an image processing method, apparatus, electronic device, and storage medium. Background Technology

[0002] With the rapid development of computer graphics and artificial intelligence technologies, image processing technology has become a core link connecting the digital world and real-world experiences, widely penetrating into various cutting-edge fields such as games, film and television, virtual reality, and intelligent vehicles. In these application scenarios, high-quality, low-latency image generation is not only key to improving user experience but also the foundation for achieving immersive interaction and intelligent decision-making. However, the extreme pursuit of image detail and realism often comes with the consumption of massive amounts of texture data and computing resources, resulting in significant memory usage, which has become a core bottleneck restricting the implementation of the technology and the upgrading of the user experience. Summary of the Invention

[0003] In view of the aforementioned technical problems, this disclosure proposes an image processing method, apparatus, electronic device, and storage medium.

[0004] According to one aspect of the embodiments of the present disclosure, an image processing method is provided, the method comprising: A parameter set corresponding to each of the multiple elements of the pre-built object, wherein the parameter set includes the attribute parameters of each of the multiple element styles of the corresponding element; Upon receiving a first processing instruction for the object, the first element style corresponding to each of the plurality of first elements is obtained, wherein the first element belongs to the plurality of elements; In the parameter set corresponding to each of the multiple elements, extract the target attribute parameters corresponding to each style of the first element. Configure each of the target attribute parameters in a single material sphere; Based on the single material sphere, a first image corresponding to the object is generated.

[0005] According to another aspect of the present disclosure, an image processing apparatus is provided, the apparatus comprising: A pre-construction module is used to pre-construct parameter sets corresponding to multiple elements of an object, wherein the parameter sets include attribute parameters of multiple element styles of the corresponding elements; The first style determination module is used to obtain the first element style corresponding to each of the multiple first elements when a first processing instruction is received for the object, wherein the first element belongs to the multiple elements. The parameter extraction module is used to extract the target attribute parameters corresponding to each style of the first element from the parameter sets corresponding to the multiple elements. The first configuration module is used to configure each of the target attribute parameters in a single material sphere; The first generation module is used to generate a first image corresponding to the object based on the single material sphere.

[0006] In an optional embodiment, the target attribute parameters include target deformation parameters and target element texture index; the first generation module includes: The parameter extraction unit is used to extract the target element texture index corresponding to each of the first element styles and the corresponding target deformation parameters from the single material sphere. The first texture acquisition unit is used to acquire the target element texture corresponding to each of the first element styles according to the texture index of each target element. The deformation unit is used to perform deformation processing on each of the target element textures based on each of the target deformation parameters, and generate element style layers corresponding to each of the first element styles. The compositing unit is used to composite the various element style layers to obtain the first image.

[0007] In an optional embodiment, the apparatus further includes: The first texture acquisition module is used to acquire the original texture, which includes element textures corresponding to multiple element styles; The first index generation module is used to generate element texture indexes corresponding to the multiple element styles based on the position of each element texture in the original texture. Accordingly, the first texture acquisition unit includes: The second texture acquisition unit is used to extract the corresponding element texture from the original texture based on the texture index of each target element.

[0008] In an optional embodiment, the apparatus further includes: The second texture acquisition module is used to acquire the original texture, which includes multiple sub-textures corresponding to each element style; The black border removal module is used to remove black borders from each of the sub-textures to obtain element textures corresponding to each of the multiple element styles. The second index generation module is used to generate element texture indexes corresponding to the multiple element styles based on the position of each element texture in the original texture. Accordingly, the first texture acquisition unit includes: The third texture acquisition unit is used to extract the corresponding element texture from the original texture based on the texture index of each target element.

[0009] In an optional embodiment, the black border removal module includes: A pixel data determining unit is used to determine the first color data of a plurality of first pixels in the sub-texture, and the transparency of the plurality of first pixels; A region determination unit is used to determine, based on the transparency, the region to be filled and the corresponding filling reference region corresponding to the sub-map among the plurality of first pixels; A fill unit is used to fill the area to be filled based on the first color data corresponding to the fill reference area to obtain the element texture corresponding to the sub-texture.

[0010] In an optional embodiment, the region determination unit is configured to: Based on the transparency, among the plurality of first pixels, a plurality of second pixels and a plurality of third pixels are determined, wherein the transparency of the second pixels is greater than a transparency threshold, and the transparency of the third pixels is less than or equal to the transparency threshold; The area to be filled is determined based on the plurality of second pixels; The filling reference area is determined based on the plurality of third pixels.

[0011] In an optional embodiment, the apparatus further includes: A pixel point determination module is used to determine the fourth pixel point corresponding to each of the third pixel points, wherein the fourth pixel point is the second pixel point that is closest to the corresponding third pixel point; Accordingly, the filling unit is used for: Based on the first color data of the fourth pixel corresponding to each of the third pixels, the third pixels are diffused and filled to obtain the second color data corresponding to each of the third pixels. Based on each of the second color data, the first color data of the plurality of second pixels, and the transparency of the plurality of first pixels, an element texture corresponding to the sub-texture is generated.

[0012] In an optional embodiment, the deformation unit includes: The deformation processing unit is used to perform deformation processing on the corresponding target element texture based on the target deformation parameters corresponding to the first element style, so as to obtain the corresponding initial style layer. A transition mask generation unit is used to generate an edge transition mask corresponding to the initial style layer; The mask compositing unit is used to composite the initial style layer and the edge transition mask to obtain the corresponding element style layer.

[0013] In an optional embodiment, the transition mask generation unit is configured to: Determine the element boundary strength corresponding to the initial style layer, the element boundary strength being determined based on the distance from each pixel in the initial style layer to the corresponding pattern boundary; Based on the element boundary strength, an edge transition mask corresponding to the initial style layer is generated.

[0014] In an optional embodiment, the first configuration module is configured to: Each of the target attribute parameters is configured in a different parameter layer in the single material sphere, and the parameter layer is used to generate the corresponding element style layer.

[0015] In an optional embodiment, the apparatus further includes: The page display module is used to display the style preview page corresponding to the element. The style preview page includes a deformation setting control, a deformation effect preview control, and a texture index setting control. The deformation effect preview module is used to display the corresponding deformation processing effect in the deformation effect preview control when the deformation setting control is triggered. The parameter set generation module is used to generate the parameter set corresponding to the element in response to the configuration operation of the deformation setting control and the texture index setting control.

[0016] In an optional embodiment, the apparatus further includes: The instruction receiving module is used to receive a linkage setting instruction, which indicates that there is a linkage relationship between the driving element and the driven element, wherein the driving element and the driven element are different elements among the plurality of elements; The linkage setting module is used to set the element style corresponding to the driven element to the second associated element style if the element style corresponding to the driving element is set to the first associated element style, wherein the first associated element style and the second associated element style have a corresponding relationship.

[0017] In an optional embodiment, the apparatus further includes: The second style determination module is used to receive a second processing instruction for the object, the second processing instruction being used to indicate the second element style corresponding to each of the plurality of second elements, the second element belonging to the plurality of elements; The second configuration module is used to update the single material ball based on the differences between each second element style and each first element style; The second generation module is used to generate a second image corresponding to the object based on the updated single material sphere.

[0018] In an optional embodiment, the second configuration module is configured to: In each of the first element styles, find the second element style corresponding to each of the second elements to obtain the search results; The configuration of the single material sphere is updated based on the unfound second element style indicated by the search results.

[0019] In an optional embodiment, the apparatus further includes: The configuration acquisition module is used to acquire first configuration information generated based on the first application. The first configuration information is used to record the first element and the corresponding first element style using a first format. The format conversion module is used to convert the first configuration information to obtain the second configuration information, the second configuration information using the second format, and the second format being compatible with the second application; The first style determination module is used for: In the second application, based on the second configuration information, the first element style corresponding to each of the plurality of first elements is obtained.

[0020] In an optional embodiment, the apparatus further includes: The rationality verification module is used to perform rationality verification on the scaling component and the position offset component respectively, and obtain the verification result; A correction module is used to correct the unreasonable component if the verification result indicates the presence of an unreasonable component. The parameter extraction module is used for: The target attribute parameters are extracted from the corrected parameter set.

[0021] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the image processing method described above.

[0022] According to another aspect of the present disclosure, a computer-readable storage medium is provided, wherein when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the image processing method described above.

[0023] According to another aspect of the present disclosure, a computer program product containing instructions is provided that, when run on a computer, causes the computer to perform the above-described image processing method.

[0024] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects: By pre-constructing parameter sets corresponding to multiple elements of an object, including attribute parameters of multiple element styles, upon receiving a first processing instruction for the object, the first element styles corresponding to multiple first elements are obtained. Since a first element belongs to multiple elements, the first element style indicated by the first processing instruction can be obtained. Then, the target attribute parameters corresponding to each first element style are extracted from the parameter sets corresponding to multiple elements, thus realizing the extraction of attribute parameters of the first element style. Next, each target attribute parameter is configured in a single material ball. Based on the single material ball, the first image corresponding to the object is generated. The generation of the first image of an object containing multiple elements can be achieved through a single material ball, which avoids the large memory consumption caused by using multiple material balls in the image processing of the object, thereby reducing memory consumption and improving image processing performance.

[0025] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0026] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0027] Figure 1 This is a schematic diagram of an application environment provided in an embodiment of this application; Figure 2 This is a schematic flowchart of an image processing method provided in an embodiment of this application; Figure 3 This is a schematic diagram of the element style of an emoticon element provided in an embodiment of this application; Figure 4 This is a schematic diagram of a parameter set configuration provided in an embodiment of this application; Figure 5 This is a schematic diagram of a second configuration information import interface provided in an embodiment of this application; Figure 6 This is a schematic diagram of a parameter set import interface provided in an embodiment of this application; Figure 7 This is a flowchart of an image processing method based on a first application and a second application provided in an embodiment of this application; Figure 8 This is an interactive schematic diagram of an image processing method based on a first application and a second application provided in an embodiment of this application; Figure 9 This is an architecture diagram of an image processing method provided in an embodiment of this application; Figure 10This is a schematic diagram of a first image generated in an expression generation scenario provided in an embodiment of this application; Figure 11 This is a schematic diagram of a first image generated in a virtual reality scene according to an embodiment of this application; Figure 12 This is a schematic diagram of a first image generated in a driving environment perception scene according to an embodiment of this application; Figure 13 This is a schematic diagram of a single material sphere in an image processing method provided in an embodiment of this application; Figure 14 This is a schematic diagram of the parameter-driven process of a single material sphere in an image processing method provided in an embodiment of this application; Figure 15 This is a block diagram of an image processing apparatus provided in an embodiment of this application; Figure 16 This is a block diagram of an electronic device for generating a first image based on a pre-built parameter set, as provided in an embodiment of this application. Figure 17 This is a block diagram of another electronic device for generating a first image based on a pre-built parameter set, provided in an embodiment of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0029] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0030] In the embodiments of this application, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0031] The following is a description of the technical terms related to the embodiments of this application: Element map index: By merging multiple element maps into a single original map, and generating an element map index corresponding to each element map based on its position in the original map, the element map can be extracted from the original map during image processing.

[0032] Layer compositing: Layer compositing is a core technology that superimposes and calculates multiple independent visual elements (i.e., layers) according to preset depth order, blending mode and transparency rules, thereby constructing a single, complex and layered visual image.

[0033] UV Transformation: UV transformation is a core technique in computer graphics that alters the appearance of a texture on a model's surface by performing mathematical operations on texture coordinates (UV coordinates). By modifying these UV coordinate values, the sampling position is changed, ultimately resulting in various dynamic or static visual changes to the texture. Basic transformations achievable through different mathematical operations on the UV coordinates include offset transformations, scaling transformations, and rotation transformations. For example, addition and subtraction of UV coordinates can achieve texture translation; multiplication and division of UV coordinates can achieve texture scaling or tiling; and transformations of UV coordinates using rotation matrices can achieve texture rotation.

[0034] The image processing method of this application can be applied to scenarios including but not limited to: 1) Game Character Creation Scenarios. In game development, character facial expressions are an important means of shaping character personality and enhancing player immersion. Due to the limitations of hardware performance and real-time rendering requirements during game runtime, excessive use of video memory and system memory can easily trigger the memory limits of mobile devices or consoles, causing slow loading or even crashes, severely restricting the upper limit of game graphics quality and cross-platform compatibility.

[0035] For example, multiple parameter sets corresponding to each character element of a game character object can be pre-constructed. These parameter sets include attribute parameters for each of the multiple element styles of the corresponding character elements. Upon receiving a first processing instruction for the character object, the styles of the multiple elements to be processed are determined. From the parameter sets corresponding to the multiple character elements, the target attribute parameters corresponding to each style of the elements to be processed are extracted. Each target attribute parameter is configured in a single material. Based on the single material, the first image corresponding to the aforementioned character object is generated. This reduces drawing requests for the character object, significantly reduces GPU overhead, reduces memory usage during game operation, and facilitates resource packaging and loading management, thereby improving game development efficiency.

[0036] 2) Film and Animation Character Production. Film and animation production places an extreme emphasis on the realism and artistic expression of facial expressions. Traditional production workflows also rely on pre-rendering technology, but the high image quality requirements mean that memory issues manifest at the production end rather than the playback end. To achieve cinematic-level detail, animators typically need to generate extremely high-resolution (4K and above) facial texture sequences. When dealing with complex micro-expressions or transitions in long takes, even subtle muscle changes may be created as independent texture layers or sequence frames. Because film and animation often involve a large character library and complex ensemble scenes, each character's facial expression combination requires the separate creation and storage of massive amounts of high-precision image data. This workflow places enormous data storage pressure on post-production teams, requiring not only expensive storage devices to hold these materials but also slowing down workstations during rendering and compositing due to the large data throughput, significantly lengthening the production cycle and increasing overall production costs.

[0037] For example, parameter sets corresponding to multiple character elements of the character object in the animation can be pre-constructed, including attribute parameters of multiple element styles of the corresponding character elements; upon receiving the first processing instruction for the character object, the styles of the multiple elements to be processed are determined; from the parameter sets corresponding to the multiple elements, the target attribute parameters corresponding to each style of the elements to be processed are extracted; each target attribute parameter is configured in a single material; and based on the single material, the first image corresponding to the character object is generated. This can reduce the drawing requests for the character object, significantly reduce GPU overhead, reduce memory usage during animation production, and thus reduce the cost requirements for animation production.

[0038] 3) Virtual Reality Scenarios. In the field of virtual reality (VR), image generation faces higher requirements for real-time performance and immersion. VR systems need to generate high-resolution, low-distortion images for each of the user's eyes separately, while maintaining an extremely high frame rate to prevent dizziness. Traditional methods relying on large amounts of pre-rendered materials are insufficient to meet VR's demands for real-time construction of dynamic scenes. The massive texture data not only consumes valuable video memory resources but may also cause stuttering due to loading delays, thus disrupting the immersive experience. Therefore, VR image generation urgently needs a new image generation mechanism that can ensure visual realism while effectively controlling memory usage and computational overhead.

[0039] For example, parameter sets corresponding to multiple elements of a virtual object in a virtual reality scene can be pre-constructed. These parameter sets include attribute parameters for multiple element styles of the corresponding elements. Upon receiving a first processing instruction for the virtual object, the styles of the elements to be processed corresponding to each element are determined. Target attribute parameters corresponding to each style of the elements to be processed are extracted from the parameter sets corresponding to the multiple elements. Each target attribute parameter is configured in a single material sphere. Based on the single material sphere, the first image corresponding to the virtual object is generated. This reduces drawing requests for the virtual object, significantly reduces GPU overhead, reduces memory usage during the virtual environment generation process, and facilitates resource packaging and loading management, thereby improving the development efficiency of virtual reality applications.

[0040] 4) Driving Environment Perception Scenarios. In driving environment perception scenarios, image generation technology plays a dual role of "visual enhancement" and "decision assistance." In-vehicle systems need to process massive amounts of visual data from cameras in real time to generate clear and accurate environmental semantic segmentation maps or augmented reality navigation images to assist drivers or autonomous driving systems in making judgments. The driving environment imposes strict limitations on the power consumption and heat dissipation of computing resources, and storage space is limited. If traditional image processing methods with high memory consumption are used, it will be difficult to guarantee the real-time performance and stability of image enhancement and generation under complex road conditions (such as at night or in rainy / foggy weather), thus affecting driving safety. Therefore, developing an image generation method with controllable memory usage has become an urgent need for cross-domain technological development.

[0041] For example, a parameter set corresponding to each of multiple elements of an environment object in a driving environment can be pre-constructed. The parameter set includes attribute parameters of multiple element styles of the corresponding elements. Upon receiving a first processing instruction for the environment object, the style of each element to be processed corresponding to the multiple elements to be processed can be determined. From the parameter set corresponding to each of the multiple elements, the target attribute parameters corresponding to each style of the element to be processed can be extracted. Each target attribute parameter is configured in a single material sphere. Based on the single material sphere, the first image corresponding to the above-mentioned environment object can be generated. This can reduce the drawing requests for the environment object, significantly reduce GPU overhead, and reduce memory usage in the process of generating the virtual driving environment.

[0042] It should be noted that the above applicable application scenarios are only examples, and may be applied to other image processing scenarios as well. This disclosure does not limit the scope of the application.

[0043] Please see Figure 1 , Figure 1 This is a schematic diagram of an application environment provided in an embodiment of this application. The application environment may include at least a terminal device 101 and a server 102.

[0044] The terminal device 101 and the server 102 are connected via a wireless or wired network. Specifically, the terminal device 101 can generate a first processing instruction for an object and send the first processing instruction to the server 102. The server 102 can pre-build parameter sets corresponding to multiple elements of the object, and upon receiving the first processing instruction for the object, obtain the first element styles corresponding to multiple first elements, extract the target attribute parameters corresponding to each first element style from the parameter sets corresponding to multiple elements, configure each target attribute parameter in a single material sphere, generate a first image corresponding to the object based on the single material sphere, and send the first image to the terminal device 101 so that the terminal device 101 can display the first image.

[0045] Optionally, the terminal device 101 may be a smartphone, tablet computer, laptop computer, desktop computer, smart speaker, smartwatch, smart voice interaction device, smart home appliance, or in-vehicle terminal, but is not limited to these.

[0046] Optionally, the server 102 is an independent physical server, or a server cluster or distributed system composed of multiple physical servers. Optionally, it is a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0047] Those skilled in the art should understand that the terminal device 101 and server 102 described above are merely illustrative examples. Other existing or future terminal devices or servers that are applicable to this application should also be included within the scope of protection of this application, and are hereby incorporated by reference.

[0048] In related technologies, taking animated emoji generation as an example, the styles of all emoji elements can be rendered as independent images, and the rendered images can be used as textures and configured in a material sphere. This allows for switching between different emoji element styles by changing the material sphere. However, in the above solution, if multiple emoji element styles (e.g., eyebrows, eyes, nose, and mouth) need to be displayed for a single emoji, the material sphere needs to be switched multiple times. Each material sphere switch requires generating a corresponding drawing instruction, necessitating the GPU to re-verify and configure the rendering pipeline, resulting in excessive CPU load and high memory consumption.

[0049] In this application, a parameter set corresponding to each of multiple elements of an object is pre-constructed. The parameter set includes attribute parameters of multiple element styles of the corresponding elements. Upon receiving a first processing instruction for the object, the first element styles corresponding to multiple first elements are obtained. Since the first element belongs to multiple elements, the first element style indicated by the first processing instruction can be obtained. Then, the target attribute parameters corresponding to each first element style are extracted from the parameter set corresponding to each of the multiple elements. The attribute parameters of the first element style can be extracted. Next, each target attribute parameter is configured in a single material ball. Based on the single material ball, the first image corresponding to the object is generated. The generation of the first image of an object containing multiple elements can be achieved by using a single material ball. This avoids the large memory consumption caused by using multiple material balls in the image processing of the object, reduces memory consumption, and thus improves image processing performance.

[0050] The following describes an image processing method according to this application. Figure 2 This is a flowchart illustrating an image processing method provided in an embodiment of this application. The method is executed by a computer device, which may include a terminal device or a server. Specifically, as shown... Figure 2 As shown, the method may include: S201: The parameter set corresponding to each of the multiple elements of the pre-built object. The parameter set includes the attribute parameters of each of the multiple element styles of the corresponding element.

[0051] In one specific embodiment, the object can refer to an object contained in the image to be generated. Specifically, the object can include virtual objects. Further, virtual objects can include virtual characters, virtual objects, or virtual character expressions, etc.

[0052] For example, in a game character creation scene or a film and animation character creation scene, the object can be a virtual character; in a virtual reality scene, the object can include virtual characters or virtual objects; in a driving environment perception scene, the object can refer to environmental objects, which can include vehicles, pedestrians, non-motorized vehicles, animals, obstacles, road structures, or traffic control facilities, etc.

[0053] In one specific embodiment, any object may include at least one element. An element may refer to the basic unit that constitutes the object.

[0054] For example, taking a game character creation scene or a film / animation character creation scene as an example, the elements may include a head group, a torso group, or an accessory group. Further, the head group may include a basic face shape, facial features (such as left eye, right eye, left eyebrow, right eyebrow, mouth, or nose, etc.) or hair, etc.; the torso group may include a neck, upper garment, arms, lower garment, or legs, etc.; the accessory group may include earrings, necklaces, or glasses, etc.

[0055] For example, taking a virtual reality scene as an example, elements can include character elements or object elements. Character elements can be categorized according to the aforementioned character element classification methods, including head groups, torso groups, or accessory groups. Further, the head group can include basic face shape, facial features (such as left eye, right eye, left eyebrow, right eyebrow, mouth, or nose, etc.) or hair, etc.; the torso group can include neck, upper garment, arms, lower garment, or legs, etc.; the accessory group can include earrings, necklaces, or glasses, etc. Object elements can be obtained by classifying objects according to material / texture. For example, a sword to be displayed in a virtual reality scene can be divided into "metal blade," "leather grip," and "gemstone decorations."

[0056] For example, taking a driving environment perception scenario, elements can include pedestrian elements, vehicle elements, non-motorized vehicle elements, obstacle elements, road structure elements, or traffic control facility elements. Specifically, vehicle elements can include the vehicle body, headlights, wheels, windows, license plates, or learner's sign. Non-motorized vehicle elements can include vehicle structure elements (such as handlebars, baskets / trunks, or pedals) or rider-related elements (helmets or raincoats). Obstacle elements can include highly reflective elements (such as fallen metal objects or puddles), light-absorbing elements (such as black tires or coal), or flexible elements (such as plastic bags, cardboard boxes, or stones). Road structure elements can include lane-level elements (such as lane lines or directional arrows), boundary elements (such as curbs, guardrails, or medians), or road surface elements (such as asphalt, cement, or soil). Traffic control facility elements can include traffic light elements, traffic sign elements, or road marking elements.

[0057] In one specific embodiment, a parameter set can be used to indicate the configuration of element styles for each element in an object. The parameter set may include attribute parameters for each of the corresponding element's element styles. These attribute parameters may include element texture indexes and deformation parameters.

[0058] In one specific embodiment, an element style can be used to indicate the specific visual effect that the corresponding element is required to display. Specifically, multiple different element styles can be included for any given element.

[0059] For example, taking a character's facial expression as an example, the elements can be the left eye, right eye, left eyebrow, right eyebrow, mouth, or nose; further, taking the element as the left eye as an example, the element style 1 corresponding to this element can be "open eye style", and the element style 2 corresponding to this element can be "closed eye style"; taking the element as the mouth as an example, the element style 1 corresponding to this element can be "long mouth style", and the element style 2 corresponding to this element can be "smiling style".

[0060] Figure 3 This is a schematic diagram of the element style of an emoji element provided in an embodiment of this application. Specifically, as shown... Figure 3 As shown, there are 5 different element styles for element L0 "left eyebrow"; 5 different element styles for element L1 "right eyebrow"; 13 different element styles for element L2 "left eye"; 13 different element styles for element L3 "right eye"; and 11 different element styles for element L4 "mouth".

[0061] For example, in a virtual reality scene, the element can be an apple, and the element style 1 corresponding to the element can be "green apple style", while the element style 2 corresponding to the element can be "red apple style".

[0062] For example, taking a driving environment perception scenario, the object can be a vehicle; correspondingly, the element can be the main body of the vehicle body, the element style 1 corresponding to the element can be "white body style", and the element style 2 corresponding to the element can be "colored body style"; the element can be a wheel, the element style 1 corresponding to the element can be "black wheel", and the element style 2 corresponding to the element can be "colored wheel".

[0063] In one specific embodiment, the element map index can be used to indicate the position of the corresponding element map in the original map. Specifically, the element map index can be represented as a number, vector, or matrix, etc., and this disclosure does not limit it.

[0064] In one specific embodiment, the original texture may include multiple element textures. Specifically, the original texture may be obtained by stitching together multiple different element textures. Furthermore, an element texture index may be generated for each element texture based on its position within the original texture.

[0065] For example, assuming the original texture is obtained by stitching together 16 element textures arranged in a 2x18 grid, the position of each element texture in the original texture can be used to determine the location of the element texture. Figure 1 The element texture index is (1, 1), and the element texture... Figure 2 The element texture index is (1, 2), ..., element texture Figure 9 The element texture index is (2, 1), and so on.

[0066] In a specific embodiment, deformation parameters can be used to control the deformation effect on the corresponding element texture. Specifically, deformation parameters can include position deformation parameters or shape deformation parameters. Position deformation parameters can be used to control the change of position of the corresponding element texture. Position deformation parameters can include rotation parameters or position offset parameters. Shape deformation parameters can be used to control the change of shape of the corresponding element texture. Shape deformation parameters can include scaling parameters or distortion parameters.

[0067] In one specific embodiment, the deformation parameters may further include mirroring indication information. This mirroring indication information can be used to indicate whether mirroring is performed on the corresponding element style. The mirroring indication information may include first mirroring indication information or second mirroring indication information. First mirroring indication information can be used to indicate that mirroring is performed on the corresponding element style. Second mirroring indication information can be used to indicate that mirroring is not required for the corresponding element style. Specifically, the user can enable mirroring for any element style, and the corresponding mirroring indication information can be the first mirroring indication information; if the user does not enable mirroring, the mirroring indication information can be the second mirroring indication information. Further, when the mirroring indication information included in the deformation parameters is the first mirroring indication information, the target element texture can be mirrored. Specifically, the UV coordinates can be mapped to the other half and normalized to achieve left-right symmetrical reuse.

[0068] In one specific embodiment, the style content generator can perform attribute parameter input operations on the user terminal so that the user terminal can obtain the parameter set corresponding to each of the multiple elements of any object.

[0069] In one specific embodiment, the above method may further include: S301: Displays the style preview page corresponding to the element. The style preview page includes deformation setting controls, deformation effect preview controls, and texture index setting controls. S303: When the deformation setting control is triggered, the corresponding deformation processing effect is displayed in the deformation effect preview control; S305: In response to configuration operations on the deformation setting control and the texture index setting control, generate the parameter set corresponding to the element.

[0070] In one specific embodiment, the style preview page can be used to set attribute parameters and preview the display effect of the element style designed for the corresponding element. Specifically, the style preview page may include a deformation setting control, a deformation effect preview control, and a texture index setting control. The deformation setting control can be used to control the deformation of the corresponding element texture. The texture index setting control can be used to set the corresponding element texture index. The deformation effect preview control can be used to preview the display effect of the element style designed for the corresponding element.

[0071] In one specific embodiment, a texture index setting operation can be performed through a texture index setting control to display the corresponding element texture in the deformation effect preview control. Specifically, by performing the texture index setting operation, the user terminal can obtain the element texture index. Accordingly, based on the selected element texture index, the corresponding element texture can be retrieved from the original texture and displayed in the deformation effect preview control. Furthermore, when the deformation setting control is triggered, the deformation processing effect corresponding to the selected element texture is displayed in the deformation effect preview control.

[0072] In one specific embodiment, the deformation setting control may include a first deformation setting control or a second deformation setting control. The first deformation setting control can be used to adjust deformation parameters to achieve deformation of the corresponding element texture. The second deformation setting control can be used to control changes in the preview style content of the deformation effect preview control to achieve deformation of the corresponding element texture.

[0073] In one specific embodiment, when the deformation setting control includes a first deformation setting control, the first deformation setting control may include a deformation parameter modification control. Specifically, a deformation parameter modification operation can be performed on the aforementioned deformation parameter modification control, that is, the deformation setting control is triggered, so that the corresponding deformation processing effect is displayed in the deformation effect preview control.

[0074] In one specific embodiment, when the deformation setting control includes a second deformation setting control, the second deformation setting control may include a deformation control control. For example, the deformation control control may include a handle control. Specifically, by operating the deformation control control (such as a handle control), i.e., triggering the deformation setting control, the corresponding deformation processing effect can be displayed in the deformation effect preview control. Furthermore, based on the adjusted deformation processing effect, the corresponding adjusted deformation parameters can be displayed in the deformation parameter modification control.

[0075] In one specific embodiment, the configuration operation can be used to indicate the parameter set corresponding to the generated element.

[0076] In a specific embodiment, in response to the configuration operation of the deformation setting control and the texture index setting control, the deformation parameters corresponding to the current element style indicated by the deformation setting control can be obtained, and the element texture index corresponding to the current element style indicated by the texture index setting control can be obtained. Accordingly, the attribute parameters corresponding to the current element style can be generated based on the above deformation parameters and element texture index. Furthermore, a parameter set corresponding to the element can be generated for multiple different element styles of the element.

[0077] In the above embodiments, by displaying a style preview page corresponding to the element, the style preview page includes a deformation setting control, a deformation effect preview control, and a texture index setting control. When the deformation setting control is triggered, the corresponding deformation processing effect is displayed in the deformation effect preview control, which can realize the preview of deformation processing effect during the element style design process. Then, in response to the configuration operation of the deformation setting control and the texture index setting control, the parameter set corresponding to the element is generated. The parameter set can be generated through visual editing, thereby improving the convenience of parameter set generation and improving the accuracy of the generated parameter set.

[0078] In one specific embodiment, before receiving the first processing instruction for the object, the method further includes: Receive linkage setting instructions. Linkage setting instructions are used to indicate that there is a linkage relationship between the driving element and the driven element. The driving element and the driven element are different elements among multiple elements. If the style of the element corresponding to the driving element is set to the style of the first associated element, the style of the element corresponding to the driven element will be set to the style of the second associated element. The styles of the first and second associated elements have a corresponding relationship.

[0079] In one specific embodiment, the linkage setting instruction can be used to indicate that there is a linkage relationship between the driving element and the driven element. Specifically, the linkage setting instruction may include the driving element identifier corresponding to the driving element and the driven element identifier corresponding to the driven element. Furthermore, the linkage setting instruction can be triggered through a linkage setting control in the linkage setting page.

[0080] In one specific embodiment, there is a linkage between the driving element and the driven element. The driving element can refer to the element style used as a reference during the configuration of the driven element's element style. The driven element can refer to the element whose element style changes with the driving element. Specifically, the driving element and the driven element can be any two different elements from a set of elements. For example, the driving element can be the element "left eye," and correspondingly, the driven element can be the element "left eyebrow."

[0081] In one specific embodiment, the linkage settings page can be used to set driving elements and driven elements, and establish the linkage relationship between the driving elements and driven elements. The linkage settings page may include linkage settings controls. These controls may include a driving element selection control, a driven element selection control, and a linkage establishment control. The driving element selection control can be used to select a driving element. The driven element selection control can be used to select a driven element. Specifically, the driving element selection control can be used to select a driving element from multiple elements, and the driven element selection control can be used to select a driven element from multiple elements. Correspondingly, a trigger operation can be performed on the linkage establishment control to bind the driving element and the driven element, thereby establishing the linkage relationship between the selected driving element and the driven element.

[0082] In one specific embodiment, there is a correspondence between the first associated element style and the second associated element style. The first associated element style can refer to the element style set for the driving element. The second associated element style can refer to the element style of the driven element that has a corresponding relationship with the first associated element style. Specifically, the first associated element style can be any one of the element styles corresponding to the driving element, and the second associated element style can be any one of the element styles corresponding to the driven element.

[0083] For example, suppose the element styles corresponding to the driving element include element style 1, element style 2, and element style 3, and the element styles corresponding to the driven element include element style 1, element style 2, and element style 3. The element style 1 of the driving element corresponds to the element style 1 of the driven element, the element style 2 of the driving element corresponds to the element style 2 of the driven element, and the element style 3 of the driving element corresponds to the element style 3 of the driven element. Accordingly, when the element style 1 of the driving element is set as the first associated element style, the element style 1 of the driven element can be set as the second associated element style; or, when the element style 2 of the driving element is set as the first associated element style, the element style 2 of the driven element can be set as the second associated element style; or, when the element style 3 of the driving element is set as the first associated element style, the element style 3 of the driven element can be set as the second associated element style.

[0084] In a specific embodiment, when the element style corresponding to the driving element is set to the first associated element style, the element style corresponding to the driven element is set to the second associated element style. Accordingly, configuration of the element style for each of multiple elements can be implemented. Based on the configuration of the element styles for each element, a configuration set for an object can be generated; and based on the configuration set, a first processing instruction for the object can be generated. The configuration set may include element styles corresponding to multiple elements. Furthermore, the configuration set may also include attribute parameters corresponding to each element style.

[0085] In a specific embodiment, in an image display scenario, the configuration set may include element styles corresponding to each of multiple elements, and further, the configuration set may also include attribute parameters corresponding to each element style; in an animation display scenario, the configuration set may include element styles corresponding to each animation frame of multiple elements, and further, the configuration set may also include attribute parameters corresponding to each element style.

[0086] In a specific embodiment, when the element style corresponding to the driving element is set to the first associated element style, the element style corresponding to the driven element can be set to the second associated element style, and the attribute parameters corresponding to the second associated element style can be obtained from the parameter set corresponding to the pre-constructed object. Correspondingly, the element styles corresponding to multiple elements in each frame and the attribute parameters corresponding to each element style can be configured. The element styles corresponding to multiple elements in the multiple animation frames and the attribute parameters corresponding to each element style can be packaged to obtain the configuration set corresponding to the animation. Furthermore, upon receiving a display instruction for the animation, the current animation frame can be determined; the element styles corresponding to the elements contained in the current animation frame can be determined based on the configuration set corresponding to the animation; and a first processing instruction can be generated based on the element styles corresponding to the current animation frame.

[0087] Understandably, through linkage settings, after configuring the element style for the driving element, the element style for the subordinate element can be automatically configured in conjunction with it, enabling rapid configuration of element styles and improving configuration efficiency. Secondly, for situations where it is necessary to further configure the attribute parameters of the element style based on the configured element style, the above linkage settings can further eliminate the repetitive work of inputting the attribute parameters of the subordinate element, further improving content production efficiency.

[0088] Figure 4 This is a schematic diagram of a parameter set configuration provided in an embodiment of this application. Specifically, as shown... Figure 4 As shown, you can select element 1 using the second element selection control in the element selection and associated controls. After selecting element 1, you can adjust the texture index and deformation parameters of the current element style using the parameter adjustment control. After the adjustment is complete, you can click the save modification button to generate the attribute parameters of the current element style, save and display them in the data list.

[0089] Furthermore, such as Figure 4 As shown, the driving element and the driven element can be set through the linkage setting control. Specifically, the current linkage state can be set in the association configuration control. For example, by selecting "Drive," the linkage state corresponding to the current element 1 can be determined as the driving state, and the current element 1 can be determined as the driving element. Then, the driven element selection control can be used to perform a driven element selection operation to determine the driven element corresponding to the driving element.

[0090] In the above embodiments, a linkage setting instruction is received. The linkage setting instruction is used to indicate that there is a linkage relationship between the driving element and the driven element. The driving element and the driven element are different elements among multiple elements. If the element style corresponding to the driving element is set to the first associated element style, the element style corresponding to the driven element is set to the second associated element style. The first associated element style and the second associated element style have a corresponding relationship, which can realize the linkage configuration of element styles, improve the configuration efficiency in the parameter set configuration process, thereby improving the generation efficiency and convenience of the parameter set, and thus greatly improving production efficiency while ensuring high-quality visual performance.

[0091] S203: Upon receiving a first processing instruction for an object, obtain the style of the first element corresponding to each of the multiple first elements, where the first element belongs to multiple elements.

[0092] In one specific embodiment, the first processing instruction can be used to instruct the generation of an image corresponding to the object. The first processing instruction may include a first style identifier corresponding to the first element style of each of a plurality of first elements. It is understood that the first processing instruction can be a processing instruction for the image of the object, or it can be a processing instruction for any frame in the animation.

[0093] In one specific embodiment, the first element may refer to the element to be displayed as indicated by the first processing instruction. Specifically, the first element may be any one of multiple elements. Correspondingly, the first element belongs to multiple elements.

[0094] In one specific embodiment, the first element style corresponding to any first element can refer to the element style that needs to be displayed for any of the aforementioned first elements. The first element style corresponding to any first element can be any one of multiple element styles corresponding to any of the aforementioned first elements.

[0095] For example, taking the scenario of generating game character expressions as an example, during the game's operation, the game user can perform game operations on the user terminal to generate game operation instructions, and send the game operation instructions to the server; upon receiving the game operation instructions, the server generates game state data based on the game operations indicated by the game operation instructions, and returns the game state data; correspondingly, upon receiving the game state data, the user terminal can determine the object to be displayed, as well as the first element and the corresponding first element style to be displayed for the object, and based on the determined first element style, can generate a first processing instruction for the object to instruct the rendering of the game interface image containing the object.

[0096] For example, in a virtual reality scenario, when a user is wearing a VR headset, the movement of the head allows the sensors in the VR headset to detect changes in the head's position and angle, and transmit the acquired sensory data indicating these changes to the controller in the VR headset. Accordingly, the controller in the VR headset can determine all objects that need to be rendered, as well as the first element and style of the first element to be displayed within those objects, based on the aforementioned sensory data, and generate a first processing instruction to instruct the rendering of a virtual world image containing the aforementioned objects.

[0097] For example, taking a driving environment perception scenario, a vehicle can collect environmental data around the vehicle in real time through various sensors installed on the vehicle body; the vehicle controller can analyze the surrounding environment through the aforementioned environmental data and determine the objects to be displayed for the current surrounding environment of the vehicle, as well as the first element contained in the aforementioned objects and the corresponding first element style; the vehicle controller can generate a first processing instruction based on the determined first element style to instruct the rendering of a perception environment image of the vehicle's surrounding environment containing the aforementioned objects.

[0098] In one specific embodiment, the first element style corresponding to each of the multiple first elements can be determined based on the first style identifier carried by the first processing instruction.

[0099] In one specific embodiment, the above method may further include: S401: Obtain first configuration information generated based on the first application. The first configuration information is used to record the first element and the corresponding style of the first element using a first format. S403: Convert the format of the first configuration information to obtain the second configuration information. The second configuration information uses the second format and the second format is compatible with the second application. Accordingly, obtaining the styles of multiple first elements can include: In the second application, based on the second configuration information, the styles of the first elements corresponding to each of the multiple first elements are obtained.

[0100] In one specific embodiment, the first application can be used to generate first configuration information for an object. Specifically, the first application can be digital content creation software. Furthermore, the first application can be used for the production of 3D digital content in fields such as film, animation, and games.

[0101] In one specific embodiment, the first configuration information can be used to record a first element and its corresponding first element style using a first format. Specifically, the first configuration information for an image may include first element identifiers of multiple first elements and first style identifiers of the first element style corresponding to each first element; or, the first configuration information for an animation may include first element identifiers of multiple first elements corresponding to each frame in multiple animation frames, and first style identifiers of the first element styles of each of the multiple first elements corresponding to each frame. For example, the first format may be JSON format.

[0102] In one specific embodiment, the second configuration information may refer to the configuration information of the first element and its corresponding style recorded using a second format. Furthermore, the second format may be adapted to a second application. For example, the second format may be a ScriptableObject resource format.

[0103] In one specific embodiment, the second application can be real-time development platform software. For example, the second application can be a game engine application (such as Unity). Specifically, the first and second applications can be digital content creation software applied in different technical fields, or the first application can generate digital content, and the digital content generated by the first application can be imported into the second application for real-time rendering. It is understood that the application can directly use the configuration information generated by the first or second application, i.e., the first or second application can each have configuration generation capabilities; or it can generate first configuration information using the digital content creation function of the first application, and obtain second configuration information through format conversion, and then import the second configuration information into the second application.

[0104] In one specific embodiment, the first configuration information can be converted to the second configuration information using a preset format conversion tool.

[0105] In one specific embodiment, the converted second configuration information can be imported into a second application; correspondingly, the second application can obtain the first element style corresponding to each of the multiple first elements based on the second configuration information, so as to realize the rendering of the element style of each element.

[0106] Figure 5 This is a schematic diagram of a second configuration information import interface provided in an embodiment of this application. Specifically, as shown... Figure 5As shown, the second configuration information can be imported based on the configuration importer. Furthermore, a file to be imported can be selected using a file selection control; if the file to be imported is determined using the file selection control, an import confirmation operation can be performed to parse the file, thereby importing the second configuration information into the second application.

[0107] In a specific embodiment, a first file containing a parameter set recorded in a first format can be generated and exported based on a first application. By converting the format of the first file, a second file containing a parameter set recorded in a second format can be obtained. Correspondingly, the second file can be imported into a second application so that the second application can read the attribute parameters of the element style corresponding to each element in the parameter set.

[0108] Figure 6 This is a schematic diagram of a parameter set import interface provided in an embodiment of this application. Specifically, as shown... Figure 6 As shown, the target file can be selected using the file selection control in the import interface of the second application; after selecting the target file and performing a confirmation trigger operation, the parameter set corresponding to the target file can be imported into the second application. Correspondingly, multiple elements corresponding to the parameter set can be displayed in the attribute parameter setting control in the import interface (i.e., such as...). Figure 6 The attributes of multiple element styles corresponding to each of the elements L0, L1, L2, L3, L4, L5, and L6 shown. Further, such as... Figure 6 As shown, the parameter set includes attribute parameters for multiple element styles corresponding to elements L0, L1, L2, L3, L4, L5, and L6. By clicking the first selection control ("L0" in the figure) of element L0 in the second element selection control, the style selection controls for multiple element styles corresponding to element L0 can be displayed in the attribute parameter display area of ​​the attribute parameter setting control. Then, by clicking the second selection control of element style 1, the attribute parameters corresponding to element style 1 can be displayed, that is, the texture index and deformation parameters set for element style 1 can be shown.

[0109] It is understood that the parameter set construction process, the configuration information conversion process, and the process of generating the first image based on the first processing instruction can be executed on the same terminal device or on different terminal devices, and this disclosure does not limit them. For example, the parameter set construction process can be executed on terminal 1, the configuration information conversion process can be executed on terminal 2, and the first image generation process can be executed on terminal 3; or, the parameter set construction process can be executed on terminal 1, the configuration information conversion process can be executed on terminal 1, and the first image generation process can be executed on terminal 1; or, the parameter set construction process can be executed on terminal 1, the configuration information conversion process can be executed on terminal 1, and the first image generation process can be executed on terminal 2.

[0110] In the above embodiments, first configuration information generated based on the first application is obtained. The first configuration information is used to record the first element and the corresponding first element style using a first format. The first configuration information is converted to a second configuration information. The second configuration information uses a second format and is adapted to the second application. This can realize the format conversion of the first configuration information, thereby enabling seamless connection between the first application and the second application. It can connect the design, animation and program toolchains, thereby improving production efficiency.

[0111] S205: Extract the target attribute parameters corresponding to the style of each first element from the parameter sets corresponding to multiple elements.

[0112] In a specific embodiment, the target attribute parameter corresponding to any first element style can refer to the attribute parameter corresponding to any of the aforementioned first element styles. Specifically, the target attribute parameter may include a target deformation parameter and a target element texture index. The target deformation parameter can refer to the deformation parameter corresponding to any of the aforementioned first element styles. The target element texture index can refer to the element texture index corresponding to any of the aforementioned first element styles.

[0113] In a specific embodiment, the attribute parameter corresponding to any first element style can be found in the parameter set corresponding to each of the multiple elements, and the found attribute parameter can be used as the target attribute parameter corresponding to any first element style.

[0114] In one specific embodiment, the deformation parameters may include scaling parameters corresponding to the scaling component and position offset parameters corresponding to the position offset component.

[0115] In a specific embodiment, where the attribute parameters include deformation parameters, and the deformation parameters include scaling components and position offset components, the above method may further include: The rationality of the scaling component and the position offset component were verified separately, and the verification results were obtained. If the verification results indicate the presence of unreasonable components, correct the unreasonable components. Accordingly, extracting the target attribute parameters corresponding to the style of each first element from the parameter sets corresponding to multiple elements can include: The target attribute parameters are extracted from the corrected parameter set.

[0116] In one specific embodiment, the verification result can be used to indicate whether the parameters corresponding to the scaling component and the position offset component in the deformation parameters are reasonable. Specifically, the verification result may include a first verification result or a second verification result. The first verification result can be used to indicate that there are unreasonable components in the deformation parameters. The second verification result can be used to indicate that there are no unreasonable components in the deformation parameters.

[0117] In one specific embodiment, the scaling parameter corresponding to the scaling component in the deformation parameters is compared with a first preset parameter to obtain a first comparison result. The first comparison result can be used to indicate whether the scaling parameter corresponding to the scaling component in the deformation parameters matches the first preset parameter. Specifically, the first preset parameter can be set according to actual application needs. Optionally, the first preset parameter can be 0.

[0118] In one specific embodiment, the position offset parameter corresponding to the position offset component in the deformation parameters is compared with a second preset parameter to obtain a second comparison result. The second comparison result can be used to indicate whether the position offset parameter corresponding to the position offset component in the deformation parameters matches the second preset parameter. Specifically, the second preset parameter can be set according to actual application needs. Optionally, the second preset parameter can be 0.

[0119] In one specific embodiment, a verification result can be generated based on a first comparison result and a second comparison result. Specifically, a first verification result can be generated if the parameters indicated by the first comparison result match or the parameters indicated by the second comparison result match; a second verification result can be generated if the parameters indicated by both the first and second comparison results do not match.

[0120] In one specific embodiment, if the verification result is the first verification result, unreasonable components indicated by the verification result in the parameter set can be corrected to obtain a corrected parameter set. Specifically, the parameters corresponding to the unreasonable components in the parameter set can be corrected to a third preset parameter to obtain a corrected parameter set. Specifically, the third preset parameter can be set according to actual application needs, and this disclosure does not limit it. Optionally, the third preset parameter can be 1.

[0121] In one specific embodiment, when loading data, the transparency channel of the color tinting can also be cleared by forcibly setting it to 0 to avoid accidentally covering the underlying texture.

[0122] In the above embodiments, by performing reasonableness verification on the scaling component and the position offset component respectively, the verification results can be obtained, and the deformation parameters can be safely verified. If the verification results indicate that there are unreasonable components, the unreasonable components are corrected. The target attribute parameters are extracted from the parameter set obtained after correction, which can prevent subsequent deformation calculation from crashing and avoid rendering abnormalities caused by art or export errors. In this way, the system can still run stably when facing abnormal data, thus improving robustness.

[0123] S207: Configure the target attribute parameters in a single material sphere.

[0124] In one specific embodiment, a single material sphere can be a data container used to store configuration parameters for the element styles corresponding to multiple elements. Specifically, a single material sphere can include multiple parameter layers. Each parameter layer can correspond to an element. Each parameter layer can be used to generate a corresponding element style layer.

[0125] In one specific embodiment, an element style layer can be used to display corresponding element styles in the form of layers. It is understood that when an object contains multiple elements, each with its own element style that needs to be displayed, multiple layers can be overlaid to achieve the display of the element styles corresponding to each of the multiple elements in the object.

[0126] In a specific embodiment, configuring each target attribute parameter in a single material sphere as described above may include: Each target attribute parameter is configured in a different parameter layer within a single material sphere. The parameter layer is used to generate the corresponding element style layer.

[0127] In a specific embodiment, the target attribute parameters of the first element style corresponding to any first element can be stored in any parameter layer of a single material sphere; wherein, the target attribute parameters corresponding to different first elements are stored in different parameter layers. It can be understood that by storing the target attribute parameters corresponding to any first element style in a parameter layer of the aforementioned single material sphere, it is possible to instruct the generation of an element style layer for any first element style based on the target attribute parameters stored in the aforementioned parameter layer; correspondingly, an element style layer for multiple elements can be generated using the aforementioned single material sphere, that is, the rendering of element styles for multiple elements can be achieved using a single material sphere.

[0128] In the above embodiments, by configuring each target attribute parameter in different parameter layers in a single material ball, and using the parameter layers to generate corresponding element style layers, a single material ball can render the element styles of multiple elements. This avoids the large memory consumption caused by using multiple material balls in the image processing of objects, and can reduce memory consumption.

[0129] S209: Generate the first image corresponding to the object based on a single material sphere.

[0130] In one specific embodiment, the first image may refer to the image to be generated as instructed by the first processing instruction. Specifically, the first image may at least show the aforementioned object, and further, the first image may at least show the first element style of each of the plurality of first elements of the aforementioned object.

[0131] It is understood that the first image may be an image generated for an image generation task, or an image generated for any animation frame in an animation generation task, or a current screen image generated for a real-time rendering task; this disclosure does not limit the scope of the image.

[0132] In a specific embodiment, when the target attribute parameters include target deformation parameters and target element texture index, the above-mentioned generation of the first image corresponding to the object based on a single material sphere may include: Extract the target element texture index and the target deformation parameters corresponding to each first element style from a single material sphere. Based on the texture index of each target element, obtain the texture of the target element corresponding to each style of the first element; Based on the deformation parameters of each target, the texture of each target element is deformed to generate the element style layer corresponding to each first element style. The style layers of each element are combined to obtain the first image.

[0133] In a specific embodiment, the target element texture index corresponding to each first element style and the corresponding target deformation parameters can be extracted from each parameter layer of a single material sphere.

[0134] In one specific embodiment, the above method may further include: Get the original texture, which includes element textures corresponding to multiple element styles; Based on the position of each element texture in the original texture, generate element texture indices corresponding to multiple element styles; Accordingly, obtaining the target element texture corresponding to each first element style based on the texture index of each target element can include: Based on the texture index of each target element, the corresponding element texture is extracted from the original texture.

[0135] In one specific embodiment, the corresponding element texture can be extracted from the original texture based on the position of the element texture indicated by each target element texture index in the original texture, so as to obtain the target element texture corresponding to each first element style.

[0136] In the above embodiments, by obtaining the original texture, which includes element textures corresponding to multiple element styles, the element textures corresponding to multiple element styles can be integrated into one original texture to achieve the extraction of multiple different element textures. Then, based on the position of each element texture in the original texture, element texture indices corresponding to multiple element styles are generated, which can realize the generation of element texture indices for each element style, making it easy to quickly and accurately locate the corresponding element texture from the original texture. Next, based on each target element texture index, the corresponding element texture is extracted from the original texture, which can realize the accurate extraction of element textures corresponding to each element style, and thus realize the display of multiple element styles corresponding to one material ball.

[0137] In a specific embodiment, the target element texture corresponding to any first element style can be deformed based on the deformation operation indicated by the target deformation parameter corresponding to any first element style to obtain the element style layer corresponding to any first element style.

[0138] In a specific embodiment, if the target deformation parameter corresponding to any first element style includes a position deformation parameter, the target element texture can be subjected to position deformation processing based on the aforementioned position deformation parameter to obtain the first layer after position deformation; further, if the target deformation parameter also includes a shape deformation parameter, the first layer can be subjected to shape deformation processing based on the aforementioned shape deformation parameter to obtain the element style layer corresponding to any first element style.

[0139] In a specific embodiment, if the target deformation parameter corresponding to any first element style includes a shape deformation parameter, the target element texture can be shaped and deformed based on the shape deformation parameter to obtain a second layer after shape deformation; further, if the target deformation parameter also includes a position deformation parameter, the second layer can be shaped and deformed based on the position deformation parameter to obtain an element style layer corresponding to any first element style.

[0140] It is understood that, for cases involving both position deformation parameters and shape deformation parameters, the order of the position deformation processing and shape deformation processing described above is not limited in this disclosure. For example, position deformation processing can be performed first, followed by shape deformation processing, or shape deformation processing can be performed first, followed by position deformation processing. Both methods can yield the element style layer corresponding to any of the above first element styles.

[0141] In one specific embodiment, when the position deformation parameters include position offset parameters, the offset direction and offset amount can be determined based on the position offset parameters; the target element texture can then be offset based on the offset direction and offset amount. When the position deformation parameters include rotation parameters, the rotation direction and rotation angle can be determined based on the rotation parameters; the target element texture can then be rotated based on the rotation direction and rotation angle. Accordingly, after the above position offset or rotation, a position-deformed layer can be obtained.

[0142] In a specific embodiment, the position offset parameters may further include basic offset parameters and fine offset parameters. When the position offset parameters include both basic and fine offset parameters, the target element texture can be coarsely adjusted based on the basic offset parameters, and then finely adjusted based on the fine offset parameters, thereby adapting to different fine-grained position adjustment requirements. For example, in an expression generation scenario, fine-grained position adjustments can be used to adapt to different face shapes.

[0143] In a specific embodiment, when the shape deformation parameters include scaling parameters, a scaling ratio can be determined based on the scaling parameters; the target element texture can then be scaled based on the aforementioned scaling ratio. When the shape deformation parameters include distortion parameters, a distortion transformation function can be determined based on the aforementioned distortion parameters; each pixel in the target element volume texture can then be distorted based on the aforementioned distortion transformation function. Accordingly, after the aforementioned scaling or distortion transformation, a shape-deformed layer can be obtained.

[0144] In one specific embodiment, the element style layers corresponding to the first element styles of multiple first elements can be combined to obtain a first image.

[0145] In the above embodiments, the target element texture index and the target deformation parameter corresponding to each first element style are extracted from a single material sphere. This allows a single material sphere to extract the element texture index and deformation parameter of multiple element styles. Then, based on each target element texture index, the target element texture corresponding to each first element style is obtained, enabling accurate acquisition of the target element texture for any first element style. Next, based on each target deformation parameter, deformation processing is performed on each target element texture to generate the element style layer corresponding to each first element style. This enables the generation of the element style layer for any first element style. The element style layers are then composited to obtain the first image. The generation of a first image containing multiple elements can be achieved through a single material sphere and parameter-driven processing, thereby reducing memory usage and improving image processing performance.

[0146] In one specific embodiment, the above method may further include: Get the original texture, which includes multiple sub-textures corresponding to the styles of each element; Remove the black borders from each sub-texture to obtain element textures corresponding to each element style; Based on the position of each element texture in the original texture, generate element texture indices corresponding to multiple element styles; Accordingly, obtaining the target element texture corresponding to each first element style based on the texture index of each target element can include: Based on the texture index of each target element, the corresponding element texture is extracted from the original texture.

[0147] In a specific embodiment, black borders can be removed from each sub-texture to obtain a sub-texture with black borders removed. Correspondingly, the above multiple sub-textures with black borders removed can be used as element textures corresponding to multiple element styles.

[0148] In a specific embodiment, the above-mentioned black border removal process for each sub-texture to obtain element textures corresponding to multiple element styles may include: Determine the first color data of multiple first pixels in the sub-map, as well as the transparency of multiple first pixels; Based on transparency, the area to be filled and the corresponding filling reference area of ​​the sub-map are determined among multiple first pixels; Based on the first color data corresponding to the fill reference area, the area to be filled is filled to obtain the element texture corresponding to the sub-texture.

[0149] In one specific embodiment, the plurality of first pixels of any sub-map may refer to the pixels contained in any sub-map. Further, the plurality of first pixels of any sub-map may be all the pixels in any sub-map.

[0150] In one specific embodiment, the first color data of any first pixel can represent the color of any first pixel. The first color data of any first pixel may include red component data, green component data, and blue component data. The red component data can be used to represent the red component value contained in the color of any first pixel. The green component data can be used to represent the green component value contained in the color of any first pixel. The blue component data can be used to represent the blue component value contained in the color of any first pixel.

[0151] In a specific embodiment, the transparency of any first pixel can characterize the degree of transparency of that first pixel. Specifically, the transparency of any first pixel can be characterized numerically. It can be understood that the greater the transparency of any first pixel, the more transparent the first pixel is; the smaller the transparency of any first pixel, the less transparent the first pixel is.

[0152] In a specific embodiment, any sub-map can be converted to RGBA format to obtain RGBA format image data. By separating the transparency channel and color channel in the RGBA format image data, the first color data of the plurality of first pixels and the transparency of the plurality of first pixels can be obtained.

[0153] In one specific embodiment, the area to be filled can refer to the area that needs to be filled during the black border removal process of any sub-texture. The area to be filled can be a transparent or semi-transparent area in any sub-texture. The area to be filled can include multiple second pixels. Each second pixel can refer to a first pixel whose transparency is greater than a transparency threshold. Specifically, the transparency threshold can be set according to actual application needs, and this disclosure does not limit it. Optionally, the transparency threshold range can be [125, 130]. ​​For example, the transparency threshold can be 128.

[0154] In one specific embodiment, the filling reference region can refer to the region required for filling processing during the black border removal process of any sub-texture. The filling reference region can be a color-confidential region in any sub-texture, i.e., a non-transparent region. The filling reference region can include multiple third pixels. Each third pixel can refer to a first pixel whose transparency is less than or equal to a transparency threshold.

[0155] In one specific embodiment, the above-mentioned determination of the area to be filled and the corresponding filling reference area of ​​the sub-map among multiple first pixels based on transparency may include: Based on transparency, multiple second pixels and multiple third pixels are determined among multiple first pixels, where the transparency of the second pixels is greater than the transparency threshold and the transparency of the third pixels is less than or equal to the transparency threshold. The area to be filled is determined based on multiple second pixels. The filling reference area is determined based on multiple third pixel points.

[0156] In one specific embodiment, the transparency of any first pixel can be compared with a transparency threshold, and based on the relationship between the transparency of any first pixel and the transparency threshold, the first pixel can be determined to be either a second pixel or a third pixel. Specifically, if the transparency of any first pixel is greater than the transparency threshold, the first pixel can be determined to be a second pixel. If the transparency of any first pixel is less than or equal to the transparency threshold, the first pixel can be determined to be a third pixel.

[0157] In one specific embodiment, the pixel range of any sub-map indicated by multiple second pixels in any of the above sub-maps can be used as the area to be filled.

[0158] In one specific embodiment, the pixel range of any sub-map indicated by multiple third pixels in any of the above sub-maps can be used as the filling reference area.

[0159] In the above embodiments, by determining multiple second pixels and multiple third pixels among multiple first pixels based on transparency, where the transparency of the second pixels is greater than a transparency threshold and the transparency of the third pixels is less than or equal to the transparency threshold, the area to be filled is determined based on the multiple second pixels, and the filling reference area is determined based on the multiple third pixels. This enables the rapid and accurate delineation of the area to be filled and the filling reference area for any sub-texture, thereby improving the efficiency and accuracy of black border removal for any sub-texture.

[0160] In one specific embodiment, the above method may further include: Determine the fourth pixel corresponding to each third pixel, where the fourth pixel is the second pixel closest to the corresponding third pixel. Accordingly, the process of filling the area to be filled based on the first color data corresponding to the fill reference area to obtain the element texture corresponding to the sub-texture can include: Based on the first color data of the fourth pixel corresponding to each third pixel, the third pixel is diffused and filled to obtain the second color data corresponding to each third pixel. Based on the second color data, the first color data of multiple second pixels, and the transparency of multiple first pixels, an element texture corresponding to the sub-texture is generated.

[0161] In one specific embodiment, the fourth pixel may refer to the second pixel in the region to be filled that is closest to the corresponding third pixel.

[0162] In a specific embodiment, for each third pixel, distance analysis is performed between the third pixel and each second pixel in the area to be filled, resulting in multiple spacing data corresponding to each third pixel. The largest spacing data can be determined from these multiple spacing data. The second pixel corresponding to the largest spacing data can be used as the fourth pixel corresponding to the third pixel. Each spacing data can represent the distance between the third pixel and the second pixel corresponding to any of the aforementioned spacing data. Specifically, the distance between any third pixel and the fourth pixel can be calculated using Euclidean distance transformation, and the coordinate index of the fourth pixel can be determined.

[0163] In one specific embodiment, the second color data corresponding to any third pixel may refer to the replaced color data obtained after diffusion filling for any of the aforementioned third pixels. Specifically, the second color data may include red component data, green component data, and blue component data.

[0164] In one specific embodiment, each third pixel can be filled with color based on the first color data of its corresponding fourth pixel and the spacing data between each third pixel and its corresponding fourth pixel, thus obtaining the second color data of each third pixel. It is understood that by performing diffusion filling on each third pixel, the color of points closer to the generator in the area to be filled becomes darker (or brighter), creating a gradient effect that diffuses outward from the generator.

[0165] In one specific embodiment, an element map corresponding to the generated sub-map can be generated based on the second color data corresponding to each of the multiple third pixels, the first color data corresponding to each of the multiple second pixels, and the transparency of the multiple first pixels. It can be understood that by retaining the original transparency channel in any sub-map and replacing the color data in the area to be filled with the second color data, a sub-map with black borders removed can be output. That is, the sub-map with black borders removed can be used as an element map.

[0166] In the above embodiments, by determining the fourth pixel corresponding to each third pixel, where the fourth pixel is the second pixel closest to the corresponding third pixel, and by performing diffusion filling on each third pixel based on the first color data of the fourth pixel corresponding to each third pixel, the second color data corresponding to each third pixel can be obtained. This enables diffusion filling of the area to be filled. Then, based on the second color data, the first color data of multiple second pixels, and the transparency of multiple first pixels, an element texture corresponding to the sub-texture is generated. This enables the removal of black borders from any sub-texture, automatically repairing black border defects in any sub-texture without affecting the presentation effect of the original visual content of the sub-texture, thereby further improving content production efficiency and quality.

[0167] In the above embodiments, by determining the first color data and transparency of multiple first pixels in the sub-texture, and based on the transparency, determining the area to be filled and the corresponding filling reference area of ​​the sub-texture among the multiple first pixels, and filling the area to be filled based on the first color data of the filling reference area, the element texture corresponding to the sub-texture is obtained. This can achieve black border removal for any sub-texture, and automatic repair of black border defects in any sub-texture, thereby improving content production efficiency and quality.

[0168] In the above embodiments, by obtaining the original texture, which includes multiple sub-textures corresponding to each element style, and removing black borders from each sub-texture, multiple element textures corresponding to each element style are obtained. This enables the removal of black borders from any sub-texture and the automatic repair of black border defects in any sub-texture. Then, based on the position of each element texture in the original texture, multiple element texture indices corresponding to each element style are generated. This enables the generation of element texture indices corresponding to each element style. Next, based on each target element texture index, the corresponding element texture is extracted from the original texture. This effectively extracts the element textures after the black border removal process, thereby improving the quality of content production.

[0169] In a specific embodiment, the above-mentioned deformation processing of each target element texture based on each target deformation parameter to generate element style layers corresponding to each first element style may include: Based on the target deformation parameters corresponding to the first element style, the corresponding target element texture is deformed to obtain the corresponding initial style layer. Generate the edge transition mask corresponding to the initial style layer; The initial style layer and the edge transition mask are combined to obtain the corresponding element style layer.

[0170] In a specific embodiment, the initial style layer may refer to the layer obtained after applying graphic transformation to the target element corresponding to any first element style.

[0171] In one specific embodiment, an edge transition mask can be used to achieve a transition of pattern edges in the initial style layer. It is understood that an edge transition mask, by controlling the transparency of the layer edges, can achieve a smooth and soft gradient from "fully visible" to "fully hidden," eliminating harsh boundaries at the pattern edges and allowing them to blend naturally and seamlessly with the background or other layers.

[0172] In a specific embodiment, the above-mentioned generation of the edge transition mask corresponding to the initial style layer may include: Determine the element boundary strength corresponding to the initial style layer. The element boundary strength is determined based on the distance from each pixel in the initial style layer to the corresponding pattern boundary. Based on the element boundary strength, generate the edge transition mask corresponding to the initial style layer.

[0173] In one specific embodiment, element boundary strength can characterize the degree of drastic change in color data around each pixel in the initial style layer. Specifically, element boundary strength can be determined based on the distance of each pixel in the initial style layer to its corresponding pattern boundary. Element boundary strength can include the boundary strength data corresponding to each pixel in the initial style layer. It can be understood that the closer a pixel is to its pattern boundary, the greater its boundary strength data; the farther a pixel is from its pattern boundary, the smaller its boundary strength data.

[0174] In one specific embodiment, a first grayscale change rate in the horizontal direction for each pixel in the initial style layer can be determined, and a second grayscale change rate in the vertical direction for each pixel in the initial style layer can be determined. The first grayscale change rate and the corresponding second grayscale change rate for each pixel in the initial style layer can be synthesized to obtain the boundary intensity data corresponding to each pixel. Here, the first grayscale change rate can refer to the degree of grayscale change of the corresponding pixel in the initial style layer in the horizontal direction. The second grayscale change rate can refer to the degree of grayscale change of the corresponding pixel in the initial style layer in the vertical direction.

[0175] In one specific embodiment, the element boundary intensity can be inverted to obtain an inverted layer; the inverted layer can then be edge-blurred to obtain the edge transition mask. Further, the element boundary intensity can be denoised first to obtain denoised element boundary intensity, and then inverted to obtain an inverted layer. Specifically, the edge transition mask can be obtained by applying a Gaussian blur to the inverted layer; alternatively, it can be obtained by applying a distance transformation to the inverted layer.

[0176] In the above embodiments, by determining the element boundary strength corresponding to the initial style layer, which is determined based on the distance from each pixel in the initial style layer to the corresponding pattern boundary, boundary strength analysis in the initial style layer can be achieved. Then, based on the element boundary strength, an edge transition mask corresponding to the initial style layer can be generated, which can achieve the generation of a smooth and soft gradient edge transition mask. This can eliminate the harsh boundaries of the pattern edges in the initial style layer, allowing it to blend naturally and seamlessly with the background or other layers.

[0177] In a specific embodiment, the initial style layer corresponding to any first element style and the edge transition mask corresponding to any first element style are combined to obtain the element style layer corresponding to any first element style.

[0178] In the above embodiments, the target element texture is deformed based on the target deformation parameters corresponding to the first element style to obtain the corresponding initial style layer. An edge transition mask corresponding to the initial style layer is generated to achieve the generation of a smooth and soft gradient edge transition mask. The initial style layer and the edge transition mask are then combined to obtain the corresponding element style layer. This can eliminate the harsh boundaries of the pattern edges in the initial style layer, allowing it to blend naturally and seamlessly with the background or other layers.

[0179] In one specific embodiment, a first image can be generated by executing pre-compiled image generation code, combined with the attribute parameters configured in a single material. The image generation code instructs the execution of the following image generation steps: extracting the target element texture index and its corresponding target deformation parameters for each first element style from the single material, and then compositing the element style layers to obtain the first image. The image generation code may include layer processing code corresponding to each of the multiple element style layers. Specifically, during the compilation of the image generation code, conditional compilation can be used to control its generation.

[0180] In one specific embodiment, the number of elements corresponding to multiple first elements can be obtained; based on the above number of elements, the layer processing code of inactive layers in the image generation code is removed to obtain the removed image generation code. Accordingly, during operation, the above-mentioned first image can be generated by executing the above-mentioned removed image generation code.

[0181] Understandably, while the system supports a maximum preset number of layers (e.g., 8), in practice, only a portion of these layers may be used (e.g., 3-5 layers). Executing all layer logic indiscriminately would incur unnecessary arithmetic logic unit overhead and sampling overhead. By removing layer processing code from the image generation code that doesn't activate the layers—for example, when the number of elements is 3 and the maximum supported number of layers is 8—the processing logic for the remaining layers (layers 4-8) will not be generated in the final shader. This ensures that only the layers actually used are executed at runtime, improving rendering efficiency.

[0182] In one specific embodiment, the above method may further include: Receive a second processing instruction for an object, the second processing instruction is used to indicate the style of each of the multiple second elements, the second element belongs to multiple elements; Update the single material ball based on the differences between the styles of each second element and each first element; Based on the updated single material sphere, generate a second image corresponding to the object.

[0183] In one specific embodiment, the second processing instruction can be used to indicate the second element style corresponding to each of the plurality of second elements. The second processing instruction may include a second style identifier corresponding to the second element style of each of the plurality of second elements. Specifically, the second processing instruction may be a processing instruction for the next frame relative to the first processing instruction. It is understood that the second processing instruction may correspond to a processing instruction for a non-first frame.

[0184] In one specific embodiment, the second element can refer to the element to be displayed as indicated by the second processing instruction. Specifically, the second element can be any one of the aforementioned multiple elements. Correspondingly, the second element belongs to multiple elements.

[0185] In one specific embodiment, the second element style corresponding to any second element can refer to the element style that needs to be displayed for any of the aforementioned second elements. The second element style corresponding to any second element can be any one of multiple element styles corresponding to any of the aforementioned second elements.

[0186] For example, taking the game character expression generation scenario as an example, during game operation, the user terminal can display the first image generated based on the first processing instruction; the game user can further perform game operations on the user terminal based on the displayed first image to generate game operation instructions, and send the game operation instructions to the server; upon receiving the game operation instructions, the server generates game state data based on the game operations indicated by the game operation instructions, and returns the game state data; correspondingly, upon receiving the game state data, the user terminal can determine the object to be displayed, as well as the second element and corresponding second element style to be displayed for the object, and based on the determined second element style, can generate a second processing instruction for the object to instruct the rendering of the game interface image containing the object.

[0187] For example, taking a virtual reality scene as an example, when a user is wearing a VR headset, the first image can be generated based on the first processing instruction and displayed. Based on the first image displayed by the VR headset, the user can further move their head so that the sensors in the VR headset detect changes in head position and angle, and transmit the acquired sensory data indicating changes in head position and angle to the controller in the VR headset. Correspondingly, the controller in the VR headset can determine all objects that need to be rendered, as well as the second elements and styles that need to be displayed in the objects, based on the aforementioned sensory data, and generate a second processing instruction to instruct the rendering of a virtual world image containing the aforementioned objects.

[0188] For example, taking a driving environment perception scenario, after the vehicle triggers the first processing command and continues to drive, it can collect environmental data around the vehicle in real time through various sensors installed on the vehicle body. The vehicle controller can analyze the surrounding environment through the aforementioned environmental data and determine the objects that need to be displayed for the current surrounding environment of the vehicle, as well as the second elements contained in the aforementioned objects and the corresponding styles of the second elements. Based on the determined styles of the aforementioned second elements, the vehicle controller can generate a second processing command to instruct the rendering of a perception environment image of the vehicle's surrounding environment containing the aforementioned objects.

[0189] In a specific embodiment, updating a single material sphere based on the differences between the styles of each second element and each first element can include: In each first element style, find the corresponding second element style for each second element to obtain the search results; Update the configuration of the single material sphere based on the style of the unfound second element indicated by the search results.

[0190] In one specific embodiment, the search result can be used to indicate whether a first element style matches each second element style. The search result can include the style search result corresponding to each second element style. The style search result corresponding to any second element style can be used to indicate whether a first element style matches any of the aforementioned multiple first element styles. The style search result can include a first search result or a second search result. The first search result can be used to indicate that a first element style matches the corresponding second element style. The second search result can be used to indicate that no first element style matches the corresponding second element style.

[0191] In a specific embodiment, for each second element style, a search can be performed among multiple first element styles to obtain the style search result corresponding to each second element style.

[0192] In one specific embodiment, a second search result can be filtered out from the search results; the second element style corresponding to the second search result is used as the unfound second element style indicated by the above search results.

[0193] In a specific embodiment, for each second element, a corresponding first element can be determined; the second style identifier of the second element's style is compared with the first style identifier of the first element's style to obtain a style search result for the second element. If the comparison determines that the corresponding first style identifier and the corresponding second style identifier do not match, the style search result corresponding to the second element's style can be determined as the second search result; if the comparison determines that the corresponding first style identifier and the corresponding second style identifier match, the style search result corresponding to the second element's style can be determined as the first search result.

[0194] In a specific embodiment, during the process of determining the first element corresponding to each second element, if it is determined that any second element does not belong to the plurality of first elements, the style search result of the second element style of any second element can be determined as the second search result.

[0195] In one specific embodiment, based on the unfound second element styles indicated by the search results, the attribute parameters corresponding to each of the unfound second element styles are obtained, and the configuration of a single material sphere is updated based on the attribute parameters corresponding to each of the unfound second element styles. It is understood that by keeping the unupdated attribute parameters unchanged, there is no need to re-extract and configure them; only the attribute parameters of the updated second element styles can be configured, which is lightweight and efficient, and can improve rendering efficiency.

[0196] In one specific embodiment, based on the unfound second element styles indicated by the search results, the attribute parameters corresponding to each of the unfound second element styles are obtained; the parameter layer to be updated in a single material sphere is determined; and the parameter layer to be updated is updated based on the attribute parameters corresponding to each of the unfound second element styles.

[0197] In a specific embodiment, if a second element belonging to multiple first elements exists within an unfound second element style, the corresponding first element can be determined based on the second element. The parameter layer corresponding to the first element style of that first element in a single material sphere is then used as the first parameter layer to be updated corresponding to the second element style. Accordingly, the extracted attribute parameters corresponding to the second element style can be configured into the aforementioned first parameter layer to be updated.

[0198] In one specific embodiment, if a second element in an unfounded second element style does not belong to multiple first elements, any inactive parameter layer in a single material sphere can be used as the second parameter layer to be updated. Correspondingly, the extracted attribute parameters corresponding to the second element style can be configured into the aforementioned second parameter layer to be updated.

[0199] In a specific embodiment, the attribute parameters corresponding to the style of the second element that was not found can be extracted from the parameter sets corresponding to the above multiple elements.

[0200] In the above embodiments, by searching for the corresponding second element style of each second element in each first element style and obtaining the search results, it is possible to quickly determine the second element style that has changed. Then, by combining the second element style that was not found indicated by the search results, the configuration of a single material ball can be updated, which can realize the configuration of the attribute parameters that have changed. This is lightweight and efficient, which can improve the configuration efficiency of the material ball and thus improve the overall image processing efficiency.

[0201] In one specific embodiment, the target element texture index and its corresponding target deformation parameter are extracted from each second element style from a single material sphere; the target element texture corresponding to each second element style is obtained according to the target element texture index; based on the target deformation parameters, the target element texture is deformed to generate the element style layer corresponding to each second element style; and the element style layers are composited to obtain the second image. Specifically, the specific image generation process for generating the second image based on the first material sphere can refer to the aforementioned specific image generation process, which will not be repeated here.

[0202] In the above embodiments, a second processing instruction for an object is received. This second processing instruction indicates the second element style corresponding to each of the multiple second elements. Since the second element belongs to multiple elements, a single material sphere is updated based on the differences between each second element style and each first element style. This update allows for updating the attribute parameters of element styles with differences within the single material sphere. Based on the updated single material sphere, a second image corresponding to the object is generated, improving parameter configuration efficiency and thus rendering efficiency. It is understood that by keeping the unupdated attribute parameters unchanged, there is no need to re-extract and configure them; only the attribute parameters of the updated second element styles can be configured, resulting in a lightweight and efficient approach that improves rendering efficiency.

[0203] In the above embodiments, by pre-constructing parameter sets corresponding to multiple elements of an object, including attribute parameters of multiple element styles of the corresponding elements, upon receiving a first processing instruction for the object, the first element styles corresponding to multiple first elements are obtained. Since the first element belongs to multiple elements, the first element styles indicated by the first processing instruction can be obtained. Then, in the parameter sets corresponding to multiple elements, the target attribute parameters corresponding to each first element style are extracted, thus realizing the extraction of attribute parameters of the first element styles. Next, each target attribute parameter is configured in a single material ball, and the first image corresponding to the object is generated based on the single material ball. The generation of a first image containing multiple elements of an object can be achieved through a single material ball, which can avoid the large memory consumption caused by using multiple material balls in the image processing of the object, thereby reducing memory consumption and improving image processing performance.

[0204] Figure 7 This is a flowchart of an image processing method based on a first application and a second application provided in an embodiment of this application. Figure 8 This is an interactive schematic diagram of an image processing method based on a first application and a second application provided in an embodiment of this application. Specifically, as shown... Figure 7As shown, the process of constructing the parameter set and configuration information can be as follows: Display the style preview page corresponding to the element, which includes a deformation setting control, a deformation effect preview control, and a texture index setting control; when the deformation setting control is triggered, display the corresponding deformation processing effect in the deformation effect preview control; in response to the configuration operation of the deformation setting control and the texture index setting control, generate the parameter set corresponding to the element; obtain the first configuration information generated based on the first application; convert the format of the first configuration information to obtain the second configuration information. Correspondingly, upon receiving the first processing instruction for the object, obtain the first element styles corresponding to each of the multiple first elements; extract the target attribute parameters corresponding to each first element style from the parameter sets corresponding to the multiple elements; configure each target attribute parameter in a single material sphere; and generate the first image corresponding to the object based on the single material sphere.

[0205] Specifically, such as Figure 8 As shown, the style content producer can adjust element styles in the first application through the deformation setting control, deformation effect preview control, and texture index setting control in the style preview page of the first application. Once the element style adjustment is confirmed, the producer can click the confirmation button to collect data, generate the parameter set corresponding to the element, and save it as JSON format data. Furthermore, the JSON format data exported from the first application can be converted to a second format of second configuration information. This format conversion can be achieved using a format conversion tool, specifically including: parsing the element style of each frame by element to generate a scripted object; converting the frame number to time (based on 30fps) to construct keyframes; setting the interpolation mode to a stepped interpolation mode to avoid illegal mixing of element styles between frames (e.g., invalid values ​​appearing between "eyebrow 0" and "eyebrow 1"); and binding the element style curve for any element indicated in the first configuration information to the corresponding attribute of the animation component, achieving one-click import and automatic driving. For example, in a game character expression generation scenario, the above animation component can be a facial animation component. Correspondingly, during game runtime, this component can output element style trajectories from the animation system to pass the style identifiers of the element styles in the element style trajectories to the shader in real time. The shader can read the target attribute parameters through the single material sphere, obtain the corresponding target element texture using the target element texture index in the target attribute parameters, and perform multi-layer hybrid calculations to generate the texture by combining the deformation parameters in the target attribute parameters. This can achieve single-material sphere and parameter-driven rendering, improving rendering efficiency and performance while reducing memory usage.

[0206] Figure 9 This is an architectural diagram of an image processing method provided in an embodiment of this application. Specifically, as shown... Figure 9As shown, the target system may include an application layer, a runtime layer, and a rendering layer. The target system can be used to implement the aforementioned image processing method. The application layer can be used to generate first processing instructions. The application layer may include a game application module, an in-vehicle application module, and a virtual reality application module. The runtime layer can be used, upon receiving the first processing instruction for an object, to obtain the first element styles corresponding to multiple first elements, extract the target attribute parameters corresponding to each first element style from the parameter sets corresponding to the multiple elements, and configure each target attribute parameter in a single material sphere. The rendering layer can be used to extract the target element texture index and the corresponding target deformation parameters corresponding to each first element style from the single material sphere, obtain the target element texture corresponding to each first element style based on the target element texture index, perform deformation processing on each target element texture based on the target deformation parameters, generate element style layers corresponding to each first element style, and composite the element style layers to obtain the first image.

[0207] Figure 10 This is a schematic diagram of a first image generated in an expression generation scenario provided by an embodiment of this application. Specifically, taking a game character expression generation scenario as an example, during game operation, the game user can perform game operations on the user terminal to generate game operation instructions, and send the game operation instructions to the server; upon receiving the game operation instructions, the server generates game state data based on the game operations indicated by the game operation instructions, and returns the game state data; correspondingly, upon receiving the game state data, the user terminal can determine the object to be displayed, as well as the first element and corresponding first element style to be displayed for the object, and based on the determined first element style, can generate a first processing instruction for the object. Furthermore, upon receiving a first processing instruction for an object, the system can obtain the first element styles corresponding to multiple first elements; extract the target attribute parameters corresponding to each first element style from the parameter sets corresponding to the multiple elements; configure each target attribute parameter in a single material sphere; extract the target element texture index and its corresponding target deformation parameters corresponding to each first element style from the single material sphere; obtain the target element texture corresponding to each first element style based on the target element texture index; perform deformation processing on each target element texture based on the target deformation parameters to generate element style layers corresponding to each first element style; and composite the element style layers to obtain the desired result. Figure 10 The first image shown above. Accordingly, the first image can be displayed on the user terminal.

[0208] For example, when a game user triggers a dialogue interaction with a non-player character in the game, the target system can load facial animations; correspondingly, the animation player can drive the animation component, and the animation component can update the attribute parameter configuration in a single material; the GPU's shader can render facial expression changes in real time through the attribute parameter configuration in the aforementioned single material.

[0209] For example, game users can adjust element styles through the style preview page displayed in the character personalization system. Specifically, the style preview page can also display a style slider. By sliding the style slider corresponding to any element, the style of that element can be switched, and after switching the element style, the corresponding character facial display effect is previewed. When switching element styles using the style slider, the element style can be obtained, and the corresponding attribute parameters of the element style can be obtained from the parameter set. The obtained attribute parameters are then used to update the parameter layer of the element corresponding to that element in a single material ball, thus keeping the effects of other element styles unchanged, and only changing the style of the element switched by sliding in the facial display effect, with the preview window displaying the effect immediately.

[0210] For example, during the creation of facial animation, the facial modeling tool of the second application can be opened, and a preset facial element style (such as "surprised") can be selected. The facial modeling tool can automatically set keyframes in the current frame. Repeating the above steps can complete the animation, and the second configuration information can be obtained by exporting.

[0211] Figure 11This is a schematic diagram of a first image generated in a virtual reality scene according to an embodiment of this application. Specifically, taking a virtual reality scene as an example, when a user is wearing a VR headset, the movement of the head allows the sensors in the VR headset to detect changes in head position and angle, and transmits the acquired sensory data indicating changes in head position and angle to the controller in the VR headset. Accordingly, the controller in the VR headset can determine all objects that need to be rendered, as well as the first element and style of the first element to be displayed in the objects, based on the aforementioned sensory data, and generate a first processing instruction. Furthermore, upon receiving a first processing instruction for an object, the system can obtain the first element styles corresponding to multiple first elements; extract the target attribute parameters corresponding to each first element style from the parameter sets corresponding to the multiple elements; configure each target attribute parameter in a single material sphere; extract the target element texture index and its corresponding target deformation parameters corresponding to each first element style from the single material sphere; obtain the target element texture corresponding to each first element style based on the target element texture index; perform deformation processing on each target element texture based on the target deformation parameters to generate element style layers corresponding to each first element style; and composite the element style layers to obtain the desired result. Figure 11 The first image shown above can be displayed on the VR headset worn by the user.

[0212] Figure 12 This is a schematic diagram of a first image generated in a driving environment perception scenario provided in an embodiment of this application. Specifically, taking a driving environment perception scenario as an example, a vehicle can collect environmental data around the vehicle in real time through various sensors installed on the vehicle body; the vehicle controller can analyze the surrounding environment through the aforementioned environmental data and determine the objects to be displayed for the current surrounding environment of the vehicle, as well as the first elements and corresponding first element styles contained in the aforementioned objects; the vehicle controller can generate a first processing instruction based on the determined first element styles. Further, upon receiving the first processing instruction for the object, the first element styles corresponding to multiple first elements can be obtained; target attribute parameters corresponding to each first element style can be extracted from the parameter sets corresponding to multiple elements; each target attribute parameter can be configured in a single material sphere; from the single material sphere, the target element texture index and corresponding target deformation parameters corresponding to each first element style can be extracted; according to each target element texture index, the target element texture corresponding to each first element style can be obtained; based on each target deformation parameter, deformation processing is performed on each target element texture to generate element style layers corresponding to each first element style; the element style layers are synthesized to obtain the image shown below. Figure 12The first image shown can be displayed on the vehicle's infotainment system. It is understood that by using the image processing method described above to generate the first image in a driving environment perception scenario, high-performance rendering of complex or detailed environmental renderings can be achieved.

[0213] Figure 13 This is a schematic diagram of a single material sphere in an image processing method provided in an embodiment of this application. Figure 14 This is a schematic diagram illustrating the parameter-driven process of a single material sphere in an image processing method provided in an embodiment of this application. Specifically, as shown... Figure 13 As shown, a single material can include multiple parameter layers, and any parameter layer can be used to generate a corresponding element style layer. A single material can support a preset number of parameter layers. For example, with a preset number of 8, a single material can support the configuration of attribute parameters for up to 8 parameter layers. Assuming there are 8 elements, this can be achieved by... Figure 13 The eight parameter layers (i.e.) Figure 13 The “parameter layer 1”, “parameter layer 2”, “parameter layer 3”, “parameter layer 4”, “parameter layer 5”, “parameter layer 6”, “parameter layer 7” and “parameter layer 8” are configured with the corresponding element style attribute parameters to generate the above 8 element style layers, thereby generating the first image.

[0214] Furthermore, such as Figure 14 As shown, taking five different first element styles indicated by the first processing instruction as an example, upon receiving the first processing instruction for an object, the first element styles corresponding to each of the multiple first elements can be obtained (e.g., ...). Figure 14 The text shows "First Element Style 1", "First Element Style 2", "First Element Style 3", "First Element Style 4", and "First Element Style 5"; it then extracts the target attribute parameters (e.g., ...) corresponding to each first element style from the parameter sets corresponding to multiple elements. Figure 14 The text shows "Target Attribute Parameter 1", "Target Attribute Parameter 2", "Target Attribute Parameter 3", "Target Attribute Parameter 4", and "Target Attribute Parameter 5"; it then configures each target attribute parameter in different parameter layers within a single material; from each parameter layer of the single material, it extracts the target element texture index corresponding to each first element style, as well as its corresponding target deformation parameter; based on the target element texture index, it obtains the target element texture corresponding to each first element style (e.g., ...). Figure 14 The "target element" shown in the image Figure 1 "Target element sticker" Figure 2 "Target element sticker" Figure 3 "Target element sticker" Figure 4"and target element sticker" Figure 5 Based on the deformation parameters of each target element, the texture of each target element is deformed to generate the element style layer corresponding to each first element style (e.g., ...). Figure 14 The first image is obtained by combining the element style layers shown in the image, which are "Element Style Layer 1", "Element Style Layer 2", "Element Style Layer 3", "Element Style Layer 4" and "Element Style Layer 5".

[0215] The image processing method of this application is manifested as an image processing system, which can be deployed in various specific product forms. For example, it can be deployed in game applications to generate the facial expressions of game objects in real time; or it can be deployed in virtual reality devices to generate virtual reality images in real time by combining the changes in head position and angle perceived by the user's head-mounted device; or it can be deployed in vehicle systems to render the driving environment perception effect map of the vehicle in real time based on the environmental data collected in real time.

[0216] Compared with related technologies, this application has the following advantages: 1) Significantly reduced resource consumption: Taking 3 elements each corresponding to 5 element styles as an example, the number of textures can be reduced from 125 (5*5*5 combination) to 15 (5+5+5). The corresponding generated resource package size can be reduced by 88%. For a single character, memory consumption can be reduced from 5MB to 0.6MB.

[0217] 2) Significantly improved rendering performance: The number of drawing requests can be reduced from N (where N is the number of elements) to 1; by controlling the removal of inactive code in the image generation code through conditional compilation, GPU usage can be reduced by 30%; and it can support smooth operation at 60fps on mobile devices.

[0218] 3) Improved visual quality: Black borders caused by transparency can be completely eliminated through black border removal processing; soft edge transitions can be achieved through edge transition masking to avoid hard edge cutting; advanced effects such as rotation and mirroring can be supported.

[0219] 4) Improved Production Efficiency: Transition element styles can be visually fine-tuned through the style preview page. The visual preview provides a WYSIWYG experience, and automated black border removal eliminates the need for manual image retouching, effectively shortening the content creation time for element styles. For example, emoji creation time can be reduced from 2 hours per emoji to 15 minutes per emoji. Secondly, it improves animation production efficiency. Specifically, based on the visually generated element styles, keyframes can be applied by clicking, increasing the reusability of parameter sets. Format conversion allows for seamless cross-tool collaboration between the first and second applications, improving animation production efficiency. Furthermore, modifying a single element style does not require re-exporting all combinations, supporting hot updates and user-friendly version control (JSON format), reducing iteration costs.

[0220] 5) Extensibility Advantages: When adding new elements, the corresponding textures can be added to the original textures, generating a corresponding element texture index, which improves the ease of element expansion. When adding new layers, the number of elements can be modified to control the generated image generation code, eliminating the need for manual code or shader modification, further enhancing layer expansion convenience. Secondly, it supports personal computers, mobile devices, and console platforms, automatically adapting to different performance levels and supporting various application scenarios, achieving cross-platform compatibility. Furthermore, the above image processing methods can be combined with blending deformation techniques, supporting physical simulations (such as hair or cloth), and is compatible with various animation systems, meaning it can be integrated with other systems.

[0221] Figure 15 This is a block diagram of an image processing apparatus provided in an embodiment of this application. Specifically, as shown... Figure 15 As shown, the device may include: The pre-construction module 1510 is used to pre-construct parameter sets corresponding to multiple elements of an object, wherein the parameter sets include attribute parameters of multiple element styles of the corresponding elements. The first style determination module 1520 is used to obtain the first element style corresponding to each of the multiple first elements when a first processing instruction for the object is received, wherein the first element belongs to the multiple elements. The parameter extraction module 1530 is used to extract the target attribute parameters corresponding to each style of the first element from the parameter sets corresponding to the multiple elements. The first configuration module 1540 is used to configure each of the target attribute parameters in a single material sphere; The first generation module 1550 is used to generate a first image corresponding to the object based on the single material sphere.

[0222] In an optional embodiment, the target attribute parameters include target deformation parameters and target element texture index; the first generation module includes: The parameter extraction unit is used to extract the target element texture index corresponding to each of the first element styles and the corresponding target deformation parameters from the single material sphere. The first texture acquisition unit is used to acquire the target element texture corresponding to each of the first element styles according to the texture index of each target element. The deformation unit is used to perform deformation processing on each of the target element textures based on each of the target deformation parameters, and generate element style layers corresponding to each of the first element styles. The compositing unit is used to composite the various element style layers to obtain the first image.

[0223] In an optional embodiment, the apparatus further includes: The first texture acquisition module is used to acquire the original texture, which includes element textures corresponding to multiple element styles; The first index generation module is used to generate element texture indexes corresponding to the multiple element styles based on the position of each element texture in the original texture. Accordingly, the first texture acquisition unit includes: The second texture acquisition unit is used to extract the corresponding element texture from the original texture based on the texture index of each target element.

[0224] In an optional embodiment, the apparatus further includes: The second texture acquisition module is used to acquire the original texture, which includes multiple sub-textures corresponding to each element style; The black border removal module is used to remove black borders from each of the sub-textures to obtain element textures corresponding to each of the multiple element styles. The second index generation module is used to generate element texture indexes corresponding to the multiple element styles based on the position of each element texture in the original texture. Accordingly, the first texture acquisition unit includes: The third texture acquisition unit is used to extract the corresponding element texture from the original texture based on the texture index of each target element.

[0225] In an optional embodiment, the black border removal module includes: A pixel data determining unit is used to determine the first color data of a plurality of first pixels in the sub-texture, and the transparency of the plurality of first pixels; A region determination unit is used to determine, based on the transparency, the region to be filled and the corresponding filling reference region corresponding to the sub-map among the plurality of first pixels; A fill unit is used to fill the area to be filled based on the first color data corresponding to the fill reference area to obtain the element texture corresponding to the sub-texture.

[0226] In an optional embodiment, the region determination unit is configured to: Based on the transparency, among the plurality of first pixels, a plurality of second pixels and a plurality of third pixels are determined, wherein the transparency of the second pixels is greater than a transparency threshold, and the transparency of the third pixels is less than or equal to the transparency threshold; The area to be filled is determined based on the plurality of second pixels; The filling reference area is determined based on the plurality of third pixels.

[0227] In an optional embodiment, the apparatus further includes: A pixel point determination module is used to determine the fourth pixel point corresponding to each of the third pixel points, wherein the fourth pixel point is the second pixel point that is closest to the corresponding third pixel point; Accordingly, the filling unit is used for: Based on the first color data of the fourth pixel corresponding to each of the third pixels, the third pixels are diffused and filled to obtain the second color data corresponding to each of the third pixels. Based on each of the second color data, the first color data of the plurality of second pixels, and the transparency of the plurality of first pixels, an element texture corresponding to the sub-texture is generated.

[0228] In an optional embodiment, the deformation unit includes: The deformation processing unit is used to perform deformation processing on the corresponding target element texture based on the target deformation parameters corresponding to the first element style, so as to obtain the corresponding initial style layer. A transition mask generation unit is used to generate an edge transition mask corresponding to the initial style layer; The mask compositing unit is used to composite the initial style layer and the edge transition mask to obtain the corresponding element style layer.

[0229] In an optional embodiment, the transition mask generation unit is configured to: Determine the element boundary strength corresponding to the initial style layer, the element boundary strength being determined based on the distance from each pixel in the initial style layer to the corresponding pattern boundary; Based on the element boundary strength, an edge transition mask corresponding to the initial style layer is generated.

[0230] In an optional embodiment, the first configuration module is configured to: Each of the target attribute parameters is configured in a different parameter layer in the single material sphere, and the parameter layer is used to generate the corresponding element style layer.

[0231] In an optional embodiment, the apparatus further includes: The page display module is used to display the style preview page corresponding to the element. The style preview page includes a deformation setting control, a deformation effect preview control, and a texture index setting control. The deformation effect preview module is used to display the corresponding deformation processing effect in the deformation effect preview control when the deformation setting control is triggered. The parameter set generation module is used to generate the parameter set corresponding to the element in response to the configuration operation of the deformation setting control and the texture index setting control.

[0232] In an optional embodiment, the apparatus further includes: The instruction receiving module is used to receive a linkage setting instruction, which indicates that there is a linkage relationship between the driving element and the driven element, wherein the driving element and the driven element are different elements among the plurality of elements; The linkage setting module is used to set the element style corresponding to the driven element to the second associated element style if the element style corresponding to the driving element is set to the first associated element style, wherein the first associated element style and the second associated element style have a corresponding relationship.

[0233] In an optional embodiment, the apparatus further includes: The second style determination module is used to receive a second processing instruction for the object, the second processing instruction being used to indicate the second element style corresponding to each of the plurality of second elements, the second element belonging to the plurality of elements; The second configuration module is used to update the single material ball based on the differences between each second element style and each first element style; The second generation module is used to generate a second image corresponding to the object based on the updated single material sphere.

[0234] In an optional embodiment, the second configuration module is configured to: In each of the first element styles, find the second element style corresponding to each of the second elements to obtain the search results; The configuration of the single material sphere is updated based on the unfound second element style indicated by the search results.

[0235] In an optional embodiment, the apparatus further includes: The configuration acquisition module is used to acquire first configuration information generated based on the first application. The first configuration information is used to record the first element and the corresponding first element style using a first format. The format conversion module is used to convert the first configuration information to obtain the second configuration information, the second configuration information using the second format, and the second format being compatible with the second application; The first style determination module is used for: In the second application, based on the second configuration information, the first element style corresponding to each of the plurality of first elements is obtained.

[0236] In an optional embodiment, the apparatus further includes: The rationality verification module is used to perform rationality verification on the scaling component and the position offset component respectively, and obtain the verification result; A correction module is used to correct the unreasonable component if the verification result indicates the presence of an unreasonable component. The parameter extraction module is used for: The target attribute parameters are extracted from the corrected parameter set.

[0237] Regarding the apparatus in the above embodiments, the specific manner in which each module and unit performs its operations has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0238] Figure 16 This is a block diagram of an electronic device for generating a first image based on a pre-built parameter set, provided in an embodiment of this application. The electronic device can be a server, and its internal structure diagram can be as follows: Figure 16 As shown, the electronic device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements the aforementioned image processing method.

[0239] Figure 17This is a block diagram of another electronic device provided in this application for generating a first image based on a pre-built parameter set. The electronic device can be a terminal, and its internal structure diagram can be as follows: Figure 17 As shown, the electronic device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements the aforementioned image processing method. The display screen can be a liquid crystal display (LCD) or an e-ink display. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.

[0240] Those skilled in the art will understand that Figure 16 or Figure 17 The structure shown is merely a block diagram of a portion of the structure related to the present disclosure and does not constitute a limitation on the electronic device to which the present disclosure is applied. A specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0241] In an exemplary embodiment, an electronic device is also provided, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the image processing method as described in the embodiments of this disclosure.

[0242] In an exemplary embodiment, a computer-readable storage medium is also provided, wherein when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the image processing method of the present disclosure.

[0243] In an exemplary embodiment, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to perform the image processing method of the present disclosure embodiments.

[0244] It is understood that in the specific implementation of this application, user-related data is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0245] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0246] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0247] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. An image processing method, characterized in that, The method includes: A parameter set corresponding to each of the multiple elements of the pre-built object, wherein the parameter set includes the attribute parameters of each of the multiple element styles of the corresponding element; Upon receiving a first processing instruction for the object, the first element style corresponding to each of the plurality of first elements is obtained, wherein the first element belongs to the plurality of elements; In the parameter set corresponding to each of the multiple elements, extract the target attribute parameters corresponding to each style of the first element. Configure each of the target attribute parameters in a single material sphere; Based on the single material sphere, a first image corresponding to the object is generated.

2. The method according to claim 1, characterized in that, The target attribute parameters include target deformation parameters and target element texture index; The step of generating the first image corresponding to the object based on the single material sphere includes: Extract the target element texture index corresponding to each of the first element styles, as well as the target deformation parameters corresponding to each of them, from the single material sphere. Based on the target element texture index, obtain the target element texture corresponding to each of the first element styles; Based on the target deformation parameters, the textures of each target element are deformed to generate element style layers corresponding to each of the first element styles. The style layers of each element are combined to obtain the first image.

3. The method according to claim 2, characterized in that, The method further includes: Obtain the original texture, which includes element textures corresponding to multiple element styles; Based on the position of each element texture in the original texture, an element texture index corresponding to the multiple element styles is generated; The step of obtaining the target element texture corresponding to each of the first element styles based on each target element texture index includes: Based on the texture index of each target element, the corresponding element texture is extracted from the original texture.

4. The method according to claim 2, characterized in that, The method further includes: Obtain the original texture, which includes multiple sub-textures corresponding to each element style; Remove the black borders from each of the sub-textures to obtain the element textures corresponding to each of the multiple element styles; Based on the position of each element texture in the original texture, an element texture index corresponding to the multiple element styles is generated; The step of obtaining the target element texture corresponding to each of the first element styles based on each target element texture index includes: Based on the texture index of each target element, the corresponding element texture is extracted from the original texture.

5. The method according to claim 4, characterized in that, The black border removal process is performed on each of the sub-textures to obtain element textures corresponding to each element style, including: Determine the first color data of a plurality of first pixels in the sub-map, and the transparency of the plurality of first pixels; Based on the transparency, among the plurality of first pixels, the area to be filled and the corresponding filling reference area corresponding to the sub-map are determined; Based on the first color data corresponding to the filling reference area, the area to be filled is filled to obtain the element texture corresponding to the sub-texture.

6. The method according to claim 5, characterized in that, The step of determining the area to be filled and the corresponding filling reference area of ​​the sub-map among the plurality of first pixels based on the transparency includes: Based on the transparency, among the plurality of first pixels, a plurality of second pixels and a plurality of third pixels are determined, wherein the transparency of the second pixels is greater than a transparency threshold, and the transparency of the third pixels is less than or equal to the transparency threshold; The area to be filled is determined based on the plurality of second pixels; The filling reference area is determined based on the plurality of third pixels.

7. The method according to claim 6, characterized in that, The method further includes: Determine the fourth pixel corresponding to each of the third pixel points, wherein the fourth pixel point is the second pixel point that is closest to the corresponding third pixel point; The step of filling the area to be filled based on the first color data corresponding to the filling reference area to obtain the element texture corresponding to the sub-texture includes: Based on the first color data of the fourth pixel corresponding to each of the third pixels, the third pixels are diffused and filled to obtain the second color data corresponding to each of the third pixels. Based on each of the second color data, the first color data of the plurality of second pixels, and the transparency of the plurality of first pixels, an element texture corresponding to the sub-texture is generated.

8. The method according to any one of claims 2 to 7, characterized in that, The step of deforming each target element texture based on the target deformation parameters to generate element style layers corresponding to each of the first element styles includes: Based on the target deformation parameters corresponding to the first element style, the corresponding target element texture is deformed to obtain the corresponding initial style layer. Generate the edge transition mask corresponding to the initial style layer; The initial style layer and the edge transition mask are combined to obtain the corresponding element style layer.

9. The method according to claim 8, characterized in that, The process of generating the edge transition mask corresponding to the initial style layer includes: Determine the element boundary strength corresponding to the initial style layer, the element boundary strength being determined based on the distance from each pixel in the initial style layer to the corresponding pattern boundary; Based on the element boundary strength, an edge transition mask corresponding to the initial style layer is generated.

10. The method according to claim 2, characterized in that, The step of configuring each of the target attribute parameters in a single material sphere includes: Each of the target attribute parameters is configured in a different parameter layer in the single material sphere, and the parameter layer is used to generate the corresponding element style layer.

11. The method according to claim 2, characterized in that, The method further includes: Display the style preview page corresponding to the element. The style preview page includes deformation setting controls, deformation effect preview controls, and texture index setting controls. When the deformation setting control is triggered, the corresponding deformation processing effect is displayed in the deformation effect preview control; In response to configuration operations on the deformation setting control and the texture index setting control, a parameter set corresponding to the element is generated.

12. The method according to claim 1, characterized in that, Before receiving a first processing instruction for the object, the method further includes: Receive a linkage setting instruction, the linkage setting instruction being used to indicate that there is a linkage relationship between the driving element and the driven element, wherein the driving element and the driven element are different elements among the plurality of elements; If the element style corresponding to the driving element is set to the first associated element style, the element style corresponding to the driven element is set to the second associated element style, and the first associated element style and the second associated element style have a corresponding relationship.

13. The method according to claim 1, characterized in that, The method further includes: Receive a second processing instruction for the object, the second processing instruction being used to indicate the second element style corresponding to each of a plurality of second elements, the second element belonging to the plurality of elements; Update the single material sphere based on the differences between each second element style and each first element style; Based on the updated single material sphere, a second image corresponding to the object is generated.

14. The method according to claim 13, characterized in that, The step of updating the single material sphere based on the differences between each second element style and each first element style includes: In each of the first element styles, find the second element style corresponding to each of the second elements to obtain the search results; The configuration of the single material sphere is updated based on the unfound second element style indicated by the search results.

15. The method according to claim 1, characterized in that, The method further includes: Obtain first configuration information generated based on the first application, wherein the first configuration information is used to record the first element and the corresponding first element style using a first format; The first configuration information is converted to obtain the second configuration information, which uses a second format and is adapted to the second application. The step of obtaining the style of each of the multiple first elements includes: In the second application, based on the second configuration information, the first element style corresponding to each of the plurality of first elements is obtained.

16. The method according to any one of claims 1 to 15, characterized in that, The attribute parameters include deformation parameters, which include scaling components and position offset components. The method further includes: The scaling component and the position offset component are respectively verified for reasonableness, and the verification results are obtained; If the verification result indicates the presence of unreasonable components, the unreasonable components shall be corrected. The step of extracting the target attribute parameters corresponding to each style of the first element from the parameter sets corresponding to the multiple elements includes: The target attribute parameters are extracted from the corrected parameter set.

17. An image processing apparatus, characterized in that, The device includes: A pre-construction module is used to pre-construct parameter sets corresponding to multiple elements of an object, wherein the parameter sets include attribute parameters of multiple element styles of the corresponding elements; The first style determination module is used to obtain the first element style corresponding to each of the multiple first elements when a first processing instruction is received for the object, wherein the first element belongs to the multiple elements. The parameter extraction module is used to extract the target attribute parameters corresponding to each style of the first element from the parameter sets corresponding to the multiple elements. The first configuration module is used to configure each of the target attribute parameters in a single material sphere; The first generation module is used to generate a first image corresponding to the object based on the single material sphere.

18. An electronic device, characterized in that, include: processor; Memory used to store computer programs; The processor is configured to execute the computer program to implement the image processing method according to any one of claims 1 to 16.

19. A non-volatile computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the image processing method according to any one of claims 1 to 16.

20. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by an electronic device, it implements the image processing method according to any one of claims 1 to 16.

Images