Model car processing methods, vehicles and related devices

By selecting or generating images from the vehicle's local storage and adjusting the composition and parameters, the limitations of existing technologies in personalized car model customization are overcome, enabling efficient and personalized car model rendering by the user, and improving ease of operation and visual effects.

CN123114341APending Publication Date: 2026-11-17HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510625933.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-14
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

In existing technologies, users can only select patterns for vehicle 3D models from a range of options limited by the system, and the patterns are fixed in preset positions, making personalized customization impossible. The operation process is cumbersome and the visual presentation is monotonous.

Method used

Images can be generated by selecting images from the vehicle's local storage or by inputting voice commands. The images can be recomposed and semantically segmented. Users can customize the movement, rotation, cropping, scaling, and adjustment of image parameters such as brightness, contrast, and saturation to achieve intelligent rendering of the images onto the surface of the car model.

Benefits of technology

It enhances the personalization and customization of car models, simplifies user operation, reduces learning costs, and improves the richness and real-time nature of visual presentation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123114341A_ABST
    Figure CN123114341A_ABST
Patent Text Reader

Abstract

This application provides a method for processing vehicle models, a vehicle, and related devices, relating to the field of terminal technology. In this method, in response to a first operation for determining a first image, a target vehicle model rendered with a second image can be displayed on a first interface. The first image is locally stored on the vehicle or generated based on voice commands. The image size of the second image meets preset size requirements, and the second image contains a main object present in the first image. Subsequently, in response to a second operation applied to the target vehicle model, a first adjustment process can be performed on the second image displayed on the surface of the target vehicle model. The first adjustment process includes at least one of the following: moving, rotating, cropping, and scaling. Furthermore, in response to a third operation applied to a first adjustment control in the first interface, a second adjustment process can be performed on the second image displayed on the surface of the target vehicle model. This effectively enhances the personalization of the vehicle model.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a method for processing car models, a vehicle, and related devices. Background Technology

[0002] With the accelerating pace of automotive intelligence, it's now possible to display a 3D virtual model of a vehicle on its screen. Users can then adjust the appearance of the 3D model through a graphical interface.

[0003] In one implementation, preset options can be provided in the settings interface, which may include color options, wheel options, texture options, and pattern options, etc. The user then selects a specific option through a menu. Subsequently, the system renders the 3D car model based on the user's selection to generate a 3D car model that reflects the corresponding effect, where the pattern selected by the user is typically displayed in a fixed preset position on the 3D car model.

[0004] However, in this implementation, users can only select from a limited range of options provided by the system, and the pattern can only be displayed in a fixed position, thus failing to effectively meet users' personalized customization needs. Summary of the Invention

[0005] This application provides a method for processing vehicle models, a vehicle, and related devices to enhance the personalization of vehicle models.

[0006] In a first aspect, embodiments of this application provide a method for processing vehicle models, applied to vehicles, the method comprising:

[0007] The response is used to determine the first image, display the target car model with the second image rendered in the first interface, the first image is determined in the local storage of the vehicle, or the first image is generated based on voice command, the image size of the second image meets the preset size requirements, and the second image contains the main object existing in the first image;

[0008] In response to a second operation applied to a target car model, a first adjustment process is performed on a second image displayed on the surface of the target car model, the first adjustment process including at least one of the following: moving, rotating, cropping, and scaling;

[0009] In response to a third operation performed on a first adjustment control in the first interface, a second adjustment process is performed on a second image displayed on the surface of the target car model. The second adjustment process is used to adjust at least one of the following image parameters: brightness, contrast, saturation, hue, color temperature, transparency, and blending mode.

[0010] This allows users to select a custom first image for vehicle painting, a significantly improved approach compared to limiting selection to preset images, enhancing the personalization of the model car's appearance. Furthermore, this application supports voice command-based painting, eliminating the need for multiple user operations and reducing complexity. Additionally, the technical solution allows users to adjust the composition or parameters of the image on the model car's surface using gestures, further enhancing the final appearance and personalization of the model.

[0011] In one possible implementation, the response for determining a first operation of the first image, displaying a target car model rendered with a second image in a first interface, includes:

[0012] The response is used to determine a first operation of the first image, to perform a compositional adjustment on the first image to obtain at least one second image;

[0013] The preset car model is rendered based on at least one second image, so as to display the target car model with the rendered second image in the first interface.

[0014] In this way, intelligent composition can be performed on the first image determined by the user to generate a second image that meets the preset size requirements. At the same time, the main object in the first image can be included in the second image, which can effectively improve the rationality and aesthetics of the painting effect.

[0015] In one possible implementation, the composition of the first image is adjusted to obtain at least one second image, including:

[0016] The first image is input into the first model so that the first model outputs the second image; wherein the first model is used to perform a first adjustment process on the first image, and the first model is a model trained based on at least one set of sample data.

[0017] Among them, intelligent composition using the first model can improve the rationality of the second image obtained after composition.

[0018] In one possible implementation, the composition of the first image is adjusted to obtain at least one second image, including:

[0019] The first image is semantically segmented according to the second model to obtain segmented sub-images corresponding to each of the at least one target object contained in the first image, wherein the segmented sub-images obtained after semantic segmentation are the second image.

[0020] Furthermore, the technical solution of this application can also support semantic segmentation of the first image to obtain the second image corresponding to each object in the first image. Then, multiple second images are rendered to their respective corresponding areas, thereby improving the personalization and diversification of the painting effect.

[0021] In one possible implementation, the method also includes:

[0022] The second control is displayed on the first interface. The second control is used to determine whether semantic segmentation needs to be performed.

[0023] The first image is semantically segmented according to the second model to obtain segmented sub-images corresponding to at least one target object contained in the second image, including:

[0024] In response to a fourth operation applied to the second control, the first image is semantically segmented according to the second model to obtain segmented sub-images corresponding to at least one target object contained in the second image.

[0025] This allows users to choose whether to perform semantic segmentation on the first image based on their actual needs, so as to achieve the painting effect they require.

[0026] In one possible implementation, a preset car model is rendered based on at least one second image to display the target car model with the rendered second image on a first interface, including:

[0027] For any segmented sub-image, determine the target region in the preset car model corresponding to the segmented sub-image;

[0028] Based on the segmented sub-images, the target region in the preset car model is rendered to generate the target car model. The surface of the target region of the target car model is covered with the segmented sub-images.

[0029] This allows different segmented sub-images to be rendered onto their respective areas within the preset car model, thereby enhancing the personalization and diversity of the final paint effect.

[0030] In one possible implementation, determining the target region in the preset car model corresponding to the segmented sub-image includes:

[0031] Obtain the first semantic type of the target object contained in the segmented sub-image;

[0032] Based on the preset mapping relationship, the vehicle model area corresponding to the first semantic type is determined as the target area. The preset mapping relationship is used to indicate the vehicle model areas corresponding to each of the multiple semantic types.

[0033] By pre-setting the mapping relationship, the rationality and accuracy of the target region determined for each segmented sub-image can be effectively improved.

[0034] In one possible implementation, in response to a second operation applied to a target vehicle model, a first adjustment process is performed on a second image displayed on the surface of the target vehicle model, including:

[0035] In response to the second operation, the second image is subjected to a first adjustment process, and based on the second image after the first adjustment process, the mapping relationship between each pixel in the second image and the texture coordinates of the preset car model is updated.

[0036] Based on the updated mapping relationship, the preset car model is re-rendered based on the second image to perform a first adjustment process on the second image displayed on the surface of the target car model; wherein, during the execution of the first adjustment process, the display effect of the second image on the surface of the target car model is adjusted in real time.

[0037] This implementation method allows for simple and efficient updates to the rendering effect based on the mapping relationship between the texture coordinates of the second image and the preset car model, enabling real-time adjustments to the display effect of the second image during user interaction. This approach eliminates the need for users to possess specialized rendering knowledge, providing the necessary technical support for real-time changes in rendering effects.

[0038] In one possible implementation, the first operation is to select an image from the vehicle's local storage; or, the first operation is to input a voice command to instruct the acquisition of a first image.

[0039] Secondly, embodiments of this application provide a vehicle including a processor and a memory, the memory for storing code instructions, and the processor for running the code instructions to perform the methods described in the first aspect or any possible implementation of the first aspect.

[0040] Thirdly, embodiments of this application provide a computer-readable storage medium storing a computer program or instructions that, when executed on a computer, cause the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0041] Fourthly, embodiments of this application provide a computer program product including a computer program, which, when run on a computer, causes the computer to perform the methods described in the first aspect or any possible implementation of the first aspect.

[0042] Fifthly, this application provides a chip or chip system including at least one processor and a communication interface. The communication interface and the at least one processor are interconnected via a circuit. The at least one processor is used to run computer programs or instructions to perform the methods described in the first aspect or any possible implementation thereof. The communication interface in the chip can be an input / output interface, pins, or circuits, etc.

[0043] In one possible implementation, the chip or chip system described above in this application further includes at least one memory storing instructions. The memory can be an internal storage unit of the chip, such as a register or cache, or it can be a storage unit of the chip itself (e.g., read-only memory, random access memory, etc.).

[0044] It should be understood that the second to fifth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0045] Figure 1 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 1 ;

[0046] Figure 2 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 2 ;

[0047] Figure 3 A flowchart of the car model processing method provided in the embodiments of this application;

[0048] Figure 4 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 3 ;

[0049] Figure 5 Illustration of image processing provided in the embodiments of this application Figure 1 ;

[0050] Figure 6 Illustration of image processing provided in the embodiments of this application Figure 2 ;

[0051] Figure 7 Illustration of image processing provided in the embodiments of this application Figure 3 ;

[0052] Figure 8 A schematic diagram illustrating the preset mapping relationship provided in the embodiments of this application;

[0053] Figure 9A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 4 ;

[0054] Figure 10 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 5 ;

[0055] Figure 11 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 6 ;

[0056] Figure 12 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 7 ;

[0057] Figure 13 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 8 ;

[0058] Figure 14 A schematic diagram illustrating the implementation of the image adjustment method provided in this application embodiment;

[0059] Figure 15 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 9 ;

[0060] Figure 16 A schematic diagram illustrating transparency adjustment provided in an embodiment of this application;

[0061] Figure 17 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 10 ;

[0062] Figure 18 A schematic diagram of the software architecture of an electronic device provided in an embodiment of this application. Detailed Implementation

[0063] To facilitate understanding, the relevant terms and concepts involved in the embodiments of this application will be introduced below:

[0064] 1. 3D car model: In this application, 3D car model refers to a three-dimensional virtual car model, which is usually a virtual car model created by 3D modeling software. For example, a virtual 3D car model can be displayed on the screen of an electronic device to meet the corresponding user needs.

[0065] 2. Painting: Rendering and displaying 2D images on the 3D car model of the smart cockpit.

[0066] 3. UV: UV is a two-dimensional coordinate system (usually represented as the U-axis and V-axis), used to define the correspondence between the vertices of a 3D model surface and the 2D texture image.

[0067] 4. Electronic equipment

[0068] The electronic devices in this application embodiment can be referred to as user equipment (UE), terminal, etc. For example, electronic devices can be mobile phones, tablets, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices, in-vehicle devices or wearable devices, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in smart homes, etc. The form of the electronic devices is not specifically limited in this application embodiment.

[0069] To better understand the technical solution of this application, the relevant technologies involved in this application will be further introduced below.

[0070] As the automotive industry accelerates its intelligent transformation, smart cockpits are evolving from functional carriers to centers of emotional interaction. In one scenario, a 3D virtual model of the vehicle can be displayed on an electronic device screen. Users can then interact with the model via a graphical interface to adjust its appearance, enhancing visual immersion and emotional engagement, and strengthening the human-vehicle interaction experience.

[0071] To support users in adjusting the appearance of 3D car models, one implementation method exists, which may include the following steps:

[0072] 1) The settings interface provides preset options, which may include color options, wheel options, texture options, and pattern options, etc.

[0073] 2) Users can select basic appearance parameters such as body color, wheel style, and body texture through menu operations, and users can also choose from preset pattern options;

[0074] 3) The system renders the 3D car model based on the user's selection to generate a 3D car model that represents the corresponding body color, wheel style, body texture and the pattern selected by the user. The pattern selected by the user is usually fixedly displayed in a preset position on the 3D car model.

[0075] However, this implementation method has many limitations: First, it has low freedom, with users only able to select from a limited range of options and the pattern only displayed in a fixed position, thus failing to effectively meet the personalized customization needs of users; second, the operation process is relatively cumbersome, requiring users to configure parameters item by item through multiple menus, resulting in a high learning cost and hindering quick mastery; third, the visual presentation is relatively simple, only supporting the replacement of basic colors or simple textures, lacking processing of blending effects, and the overall visual experience is not realistic or rich enough.

[0076] In addition, there is another implementation method, which may include the following steps:

[0077] 1) Obtain real-time scene information (such as entertainment application data, vehicle speed, gear position, etc.) and basic data of 3D car model through the vehicle system;

[0078] 2) The vehicle system uploads data to the cloud-based large model platform so that the cloud-based large model platform can generate a vehicle model painting effect that matches the current scene;

[0079] 3) The vehicle's infotainment system receives the painting data generated in the cloud and then renders and displays it.

[0080] This approach also has its drawbacks, such as: First, users passively accept preset styles, where the painting effect is automatically matched by the system according to the scene, and users cannot choose or create personalized patterns on their own; Second, the interaction latency is high, where the painting effect relies on cloud computing, and a single rendering usually takes more than 1 second, making it difficult to support real-time adjustments.

[0081] To address the aforementioned problems, this application proposes a method for processing 3D car models. This method allows users to select any image from their photo album, and also allows users to generate any desired image through semantic commands. The 3D car model is then selected based on the user-selected image or the image generated by the command, thereby enhancing the personalization of the 3D car model. Furthermore, before performing rendering processing, the technical solution of this application can intelligently adjust the selected image to improve the final rendered 3D car model's performance.

[0082] Based on the above introduction, the following describes the car model processing method provided in this application in conjunction with specific embodiments.

[0083] In the technical solution of this application, users can select the required images from the local photo album of the electronic device for painting the 3D car model, or users can input instructions and then generate corresponding images based on the instructions output by the user to paint the 3D car model. For example, the operation of the user determining the image can be called the first operation, and the image selected by the user or the image generated based on the user's instructions can be called the first image.

[0084] The following is combined Figure 1 and Figure 2 This paper introduces the relevant implementation of determining the first image based on the first operation. Figure 1 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 1 , Figure 2 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 2 .

[0085] In one implementation, for example, the screen of an electronic device can display something like... Figure 1 The user interface shown in (a) can be understood as an interface used to adjust the style of the car model. (See reference...) Figure 1 In (a) of the embodiment, a 3D car model 101 can be displayed in the user interface. The appearance style of the car model 101 can be, for example, the default style, or the style after the most recent adjustment. This embodiment does not limit this.

[0086] and reference Figure 1 As shown in (a), the user interface for adjusting the model car style may also include control unit 102 and control unit 103 as shown in the figure.

[0087] The control unit 102 provides options for the color of the car model. For example, the control unit 102 may include operation controls 1021-1025 as shown in the figure. Exemplarily, operation controls 1022-1025 may each correspond to a different color, so that when the user operates these controls, the color of the car model 101 displayed on the interface is adjusted to the color corresponding to the control. Furthermore, operation control 1021 may be a control for providing more color options. For example, after detecting a user operation on operation control 1021, a color selection window can be displayed on the interface for the user to select the desired color.

[0088] Furthermore, the control unit 103 is used to provide a selection of the paint image. For example, the control unit 103 may include operation controls 1031 to 1035 as shown in the figure. Exemplarily, operation control 1031 is used to remove the paint effect applied to the car model 101, that is, to restore the car model 101 to the style of the unpainted image. Also, operation controls 1032 to 1033 may each correspond to different images. These images may be images selected by the user from the album during historical operations, or they may be preset images; this embodiment does not limit this. In this way, when the user operates these controls, the paint effect of the car model 101 displayed on the interface can be adjusted to the appearance of the image corresponding to the control, that is, the image corresponding to the control is rendered on the surface of the car model.

[0089] Furthermore, the operation control 1035 can be a control for users to select images. For example, after detecting a user operation on the operation control 1035, an image can be displayed on the screen as shown below. Figure 1 The image selection interface is shown in (b) above. As shown, multiple images can be displayed in the image selection interface; a rectangle in the figure can be understood as one image. These images can be, for example, images from the local photo album of an electronic device. For example, Figure 1 The interface shown in (b) can also be the photo album interface of an electronic device, that is, the photo album interface can be pulled up and displayed on the screen by operating the control 1035.

[0090] Then, for example, if a user action is detected on image 104, it can be determined that the current user has selected image 104 for vehicle painting. Then, the car model can be rendered based on image 104, thereby generating... Figure 1 The model car 105 shown in (c) includes a paint job. (See reference...) Figure 5 It is understood that image 104 is rendered on the side of the car model 105. In the current embodiment, the user operation on the operation control 1035 and the user operation on selecting image 104 can be understood as the first operation described above. In actual implementation, the specific implementation of the first operation can be set according to actual needs, as long as the first operation is used to select an image from local storage.

[0091] This allows users to select custom images for vehicle painting, which is a more personalized approach compared to the previous method of only allowing selection from preset images.

[0092] In addition, in another scenario, users can also paint the car model using voice commands, as shown below. Figure 2 This scenario will be described.

[0093] exist Figure 2 The user interface shown in (a) above is similar to the one described above. Figure 1 The user interface shown in (a) is similar and will not be described again here. Furthermore, the user can, for example, activate the electronic device's voice assistant and input commands to instruct the model car to be painted. As shown in the figure, for example, the user can input the voice command "Please put a pattern containing star elements on my model car".

[0094] The electronic device then responds to the user's voice command, for example, by matching relevant images from the device's local photo album. For instance, keywords can be extracted from the voice command, and then matched against images in the local photo album to retrieve relevant images and apply paint to the car model.

[0095] Alternatively, electronic devices can respond to voice commands and directly generate the image specified by the command. For example, a voice command can be input into an image generation model, causing the model to generate an image corresponding to the voice command. The image generation model can be deployed within the electronic device, allowing image generation to be achieved directly through the device. Alternatively, the image generation model can be deployed in the cloud, allowing the electronic device to upload the voice command to the cloud, enabling the cloud to generate a corresponding image based on the command. The electronic device then receives the generated image from the cloud and performs the painting process on the car model.

[0096] In one implementation, the electronic device can first respond to a voice command and perform image matching locally. If an image matching the voice command exists, the vehicle model can be painted directly based on the local image. If no image matching the voice command exists locally, a corresponding image is generated based on an image generation model for painting the vehicle model. This application does not limit the specific implementation of how the image to be painted is determined based on the voice command; it can be selected according to actual needs.

[0097] In the current embodiment, the user input of voice commands can be understood as the first operation described above. In actual implementation, the specific implementation of the first operation can be set according to actual needs, as long as the first operation is used to indicate the operation of determining the first image.

[0098] After the corresponding image is determined based on the voice command, the car model can be painted based on that image. Let's assume the image determined by the voice command based on the illustration is... Figure 1 The image shown in (b) can then be displayed, for example, as shown below. Figure 2 The interface shown in (b) is the car model 202 with paint effects displayed on the screen.

[0099] This allows users to input custom commands to instruct the vehicle to be painted according to the corresponding images. This approach can effectively enhance the personalization of the model car's performance. At the same time, using voice commands to instruct the model car to be painted can avoid requiring users to perform multiple operations, thus reducing the difficulty of operation for users.

[0100] Based on the above embodiments, the following describes the process of painting car models based on selected or generated images, using specific embodiments as examples. Figure 3 This is a flowchart of the car model processing method provided in the embodiments of this application. Figure 4 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 3 , Figure 5 Illustration of image processing provided in the embodiments of this application Figure 1 , Figure 6 Illustration of image processing provided in the embodiments of this application Figure 2 , Figure 7 Illustration of image processing provided in the embodiments of this application Figure 3 , Figure 8 This is a schematic diagram of the preset mapping relationship provided in the embodiments of this application. Figure 9 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 4 .

[0101] like Figure 3 As shown, the method includes:

[0102] S301, a first operation for determining the first image is to acquire the first image, wherein the first image is acquired from the local storage of the electronic device, or the first image is generated based on instructions.

[0103] In this embodiment, the first image can be an image acquired locally on the electronic device as described in the above embodiments, or the first image can be an image generated based on a voice command input by the user. Implementation details regarding the first operation and the first image can be understood by referring to the above embodiments, and will not be repeated here.

[0104] S302. Adjust the composition of the first image to obtain at least one second image.

[0105] It is understandable that in the process of rendering a car model based on an image to achieve the final painting effect, there are usually certain requirements for the size of the image; otherwise, the final rendering effect will be unreasonable or the performance will be poor.

[0106] However, since the first image in this embodiment is obtained from the local storage of the electronic device or is generated based on instructions, it cannot be guaranteed that the first image will meet the image size requirements for rendering the car model. Therefore, in this embodiment, the composition of the first image can be adjusted to obtain a second image that meets the preset size requirements. The preset size requirements are the image sizes pre-set for rendering the car model. The specific implementation of the preset size requirements can be set according to actual needs, and this embodiment does not impose any restrictions on this.

[0107] In this embodiment, the composition adjustment of the first image is divided into two different cases, which will be described below. Before proceeding with the detailed description, the reason for dividing the cases will be explained first. The technical solution of this application provides a function that can perform semantic segmentation on objects in the first image, and then paint different objects on different areas of the car model to improve the performance of the car model painting. For example, the technical solution of this application can provide users with options so that users can choose whether to use this function for car model painting according to their actual needs.

[0108] For example, you can refer to Figure 4 To understand, Figure 4 (a) shows the case where the user selects image 104 as the first image, which is consistent with the above. Figure 1 Similar to (b) described in the previous section, it will not be repeated here. For example, after detecting a selection operation on image 104, a display such as... can be shown in the interface. Figure 4 The pop-up window 401 shown in (b) asks the user whether they need to paint in sections by object, that is, whether they need to use the semantic segmentation function described above. For example, pop-up window 401 may include a "Yes" selection control and a "No" selection control. The subsequent processing methods differ according to the user's operation on different selection controls, which will be described below.

[0109] In this application, Figure 4 The pop-up window 401 shown can also be understood as a second control, which is used to determine whether to perform semantic segmentation. In actual implementation, the second control can, in addition to... Figure 4 Besides the pop-up window shown, the second control can also be set as a toggle button or an option control. This application does not limit the specific form of the second control; it can be set according to actual needs, as long as the second control can be used to determine whether semantic segmentation is required. Similarly, this application does not restrict the entry point for the second control. The above description shows the second control displayed on the first interface after the user selects the first image to ask the user whether semantic segmentation is needed. In other implementations, the second control can be set at a fixed entry point (such as in the car model painting settings) so that the user can adjust whether semantic segmentation is needed according to actual needs.

[0110] Using the second control as Figure 4 Taking the pop-up window format described in the article as an example, the following will explain two different user operations on the second control.

[0111] In one implementation, if the user interacts with the "No" selection control, it means that the user has not selected the semantic segmentation function. In this case, the overall composition of the first image is adjusted to obtain the second image.

[0112] The following can be combined Figure 5 To understand, refer to Figure 5 If the user does not select semantic segmentation, the composition of the first image can be adjusted based on the first model. For example, the first model can crop and / or enlarge the first image. Then, for example, the first image can be input into the first model so that the first model outputs a second image that meets the preset size requirements.

[0113] Furthermore, during the composition adjustment process, the first model in this application can, for example, retain the main subject object present in the first image. That is, the second image output by the first model includes the main subject object present in the first image. It can be understood that compared to cropping the main subject object from the first image while retaining some unimportant objects (such as background content), retaining the main subject object from the first image effectively improves the rationality of the second image obtained by adjusting the composition of the first image, and also enhances the subsequent performance of the car model painting.

[0114] The subject object can be understood as a prominent object in the image, or as the main object in the image. For example, in an image containing objects such as blue sky, white clouds, grass, and a pet, the pet is usually identified as the main object. For instance, within the first model, the subject object in the first image can be identified through methods such as saliency analysis, semantic segmentation, or object detection. Alternatively, objects occupying more than 30% of the first image and located in the central region can be identified as the subject object. This application does not limit the implementation method for determining the subject object.

[0115] For example, you can refer to Figure 6 To clarify, 601 in the diagram can be understood as the first image. Referring to the diagram, it can be determined that image 601 contains two triangular objects and one star-shaped object. Figure 6 The diagram illustrates several different scenarios for adjusting the composition of the first image, which will be explained below.

[0116] In one scenario, the first model can obtain a second image that meets the preset size requirements by cropping only the first image 601. Furthermore, as described above, the first model can perform intelligent composition during image cropping to preserve the main subject in the first image. (Refer to...) Figure 6After the first image 601 is input into the first model, the first model can output, for example, as follows: Figure 6 The second image shown in 602 can have a preset size and contains the main objects present in the first image, namely the two triangles and a pentagram shown in the figure.

[0117] In another scenario, the first model can both crop and expand the first image 601 to obtain a second image that meets the preset size requirements. During image cropping, the first model preserves the main subject of the first image, and during image expansion, it intelligently expands the image based on its original content. (Refer to...) Figure 6 After the first image 601 is input into the first model, the first model can output, for example, as follows: Figure 6 The second image shown in 603 has a preset image size.

[0118] Referring to the illustration, it can be determined that, in order to meet the preset size, the first image 601 is both cropped vertically and expanded horizontally. Regions a and b shown in the illustration are the expanded regions. For example, expanded region a may include a triangular object, and expanded region b may include a pentagram object. This allows for image expansion based on the image content of the first image, thereby improving the image quality of the expanded image. Furthermore, the second image also includes the main objects present in the first image, namely the two triangles and one pentagram shown in the illustration.

[0119] However, it's understandable that, in order to meet the preset size requirements, parts of the two triangles are cropped during the image cropping process. In other words, although the first model performs intelligent composition to preserve the main object in the first image as much as possible, under certain image size requirements, parts of the main object will inevitably be cropped.

[0120] Furthermore, in an optional implementation, the first model may, for example, scale the first image to preserve the main subject object in the first image as much as possible. It can be understood that after scaling the first image, the main subject object in the first image can be preserved as completely as possible while meeting the preset size requirements.

[0121] For example, you can refer to Figure 6 To understand, refer to Figure 6 After the first image 601 is input into the first model, the first model can output, for example, as follows: Figure 6The second image shown in 604 has a preset image size. Comparing 601 and 604, it can be understood that the main object has been reduced in size. That is, the first image is reduced in size, and then, while still meeting the preset size, the reduced first image 601 is cropped vertically and expanded horizontally. Regions c and d shown in the figure are the expanded regions. The understanding is similar to that described above, and will not be elaborated here.

[0122] Understandably, the area indicated by symbol 'e' in image 604 corresponds to the area in the first image. This also shows that the first model scales the first image to preserve the integrity of the main object. This allows the second image to include the main object present in the first image, namely the two triangles and one pentagram shown in the figure.

[0123] The above combination Figure 6 The first and second images described are merely illustrative examples. In actual implementation, the specific image content depends on the chosen image, and this application does not impose any limitations on this. Understanding the processing procedures for the first image in conjunction with the above description is sufficient.

[0124] In another implementation, if the user interacts with the "Yes" selection control, it means that the user has selected the semantic segmentation function. Then, semantic segmentation is performed on the first image to obtain multiple segmented sub-images to achieve composition adjustment. These multiple segmented sub-images are also the second image in this application.

[0125] The following can be combined Figure 5 To understand, refer to Figure 5 When the user selects semantic segmentation, semantic segmentation of the first image can be performed based on a second model, where the second model is the model used for semantic segmentation of the image. For example, the first image can be input into the second model, causing the second model to output multiple segmented sub-images obtained after semantic segmentation. Exemplarily, after semantic segmentation by the second model, segmented sub-images corresponding to at least one target object in the first image can be obtained. The segmented sub-images obtained after semantic segmentation are the second image described above.

[0126] For example, you can refer to Figure 7For clarity, image 700 in the figure can be understood as the first image. Referring to the figure, image 700 contains two triangular objects and one star-shaped object. After semantic segmentation of the first image 700, for example, we can obtain the segmented sub-images corresponding to these three objects, namely images 701, 702, and 703 shown in the figure. These three segmented sub-images are also the second image described in this embodiment.

[0127] Understandable Figure 7 The illustration shown is merely an example of semantic segmentation. In actual implementation, the specific processing of semantic segmentation can be understood with reference to the actual situation. This application does not limit the specific processing of semantic segmentation.

[0128] Furthermore, after semantic segmentation to obtain multiple segmented sub-images, the second model can, for example, perform at least one of the following operations on the multiple segmented sub-images: image cropping, image augmentation, or image scaling, so that the second image output by the second model meets the preset size requirements. Specific image adjustments can be referred to the description in the above embodiments, and will not be repeated here. In one implementation, the preset size requirements corresponding to the user selecting semantic segmentation may be different from the preset size requirements corresponding to the user not selecting semantic segmentation. Specific size requirements can be arbitrarily set according to actual needs, and this embodiment does not impose any restrictions on this.

[0129] And it is understandable, because the second model is obtained by semantic segmentation of the first image, where semantic segmentation itself is the process of segmenting the main object, so the second image naturally contains the main object that exists in the first image.

[0130] S303. Render the preset car model according to the second image to generate the target car model.

[0131] After adjusting the first image to obtain the second image, the preset car model can be rendered based on the second image. In this application, the preset car model can be understood as a car model that has already been rendered with a specific color. This specific color can be a default color or it can be selected by the user; there is no limitation on this. Then, by rendering the preset car model based on the second image, the second image can be applied to the surface of the car model, thereby generating the target car model. Correspondingly, the second image is then covered on the surface of the target car model.

[0132] The above describes two different scenarios for generating the second image. The rendering implementation for each of these scenarios will be explained below.

[0133] In one implementation, if the user does not select the semantic segmentation function, the second image is an image obtained by adjusting the complete first image. Therefore, rendering can be performed directly on the second image to generate the target car model. This model can then be displayed on the first interface, for example... Figure 1 The target car model shown in (c) allows users to see the effect of the painted car model in real time.

[0134] In another implementation, if the user selects the semantic segmentation function, then the second image is multiple segmented sub-images obtained by semantically segmenting the first image. For example, the rendering process can be performed as follows:

[0135] First, for any given segmented sub-image, determine the target region within the preset car model corresponding to the segmented sub-image. Then, based on the segmented sub-image, render the target region within the preset car model to generate the target car model, whose surface is covered by the segmented sub-image.

[0136] For example, in determining the target region corresponding to the segmented sub-image, a first semantic type of the target object contained in the segmented sub-image can be obtained. This first semantic type can be, for example, output by a second model, or it can be determined after image analysis of the segmented sub-image; this embodiment does not limit this. Then, based on a preset mapping relationship, the car model region corresponding to the first semantic type can be determined as the target region, where the preset mapping relationship is used to indicate the car model regions corresponding to each of the multiple semantic types.

[0137] For example, you can refer to Figure 8 Understanding the pre-defined mapping relationships, such as Figure 8 As shown, for example, in the preset mapping relationship, there can be pre-set car model areas corresponding to various semantic types. For instance, the car model area corresponding to the semantic type "pet" is the hood, the car model area corresponding to the semantic type "person" is the left front door, and the car model area corresponding to the semantic type "plant" is the right front door. In this way, different semantic types can be rendered to different areas of the preset car model.

[0138] In one implementation, when multiple segmented sub-images correspond to the same car model area, these sub-images can be arranged to ensure that different semantic objects are rendered in an orderly manner within the car model area, thus avoiding overlap between semantic objects. The specific arrangement can be pre-defined according to actual needs, as long as the segmented sub-images do not overlap.

[0139] It is also important to understand that the specific division of semantic types and the specific division of the model area on the preset model can be preset according to actual needs. Similarly, the correspondence between semantic types and model areas recorded in the preset mapping relationship can also be set according to actual needs; this embodiment does not limit the specific implementation of the preset mapping relationship.

[0140] Based on this, we can determine which car model region in the preset car model each segmented sub-image corresponds to based on the preset mapping relationship and the first semantic type corresponding to each segmented sub-image.

[0141] For example, if the first semantic type of a segmented sub-image is "pet", then based on Figure 8 The pre-defined mapping relationship introduced can determine that the pre-defined region corresponding to the segmented sub-image is the front hood. For example, if the first semantic type of a segmented sub-image is "plant," then based on... Figure 8 The preset mapping relationship introduced can determine that the preset region corresponding to the segmented sub-image is the right front door.

[0142] After determining the corresponding car model region for each segmented sub-image, each segmented sub-image can be rendered onto the corresponding car model region on the preset car model. The specific implementation of the rendering process can be understood by referring to the above introduction, and will not be repeated here.

[0143] For example, it can be combined Figure 9 To understand the target car model obtained after rendering, in Figure 7 In the example presented, semantic segmentation of the first image yielded three segmented sub-images corresponding to each of the two triangles and the pentagram. Let's assume these three segmented sub-images correspond to the car model regions as follows: Figure 9 In the scenario shown, after rendering, it can be displayed, for example, in the first interface. Figure 9 The target car model shown.

[0144] In this embodiment, the user can select images from local storage for painting, and the user can also trigger the generation of corresponding images for painting based on voice commands. This implementation can effectively improve the personalization of the painting effect. Furthermore, the technical solution of this application will intelligently compose the first image determined by the user to generate a second image that meets the preset size requirements, while also including the main object in the first image in the second image. This can effectively improve the rationality and aesthetics of the painting effect. In addition, the technical solution of this application can also support semantic segmentation of the first image to obtain the second images corresponding to each object in the first image. Then, multiple second images are rendered to their respective corresponding areas, thereby improving the personalization and diversification of the painting effect.

[0145] Referring to the above embodiments, it can be determined that in the technical solution of this application, after the user determines the first image, the processing described in the above embodiments can be performed based on the first image to obtain the second image. Then, a preset car model is rendered based on the second image to generate a target car model rendered with the second image. Subsequently, the target car model rendered with the second image can be displayed on the first interface, allowing the user to view the target car model and perform corresponding operations. The implementation of displaying the target car model on the first interface can refer to the above... Figure 1 and Figure 9 To understand this, the first interface can be understood as the interface used for painting the car model.

[0146] Furthermore, the car model processing method provided in this application also supports users to perform corresponding user operations on the target car model in the first interface to adjust the painting effect of the target car model. The following is in conjunction with... Figures 10 to 14 This section explains the user actions performed on the target car model. Figure 10 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 5 , Figure 11 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 6 , Figure 12 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 7 , Figure 13 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 8 , Figure 14 This is a schematic diagram illustrating the implementation of the image adjustment method provided in an embodiment of this application.

[0147] In one implementation, the electronic device may, for example, respond to a second operation acting on the target vehicle model to perform a first adjustment process on a second image displayed on the surface of the target vehicle model. The first adjustment process in this application may include at least one of the following: movement, rotation, cropping, and scaling. Several first adjustment processes described herein are described below.

[0148] Before the formal introduction, it should be noted that the first adjustment process described in this embodiment is performed on the second image displayed on the surface of the target car model. In one implementation, for example, the current first interface can be set to the editing mode of the painting effect. In this way, the second operation described above can be executed directly to achieve the first adjustment process on the second image.

[0149] Alternatively, in another implementation, it is not necessary to set an editing mode. Instead, the second image located on the surface of the target car model is selected first through a corresponding user operation, and then the second operation described above is performed on the second image to achieve the first adjustment processing of the second image. The user operation for selecting the second image can be, for example, a long press operation on the second image, or an operation on the second image with a preset sliding trajectory, etc., and this application does not limit it in this way.

[0150] Based on this, the following is combined with Figure 10 Let's understand the case where the first adjustment is a movement. For example... Figure 10 As shown, for example, the second operation can be a drag operation on the second image displayed on the surface of the target car model, which can move the second image displayed on the surface of the target car model to the position required by the user.

[0151] Reference Figure 10 As shown in (a), the second image is originally rendered on one side door of the car model (this position can be, for example, the default position, or it can be determined based on a preset mapping relationship). Then, the user can, for example, click on the second image displayed on the target car model and drag the second image. Figure 10 (b) shows the intermediate display state during the dragging process, for example, when the user drags the second image to... Figure 10 If you move the second image from the side door to the front hood as shown in (c), and release it, you can achieve the process of moving the second image from the side door to the front hood.

[0152] And it can also be combined Figure 14 To understand the internal implementation of the movement process. (Refer to...) Figure 14As shown in (a), during the rendering process, the UV unwrapping is usually performed on the preset car model. After unwrapping the UV, a UV unwrapping diagram can be obtained, which is the UV unwrapping diagram of the preset car model shown in the figure. For ease of explanation, the UV unwrapping diagram of the preset car model will be referred to as 1400 in the following text.

[0153] During the rendering process, a mapping relationship can be established between the image to be rendered and the UV unwrapped map to determine the mapping relationship between each pixel in the image to be rendered and the texture coordinates of the preset car model. This mapping relationship allows for subsequent model rendering. For example, one could refer to... Figure 14 To understand (b) in this embodiment, for example, the mapping relationship between the second image 1401 and the UV unfolded map 1400 of the preset car model is shown in the figure. For example, the position covered by the second image 1401 corresponds to the side door area on the preset car model, thus achieving the following: Figure 14 The rendering effect of the car model shown in (b) is shown in the image.

[0154] Therefore, in the technical solution of this application, for example, in response to the second operation, a corresponding first adjustment process can be performed on the second image. For instance, in the current embodiment, the moving direction and moving distance of the second image can be determined based on the second operation, thereby performing corresponding moving processing on the second image. Subsequently, based on the moved second image, the mapping relationship between each pixel in the second image and the texture coordinates of the preset car model is updated, and then rendering is re-executed based on the updated mapping relationship, so that the second image displayed by the target car model can also complete the corresponding rendering processing.

[0155] For example, you can refer to Figure 14 (b) and Figure 14 Understanding (c) in the text, for example, based on the second operation, the direction and distance of movement of the second image can be determined, thereby establishing the mapping relationship between the second image and the UV unfolded map. Figure 14 Move to the position shown in (b) Figure 14 The position shown in (c) will be further based on... Figure 14 The mapping relationship shown in (c) can be re-rendered to achieve the above. Figure 10 The target car model is shown after the second image has been moved.

[0156] Next, let's combine... Figure 11 Let's understand the case where the first adjustment is a rotation. For example... Figure 11 As shown, for example, the second operation can be a two-finger rotation operation on the second image displayed on the surface of the target car model, which can rotate the second image displayed on the surface of the target car model by a certain angle.

[0157] Reference Figure 11 As shown in (a), assuming the second image is currently rendered on the hood of the car model, the user can then, for example, rotate the second image displayed on the target car model with two fingers to rotate it by a certain angle. The direction of rotation is indicated by arrows in the diagram. Then, for example, the following can be displayed: Figure 11 The target car model shown in (b) has been rotated after the second image was displayed. In the current implementation, for example, the angle of rotation of the user's two fingers can be detected to determine the angle by which the second image displayed on the surface of the target car model needs to be rotated.

[0158] And it can also be combined Figure 14 To understand the internal implementation of the rotation process. Figure 14 (a) and Figure 14 The understanding of (b) is similar to that described above, and will not be repeated here.

[0159] The electronic device, for example, can respond to the second operation to perform a corresponding first adjustment process on the second image. For instance, in the current embodiment, the rotation angle of the second image can be determined based on the second operation, thereby performing a corresponding rotation process on the second image. Subsequently, based on the rotated second image, the mapping relationship between each pixel in the second image and the texture coordinates of the preset car model is updated, and then rendering is re-executed based on the updated mapping relationship, so that the second image displayed for the target car model can also complete the corresponding rendering process.

[0160] For example, you can refer to Figure 14 (c) and Figure 14 Understanding (d) in the text, for example, based on the second operation, the rotation angle of the second image can be determined, thereby establishing the mapping relationship between the second image and the UV unfolded map. Figure 14 Move to the position shown in (c) Figure 14 The position shown in (d) will be further based on... Figure 14 The mapping relationship shown in (d) can be re-rendered to achieve the above. Figure 11 The target car model is shown after rotating the second image as intended.

[0161] Furthermore, in implementing the rotation, besides rotating the second image using two fingers, multi-finger operations (such as three-finger rotation) can also be used to rotate the car model. This means that in this operation mode, the second image remains in its original position while the preset car model is rotated, thus achieving the corresponding rendering processing of the second image displayed on the target car model's surface. The specific methods for triggering the car model rotation and the specific operations during the rotation process can be expanded according to actual needs; this embodiment does not limit these.

[0162] The underlying logic of this implementation is similar to that described above. For example, the UV unfolded image of the preset car model can be rotated accordingly. Based on the rotated UV unfolded image, the mapping relationship between each pixel in the second image and the texture coordinates of the preset car model can be updated. Then, based on the updated mapping relationship, the rendering can be re-executed, so that the second image displayed by the target car model can also be rendered accordingly.

[0163] Next, let's combine... Figure 12 Let's understand the case where the first adjustment is scaling. For example... Figure 12 As shown, for example, the second operation can be a two-finger zoom operation on the second image displayed on the surface of the target car model, which can adjust the size of the second image displayed on the surface of the target car model.

[0164] Reference Figure 12 As shown in (a), assuming the current second image is rendered on the hood of the car model, the user can then zoom in and out on the second image displayed on the target car model using, for example, by using two fingers. This zooms in and out of the second image, and then, for example, displays as shown... Figure 12 (b) shows the target car model magnified from the second image. In the current implementation, for example, the distance of the user's two-finger zoom can be detected to determine the required scaling ratio of the second image displayed on the surface of the target car model.

[0165] And it can also be combined Figure 14 To understand the internal implementation of the rotation process. Figure 14 (a) and Figure 14 The understanding of (b) is similar to that described above, and will not be repeated here.

[0166] The electronic device, for example, can respond to the second operation to perform a corresponding first adjustment process on the second image. For instance, in the current embodiment, the scaling ratio of the second image can be determined based on the second operation, and the second image can be scaled accordingly. Subsequently, based on the scaled second image, the mapping relationship between each pixel in the second image and the texture coordinates of the preset car model is updated, and then rendering is re-executed based on the updated mapping relationship, so that the second image displayed for the target car model can also complete the corresponding rendering process.

[0167] For example, you can refer to Figure 14 (c) and Figure 14 Understanding (e) in the text, for example, based on the second operation, the scaling ratio of the second image can be determined, thereby establishing the mapping relationship between the second image and the UV unfolded map. Figure 14 Move to the position shown in (c) Figure 14The position shown in (e) will be further based on... Figure 14 The mapping relationship shown in (e) can be re-rendered to achieve the above. Figure 12 The target car model is shown after scaling the second image as intended.

[0168] Next, let's combine... Figure 13 Let's understand the case where the first adjustment is a cropping process. For example... Figure 13 As shown, for example, the second operation can be a sliding operation on a second image displayed on the surface of the target car model, which can crop the second image displayed on the surface of the target car model.

[0169] Reference Figure 12 As shown in (a), assuming the second image is rendered on the hood of a car model, the user can then, for example, select a specific area of ​​the second image displayed on the target car model by sliding their finger. The selected area can then be cropped. The box in the diagram represents the selected area described here. Then, for example, the image can be displayed as shown... Figure 12 The target car model shown in (b) has been cropped after the second image was applied. In the current implementation, for example, the cropping frame defined by the user's swipe operation can be detected to determine the area of ​​the second image that needs to be retained on the surface of the target car model.

[0170] And it can also be combined Figure 14 To understand the internal implementation of the rotation process. Figure 14 (a) and Figure 14 The understanding of (b) is similar to that described above, and will not be repeated here.

[0171] The electronic device, for example, can respond to the second operation to perform a corresponding first adjustment process on the second image. For instance, in the current embodiment, the second operation can be used to determine the area of ​​the second image to be retained, thereby performing a corresponding cropping process on the second image. Subsequently, based on the cropped second image, the mapping relationship between each pixel in the second image and the texture coordinates of the preset car model is updated, and then rendering is re-executed based on the updated mapping relationship, so that the second image displayed for the target car model can also complete the corresponding rendering process.

[0172] For example, you can refer to Figure 14 (c) and Figure 14 Understanding (f) in the text, for example, based on the second operation, the region to be retained in the second image can be determined, thereby establishing the mapping relationship between the second image and the UV unfolded map. Figure 14 Move to the position shown in (c) Figure 14 The position shown in (f) will be further based on... Figure 14The mapping relationship shown in (f) can be re-rendered to achieve the above. Figure 13 The target car model is shown after cropping the second image.

[0173] It is also understood that in the technical solution of this application, during the first adjustment process, the above-described update mapping relationship and re-rendering process will be performed in real time. Accordingly, the display effect of the second image displayed on the surface of the target car model can be adjusted in real time on the first interface. This allows the user to quickly observe the specific adjustment situation and adjustment effect, thereby improving the speed and efficiency of paint effect adjustment.

[0174] Furthermore, it should be noted that the above illustrations all use a single image as an example for illustrating the second image. In another implementation, when semantic segmentation is performed, the second image can include multiple segmented sub-images, each corresponding to its own car model region. The specific implementation of the first adjustment process for the second image as a segmented sub-image is similar to that described above; the user simply selects a segmented sub-image of a specific region, and then the aforementioned processing is performed. This scenario will not be elaborated upon further here.

[0175] As can be understood from the above description, the technical solution of this application supports users to adjust the second image rendered on the surface of the target car model using specific gestures. This effectively improves the flexibility and convenience of adjusting the car model paint, and allows users to arbitrarily adjust the paint effect they need, thereby enhancing the user experience. In actual implementation, the specific gesture settings for the first operation corresponding to each first adjustment process can be set according to actual needs and are not limited to the technical solution described above.

[0176] The above embodiments describe the implementation of adjusting the position and / or size of the second image displayed on the surface of the target car model. Furthermore, the technical solution of this application can also support users in adjusting the image parameters of the second image displayed on the surface of the target car model, which will be described below. Figure 15 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 9 , Figure 16 This is a schematic diagram illustrating transparency adjustment provided in an embodiment of this application. Figure 17 A schematic diagram of the car model processing method provided in the embodiments of this application. Figure 10 .

[0177] In one implementation, a first adjustment control can be displayed on a first interface, and then a second adjustment process can be performed on the second image displayed on the surface of the target car model in response to a third operation acting on the first adjustment control on the first interface. The second adjustment process is used to adjust at least one of the following image parameters: brightness, contrast, saturation, hue, color temperature, transparency, and blending mode.

[0178] As can be understood, the first adjustment control is used to adjust the image parameters described above; for example, it can be combined with... Figure 15 To understand.

[0179] like Figure 15 As shown in (a), for example, a color adjustment control 1501 can be displayed in the first interface, and then, in response to user operations applied to the color adjustment control 1501, for example, it can be as follows: Figure 15 The color palette 1502 shown in (b) can be understood from the illustration to include, for example, first adjustment controls corresponding to each image parameter. Figure 15 The number 1503 represents the first adjustment control for the image parameter of transparency. This first adjustment control may include a movable slider, which the user can then move to adjust the corresponding image parameter. The adjustment controls for other image parameters are similarly understood and will not be elaborated upon here.

[0180] Figure 15 The example shown is one possible implementation of the first adjustment control. In actual implementation, the specific settings, operation methods, and trigger display methods of the first adjustment control can be arbitrarily set according to actual needs. This embodiment does not impose any restrictions on this.

[0181] Similar to the above description, in the process of implementing the second adjustment processing of the second image displayed on the surface of the target car model, for example, a third operation is performed on the first adjustment control to obtain the corresponding adjusted image parameters, and then the second image is adjusted based on the adjusted image parameters. Subsequently, the second image is rendered based on the second image with adjusted image parameters to realize the corresponding second adjustment processing of the second image displayed on the surface of the target car model.

[0182] Furthermore, during the second adjustment process, the image parameters of the updated image and the re-rendering process described above will be executed in real time. Consequently, the display effect of the second image on the surface of the target car model can be adjusted in real time on the first interface. This allows users to quickly observe the specific adjustment situation and effect, thereby improving the speed and efficiency of paint effect adjustment.

[0183] The following provides additional information regarding transparency and blending modes in the image parameters.

[0184] As can be understood from the above description, in this embodiment, after determining the target model, the image parameters of the second image can be further adjusted according to the first adjustment control to improve the performance of the subsequent car model rendering based on the second image and to achieve the performance effect required by the user. The image parameters may include transparency parameters and / or blending modes.

[0185] The transparency parameter is used to adjust the transparency of the second image. It is understood that if the car model is rendered directly based on the original second image, the original color and texture of the car model will be obscured. Therefore, this application adjusts the transparency of the second image so that the color and texture of the car model can still be displayed after rendering, thus improving the rendering effect of the car model.

[0186] In the process of adjusting the transparency of the second image, for example, the transparency of the entire second image can be adjusted. For example, if the transparency is set to 30%, then the transparency of the entire second image can be adjusted to 30%. This way, after the second image is covered on the surface of the car model, the original color and texture of the car model can be effectively preserved.

[0187] Alternatively, the transparency of a preset area in the second image can be adjusted. The preset area can be, for example, the edge area of ​​the second image, or the center area of ​​the second image, or the area corresponding to a range preset for the image. This application does not limit this.

[0188] The following example uses the preset area as the edge region of the second image. Figure 16 The following explanation will use the second image 603 described above as an example.

[0189] like Figure 16 As shown, for example, the length direction of image 603 can be considered as the interval from 0% to 100%. Then, the regions corresponding to the intervals of 0% to 20% and 80% to 100% in the length direction can be understood as the preset regions described here. Specifically, the region corresponding to the 0% to 20% interval in the length direction is the region indicated by 1601 in the figure, and the region corresponding to the 80% to 100% interval in the length direction is the region indicated by 1602 in the figure. Regions 1601 and 1602 can be understood as corresponding to the left and right edges of the image, respectively.

[0190] The above combination Figure 16This section describes how to set the left and right edge regions as preset regions. For example, the top and bottom edge regions can also be set as preset regions. The implementation for the top and bottom edge regions is similar to the above, simply by adjusting the length direction to the width direction. Another example is setting the four edges of the image as preset regions; that is, the edge regions are determined by the length dimension plus the width dimension. This embodiment does not limit the specific selection of the preset regions.

[0191] Furthermore, when adjusting the transparency of a preset area, you can adjust the overall transparency of the preset area. Alternatively, you can adjust the transparency of the preset area gradually.

[0192] The following also combines Figure 16 To understand this, let's assume the current transparency parameter is set to 30%. In one implementation, for example, the transparency of both regions 1601 and 1602 could be set to 30% overall. Alternatively, in another implementation, the transparency of preset regions could be set to gradually change; for example, the transparency of a preset region could gradually change from the side furthest from the non-preset region to the side closest to the non-preset region. (See reference...) Figure 16 For example, the transparency of area 1601 can be set to transition from 30% to 0% from left to right, and the transparency of area 1602 can be set to transition from 30% to 0% from right to left. This achieves a seamless transition between the transparency of preset and non-preset areas, enhancing the final effect of the image painted on the car model. It can be understood that the above combination... Figure 16 The information provided, including the range values ​​corresponding to the preset area and the transparency settings, are merely illustrative examples. In actual implementation, these settings can be adjusted according to specific needs.

[0193] In one implementation, the transparency parameter can be adjusted, for example, using a first adjustment control corresponding to the transparency parameter, such as based on the above. Figure 15 The first adjustment control 1503 described herein can adjust the transparency parameter. For example, when the transparency parameter is adjusted to 40%, then in the above... Figure 16 The implementation described above will use a 40% transparency parameter. For example, the overall transparency of regions 1601 and 1602 can be set to 40%. Alternatively, the transparency of region 1601 can be set to transition from 40% to 0% from left to right, and the transparency of region 1602 can be set to transition from 40% to 0% from right to left. The understanding is similar to that described above, so it will not be repeated here.

[0194] Furthermore, the technical solution of this application can also support users to adjust the preset area corresponding to the second image through specific gesture operations. Referring to the above description, for example, the length direction of image 603 can be considered as a range of 0% to 100%. Then, the areas corresponding to the 0% to 20% and 80% to 100% ranges in the length direction can be understood as the preset area described here. Such a preset area can be pre-set, and the user can then adjust the range of the preset area through gesture operations.

[0195] Reference Figure 17 As shown in (a), for example, a user can perform a sliding operation along the length of the second image on the target car model to adjust a preset area of ​​the second image to which the transparency parameter will be applied. For example, one could first set the adjustment mode for the current preset area, and then adjust the range of the preset area based on the sliding operation. Alternatively, a preset gesture or operation could be used to first trigger the adjustment operation of the preset area, and then the range of the preset area could be adjusted based on the sliding operation. The specific operation method for adjusting the range of the preset area can be set according to actual needs.

[0196] For example, the adjustment method for a preset area can be determined based on the user's sliding direction and distance along the length direction. For instance, if the sliding direction is from the image edge towards the image center, the preset area can be expanded. Conversely, if the sliding direction is from the image center towards the image edge, the preset area can be reduced. Furthermore, the proportion of expansion or reduction of the preset area can be determined based on the user's sliding distance to achieve adjustment of the preset area.

[0197] For example, you can refer to Figure 17 To understand this, suppose the user has swiped a certain distance from the image edge towards the image center. Then, for example, the preset area could be adjusted as follows: Figure 17 The regions shown in (b) are the intervals 1701 (0%–30%) and 1702 (70%–100%) in the length direction, and the regions assuming the current transparency parameter can be 40%. The understanding of these regions is similar to that described above, and will not be repeated here.

[0198] As can be seen from the illustration, in order to ensure the aesthetics of the final coating effect, the preset areas on both sides of the second image can be symmetrically adjusted based on the user's operation. Alternatively, the preset area on only the side operated by the user can be adjusted; this embodiment does not limit this.

[0199] As can be understood from the above description, by setting the transparency of a preset area, the display effect of the image on the car model can be improved on the one hand, and the color and texture of the car model itself can be displayed on the other hand.

[0200] In addition, image parameters may also include a blending mode, which indicates how the colors of the image and the car model are blended. For example, a blending mode may include at least one of the following: Darken mode, Multiply, Color Burn mode, Linear Burn mode, Lighten mode, etc. Specific options for the blending mode can be understood by referring to relevant implementations; this embodiment does not limit this.

[0201] In the technical solution of this application, the second image can be adjusted based on a selected blending mode so that when the adjusted second image is rendered on the surface of the car model, it can exhibit a corresponding blending effect. In one implementation, since the blending mode usually requires the mixing calculation of two colors, the calculation corresponding to the selected blending mode can be performed based on the preset color of the car model (which can be the default color or a color selected by the user) and the second image, thereby adjusting the image parameters of the second image so that when the adjusted second image is rendered on the surface of the car model, it can directly exhibit the effect of the corresponding blending mode. The image parameters may include at least one of the following: color, brightness, and contrast.

[0202] The above embodiments describe the implementation of rendering a preset car model based on a second image to display the target car model with the rendered second image on the first interface, and then making corresponding adjustments to the second image displayed on the surface of the target car model. In another implementation, the technical solution of this application can also provide the user with the first adjustment control described above before displaying the target car model, so that the user can adjust the image parameters of the second image according to actual needs before performing the rendering process. This ensures that the target car model obtained in the first rendering is the effect presented after the user adjusts the colors, thereby improving the flexibility of user operation.

[0203] The implementation is similar to that described above. For example, after the user selects the first image, the interface can display the first adjustment controls corresponding to each image parameter described above. Subsequently, the user adjusts the image parameters based on the first adjustment controls. Then, the electronic device will adjust the second image accordingly based on the user's operation on the first adjustment controls, and then perform rendering processing. The implementation method is similar to that described above, and will not be repeated here.

[0204] The electronic device described in the above embodiments can be a vehicle infotainment system or a mobile phone; this application does not limit this. In one implementation, after a user performs the above operation on the vehicle infotainment system to paint the vehicle model, the system can, for example, synchronize the painted target vehicle model to the mobile phone via the cloud, so that the vehicle model displayed in the mobile phone's application also exhibits the corresponding painting effect. Furthermore, after a user performs the above operation on the mobile phone to paint the vehicle model, the mobile phone can, for example, synchronize the painted target vehicle model to the vehicle infotainment system via the cloud, so that the vehicle model displayed on the system also exhibits the corresponding painting effect. Besides vehicle infotainment systems and mobile phones, any electronic device capable of displaying a vehicle model can use the implementation described herein to synchronize the target vehicle model, so that the painting effect determined by the user can be synchronized across various devices.

[0205] Based on the above introduction, please refer to the following: Figure 18 The car model processing method provided in this application is described in general, taking into account the software architecture of electronic devices. Figure 18 A schematic diagram of the software architecture of an electronic device provided in an embodiment of this application.

[0206] like Figure 18 As shown, an electronic device may include, for example, an interaction layer, an algorithm processing layer, and a system layer.

[0207] The interaction layer may include a gallery application and an interaction unit. For example, an electronic device can access a gallery application to determine the first image described above. During access to the gallery application, the device can access its local storage or cloud storage to obtain the first image. The interaction unit parses user-input gestures, which may include various user operations described in the embodiments above. The interaction unit can also determine adjusted image parameters based on user operations. Gesture parsing and parameter adjustment can be performed before or after rendering the target car model; this application does not limit this. In one implementation, user gesture operations and parameter adjustments can be supported both before and after rendering the target car model to adjust the corresponding painting effect.

[0208] Furthermore, the algorithm processing layer may include an image processing unit and a fusion unit. The image processing unit may include, for example, a first model and a second model. Referring to the description in the above embodiments, the first model and the second model are models used for compositional adjustments to the first image. Specific implementation details can be understood by referring to the above embodiments and will not be repeated here. The fusion unit is used to render the car model based on the second image, the 3D car model, and user-supported adjustments to obtain the painted target model, and can also adjust the painted target model.

[0209] It should be noted that both the first model and the second model in this application are models obtained after training. The training process of the first model may include, for example:

[0210] The first model is trained based on multiple sets of sample data. Each set of sample data includes: sample images and label images. The image size of the label images meets the preset size requirements, and the label images contain the main objects that exist in the sample images.

[0211] In the specific training process, for example, sample images can be input into the first model so that the first model outputs training output images. Then, based on the training output images and label images, a loss value is determined. Finally, the model parameters of the first model are updated based on the loss value to obtain the trained first model.

[0212] Furthermore, the training process for the second model is similar, and will not be elaborated here.

[0213] Furthermore, the system layer can include a GPU and a rendering engine, which can provide underlying support for the image processing and vehicle model rendering described above. After rendering is complete, the display unit can be invoked to display the target vehicle model on the screen of the electronic device. In the case where the electronic device is an in-vehicle infotainment system, the screens of the electronic device can include, for example, an instrument panel screen, a central control screen, and a passenger-side screen. In this case, multi-screen display of these screens can be achieved through the display unit.

[0214] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0215] This application provides an electronic device, comprising: a processor and a memory; the memory storing computer-executable instructions; the processor executing the computer-executable instructions stored in the memory, causing the electronic device to perform the aforementioned method. The electronic device may be, for example, a vehicle.

[0216] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.

[0217] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it implements the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0218] In one possible implementation, a computer-readable medium may include random access memory (RAM), read-only memory (ROM), compact discread-only memory (CD-ROM) or other optical disc storage, magnetic disk storage or other magnetic storage devices, or any other medium targeted to carry or to store required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0219] This application provides a computer program product, which includes a computer program that, when run, causes a computer to perform the above-described method.

[0220] It should be noted that the modules or components described in the above embodiments can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs), etc. Furthermore, when a module is implemented through processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors capable of calling program code, such as a controller. Additionally, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0221] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0222] The term "multiple" in this document refers to two or more. The term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. Furthermore, the character " / " in this document generally indicates an "or" relationship between the preceding and following related objects; in formulas, " / " indicates a "division" relationship. Additionally, it should be understood that in the description of this application, words such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating or implying relative importance or order.

[0223] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.

[0224] It is understood that, in the embodiments of this application, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

Claims

1. A method for processing car models, characterized in that, Applied to vehicles, the method includes: The response is a first operation to determine the first image, displaying a target car model with a second image rendered in a first interface, wherein the first image is determined in the local storage of the vehicle or the first image is generated based on a voice command, the image size of the second image meets a preset size requirement, and the second image contains the main object present in the first image; In response to a second operation applied to the target car model, a first adjustment process is performed on the second image displayed on the surface of the target car model, the first adjustment process including at least one of the following: moving, rotating, cropping, and scaling; In response to a third operation applied to the first adjustment control in the first interface, a second adjustment process is performed on the second image displayed on the surface of the target car model. The second adjustment process is used to adjust at least one of the following image parameters: brightness, contrast, saturation, hue, color temperature, transparency, and blending mode.

2. The method according to claim 1, characterized in that, The response is used to determine a first operation of the first image, displaying a target car model rendered with a second image in a first interface, including: The response is used to determine a first operation of the first image, to perform a compositional adjustment on the first image to obtain at least one second image; The preset car model is rendered based on the at least one second image, so as to display the target car model with the rendered second image in the first interface.

3. The method according to claim 2, characterized in that, The step of adjusting the composition of the first image to obtain at least one second image includes: The first image is input into the first model so that the first model outputs the second image; wherein the first model is used to perform the first adjustment process on the first image, and the first model is a model trained based on at least one set of sample data.

4. The method according to claim 2, characterized in that, The step of adjusting the composition of the first image to obtain at least one second image includes: The first image is semantically segmented according to the second model to obtain segmented sub-images corresponding to at least one target object contained in the first image, wherein the segmented sub-images obtained after semantic segmentation are the second image.

5. The method according to claim 4, characterized in that, The method further includes: A second control is displayed on the first interface, the second control being used to determine whether the semantic segmentation operation needs to be performed; The step of performing semantic segmentation on the first image according to the second model to obtain segmented sub-images corresponding to at least one target object contained in the second image includes: In response to a fourth operation applied to the second control, the first image is semantically segmented according to the second model to obtain segmented sub-images corresponding to at least one target object contained in the second image.

6. The method according to claim 4 or 5, characterized in that, The step of rendering a preset car model based on the at least one second image to display the target car model with the rendered second image on a first interface includes: For any one of the segmented sub-images, determine the target region in the preset car model corresponding to the segmented sub-image; Based on the segmented sub-image, the target region in the preset car model is rendered to generate the target car model, and the surface of the target region of the target car model is covered with the segmented sub-image.

7. The method according to claim 6, characterized in that, Determining the target region in the preset car model corresponding to the segmented sub-image includes: Obtain the first semantic type of the target object contained in the segmented sub-image; According to the preset mapping relationship, the vehicle model area corresponding to the first semantic type is determined as the target area. The preset mapping relationship is used to indicate the vehicle model area corresponding to each of the multiple semantic types.

8. The method according to any one of claims 1-7, characterized in that, The response to the second operation acting on the target car model involves performing a first adjustment process on the second image displayed on the surface of the target car model, including: In response to the second operation, the first adjustment process is performed on the second image, and based on the second image after the first adjustment process, the mapping relationship between each pixel in the second image and the texture coordinates of the preset car model is updated; Based on the updated mapping relationship, the preset car model is re-rendered based on the second image to perform a first adjustment process on the second image displayed on the surface of the target car model; wherein, during the execution of the first adjustment process, the display effect of the second image on the surface of the target car model is adjusted in real time.

9. The method according to any one of claims 1-8, characterized in that, The first operation is to select an image in the vehicle's local storage; or, the first operation is to input a voice command to instruct the acquisition of the first image.

10. A vehicle, characterized in that, The vehicle includes: one or more processors and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the vehicle to perform the method as described in any one of claims 1-9.

11. A chip system, characterized in that, The chip system is applied to a vehicle, and the chip system includes one or more processors, the one or more processors being used to invoke computer instructions to cause the vehicle to perform the method as described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed on a vehicle, cause the vehicle to perform the method as described in any one of claims 1-9.

13. A computer program product, characterized in that, The computer program product includes computer program code that, when run on a vehicle, causes the vehicle to perform the method as described in any one of claims 1-9.