Display method of 3D car model, car machine system and display system of 3D model

Abstract

The invention provides a 3D car model display method, a car machine system and a 3D model display system. The method is applied to a vehicle machine system and comprises the steps that a first image and / or a first video sent by a generation device are / is received, and the first image and / or the first video are / is used for appearance display of a 3D vehicle model; establishing a 3D car model carrying the first image and / or the first video; and displaying the 3D vehicle model carrying the first image and / or the first video on a display device of the vehicle. According to the application, the appearance diversity of the 3D car model is increased, and meanwhile, the sense of participation of a user for the 3D car model is also improved.

Description

Technical Field

[0001] This application relates to the field of automotive technologies, and particularly to a method for displaying a 3D vehicle model, a vehicle-mounted system, and a display system for a 3D model. Background Art

[0002] Some vehicles with a relatively high degree of intelligence are equipped with the function of displaying a 3D vehicle model to improve the display effect of the vehicle-mounted system and the user experience.

[0003] However, the 3D vehicle model is set and stored in the vehicle-mounted system based on the actual situation of the vehicle (such as the body color, body shape, etc.), resulting in the problems that it often lacks diversity in appearance and low user participation. Summary of the Invention

[0004] Embodiments of this application are committed to providing a method for displaying a 3D vehicle model, a vehicle-mounted system, and a display system for a 3D model, which will be introduced from the following aspects.

[0005] In a first aspect, a method for displaying a 3D vehicle model is provided. The method is applied to a vehicle-mounted system and includes: receiving a first image and / or a first video sent by a generating device, where the first image and / or the first video are used for the appearance display of the 3D vehicle model; establishing a 3D vehicle model carrying the first image and / or the first video; and displaying the 3D vehicle model carrying the first image and / or the first video on a display device of the vehicle.

[0006] As a possible implementation, the receiving the first image and / or the first video sent by the generating device includes: receiving the first image and / or the first video sent by a cloud platform, where the first image and / or the first video stored in the cloud platform are sent by the generating device.

[0007] As a possible implementation, the first image and / or the first video are sent by the cloud platform when the vehicle-mounted system is in a working state.

[0008] As a possible implementation, the method further includes: identifying a first area in the first image and / or the first video; and functionally associating the first area with a second area of the vehicle, where the functional association is used to trigger the second area to perform a target action by clicking a target function in the first area.

[0009] As a possible implementation, the functional association of the first region with the second region of the vehicle includes one or more of the following: functionally associating the trunk in the first image and / or the first video with the trunk of the vehicle to trigger the opening / closing of the trunk of the vehicle by clicking the opening / closing function of the trunk in the first image and / or the first video; functionally associating the vehicle door in the first image and / or the first video with the vehicle door to trigger the opening / closing of the vehicle door by clicking the opening / closing function of the vehicle door in the first image and / or the first video; functionally associating the vehicle window in the first image and / or the first video with the vehicle window to trigger the opening / closing / raising / lowering of the vehicle window by clicking the opening / closing / raising / lowering function of the vehicle window in the first image and / or the first video. As a possible implementation, the method further includes: receiving a trigger instruction from a user, where the trigger instruction is used to trigger the second region to perform a target action; wherein, the trigger instruction is realized by clicking the target function of the first region.

[0010] As a possible implementation, the first image is a two-dimensional image, and / or, the first video is a two-dimensional video.

[0011] As a possible implementation, the generating device includes a plurality of planar creation regions, and the first image is obtained by combining the images of the plurality of planar creation regions; and / or, the first video is obtained by combining the videos of the plurality of planar creation regions.

[0012] In a second aspect, a vehicle-mounted system is provided, including: a receiving module, configured to receive the first image and / or the first video sent by a generating device, where the first image and / or the first video are used for the appearance display of a 3D vehicle model; a building module, configured to build a 3D vehicle model carrying the first image and / or the first video; a display module, configured to display the 3D vehicle model carrying the first image and / or the first video on a display device of the vehicle.

[0013] In a third aspect, a display system is provided, where the display system includes a generating device and a vehicle-mounted system; the generating device is configured to generate a first image and / or a first video, where the first image and / or the first video are used for the appearance display of a 3D vehicle model; the vehicle-mounted system is configured to: receive the first image and / or the first video sent by the generating device; build a 3D vehicle model carrying the first image and / or the first video; and display the 3D vehicle model carrying the first image and / or the first video on a display device of the vehicle.

[0014] As a possible implementation, the display system further includes a cloud platform, which is configured to: receive the first image and / or the first video sent by the generating device; and send the first image and / or the first video to the in-vehicle system when the in-vehicle system is in an operating state.

[0015] In this application, a 3D vehicle model is established based on the pictures and / or videos generated by the client, and the established 3D vehicle model is displayed on the display device of the vehicle. On the one hand, it solves the problem that the 3D vehicle model prefabricated in the in-vehicle system causes the user to only passively receive the inherent style of the 3D vehicle model, making it difficult to adjust its appearance, thus reducing the user's participation. On the other hand, it solves the problem that the 3D vehicle model is set based on the actual situation of the vehicle (such as body color, shape, etc.) during prefabrication, resulting in a single appearance style and lack of diversity, which easily causes visual fatigue for the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 The figure shows a schematic diagram of the system architecture applicable to the embodiments of this application.

[0017] Figure 2 The figure shows a flowchart of the 3D vehicle model display method provided by the embodiments of this application.

[0018] Figure 3 The figure shows a flowchart of the 3D vehicle model display method provided by another embodiment of this application.

[0019] Figure 4 The figure shows a structural diagram of the in-vehicle system provided by the embodiments of this application.

[0020] Figure 5 The figure shows a structural diagram of the display system provided by the embodiments of this application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] Next, the technical solutions in the embodiments of this application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all of the embodiments.

[0022] With the development of the vehicle industry and the improvement of the integration of in-vehicle system-on-chip (SOC), especially with the increasing intelligent requirements of users for new energy vehicles, in addition to basic functions such as navigation and entertainment, users also hope that the vehicle can support more intuitive and immersive interaction experiences. For example, the currently popular 3D vehicle model display technology allows customers to view high-precision 3D vehicle models through the central control screen or instrument panel.

[0023] Among them, the 3D car model, also known as digital car wrap, is a virtual vehicle appearance model created through 3D modeling and rendering technologies, which can include details such as body color, patterns, textures, etc. The 3D car model is usually used in the human-machine interface (HMI) of in-vehicle entertainment systems or intelligent cockpits to provide users with a more intuitive and immersive interaction experience.

[0024] Regarding the classification of 3D car models, exemplarily, divided by functional use, 3D car models include display 3D car models, interactive 3D car models, and comprehensive 3D car models.

[0025] 3D car models can include display 3D car models, which are mainly used for the appearance display of vehicles and are commonly seen in virtual displays in vehicle sales showrooms, car advertisements, and promotional materials. Display 3D car models focus on the realism and detail presentation of the vehicle appearance to help users better understand the appearance features and design styles of the vehicles.

[0026] 3D car models can also include interactive 3D car models, which are used in in-vehicle or intelligent cockpits to support users to interact with the vehicle. For example, users can operate the 3D car model by touching the display screen, such as adjusting the display angle of the 3D car model.

[0027] Comprehensive 3D car models refer to 3D car models that simultaneously possess the realistic appearance display features of display 3D car models and the interactive performance of interactive 3D car models, so as to help users understand the design styles and appearance features of the vehicles while enhancing the user experience.

[0028] However, during the modeling process of current 3D car models, they are usually designed and modeled according to the standard appearance of the vehicle, and the styles are relatively monotonous. Exemplarily, current 3D car models are mostly based on vehicle conditions such as body color, shape, etc. As an example, 3D car models of the same vehicle model usually only provide a limited number of standard color options. Another example is that 3D car models of different vehicle brands with similar shapes usually have similar or even exactly the same appearances including patterns and textures except for the appearance color. That is to say, current 3D car models lack diversity and innovation, resulting in users being prone to visual fatigue during use.

[0029] In addition, most current 3D car models are pre-installed in the in-vehicle system and do not support personalized customization. Therefore, users cannot (such as according to personal preferences) adjust the appearance of the 3D car model, such as changing the body color of the 3D car model, adding patterns or textures, etc. As a result, the 3D car model cannot become a hot spot for user operation, and users also lack a sense of participation during use, leading to the weakening of the role of the 3D car model (such as in the intelligent cockpit) and its inability to fully play its due value.

[0030] In other words, since the current 3D car model is prefabricated in the in-vehicle system, it is difficult to adjust the appearance of the 3D car model, resulting in a lack of user participation; moreover, the 3D car models designed based on the actual conditions of the vehicle (such as body color, shape, etc.) are monotonous in style, causing users to easily experience visual fatigue during use.

[0031] In view of the above problems, in the embodiments of the present application, a 3D car model is established through the in-vehicle system based on the first image and / or the first video generated on the client, and the 3D car model is displayed on the display device of the vehicle.

[0032] For ease of understanding, the system architecture applicable to the embodiments of the present application will be introduced first below.

[0033] Figure 1 is a schematic diagram of the system architecture applicable to the embodiments of the present application. As Figure 1 shown, the system 100 includes a client 110, an in-vehicle system 120, and a display device 130.

[0034] As Figure 1 shown, the client 110 sends the first image and / or the first video it generates to the in-vehicle system 120. The in-vehicle system 120 establishes a 3D car model based on the first image and / or the first video. Subsequently, the display device 130 (of the vehicle) displays the 3D car model.

[0035] The client 110 includes but is not limited to smartphones, tablets, laptops, smart watches, and drones. Any terminal device that can be equipped with a first picture and / or first video generation module and can communicate and transmit data with the in-vehicle system 120 is within the scope protected by the embodiments of the present application.

[0036] The in-vehicle system 120, or can be referred to as an In-Vehicle Infotainment (IVI) system, is a set of electronic device systems integrated in a vehicle, aiming to provide information entertainment functions for the driver and passengers, enhancing the driving experience and the intelligent level of the vehicle.

[0037] The display device 130 includes but is not limited to the hardware devices in the in-vehicle system 120 for displaying information and providing an interaction interface. It usually can include a central control screen, an instrument panel, a Head-Up Display (HUD), a rear-seat entertainment system, etc. Any display device on the vehicle that supports 3D rendering technology (converting a three-dimensional model into a two-dimensional image for display to enhance the authenticity and interactivity of the display) is within the scope protected by the embodiments of the present application.

[0038] The above are the devices and equipment that may be involved in the establishment and display operations of the 3D car model according to the embodiments of the present application. It should be understood that the components included in the embodiments of the present application are not limited to this, and other components added on this basis and similar operations are all covered by the protection scope of the embodiments of the present application.

[0039] To implement the above-mentioned establishment and display operations of the 3D car model, the embodiments of the present application propose a method for displaying a 3D car model. The following will be described in detail in conjunction with Figure 2 the method for displaying the 3D car model according to the embodiments of the present application.

[0040] Figure 2 The method shown can be executed by the in-vehicle system and may include steps S2010 to S2030. The following will introduce these steps in detail.

[0041] In step S2010, the generating device 111 sends the first image and / or the first video to the in-vehicle system 120.

[0042] It is not difficult to understand that the generating device 111 is a device (such as in Figure 1 the client 110 shown) for generating the first image and / or the first video. In other words, the generating device 111 may only have the function of outputting 3D images, or only have the function of outputting 3D videos, or may have both the function of outputting 3D images and the function of outputting 3D videos. It is not difficult to see that the first image and the first video are 3D images and 3D videos respectively.

[0043] Regarding the manner in which the generating device 111 generates 3D images and / or 3D videos, the embodiments of the present application do not make any limitations. In some embodiments, the generating device 111 may have the function of generating 3D images and / or 3D videos from text. As a way, the user only needs to input descriptive text in the client, and the generating device 111 can generate high-definition and realistic 3D images and / or 3D videos.

[0044] In other embodiments, the generating device 111 may support 3D modeling and / or rendering technologies to generate 3D images and / or 3D videos. As a way, the generating device 111 may use multi-view diffusion models, reconstruction models, etc.

[0045] Regarding the type of the generating device 111, the embodiments of the present disclosure do not make any limitations. In some embodiments, the generating device 111 may be a device including high-performance computing units such as a high-performance central processing unit (CPU) and a graphics processing unit (GPU). In other embodiments, the generating device 111 may also include professional 3D modeling and rendering software.

[0046] It should be understood that the above descriptions regarding the manner in which the generating device generates 3D images and / or 3D videos and the type of the generating device are merely exemplary and not restrictive descriptions. Therefore, in the embodiments of the present application, the generating device may further include other ways of generating 3D images and / or 3D videos, the generating device may have other types, and the generating device may further include other components.

[0047] It is worth noting that when some in-vehicle infotainment systems with relatively high performance also have the function of outputting 3D images and / or 3D videos, at this time, the in-vehicle infotainment system can also be used as the generating device 111 to provide the first image and / or the first video.

[0048] When the generating device and the in-vehicle infotainment system are the same device, the transmission distance of data (including the first image and / or the first video) can be reduced, thereby reducing the latency caused by data transmission; when the generating device and the in-vehicle infotainment system are two independent devices, the first image and / or the first video can be generated by the generating device anytime and anywhere, improving the flexibility in the implementation process of the first image and / or the first video.

[0049] In addition, when the generating device and the in-vehicle infotainment system are two independent devices, as Figure 2 shown, a communication connection needs to be established between the generating device 111 and the in-vehicle infotainment system 120 to achieve data transmission, that is, the transmission of the first image and / or the first video.

[0050] Regarding the communication connection method between the generating device 111 and the in-vehicle infotainment system 120, the embodiments of the present application do not make any limitations. In some embodiments, a connection based on the Transmission Control Protocol / Internet Protocol (TCP / IP) can be adopted. As an implementation method, wired connection methods such as Universal Serial Bus (USB) and Ethernet can be used; as another method, wireless connections such as Wireless Fidelity (Wi-Fi) and Bluetooth (BT) can also be used.

[0051] In other embodiments, a connection based on other protocols can also be adopted. As an implementation method, wired connections such as Controller Area Network (CAN) and in-vehicle Ethernet can be used; as another method, wireless connections such as Near Field Communication (NFC) can also be adopted.

[0052] Continuing to combineFigure 2 In step S2020, the in-vehicle system 120 creates a 3D vehicle model carrying the first image and / or the first video.

[0053] Based on the first image and / or the first video sent by the generating device 110, the in-vehicle system 120 creates a 3D vehicle model carrying the first image and / or the first video. That is to say, in the embodiments of the present application, the in-vehicle system 120 can restore the first image and / or the first video to a 3D vehicle model.

[0054] In the embodiments of the present application, the implementation manner of the in-vehicle system 120 for creating the 3D vehicle model is not limited. In some embodiments, the creation of the 3D vehicle model can be achieved through 3D modeling software installed in the in-vehicle system, such as modeling software including high-performance modeling and rendering tools like Blender, Autodesk Maya, 3ds Max, etc. In other embodiments, the 3D vehicle model can also be created based on the game engine in the in-vehicle system, such as the Unity engine and the Unreal Engine that can be used for real-time 3D rendering. In still other embodiments, a three-dimensional human-machine interface module (HMI) dedicated to processing 3D graphics and user interaction in the in-vehicle system can also be adopted.

[0055] In addition, the creation of the 3D vehicle model can also be achieved through an in-vehicle entertainment system that supports multiple digital technologies. Among them, the in-vehicle entertainment system is an important part of the in-vehicle system, supporting multiple digital technologies such as 3D rendering technology, virtual reality (VR), and augmented reality (AR) to improve the reliability of the display quality of the 3D vehicle model.

[0056] In the embodiments of the present application, when the in-vehicle system creates a 3D vehicle model based on the first image / or the first video, in order to significantly improve the quality and visual effect of the finally created 3D vehicle model, the first image / or the first video will be optimized. The optimization of the first image can include one or more of adjusting the size of the first image, optimizing the shape of the first image, and converting the format of the first image. The optimization of the first video can include one or more of adjusting the size of the first video, optimizing the shape of the first video, and converting the format of the first video.

[0057] It should be understood that in the embodiments of the present application, the optimization method of the first image / or the first video by the in-vehicle system can be the same as or different from the method used when the in-vehicle system generates the first image / or the first video, and the embodiments of the present application do not limit this.

[0058] Continue to combine Figure 2, in step S2030, a 3D vehicle model carrying a first image and / or a first video is displayed on the display device of the vehicle.

[0059] Regarding the display device on the vehicle for displaying the 3D vehicle model carrying the first image and / or the first video, reference can be made to the description of the display device in the foregoing text, and details are not described herein.

[0060] In the embodiments of the present application, the 3D vehicle model displayed on the display device of the vehicle can be either dynamically displayed or statically displayed. It is not difficult to understand that the 3D vehicle model established based on the first video sent by the generation device is dynamically displayed, while the 3D vehicle model established based on the first image sent by the generation device can be either dynamically displayed or statically displayed.

[0061] Suitable for the current vehicle mode, the 3D vehicle model in the embodiments of the present application can ensure that while the appearance design of the vehicle model is carried out, it does not affect navigation and driving. In some embodiments, the display size of the 3D vehicle model can be adjusted. As a way, the display size of the 3D vehicle model can be adapted according to the screen size of the in-vehicle system to ensure that the user can clearly see the vehicle status control options. As another way, in the navigation interface, the display size of the 3D vehicle model can be automatically adjusted to ensure the clear display of navigation information, while not affecting the visualization effect of the 3D vehicle model.

[0062] In some other embodiments, the 3D vehicle model can provide multiple display modes and can be switched according to different usage scenarios. As a way, in the parking mode, a 360-degree stereogram of the 3D vehicle model can be displayed. As another way, in the navigation mode, the display of the 3D vehicle model will give priority to displaying navigation information to ensure that the user can clearly see the navigation route and instructions. As yet another way, the display mode of the 3D vehicle model can be dynamically adjusted to adapt to the change of navigation information.

[0063] In still some other embodiments, during the driving process of the vehicle, the display interface of the 3D vehicle model is designed simply to avoid excessive information interfering with driving. As a way, the 3D vehicle model can also display the vehicle status in real time, such as the opening status of vehicle lights, doors, windows, etc., so that the user can have a clear understanding of the vehicle status and ensure driving safety.

[0064] In summary, in the present application, a 3D vehicle model is established based on the images and / or videos generated by the client, and the established 3D vehicle model is displayed on the display device of the vehicle. On the one hand, it solves the problem that the prefabricated 3D vehicle model in the in-vehicle system causes users to only passively receive the inherent style of the 3D vehicle model, making it difficult to adjust its appearance, thus reducing user participation. On the other hand, it solves the problem that the 3D vehicle model is set based on the actual situation of the vehicle (such as body color, shape, etc.) during prefabrication, resulting in a single appearance style and lack of diversity, which easily causes visual fatigue for users.

[0065] In some embodiments, the data interaction between the generating device and the in-vehicle system can be achieved through a cloud platform. That is to say, in the embodiments of the present application, the first image and / or the first video generated by the generating device can be first sent to the cloud platform for storage, and then the first image and / or the first video generated by the generating device stored in the cloud platform can be sent to the in-vehicle system.

[0066] Based on the data interaction of the cloud platform, it can ensure the real-time synchronization of data between the client and the in-vehicle system. As an example, when operating on the first image and / or the first video simultaneously on multiple clients (such as mobile phones, tablets, computers, etc.), it can ensure that the data on all clients always remains consistent.

[0067] Based on the data interaction of the cloud platform, it can ensure the security of the data including the data related to the first image and / or the first video sent from the client and stored in the cloud platform, which helps to prevent security risks such as data leakage, loss, and tampering.

[0068] It should be understood that the type of the cloud platform is not limited in the embodiments of the present application.

[0069] It should be understood that the communication connection method between the cloud platform and the client (i.e., the generating device) and the communication connection method between the cloud platform and the in-vehicle system can be the same or different, and the embodiments of the present application do not limit this.

[0070] In some embodiments, before the cloud platform sends the data including the data related to the first image and / or the first video to the in-vehicle system, it will first judge the working state of the in-vehicle system. When the in-vehicle system is in the working state, the data including the data related to the first image and / or the first video will be sent to avoid data transmission when the in-vehicle system is in the non-working state. As an example, when the vehicle is in the off state or the in-vehicle system is not started, the cloud platform can temporarily cache the data and then perform data transmission after the in-vehicle system enters the working state, thus avoiding ineffective attempts of data transmission and saving network bandwidth and computing resources.

[0071] To further improve the intelligence of the 3D car model and implement related vehicle functions through the 3D car model, in some embodiments, the first region in the first image and / or the first video may be recognized first, and then the first region of the first image and / or the first video is functionally associated with the second region of the vehicle, where the functional association is used to trigger the second region to perform a target action by clicking the target function of the first region.

[0072] Regarding the recognition method of the first region in the first image and / or the first video, the embodiments of the present application do not make limitations. In some embodiments, traditional image processing algorithms may be used to recognize the first region. For example, according to the color characteristics of the first region, the first region in the first image and / or the first video may be recognized by setting a specific color threshold to simplify the recognition process and reduce the calculation time; for another example, the position of the first region in the first image and / or the first video may be recognized by matching the template image of the first region. This method of template matching can accurately recognize (i.e., match) the position of the first region without using training data, and has the characteristics of simple implementation and high accuracy.

[0073] In other embodiments, based on the Machine Learning (ML) algorithm, the first region in the first image and / or the first video may be recognized by training a model. As a way, the features of the first region (such as Histogram of Oriented Gradients (HOG)) may be extracted and a classifier (such as a random forest) may be used for recognition. Based on this method of feature extraction and classification, it is applicable to the recognition of a variety of different regions through feature selection and classifier optimization.

[0074] In still other embodiments, based on the Deep Learning (DL) model, the first region may be recognized by training a neural network. As a way, a target detection model (such as a Single Shot MultiBox Detector (SSD)) is used to recognize the position and category of the first region to improve the detection accuracy. As another way, a semantic segmentation model (such as a U-Net) is used to recognize the pixel-level position of the target region to avoid manually designing features and improve the degree of intelligence.

[0075] After determining the first region in the first image and / or the first video, the first region may be functionally associated with the second region on the vehicle, that is, the functional association, so that when the target function on the first region is clicked, the second region of the vehicle can be triggered to perform the target action.

[0076] Regarding the implementation method of the above function association, the embodiments of the present application do not make any restrictions. In some embodiments, the function association between the first area and the second area can be implemented in a hardware manner. As a way, when the target function of the first area is triggered, the second area can be triggered to execute the target action through a hardware signal of the vehicle, such as a Controller Area Network (CAN). This implementation method of transmitting through the hardware signal has a fast transmission speed, is not easily interfered by software, and has high stability. As another way, in order to improve flexibility, when the target function of the first area is triggered, the triggering of the second area can be controlled by a relay to execute the target action.

[0077] In other embodiments, the function association between the first area and the second area can also be completed in a software manner. As a way, a time listener can be set in the first area so that when the target function of this area is triggered, the second area is triggered to execute the target action. As another way, the control states of the first area and the second area can be bound, so that when the target function of the first area is triggered, the control state data of the second area is updated in real time, and then the second area is triggered to execute the target action according to the control state data.

[0078] It should be understood that the first area of the first image and / or the first video in the present application corresponds to the second area of the vehicle.

[0079] The first area of the first image and / or the first video mentioned in the present application may include, but is not limited to, the areas of the trunk, doors, and windows for generating a 3D vehicle model. Correspondingly, the second area of the vehicle may include, but is not limited to, the trunk, doors, and windows of the vehicle.

[0080] Therefore, the function association between the first area of the first image and / or the first video and the second area of the vehicle mentioned above can be specifically understood as including one or more of the following: associating the trunk of the 3D vehicle model with the trunk of the vehicle, so that the trunk of the vehicle can be triggered to open by clicking the open function of the trunk of the 3D vehicle model, and the trunk of the vehicle can be triggered to close by clicking the close function of the trunk of the 3D vehicle model; associating the doors of the 3D vehicle model with the doors of the vehicle, so that the doors of the vehicle can be triggered to open by clicking the open function of the doors of the 3D vehicle model, and the doors of the vehicle can be triggered to close by clicking the close function of the doors of the 3D vehicle model; associating the windows of the 3D vehicle model with the windows of the vehicle, so that the windows of the vehicle can be triggered to open by clicking the open function of the windows of the 3D vehicle model, the windows of the vehicle can be triggered to close by clicking the close function of the windows of the 3D vehicle model, the height of the windows of the vehicle can be increased by clicking the raise function of the windows of the 3D vehicle model, and the height of the windows of the vehicle can be decreased by clicking the lower function of the windows of the 3D vehicle model.

[0081] In addition, the embodiments of the present application do not limit the implementation manner of the trigger instruction sent by the user to trigger the target action in the second area of the vehicle. In some embodiments, the user can send a trigger instruction by clicking on the target functions (indexes) of the 3D vehicle model (such as the trunk, doors, and windows) displayed on the display device (such as the in-vehicle screen), so that after receiving the trigger instruction, the vehicle can perform the corresponding target actions in the second area, such as the trunk, doors, and windows.

[0082] In other embodiments, the user can also send a trigger instruction by an additional button (including the button displayed on the display device and / or physically set outside the display device), so that after receiving the trigger instruction, the vehicle can perform the corresponding target action.

[0083] In still other embodiments, the trigger instruction can also be completed by a control command of an external device (such as a remote control, a mouse, a keyboard, etc.) to make the vehicle perform the corresponding target action.

[0084] It should be noted that in the embodiments of the present application, when the target action in the second area is performed, the corresponding first area can perform a synchronous target action or not. Taking the first area as the trunk and the target action as opening, when clicking the opening function of the trunk of the 3D vehicle model to trigger the opening of the vehicle's trunk, the trunk of the 3D vehicle model can be opened synchronously or not.

[0085] It should be understood that the above description of the target area is only exemplary and does not constitute a limitation on the target area. The embodiments of the present application may include other target areas, such as vehicle lights, etc.

[0086] In order to reduce the difficulty of generating the 3D vehicle model, especially the difficulty of generating the first image and / or the first video, in some embodiments, the generating device can generate a two-dimensional image and use the generated two-dimensional image as the first image; and / or the generating device can generate a two-dimensional video and use the generated two-dimensional video as the first video. As a way, when the in-vehicle system receives the two-dimensional first image and / or the two-dimensional first video, it can render the two-dimensional first image and / or the two-dimensional first video through one or more of the 3D modeling software, game engines, and HMIs installed in the in-vehicle system to generate a three-dimensional first image and / or a three-dimensional first video, and then establish a 3D vehicle model based on the three-dimensional first image and / or the three-dimensional first video.

[0087] As another way, when the in-vehicle system receives the two-dimensional first image and / or the two-dimensional first video, it can directly establish a 3D vehicle model based on the two-dimensional first image and / or the two-dimensional first video.

[0088] Further, as a way, the generating device can obtain planar projection images of multiple different regions of the vehicle by projecting the 3D vehicle model, and merge the planar projection images of the multiple different regions as the first image. Then, the multiple planar projection images are numbered based on different regional positions. For example, the four doors are numbered in the order of the driver's door, the co-driver's door, the rear driver's door, and the rear co-driver's door of the vehicle; the body is numbered in the order of the roof, the left side of the vehicle, and the right side of the vehicle; the engine hood and the trunk lid are numbered in the order of the front engine hood and the rear trunk lid. And / or, the generating device can obtain planar projection videos of multiple different regions of the vehicle by projecting the 3D vehicle model, and merge the planar projection videos of the multiple different regions as the first video, and number the multiple planar projection videos based on different regional positions. For example, the four doors are numbered in the order of the driver's door, the co-driver's door, the rear driver's door, and the rear co-driver's door of the vehicle; the body is numbered in the order of the roof, the left side of the vehicle, and the right side of the vehicle; the engine hood and the trunk lid are numbered in the order of the front engine hood and the rear trunk lid.

[0089] In different planar creation regions (including planar projection images and planar projection videos), patterns, textures, or videos can be created according to their corresponding numbers. As a way, the generating device provides a custom editing function. For example, tools such as a paintbrush, an eraser, and a paint bucket can be used to perform custom editing of the planar region based on the uploaded image. As another way, the generating device also provides a function of generating images or videos with one click of artificial intelligence (AI).

[0090] In some embodiments, the generating device provides a function of previewing the 3D car model that may be formed by the first image generated based on multiple planar creation regions, so that the user can experience the 3D car model created by himself / herself as early as possible.

[0091] In some embodiments, the generating device can upload multiple planar regions to the cloud platform for storage according to the numbers. The in-vehicle system will download each planar region from the cloud platform according to the numbers in the working state and establish and display the 3D car model.

[0092] For ease of understanding, the method proposed in this application will be introduced in detail below by taking the generation and display of a 3D car model based on the cloud platform as an example.

[0093] As shown in Figure 3 In step S3010, the generating device 110 on the mobile phone side sends the two-dimensional first image to the cloud platform.

[0094] Among them, the two-dimensional first image is formed by merging multiple planar projection regions, and each planar projection region respectively includes numbers based on the door / body / cabin. Further, the planar creation region based on the number of the door includes textures and patterns drawn with tools such as brushes and paint buckets, and the planar creation region based on the number of the body includes patterns based on the AI one-key generation function.

[0095] In addition, the generation device on the mobile phone side can also preview the 3D car model established based on the two-dimensional first image made with tools such as brushes and AI one-key generation, and can send the first car model formed by merging multiple planar creation regions to the cloud platform 130 according to the numbers.

[0096] In step S3021, the cloud platform 130 stores the two-dimensional first image and judges the working state of the in-vehicle system 120. When the in-vehicle system is in a non-working state, it enters a waiting state. When the in-vehicle system 120 is in a working state, it enters step S3022.

[0097] When the cloud platform stores the first pattern generated by the generation device on the mobile phone side, it can also store the first pattern generated by the generation device on the computer side at the same time. In addition, it can also update the first patterns on the mobile phone side and the computer side to the latest first patterns at the same time. After completing the synchronization and update of the first images on multiple sides, store the first image and judge the working state of the in-vehicle system 120. When the in-vehicle system 120 is in a working state, it enters step S3022.

[0098] In step S3022, the cloud platform 130 sends the first image to the in-vehicle system 120.

[0099] In step S3031, the in-vehicle entertainment system in the in-vehicle system 120 establishes a 3D car model carrying the first image.

[0100] When the in-vehicle system 120 is in a working state, the in-vehicle system 120 downloads the first image sent by the cloud platform 130 according to the numbers, then adjusts the size and shape of the first image, and converts the format of the first image into the image format most suitable for establishing a 3D car model, and then generates a 3D car model through the HMI in the in-vehicle system based on the optimized first image.

[0101] In step S3032, establish a 3D car model HOG, and use a random forest classifier to identify the trunk, doors, and windows of the 3D car model.

[0102] In step S3033, functionally associate the trunk, doors, and windows of the 3D car model with the trunk, doors, and windows of the vehicle through CAN, so that when operating on the trunk, doors, and windows of the 3D car model, the trunk, doors, and windows of the vehicle can perform corresponding target actions.

[0103] In step S3034, a 3D vehicle model with the first image is displayed on the central control screen of the vehicle. Function indices of the 3D trunk, doors, and windows are also displayed simultaneously with the 3D vehicle model, facilitating the user to send trigger commands.

[0104] When the central control screen is in the navigation mode, the navigation information is preferentially displayed on the central control screen. With the assurance that the user can clearly see the navigation route and navigation, the 3D vehicle model is displayed in a smaller size at the lower right corner of the central control screen.

[0105] As described above in conjunction with Figures 1 to 3 , the method embodiments of the present application have been described in detail. Below, in conjunction with Figures 4 to 5 , the device embodiments of the present application will be described in detail. It should be understood that the descriptions of the method embodiments and the device embodiments correspond to each other. Therefore, for the parts not described in detail, reference can be made to the previous method embodiments.

[0106] An embodiment of the present application also provides a vehicle-mounted system. As shown in Figure 4 , the vehicle-mounted system 400 includes: a receiving module 410, configured to receive the first image and / or the first video sent by a generating device, where the first image and / or the first video are used for the appearance display of the 3D vehicle model; a building module 410, configured to build a 3D vehicle model carrying the first image and / or the first video; and a display module 430, configured to display the 3D vehicle model carrying the first image and / or the first video on a display device of the vehicle.

[0107] An embodiment of the present application also provides a display system. As shown in Figure 5 , the display system 500 includes a generating device 510 and a vehicle-mounted system 520; the generating device 510 is configured to generate the first image and / or the first video, where the first image and / or the first video are used for the appearance display of the 3D vehicle model; the vehicle-mounted system 520 is configured to: receive the first image and / or the first video sent by the generating device 510; build a 3D vehicle model carrying the first image and / or the first video; and display the 3D vehicle model carrying the first image and / or the first video on a display device of the vehicle.

[0108] In some embodiments, the display system 500 may further include a cloud platform, and the cloud platform is configured to: receive the first image and / or the first video sent by the generating device 510; and send the first image and / or the first video to the vehicle-mounted system 520 when the vehicle-mounted system 520 is in a working state.

[0109] It should be understood that in the embodiments of the present application, "B corresponding to A" means that B is associated with A, and B can be determined according to A. However, it should also be understood that determining B according to A does not mean determining B only according to A, and B can also be determined according to A and / or other information.

[0110] It should be understood that the term "and / or" in this document is merely a description of the associated relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. Additionally, the character " / " in this document generally indicates that the associated objects before and after are in an "or" relationship.

[0111] It should be understood that in various embodiments of the present application, the magnitudes of the sequence numbers of the above processes do not imply the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0112] In several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the devices or units can be in electrical, mechanical, or other forms.

[0113] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0114] In addition, in each embodiment of the present application, the functional units can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.

[0115] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be read by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a digital video disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0116] As described above, the foregoing are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily conceive of changes or substitutions within the technical scope disclosed in the present application, and all such changes or substitutions should be covered by the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A display method for a 3D car model, characterized in that, The method is applied to a vehicle infotainment system, and the method includes: Receiving a first image and / or a first video sent by a generating device, where the first image and / or the first video are used for the appearance display of a 3D vehicle model; Establishing a 3D vehicle model carrying the first image and / or the first video; Displaying, on a display device of the vehicle, the 3D vehicle model carrying the first image and / or the first video.

2. The method according to claim 1, wherein The receiving the first image and / or the first video sent by the generating device includes: Receiving the first image and / or the first video sent by a cloud platform, where the first image and / or the first video stored in the cloud platform are sent by the generating device.

3. The method according to claim 2, wherein The first image and / or the first video are sent by the cloud platform when the vehicle infotainment system is in an operating state.

4. The method according to any one of claims 1 to 3, characterized in that The method further includes: Identifying a first area in the first image and / or the first video; Functionally associating the first area with a second area of the vehicle, where the functional association is used to trigger the second area to perform a target action by clicking a target function of the first area.

5. The method according to claim 4, characterized in that, The functionally associating the first area with the second area of the vehicle includes one or more of the following: Functionally associating the trunk in the first image and / or the first video with the trunk of the vehicle, so as to trigger the opening / closing of the trunk of the vehicle by clicking the opening / closing function of the trunk in the first image and / or the first video; Functionally associating the vehicle door in the first image and / or the first video with the vehicle door, so as to trigger the opening / closing of the vehicle door by clicking the opening / closing function of the vehicle door in the first image and / or the first video; Functionally associating the vehicle window in the first image and / or the first video with the vehicle window, so as to trigger the opening / closing / raising / lowering of the vehicle window by clicking the opening / closing / raising / lowering function of the vehicle window in the first image and / or the first video.

6. The method according to claim 4, wherein The method further includes: Receiving a trigger instruction from a user, where the trigger instruction is used to trigger the second area to perform a target action; Wherein, the trigger instruction is implemented by clicking the target function of the first area.

7. The method according to any one of claims 1 to 3, characterized in that The first image is a two-dimensional image, and / or, the first video is a two-dimensional video.

8. The method according to claim 7, wherein The generating device includes a plurality of planar creation areas, and the first image is obtained by merging images of the plurality of planar creation areas; and / or, the first video is obtained by merging videos of the plurality of planar creation areas.

9. A vehicle-mounted system, characterized in that, Includes: A receiving module, configured to receive a first image and / or a first video sent by a generating device, where the first image and / or the first video are used for the appearance display of a 3D vehicle model; An establishing module, configured to establish a 3D vehicle model carrying the first image and / or the first video; A display module, configured to display, on a display device of the vehicle, the 3D vehicle model carrying the first image and / or the first video.

10. A display system for a 3D model, characterized in that, The display system includes a generating device and a vehicle infotainment system; The generating device is configured to generate a first image and / or a first video, where the first image and / or the first video are used for the appearance display of a 3D vehicle model; The vehicle infotainment system is configured to: Receive the first image and / or the first video sent by the generating device; Establish a 3D vehicle model carrying the first image and / or the first video; Display the 3D vehicle model carrying the first image and / or the first video on the display device of the vehicle.

11. The display system according to claim 10, wherein, The display system further includes a cloud platform, and the cloud platform is used for: Receive the first image and / or the first video sent by the generating device; When the vehicle-mounted system is in a working state, send the first image and / or the first video to the vehicle-mounted system.

Images