Method, electronic device, and storage medium for displaying virtual appearance of surrounding vehicles
By acquiring and matching the feature information of surrounding vehicles in the vehicle's infotainment system, and using an appearance model library to display the virtual appearance of the vehicle, the problem of the vehicle appearance simulation being too simplistic and network-dependent in the vehicle's infotainment system is solved, achieving accurate and vivid vehicle display and an efficient driving experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- ECARX (HUBEI) TECHCO LTD
- Filing Date
- 2022-02-28
- Publication Date
- 2026-05-08
AI Technical Summary
Existing technologies lack solutions for accurately and vividly simulating and displaying the appearance of surrounding vehicles in in-vehicle systems, resulting in insufficient driving experience and enjoyment for drivers, as well as heavy reliance on the network and frequent latency issues.
By acquiring perceived images of vehicles around the vehicle, identifying feature information, and obtaining corresponding display elements from a preset appearance model library, the system combines Bluetooth broadcast signals to match personalized or default appearance displays, reducing network dependence and optimizing data processing.
It achieves accurate and vivid display of the vehicle's virtual appearance in the in-vehicle system, meets the driver's personalized needs, reduces latency, and improves the driving experience and processing efficiency.
Smart Images

Figure CN116701683B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of virtual reality technology, and in particular to a method, electronic device, and machine-readable storage medium for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system. Background Technology
[0002] With the deepening development of automotive intelligence, autonomous driving is transforming cars into a more interactive environment. In this interactive environment, presenting more accurate and vivid virtual graphics (such as simulated road and vehicle displays) becomes a crucial prerequisite for improving the driver's experience and enhancing driving pleasure. However, currently, there is no solution for accurately and vividly simulating the appearance of surrounding vehicles within the in-vehicle infotainment system. Summary of the Invention
[0003] In view of the above problems, a method, electronic device and machine-readable storage medium for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system is proposed to overcome the above problems or at least partially solve the above problems.
[0004] One object of the present invention is to provide a method for displaying the virtual appearance of surrounding vehicles in a vehicle-mounted system, which can provide a virtual appearance of the vehicle for simulating road environment and vehicle display.
[0005] A further object of the present invention is to provide a display of a personalized virtual appearance for a vehicle.
[0006] Another further objective of the present invention is to reduce reliance on the network and reduce latency.
[0007] Another objective of this invention is to reduce invalid data processing and further improve processing efficiency.
[0008] In particular, according to one aspect of the present invention, a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system is provided, comprising:
[0009] Acquire perceived images of all surrounding vehicles within a specified range around the vehicle, and identify the perceived images to obtain the first feature information of each of the surrounding vehicles;
[0010] Based on the first feature information of each of the surrounding vehicles, the corresponding appearance display elements are obtained from the preset appearance model library, and the virtual appearance of each of the surrounding vehicles is displayed on the vehicle terminal using the appearance display elements.
[0011] Optionally, before obtaining the corresponding appearance display elements from a preset appearance model library based on the first feature information of each of the surrounding vehicles, the method further includes:
[0012] Receive broadcast signals from nearby vehicles and obtain the second characteristic information of each nearby vehicle carried in the broadcast signals;
[0013] The first feature information of each of the surrounding vehicles is matched with the second feature information of each of the nearby vehicles;
[0014] The step of obtaining corresponding appearance display elements from a preset appearance model library based on the first feature information of each of the surrounding vehicles, and displaying the virtual appearance of each of the surrounding vehicles on the vehicle-mounted system using the appearance display elements includes:
[0015] Based on the matching result of the first feature information of each of the surrounding vehicles and the second feature information of the nearby vehicles, the corresponding appearance display elements are obtained from the preset appearance model library, and the virtual appearance of each of the surrounding vehicles is displayed on the vehicle terminal using the appearance display elements.
[0016] Optionally, the preset appearance model library includes a first appearance model library and a second appearance model library. The first appearance model library stores second feature information of different vehicles and personalized appearance display elements set by the users of each vehicle in a corresponding relationship. The appearance display elements include personalized appearance display elements and default appearance display elements.
[0017] The step of obtaining corresponding appearance display elements from a preset appearance model library based on the matching result of the first feature information of each of the surrounding vehicles and the second feature information of the nearby vehicles, and using the appearance display elements to display the virtual appearance of each of the surrounding vehicles on the vehicle-mounted terminal includes:
[0018] If the first feature information of the surrounding vehicles matches the second feature information of a certain nearby vehicle, then the corresponding personalized appearance display element is obtained from the first appearance model library according to the second feature information of the matched nearby vehicle, and the virtual appearance of the surrounding vehicles is displayed on the vehicle terminal using the personalized appearance display element.
[0019] If the first feature information of the surrounding vehicles does not match the second feature information of each of the nearby vehicles, then the corresponding default appearance display element is obtained from the second appearance model library according to the first feature information of the surrounding vehicles, and the virtual appearance of the surrounding vehicles is displayed on the vehicle terminal using the default appearance display element.
[0020] Optionally, the first appearance model library is located in the cloud, and the personalized appearance display elements are set by the respective users of each vehicle and uploaded to the first appearance model library in the cloud in correspondence with the second feature information of each vehicle; or
[0021] The first appearance model library is set on the vehicle terminal, and the personalized appearance display elements are set by the users of each vehicle and uploaded to the cloud in correspondence with the second feature information of each vehicle, and then downloaded to the first appearance model library on the vehicle terminal.
[0022] Optionally, the method further includes:
[0023] The broadcast signal carries the second characteristic information of the vehicle.
[0024] Optionally, the broadcast signal is broadcast via Bluetooth wireless direct connection; and
[0025] The receiving of broadcast signals from nearby vehicles includes:
[0026] The broadcast signals from the nearby vehicles are received via Bluetooth handshake protocol.
[0027] Optionally, the method further includes:
[0028] Before acquiring perceived images of surrounding vehicles, the vehicle's personalized exterior display elements are set based on user input;
[0029] The personalized appearance display elements of this vehicle are saved on the vehicle's infotainment system, and the second feature information of this vehicle and the personalized appearance display elements are uploaded to the cloud in a corresponding relationship so as to be stored in the first appearance model library.
[0030] When displaying the virtual appearance of the surrounding vehicles on the vehicle-mounted system, the virtual appearance of the vehicle is displayed using the personalized appearance display elements of the vehicle stored on the vehicle-mounted system.
[0031] Optionally, the specified range is the perceptible range of the vehicle;
[0032] After acquiring perceived images of surrounding vehicles and identifying the perceived images to obtain first feature information of each surrounding vehicle, the method further includes:
[0033] The first feature information of each of the surrounding vehicles is stored in a first temporary database, and the first feature information of surrounding vehicles that are no longer within the perception range of this vehicle is removed from the first temporary database.
[0034] After receiving broadcast signals from nearby vehicles and obtaining the second characteristic information of each nearby vehicle carried in the broadcast signals, the method further includes:
[0035] The second feature information of each nearby vehicle is stored as a record in the second temporary database, and the same records in the second temporary database are merged.
[0036] The step of matching the first feature information of each of the surrounding vehicles with the second feature information of each of the nearby vehicles includes:
[0037] The first feature information of each of the surrounding vehicles in the first temporary database is matched with each record in the second temporary database.
[0038] Optionally, the second appearance model library is located in the cloud or on the vehicle's infotainment system.
[0039] Optionally, both the first feature information and the second feature information include at least one of color, vehicle model, and license plate number, and both contain at least one of the same information.
[0040] Optionally, the second feature information may also include a user identifier.
[0041] Optionally, the appearance display elements include vehicle models and / or texture skins.
[0042] According to another aspect of the present invention, an electronic device is also provided, including a memory, a processor, and a machine-executable program stored in the memory and running on the processor, wherein the processor executes the machine-executable program to implement any of the aforementioned methods for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system.
[0043] According to another aspect of the present invention, a machine-readable storage medium is also provided, on which a machine-executable program is stored, wherein the machine-executable program, when executed by a processor, implements any of the aforementioned methods for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system.
[0044] The present invention provides a method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system. By sensing the surrounding vehicles of the vehicle, the first feature information of each surrounding vehicle is obtained, and then the corresponding appearance display elements are obtained based on the first feature information of each surrounding vehicle to display the virtual appearance of the surrounding vehicles. This realizes the display of the virtual appearance of vehicles in the vehicle infotainment system, which can more accurately and vividly simulate the surrounding environment of the vehicle, improve the driver's driving experience, and increase driving pleasure.
[0045] Furthermore, in the method for displaying the virtual appearance of surrounding vehicles in the vehicle infotainment system provided by the present invention, the second feature information of each nearby vehicle is obtained by receiving broadcast signals from nearby vehicles and used to match the first feature information of the surrounding vehicles. For a nearby vehicle whose first feature information matches the second feature information of a nearby vehicle, the corresponding personalized appearance display element is obtained from the first appearance model library to display the virtual appearance of the surrounding vehicle. For a nearby vehicle whose first feature information does not match the second feature information of any of the nearby vehicles, the corresponding default appearance display element is obtained from the second appearance model library to display the virtual appearance of the surrounding vehicle. The personalized appearance display elements corresponding to different vehicles stored in the first appearance model library are set by the users of each vehicle, thereby realizing the display of personalized virtual appearance of vehicles in the vehicle infotainment system. This can present more accurate and vivid virtual vehicle images in the vehicle infotainment system, solving the problems of monotonous vehicle appearance and low recognition in simulated road environments and vehicle displays, satisfying the driver's inner need to express their personality, and thus further improving the driver's driving experience.
[0046] Furthermore, in the method for displaying the virtual appearance of surrounding vehicles in the vehicle infotainment system provided by the present invention, the first appearance model library can be set on the vehicle infotainment system, wherein the personalized appearance display elements stored therein are downloaded from the cloud. In this way, the dependence on the network during the virtual appearance display process can be reduced or even eliminated, and latency can be reduced.
[0047] Furthermore, in the method for displaying the virtual appearance of surrounding vehicles in the vehicle system provided by the present invention, after acquiring the first feature information of each surrounding vehicle, it is stored in a first temporary database, and the first feature information of surrounding vehicles that are no longer within the perceptible range of the vehicle is removed from the first temporary database; after acquiring the second feature information of each nearby vehicle, it is stored as a record in a second temporary database, and the same records in the second temporary database are merged. In this way, the processing of the same second feature information or the first feature information of surrounding vehicles that have disappeared from the perceptible range of the vehicle is avoided in the comparison process, thereby reducing invalid data processing and further improving processing efficiency.
[0048] The above description is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, and in order to make the above and other objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention are described below.
[0049] The above and other objects, advantages and features of the present invention will become more apparent to those skilled in the art from the following detailed description of specific embodiments of the invention in conjunction with the accompanying drawings. Attached Figure Description
[0050] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:
[0051] Figure 1 A flowchart illustrating a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system according to an embodiment of the present invention is shown.
[0052] Figure 2 A flowchart illustrating a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system according to another embodiment of the present invention is shown.
[0053] Figure 3 A schematic diagram illustrating an application scenario of a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system according to an embodiment of the present invention is shown.
[0054] Figure 4 A schematic diagram of a virtual appearance of a vehicle displayed in an in-vehicle infotainment system according to an embodiment of the present invention is shown;
[0055] Figure 5 A flowchart illustrating a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system according to yet another embodiment of the present invention is shown.
[0056] Figure 6 A schematic structural block diagram of an electronic device according to an embodiment of the present invention is shown. Detailed Implementation
[0057] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
[0058] To solve or at least partially solve the above-mentioned technical problems, embodiments of the present invention propose a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system.
[0059] Figure 1 A flowchart illustrating a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system according to an embodiment of the present invention is shown. See also Figure 1 The method may include at least the following steps S102 to S104.
[0060] Step S102: Obtain perception images of all surrounding vehicles within a specified range around the vehicle, and identify the first feature information of each surrounding vehicle by recognizing the perception images.
[0061] In step S102, the perceived image can be an image acquired by a sensing device (such as an image acquisition device). The image acquisition device can be an on-board sensor installed on the vehicle, such as a driving camera or other sensors, or it can be a sensor installed on a roadside unit, which transmits the acquired perceived image to the vehicle through communication between the roadside unit and the vehicle. The first feature information may include, for example, vehicle appearance (such as color, model, etc.), license plate number, and other distinguishable features. The specified range can be set according to actual application requirements; for example, it can be set to the vehicle's perceptible range, i.e., the range perceptible by the vehicle's on-board sensors, or it can be set to a predetermined distance range centered on the vehicle.
[0062] Step S104: Obtain the corresponding appearance display elements from the preset appearance model library based on the first feature information of each surrounding vehicle, and use the appearance display elements to display the virtual appearance of each surrounding vehicle on the vehicle terminal.
[0063] In step S104, the appearance display elements may include vehicle models (including color, wheels, wraps and shapes, etc.) and / or texture skins, etc., to achieve a precise and vivid display of the vehicle's appearance.
[0064] The method for displaying the virtual appearance of surrounding vehicles in the vehicle infotainment system provided by this invention obtains the first feature information of each surrounding vehicle by sensing the surrounding vehicles of the vehicle itself, and then obtains the corresponding appearance display elements based on the first feature information of each surrounding vehicle to display the virtual appearance of the surrounding vehicles. This realizes the display of the virtual appearance of vehicles in the vehicle infotainment system, which can more accurately and vividly simulate the surrounding environment of the vehicle, improve the driver's driving experience and increase driving pleasure.
[0065] In some further embodiments, the interaction information between the vehicle and nearby vehicles can be combined to achieve a more accurate and vivid display of the simulated appearance of surrounding vehicles.
[0066] Specifically, in some embodiments, the following steps may also be performed before performing step S104:
[0067] Receive broadcast signals from nearby vehicles and obtain the second characteristic information of nearby vehicles carried in the broadcast signals;
[0068] The first feature information of each surrounding vehicle is matched with the second feature information of each nearby vehicle.
[0069] Accordingly, step S104 can be specifically implemented as follows:
[0070] Based on the matching results of the first feature information of each surrounding vehicle and the second feature information of nearby vehicles, the corresponding appearance display elements are obtained from the preset appearance model library, and the virtual appearance of each surrounding vehicle is displayed on the vehicle terminal using the appearance display elements.
[0071] In general, the method of this embodiment can be divided into the following three stages:
[0072] The first stage involves acquiring and recording information about vehicles on the road.
[0073] The second stage involves matching the virtual information of vehicles on the road with their real-world status.
[0074] In the third stage, the appearance is constructed using a model library on the local end or in the cloud, and the appearance is displayed in the vehicle's infotainment system in a simulated real-world manner.
[0075] The following section provides a detailed description of the method for displaying the virtual appearance of surrounding vehicles in the vehicle infotainment system according to the present invention. Figure 2 A flowchart illustrating a method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to another embodiment of the present invention is shown. In this embodiment, the aforementioned preset appearance model library may include a first appearance model library and a second appearance model library, wherein the first appearance model library stores second feature information of different vehicles and personalized appearance display elements set by the respective users of each vehicle in a corresponding relationship. Accordingly, the acquired corresponding appearance display elements include personalized appearance display elements and default appearance display elements.
[0076] See Figure 2 The method may include at least the following steps S202 to S210.
[0077] Step S202: Obtain perception images of all surrounding vehicles within a specified range around the vehicle, and identify the first feature information of each surrounding vehicle by recognizing the perception images.
[0078] Step S204: Receive broadcast signals from nearby vehicles and obtain the second characteristic information of nearby vehicles carried in the broadcast signals.
[0079] Step S206: Match the first feature information of each surrounding vehicle with the second feature information of each nearby vehicle.
[0080] Step S208: If the first feature information of the surrounding vehicles matches the second feature information of a nearby vehicle, then the corresponding personalized appearance display element is obtained from the first appearance model library according to the second feature information of the matched nearby vehicle, and the virtual appearance of the surrounding vehicles is displayed on the vehicle terminal using the personalized appearance display element.
[0081] Step S210: If the first feature information of the surrounding vehicles does not match the second feature information of each nearby vehicle, then the corresponding default appearance display element is obtained from the second appearance model library according to the first feature information of the surrounding vehicles, and the virtual appearance of the surrounding vehicles is displayed on the vehicle terminal using the default appearance display element. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system provided by this invention further receives broadcast signals from nearby vehicles to obtain the second feature information of each nearby vehicle and uses it to match the first feature information of the surrounding vehicles. For a surrounding vehicle whose first feature information matches the second feature information of a nearby vehicle, a corresponding personalized appearance display element is obtained from a first appearance model library to display the virtual appearance of that surrounding vehicle. For a surrounding vehicle whose first feature information does not match the second feature information of any of the nearby vehicles, a corresponding default appearance display element is obtained from a second appearance model library to display the virtual appearance of that surrounding vehicle. The personalized appearance display elements corresponding to different vehicles stored in the first appearance model library are set by the users of each vehicle, thereby realizing the display of personalized virtual appearance of vehicles in the vehicle infotainment system. This enables the presentation of more accurate and vivid virtual vehicle images in the vehicle infotainment system, solving the problems of monotonous vehicle appearance and low recognition in simulated road environments and vehicle displays, satisfying the driver's desire to express their individuality, and thus further improving the driver's driving experience.
[0082] In the method of the present invention, the acquisition of vehicle information in the road in the first stage is achieved through steps S202 and S204. Step S202 is the same as step S102 described above, and will not be repeated here.
[0083] In step S204 above, the vehicle receives broadcast signals from nearby vehicles. Here, "nearby vehicles" can be understood as other vehicles within the range where the vehicle can receive their broadcast signals.
[0084] In some embodiments, the broadcast signal mentioned herein is broadcast via Bluetooth Wireless Direct Link (BWDL), and the broadcast signal carries a second characteristic information of the broadcasting vehicle. That is, nearby vehicles broadcast signals via BWDL. Accordingly, this vehicle receives the broadcast signals from nearby vehicles via the Bluetooth handshake protocol, thereby obtaining the second characteristic information of the nearby vehicles. The second characteristic information may include, for example, vehicle appearance (such as color, model, etc.), license plate number, and other distinguishable vehicle features. Furthermore, both the first and second characteristic information contain at least one identical piece of information to allow for matching. For example, the first characteristic information includes color and model, and the second characteristic information includes model and license plate number, both containing the identical information of model.
[0085] Figure 3 This diagram illustrates an application scenario of a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system according to an embodiment of the present invention. Figure 3 As shown, in some embodiments, broadcast communication between the vehicle and nearby vehicles is conducted via the A1 technical path. Nearby vehicles broadcast their second characteristic information as a summary in character format via Bluetooth modules and the BWDL direct connection layer, and the vehicle receives the broadcast via the Bluetooth handshake protocol. The vehicle acquires perceived images of surrounding vehicles on the road via the A2 technical path, and obtains the first characteristic information of these vehicles by recognizing the perceived images. Thus, the acquisition of vehicle information on the road is achieved.
[0086] It should be noted that, Figure 3 The illustration only shows the scenario where this vehicle receives a broadcast, but those skilled in the art will understand that this vehicle may also be a nearby vehicle for other vehicles. Therefore, in some embodiments, this vehicle may also broadcast a broadcast signal carrying its second characteristic information for reception by other vehicles. That is to say, the configuration of this vehicle and the nearby vehicle that sends the broadcast can be completely identical, with the same hardware architecture and software system, thereby enabling this vehicle and the nearby vehicle to identify and match each other and present a virtual visual appearance.
[0087] Additionally, it should be noted that the order of steps S202 and S204 can be interchanged, or they can be performed simultaneously.
[0088] After obtaining the vehicle information on the road, step S206 is executed, which matches the first feature information of each surrounding vehicle with the second feature information of each nearby vehicle to achieve the second stage of matching the virtual information of vehicles on the road with their real-world state.
[0089] In the third stage, for vehicles whose first feature information matches the second feature information (such as license plate number and / or consistent appearance features), step S208 is executed to complete the personalized vehicle appearance display. For vehicles whose first feature information does not match the second feature information, step S210 is executed to complete the default vehicle appearance display. Specifically, in steps S208 and S210, both personalized appearance display elements and default appearance display elements can include vehicle models (including color, wheels, decals, and styling, etc.) and / or texture skins, etc. When displaying the virtual appearance of surrounding vehicles on the vehicle's infotainment system using personalized or default appearance display elements, the corresponding vehicle appearance display is completed through rendering on the local vehicle infotainment system.
[0090] Figure 4 A schematic diagram illustrating the virtual appearance of a vehicle displayed in an in-vehicle infotainment system according to an embodiment of the present invention is shown. Figure 4As shown, using the method of the present invention, for vehicles that are successfully matched (i.e., the first feature information matches the second feature information), the virtual appearance set by the user (i.e. the other vehicle owner) of the vehicle is displayed on the vehicle terminal, while for vehicles that are not successfully matched, the default model is displayed.
[0091] In some embodiments, the first appearance model library can be located in the cloud, and the personalized appearance display elements in the first appearance model library are uploaded to the cloud for storage after being set by the users of each vehicle and corresponding to the second feature information of each vehicle. For example, the personalized appearance display elements and the second feature information can be packaged and uploaded in a corresponding relationship. Although setting the first appearance model library in the cloud may make the method of the present invention dependent on the network to some extent, it can make full use of the powerful computing power and storage resources of the cloud to improve processing efficiency.
[0092] In other embodiments, the first appearance model library can be located on the vehicle's infotainment system (i.e., locally). The personalized appearance display elements in the first appearance model library are set by each vehicle's user and uploaded to the cloud corresponding to the vehicle's second feature information. These elements are then downloaded to the first appearance model library on the vehicle's infotainment system for storage. In practical applications, the first appearance model library can be pre-downloaded before running the comparison step of this invention, or even before running the method of this invention. By setting the first appearance model library locally on the vehicle's infotainment system, and storing the personalized appearance display elements downloaded from the cloud, the dependence on the network during virtual appearance display can be reduced or even eliminated, reducing latency.
[0093] In some embodiments, before performing step S202, the following steps are further included: setting personalized appearance display elements of the vehicle according to user input; saving the personalized appearance display elements of the vehicle on the vehicle's infotainment system, and uploading the vehicle's second feature information and personalized appearance display elements to the cloud in a corresponding relationship for storage in the first appearance model library. The storage method varies depending on the location of the first appearance model library. When the first appearance model library is located in the cloud, the uploaded second feature information and personalized appearance display elements of the vehicle are directly stored in the first appearance model library. When the first appearance model library is located on the vehicle's infotainment system, the vehicle's second feature information and personalized appearance display elements, after being uploaded to the cloud, will be downloaded to the first appearance model library of other vehicles' infotainment systems for storage.
[0094] After setting and saving the vehicle's personalized appearance display elements, when displaying the virtual appearance of surrounding vehicles on the vehicle's infotainment system, the vehicle's personalized appearance display elements saved on the system can also be used to simultaneously display the vehicle's virtual appearance. For example... Figure 4As shown, the vehicle's virtual appearance (i.e., the vehicle itself) is displayed on the vehicle's infotainment system according to the owner's settings.
[0095] Similarly, the second appearance model library can also be set up in the cloud or on the vehicle's infotainment system.
[0096] In some embodiments, the aforementioned specified range may be the perceptible range of the vehicle, i.e., the perceptible range of the vehicle's onboard sensors. After obtaining the first feature information of each surrounding vehicle in step S202, the first feature information of each surrounding vehicle may be stored in a first temporary database, and the first feature information of surrounding vehicles that are no longer within the perceptible range of the vehicle may be removed from the first temporary database. Furthermore, after obtaining the second feature information of each nearby vehicle in step S204, the second feature information of each nearby vehicle may be stored as a record in a second temporary database, and identical records in the second temporary database may be merged. In this case, step S206 may further include: matching the first feature information of each surrounding vehicle in the first temporary database with each record in the second temporary database.
[0097] Specifically, such as Figure 3 As shown, the first feature information (appearance information) obtained through image recognition is recorded in real time into the first temporary database B2, and the second feature information obtained through receiving broadcasts is saved as a DNS (Domain Name System) record into the second temporary database B1, and identical records are merged. The first temporary database B2 and the second temporary database B1 are continuously matched.
[0098] In this embodiment, after acquiring the first feature information of each surrounding vehicle, it is stored in the first temporary database, and the first feature information of surrounding vehicles that are no longer within the vehicle's perception range is removed from the first temporary database; after acquiring the second feature information of each nearby vehicle, it is stored as a record in the second temporary database, and the same records in the second temporary database are merged. In this way, the processing of the same second feature information or the first feature information of surrounding vehicles that have disappeared from the vehicle's perception range is avoided in the comparison process, thereby reducing invalid data processing and further improving processing efficiency.
[0099] In some embodiments, the second feature information may further include a user identifier (i.e., a unique user ID). For vehicles whose first feature information matches the second feature information, when retrieving the corresponding personalized appearance display element from the first appearance model library, the corresponding personalized appearance display element can be determined and retrieved solely using the correspondence between the user identifier and the personalized appearance display element. This improves the speed of searching and querying in the first appearance model library.
[0100] Accordingly, when each vehicle uploads the set personalized appearance display elements and its own second feature information to the cloud, it can also upload only the set personalized appearance display elements and user identifier to the cloud for storage in the first appearance model library.
[0101] Furthermore, such as Figure 3 As shown, in some embodiments, the broadcast signal from nearby vehicles may also carry the username (user nickname). Accordingly, as... Figure 4 As shown, when displaying the virtual appearance of a vehicle on the in-vehicle system, for successfully matched vehicles, the username can also be displayed near the vehicle (such as on the vehicle's roof) to more clearly distinguish different vehicles.
[0102] See also Figure 3 In some embodiments, the broadcast signal may also carry information such as the custom model and skin of the vehicle broadcasting. Therefore, after receiving the broadcast signal, the vehicle can directly use the custom model and skin information obtained from the broadcast signal to display a personalized virtual appearance for successfully matched vehicles. This is particularly suitable for situations where the first appearance model library is unavailable (e.g., due to network issues causing the cloud-based first appearance model library to be unavailable) or the first appearance model library has not been updated in a timely manner.
[0103] Of course, when displaying the virtual appearance of a vehicle, the relative positions of surrounding vehicles to the vehicle itself also need to be considered for a more accurate display. Therefore, in step S102, the position information of each surrounding vehicle can also be obtained through a sensing device. The technology for obtaining position information is well known to those skilled in the art and will not be described in detail here.
[0104] The preceding text introduced various implementation methods of the method for displaying the virtual appearance of surrounding vehicles in the vehicle infotainment system according to the present invention. The following will describe in detail the implementation process of the method for displaying the virtual appearance of surrounding vehicles in the vehicle infotainment system according to the present invention through a specific embodiment.
[0105] Figure 5 A flowchart illustrating a method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system according to a specific embodiment of the present invention is shown. In this embodiment, the first appearance model library is located in the cloud, while the second appearance model library is located locally on the in-vehicle infotainment system. See also... Figure 5 As shown, the method applied to this vehicle may include at least the following steps S402 to S414.
[0106] Step S402: Based on the user's input, set the personalized appearance display elements of the vehicle, package the personalized appearance display elements of the vehicle and the user identifier according to the corresponding relationship, save the packaged data on the vehicle terminal, and upload the packaged data to the cloud for storage in the first appearance model library.
[0107] Step S404: Obtain perception images of all surrounding vehicles within the perception range of this vehicle, identify the perception images to obtain the first feature information of each surrounding vehicle, store the first feature information of each surrounding vehicle in a first temporary database, and remove the first feature information of surrounding vehicles that are no longer within the perception range of this vehicle from the first temporary database.
[0108] Specifically, the perceived image is obtained through the vehicle's onboard camera. The first feature information includes the vehicle's color, model, and license plate number.
[0109] Step S406: Receive broadcast signals from nearby vehicles, obtain the second feature information of nearby vehicles carried in the broadcast signals, store the second feature information of each nearby vehicle as a record in the second temporary database, and merge the identical records in the second temporary database.
[0110] Specifically, the broadcast signals from nearby vehicles are broadcast via Bluetooth wireless direct connection, and this vehicle receives the broadcast signals via the Bluetooth handshake protocol. The second characteristic information includes the user identifier, as well as the vehicle's color, model, and license plate number.
[0111] Step S408: Match the first feature information of each surrounding vehicle in the first temporary database with each record in the second temporary database.
[0112] Step S410: For each surrounding vehicle, determine whether its first feature information matches the second feature information of a nearby vehicle in the second temporary database. If yes, that is, the first feature information of the surrounding vehicle matches the second feature information of a nearby vehicle, then proceed to step S412. If no, that is, the first feature information of the surrounding vehicle does not match the second feature information of any of the nearby vehicles, then proceed to step S414.
[0113] Step S412: Based on the user identifiers of nearby vehicles, retrieve the corresponding personalized appearance display elements from the first appearance model library, and use the personalized appearance display elements to display the virtual appearance of the surrounding vehicles on the vehicle's infotainment system. The first appearance model library stores the user identifiers of each vehicle and the personalized appearance display elements set by each vehicle's user in a corresponding relationship.
[0114] Step S414: Obtain the corresponding default appearance display element from the second appearance model library based on the first feature information of the surrounding vehicles, and use the default appearance display element to display the virtual appearance of the surrounding vehicles on the vehicle terminal.
[0115] The display methods for vehicle personalization and default virtual appearance have been described above and will not be repeated here.
[0116] This embodiment can present a more accurate and vivid virtual vehicle appearance, satisfying the driver's inner need to express their personality, improving the driver's driving experience and increasing driving pleasure.
[0117] Based on the same inventive concept, embodiments of the present invention also provide an electronic device 200. See also Figure 6 As shown, the electronic device 200 includes a memory 201, a processor 202, and a machine-executable program 203 stored on the memory 201 and running on the processor 202. When the processor 202 executes the machine-executable program 203, it implements the method of displaying the virtual appearance of surrounding vehicles in the vehicle system according to any of the foregoing embodiments or combinations of embodiments.
[0118] Based on the same inventive concept, embodiments of the present invention also provide a machine-readable storage medium having a machine-executable program stored thereon. When executed by a processor, the machine-executable program implements the method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system, as described in any of the foregoing embodiments or combinations thereof.
[0119] Those skilled in the art will clearly understand that the specific working process of the systems, devices and units described above can be referred to the corresponding process in the foregoing method embodiments, and for the sake of brevity, it will not be repeated here.
[0120] Furthermore, the functional units in the various embodiments of the present invention can be physically independent of each other, or two or more functional units can be integrated together, or all functional units can be integrated into one processing unit. The integrated functional units described above can be implemented in hardware, or in software or firmware.
[0121] Those skilled in the art will understand that if the integrated functional unit is implemented in software and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or all or part of it, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computing device (e.g., a personal computer, server, or network device) to execute all or part of the steps of the methods described in the embodiments of the present invention when running the instructions. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0122] Alternatively, all or part of the steps of the foregoing method embodiments can be implemented by hardware (such as a computing device, personal computer, server, or network device) related to program instructions. The program instructions can be stored in a computer-readable storage medium. When the program instructions are executed by the processor of the computing device, the computing device executes all or part of the steps of the methods described in the various embodiments of the present invention.
[0123] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that within the spirit and principles of the present invention, modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein; and these modifications or substitutions do not cause the corresponding technical solutions to depart from the protection scope of the present invention.
Claims
1. A method for displaying the virtual appearance of surrounding vehicles in an in-vehicle infotainment system, comprising: Acquire perceived images of all surrounding vehicles within a specified range around the vehicle, and identify the perceived images to obtain the first feature information of each of the surrounding vehicles; Based on the first feature information of each of the surrounding vehicles, corresponding appearance display elements are obtained from a preset appearance model library, and the virtual appearance of each of the surrounding vehicles is displayed on the vehicle-mounted system using the appearance display elements; wherein, Before obtaining the corresponding appearance display elements from a preset appearance model library based on the first feature information of each of the surrounding vehicles, the method further includes: Receive broadcast signals from nearby vehicles and obtain the second characteristic information of each nearby vehicle carried in the broadcast signals; The first feature information of each of the surrounding vehicles is matched with the second feature information of each of the nearby vehicles; The step of obtaining corresponding appearance display elements from a preset appearance model library based on the first feature information of each of the surrounding vehicles, and displaying the virtual appearance of each of the surrounding vehicles on the vehicle-mounted system using the appearance display elements includes: Based on the matching result of the first feature information of each of the surrounding vehicles and the second feature information of the nearby vehicles, the corresponding appearance display elements are obtained from the preset appearance model library, and the virtual appearance of each of the surrounding vehicles is displayed on the vehicle terminal using the appearance display elements.
2. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 1, wherein, The preset appearance model library includes a first appearance model library and a second appearance model library. The first appearance model library stores the second feature information of different vehicles and personalized appearance display elements set by the users of each vehicle in a corresponding relationship. The appearance display elements include the personalized appearance display elements and the default appearance display elements; The step of obtaining corresponding appearance display elements from a preset appearance model library based on the matching results of the first feature information of each of the surrounding vehicles and the second feature information of the nearby vehicles, and displaying the virtual appearance of each of the surrounding vehicles on the vehicle-mounted system using the appearance display elements includes: If the first feature information of the surrounding vehicles matches the second feature information of a certain nearby vehicle, then the corresponding personalized appearance display element is obtained from the first appearance model library according to the second feature information of the matched nearby vehicle, and the virtual appearance of the surrounding vehicles is displayed on the vehicle terminal using the personalized appearance display element. If the first feature information of the surrounding vehicles does not match the second feature information of each of the nearby vehicles, then the corresponding default appearance display element is obtained from the second appearance model library according to the first feature information of the surrounding vehicles, and the virtual appearance of the surrounding vehicles is displayed on the vehicle terminal using the default appearance display element.
3. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 2, wherein, The first appearance model library is located in the cloud, and the personalized appearance display elements are set by the respective users of each vehicle and uploaded to the first appearance model library in the cloud in correspondence with the second feature information of each vehicle; or The first appearance model library is set on the vehicle terminal, and the personalized appearance display elements are set by the users of each vehicle and uploaded to the cloud in correspondence with the second feature information of each vehicle, and then downloaded to the first appearance model library on the vehicle terminal.
4. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 1, further comprising: The broadcast signal carries the second characteristic information of the vehicle.
5. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 1, wherein, The broadcast signal is broadcast via Bluetooth wireless direct connection; and The receiving of broadcast signals from nearby vehicles includes: The broadcast signals from the nearby vehicles are received via Bluetooth handshake protocol.
6. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 2, wherein, Also includes: Before acquiring perceived images of surrounding vehicles, the vehicle's personalized exterior display elements are set based on user input; The personalized appearance display elements of this vehicle are saved on the vehicle's infotainment system, and the second feature information of this vehicle and the personalized appearance display elements are uploaded to the cloud in a corresponding relationship so as to be stored in the first appearance model library. When displaying the virtual appearance of the surrounding vehicles on the vehicle-mounted system, the virtual appearance of the vehicle is displayed using the personalized appearance display elements of the vehicle stored on the vehicle-mounted system.
7. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 1, wherein, The specified range is the perceptible range of this vehicle; After acquiring perceived images of surrounding vehicles and identifying the first feature information of each surrounding vehicle from the perceived images, the method further includes: The first feature information of each of the surrounding vehicles is stored in a first temporary database, and the first feature information of surrounding vehicles that are no longer within the perception range of this vehicle is removed from the first temporary database. After receiving broadcast signals from nearby vehicles and obtaining the second characteristic information of each nearby vehicle carried in the broadcast signals, the method further includes: The second feature information of each nearby vehicle is stored as a record in the second temporary database, and the same records in the second temporary database are merged. The step of matching the first feature information of each of the surrounding vehicles with the second feature information of each of the nearby vehicles includes: The first feature information of each of the surrounding vehicles in the first temporary database is matched with each record in the second temporary database.
8. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 2, wherein, The second appearance model library is located in the cloud or on the vehicle's infotainment system.
9. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 1, wherein, Both the first feature information and the second feature information include at least one of color, vehicle type and license plate number, and both contain at least one of the same information.
10. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 9, wherein, The second feature information also includes a user identifier.
11. The method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to claim 1, wherein, The appearance display elements include vehicle models and / or texture skins.
12. An electronic device comprising a memory, a processor, and a machine-executable program stored on the memory and running on the processor, wherein the processor, when executing the machine-executable program, implements a method for displaying a virtual appearance of surrounding vehicles in a vehicle-mounted system according to any one of claims 1-11.
13. A machine-readable storage medium having a machine-executable program stored thereon, the machine-executable program, when executed by a processor, implementing a method for displaying the virtual appearance of surrounding vehicles in a vehicle infotainment system according to any one of claims 1-11.
Citation Information
Patent Citations
Method and device for establishing surrounding vehicle model, storage medium and computer equipment
CN111860379A