Vehicle information query method and device and vehicle

By identifying the image of the vehicle component, and filtering information with the augmented reality display introduction and historical query records, the problem that vehicle component knowledge cannot be displayed intuitively is solved, and the user experience and information relevance is improved.

CN119829785APending Publication Date: 2025-04-15GREAT WALL MOTOR CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411913142.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-24
Publication Date
2025-04-15

AI Technical Summary

Technical Problem

Knowledge of vehicle components cannot be displayed to users more intuitively, resulting in poor user experience.

Method used

By obtaining images of vehicle components, identifying and obtaining component names, obtaining augmented reality display introduction based on the name, and filtering display information based on historical query records and user identity information.

Benefits of technology

It realizes fast and intuitive query of vehicle component information, improves user experience, and ensures that the displayed information is more in line with the user's wishes and needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119829785A_ABST
    Figure CN119829785A_ABST
Patent Text Reader

Abstract

The invention is suitable for the technical field of intelligent automobiles, and provides a vehicle information query method and device and a vehicle, and the method comprises the steps: obtaining a first image with a to-be-queried target vehicle part, and obtaining an augmented reality display introduction of the display information of the target vehicle part by recognizing the image of the target vehicle part in the first image; then obtaining a historical query record in a historical time period; and based on the historical query record, determining target information needing to be displayed in the query from the display information, and finally displaying the target information. The augmented reality display introduction of the display information of the target vehicle component can be automatically queried through the image of the target vehicle component, and the query is simple, convenient and rapid; besides, after the display information of the target vehicle part is obtained through query, the target information needing to be displayed can be screened from the display information according to the historical query record, so that the target information displayed this time better conforms to the willingness of the user, and the displayed content is more concise.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of intelligent automobile technology, and in particular, relates to a vehicle information query method, device and vehicle. Background Art

[0002] There are many parts in a vehicle, and novice users often do not know the relevant knowledge about the parts. At present, when users query the knowledge of vehicle parts, they need to query the vehicle manual index according to the name of the vehicle part on the car computer or mobile phone APP to obtain the knowledge introduction of the vehicle parts. In addition, since the current knowledge introduction is mostly in the form of text, it cannot be presented to users intuitively. Users need to read repeatedly or compare the car and text to understand the vehicle parts, resulting in a poor user experience. Summary of the invention

[0003] The embodiments of the present application provide a vehicle information query method, device and vehicle, which can solve the problem of poor user experience caused by the inability to display knowledge of vehicle components to users more intuitively.

[0004] In a first aspect, an embodiment of the present application provides a method for querying vehicle information, comprising:

[0005] Acquire a first image, wherein the first image includes a target vehicle component to be queried;

[0006] Based on the image of the target vehicle component in the first image, obtaining a component name of the target vehicle component;

[0007] Based on the component name of the target vehicle component, obtaining an augmented reality display introduction of display information of the target vehicle component;

[0008] Get historical query records within the historical time period;

[0009] Based on the historical query records, determining target information to be displayed for this query from the display information;

[0010] The target information is displayed.

[0011] In a possible implementation of the first aspect, the method further includes: acquiring identity information of the user at a current moment;

[0012] The method further comprises:

[0013] Based on the historical query records and the identity information of the user, target information to be displayed for this query is determined from the display information.

[0014] In a possible implementation manner of the first aspect, determining the target information to be displayed for the current query from the display information based on the historical query record and the identity information of the user includes:

[0015] Based on the historical query records, the identity information of the user and the component name, determining whether the user has a query record for the target vehicle component within the historical time period;

[0016] If it is determined that the user does not have a query record for the target vehicle component within the historical time period, all of the display information is determined as target information that needs to be displayed for this query.

[0017] In a possible implementation manner of the first aspect, after determining whether the user has a query record for the target vehicle component within the historical time period based on the historical query record, the identity information of the user, and the component name, the method further includes:

[0018] If it is determined that the user has a query record for the target vehicle component within the historical time period, obtaining the number of times the user has viewed each display information within the historical time period;

[0019] If the number of views of the first type of information in the display information is less than the preset number, the first type of information is determined as the target information to be displayed in this query.

[0020] In a possible implementation manner of the first aspect, if the number of views of the first category of information in the display information is less than a preset number, the method further includes:

[0021] If the first category of information includes the second category of information and the third category of information, the second category of information is display information with a viewing count of 0, and the third category of information is display information with a viewing count not equal to 0, the second category of information is determined as the target information to be displayed for this query, and the text introduction information of the third category of information is displayed.

[0022] In a possible implementation manner of the first aspect, obtaining the component name of the target vehicle component based on the image of the target vehicle component in the first image includes:

[0023] Recognize the first image, obtain an image of each vehicle component existing in the first image and position information of each vehicle component in the first image;

[0024] Based on the image of each of the vehicle components, obtaining a component name of each of the vehicle components;

[0025] When there are a plurality of the vehicle components in the first image, the target vehicle component and the component name of the target vehicle component among the vehicle components are obtained according to the position information of each of the vehicle components.

[0026] In a possible implementation manner of the first aspect, obtaining the target vehicle component and the component name of the target vehicle component among the vehicle components according to the position information of each of the vehicle components includes:

[0027] Determine a query score for each of the vehicle components according to the location information of each of the vehicle components, wherein the query score represents a predicted probability of a user querying the vehicle component;

[0028] sorting the vehicle parts in descending order of the query scores to obtain a name list, wherein the name list contains the names of the vehicle parts and the corresponding images;

[0029] displaying the name list, wherein the name list is used to prompt the user to select a target vehicle component from the name list;

[0030] After receiving a first operation acting on the name list, the target vehicle component and the component name of the target vehicle component in the vehicle components are obtained.

[0031] In a possible implementation manner of the first aspect, the method further includes:

[0032] determining the definition of each of the vehicle components based on the image of each of the vehicle components;

[0033] Accordingly, determining the query score of each vehicle component according to the location information of each vehicle component includes:

[0034] A query score of each of the vehicle components is determined according to the location information of each of the vehicle components and the clarity of each of the vehicle components.

[0035] In a second aspect, an embodiment of the present application provides a vehicle information query device, including:

[0036] An image acquisition module, used for acquiring a first image, wherein the first image includes a target vehicle component to be queried;

[0037] a name search module, configured to obtain a component name of the target vehicle component based on an image of the target vehicle component in the first image;

[0038] An information search module, used for obtaining an augmented reality display introduction of display information of the target vehicle component based on the component name of the target vehicle component;

[0039] A historical record acquisition module is used to obtain historical query records within a historical time period;

[0040] An information screening module, used to determine target information to be displayed for this query from the displayed information based on the historical query records;

[0041] The information display module is used to display the target information.

[0042] In a third aspect, an embodiment of the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the vehicle information query method described in any one of the first aspects above when executing the computer program.

[0043] In a fourth aspect, an embodiment of the present application provides a terminal device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the vehicle information query method described in any one of the first aspects above is implemented.

[0044] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the vehicle information query method described in any one of the above-mentioned first aspects is implemented.

[0045] In a sixth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device, the terminal device executes the vehicle information query method described in any one of the above-mentioned first aspects.

[0046] Compared with the prior art, the beneficial effects of the first aspect of the embodiment of the present application are as follows: the present application obtains a first image in which a target vehicle part to be queried exists, and obtains an augmented reality display introduction of the display information of the target vehicle part by identifying the image of the target vehicle part in the first image; then obtains the historical query records within the historical time period; based on the historical query records, determines the target information to be displayed in this query from the display information, and finally displays the target information. The present application can automatically query the augmented reality display introduction of the display information of the target vehicle part through the image of the target vehicle part, and the query is simple, convenient, and fast; in addition, after the display information of the target vehicle part is obtained through query in the present application, the target information to be displayed can be filtered from the display information according to the historical query records, so that the target information displayed this time is more in line with the user's wishes and the displayed content is more concise; furthermore, the target information of the present application is displayed to the user in the form of an enhanced display display introduction, and the user can understand the target vehicle part more quickly and intuitively according to the information of the enhanced display display introduction, so that the user experience is better.

[0047] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0049] Figure 1 It is a flowchart of a method for querying vehicle information provided by an embodiment of the present application;

[0050] Figure 2 is a flowchart of a method for obtaining target information provided by an embodiment of the present application;

[0051] Figure 3 is a flowchart of a method for determining display information provided by an embodiment of the present application;

[0052] Figure 4 It is a flowchart of a method for querying component names provided in an embodiment of the present application;

[0053] Figure 5 is a flow chart of a method for determining a target vehicle component provided by an embodiment of the present application;

[0054] Figure 6 is a flow chart of a method for determining a target vehicle component provided by another embodiment of the present application;

[0055] Figure 7 is a flowchart of a method for determining a query score provided in an embodiment of the present application;

[0056] Figure 8 It is a structural diagram of a vehicle information query device provided in an embodiment of the present application;

[0057] Fig. 9 It is a structural diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0058] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0059] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0060] At present, the introduction of each component in the vehicle usually exists in the form of a vehicle manual. The vehicle manual can exist in the vehicle computer and the mobile phone APP. If the user needs to query the introduction of a vehicle component, he can query it in the vehicle computer or the mobile phone APP. Specifically, the user needs to know the name of the vehicle component to be queried, and query according to the name of the vehicle component and the directory index in the vehicle manual. However, for novice users, they may not know the names of each vehicle component, which makes the query difficult and inefficient.

[0061] In addition, the introductions to vehicle parts in the vehicle manual are all in text form, and users need to read repeatedly or compare the vehicle manual with the text repeatedly to gain a clear understanding of the vehicle parts, resulting in a poor user experience.

[0062] Based on the above problems, the present application proposes a method for querying vehicle information. The user can take a photo of the vehicle parts to be queried, and the terminal device can query the component name of the vehicle part based on the image of the vehicle part, and then automatically obtain the display information of the vehicle part based on the component name of the vehicle part, and the display information of the vehicle includes an augmented reality display introduction of the vehicle parts, so that the introduction of the vehicle parts can be displayed more intuitively, and the user can also quickly understand the vehicle parts through the augmented reality display introduction of the vehicle parts. In addition, after determining the display information of the target vehicle parts, the present application can also filter the target information that needs to be displayed this time from the display information according to the user's historical query records, so that the information displayed this time is more in line with the user's wishes; the method of the present application not only makes the knowledge query of vehicle parts simpler, more convenient, and more efficient, but also makes the display of vehicle parts more intuitive, so that the user experience is better.

[0063] The following is a detailed description of the vehicle information query method of an embodiment of the present application. The method of the present application can be executed in an application APP of a terminal device or in a vehicle. The terminal device can be a mobile phone, a tablet computer, etc. For the sake of ease of description, the following description is based on the execution of the terminal device as an example to illustrate the method of the present application.

[0064] Figure 1 A schematic flow chart of the vehicle information query method provided by the present application is shown, referring to Figure 1 , the method is described in detail as follows:

[0065] S101, acquiring a first image, wherein the first image includes a target vehicle component to be queried.

[0066] In this embodiment, the first image may be one or more images, and the multiple images may be images taken at different angles, for example, the first image includes 3 or 4 images, etc. If the first image is multiple images, the vehicle parts subsequently determined based on the images can be more accurate.

[0067] The first image may be an image taken by the user using a camera on the terminal device.

[0068] The first image can also be generated by the user opening an application APP, using the "scan" function on the application APP, and scanning the vehicle part to be queried. Specifically, the application APP can capture multiple images at a preset frequency when scanning the vehicle part. The preset frequency can be set as needed. For example, the preset frequency can be 60Hz or 70Hz.

[0069] In this embodiment, the target vehicle component to be queried may be one or more.

[0070] S102: Obtain a component name of the target vehicle component based on the image of the target vehicle component in the first image.

[0071] In this embodiment, the first image is recognized, and the complete vehicle parts in the first image are extracted. The vehicle parts in the complete image are used as target vehicle parts, and the vehicle parts in the incomplete image are ignored.

[0072] In this embodiment, after the image of the target vehicle component is identified, the obtained image of the target vehicle component is compared with the pre-stored images to obtain the similarity between the image of the target vehicle component and each pre-stored image. The pre-stored image with the greatest similarity is determined as the image that matches the image of the target vehicle component. The component name corresponding to the pre-stored image with the greatest similarity is searched to obtain the component name of the target vehicle component.

[0073] In this embodiment, after the image of the target vehicle component is identified, a three-dimensional image of the target vehicle component is constructed based on the image of the target vehicle component, and a three-dimensional component image matching the constructed three-dimensional image is searched in the stored three-dimensional component images. The component name of the target three-dimensional component image is determined as the component name of the target vehicle component, and the target three-dimensional component image is the searched three-dimensional component image matching the constructed three-dimensional image.

[0074] S103, based on the component name of the target vehicle component, obtaining an augmented reality display introduction of display information of the target vehicle component.

[0075] In this embodiment, the display information corresponding to each vehicle component is pre-stored. The display information exists in the form of an electronic manual. After the component name of the target vehicle component is obtained, the display information corresponding to the component name is searched from the electronic manual to obtain the display information of the target vehicle component. The display information may include the component name, operation method, maintenance information, structure display and performance introduction of the target vehicle component.

[0076] The displayed information is in the form of augmented reality introduction (AR introduction), text introduction, and combined text and graphic introduction.

[0077] Alternatively, after obtaining the component name of the target vehicle component, the page number of the page where the display information corresponding to the component name is located is searched in the directory of the vehicle manual, and the display information of the target vehicle component is obtained according to the page number.

[0078] In this embodiment, the component name of the target vehicle component is sent to the server, and the component name is used to instruct the server to query the display information of the target vehicle component according to the component name of the target vehicle component. The server sends the display information of the target vehicle component to the terminal device, and the terminal device receives the display information of the target vehicle sent by the server.

[0079] Alternatively, the component name of the target vehicle component is sent to the server, and the server determines the display information of the target vehicle component based on the component name and vehicle information. The vehicle information may include the vehicle model and / or vehicle identification code (WIN code), etc. The server can determine the corresponding vehicle information based on the user information of the terminal device that sends the component name.

[0080] S104, obtaining historical query records within a historical time period.

[0081] In this embodiment, each time a user queries a vehicle component, the query is stored. The historical query record may include the component name of the queried vehicle component, the display information of the queried vehicle component, and the identity information of the user who queries the vehicle component.

[0082] S105: Based on the historical query records, determine the target information to be displayed for this query from the display information.

[0083] In this embodiment, if the user has queried a display information of the target vehicle part within the historical time period, then the probability of the user querying the display information this time is not high. It can be inferred that the user may need to query the display information that has not been queried. Therefore, all the display information can be filtered according to the historical query records, and the display information that the user may need can be inferred, so that the final displayed information is more concise and more in line with the user's wishes.

[0084] S106, displaying the target information.

[0085] In this embodiment, the target information may be a usage instruction video, a structural composition video, etc. of the target vehicle component.

[0086] In this embodiment, when the target information is displayed through the terminal device, the augmented reality display introduction in the target information can adaptively match the camera as the angle of the terminal device changes, so that the augmented reality display introduction is more compatible with the terminal device.

[0087] In the present application, a first image in which a target vehicle part to be queried is obtained, and an augmented reality display introduction of the display information of the target vehicle part is obtained by identifying the image of the target vehicle part in the first image; then the historical query records within the historical time period are obtained; based on the historical query records, the target information to be displayed for this query is determined from the display information, and finally the target information is displayed. The present application can automatically query the augmented reality display introduction of the display information of the target vehicle part through the image of the target vehicle part, and the query is simple, convenient, and fast; in addition, after the display information of the target vehicle part is obtained through query in the present application, the target information to be displayed can be filtered from the display information according to the historical query records, so that the target information displayed this time is more in line with the user's wishes and the displayed content is more concise; furthermore, the target information of the present application is displayed to the user in the form of an enhanced display display introduction, and the user can understand the target vehicle part more quickly and intuitively according to the information of the enhanced display display introduction, so that the user experience is better.

[0088] In a possible implementation, in order to make the filtered target information more accurate, the identity information of the user who is currently querying may be obtained, and the target information to be displayed for this query may be determined from the display information according to the user's identity information.

[0089] Specifically, the above method may further include:

[0090] Based on the historical query records and the identity information of the user, target information to be displayed for this query is determined from the display information.

[0091] In this embodiment, the user's identity information may include the user name and / or the user's image information, etc. According to the user's identity information, the user's historical query records in the historical time period can be searched; and then the display information that the user may need can be filtered, so that the target information obtained is more accurate.

[0092] In a possible implementation, when filtering target information from various display information, the target information to be displayed may be determined based on whether the user has searched for the target vehicle component.

[0093] like Figure 2 Specifically, the method for determining target information may include:

[0094] S201, based on the historical query records, the identity information of the user and the component name, determining whether the user has a query record for the target vehicle component within the historical time period.

[0095] In this embodiment, the query record corresponding to the current user is searched from the historical query record to obtain the target query record. It is searched from the target query record whether there is a component name of the target vehicle component for this query. If the component name of the target vehicle component for this query exists in the target query record, it is determined that the user has searched for the target vehicle component within the historical time period. If the component name of the target vehicle component for this query does not exist in the target query record, it is determined that the user has not searched for the target vehicle component within the historical time period.

[0096] S202: If it is determined that the user has no query record for the target vehicle component within the historical time period, all of the display information is determined as target information to be displayed for this query.

[0097] In this embodiment, if the user has not searched for the target vehicle part within the historical time period, it means that this query is the first time for the user to search for the target vehicle part, and the user may not know all the information about the target vehicle part. In order to make the content displayed to the user more comprehensive, all the displayed information can be displayed to the user as the target information, so that the user can understand all the information about the target vehicle part.

[0098] S203: If it is determined that the user has a query record for the target vehicle component in the historical time period, the number of times the user has viewed each display information in the historical time period is obtained.

[0099] In this embodiment, if there is a query record of the target vehicle part within the historical time period, it means that the user has previously queried the target vehicle part and may have a certain understanding of the target vehicle part; then, based on the number of times the user has viewed each display information, it can be determined which display information the user has previously understood; if the user has previously viewed a display information a large number of times, then the user should have a better understanding of the display information, and therefore, the display information that the user is more familiar with may not be highlighted this time, so that the displayed content meets the user's expectations.

[0100] S204: If the number of views of the first type of information in the displayed information is less than a preset number, the first type of information is determined as the target information to be displayed in this query.

[0101] In this embodiment, the preset number of times can be set as needed, for example, the preset number of times can be set to 4 times or 5 times, etc.

[0102] The number of views of the first type of information is less than the preset number, which means that the user has viewed the first type of information less frequently and may not be familiar with it. The user may need to view the first type of information again. Therefore, the target information to be displayed this time is the first type of information. The first type of information may be the maintenance method and structure introduction of the target vehicle parts.

[0103] In this embodiment, the display information other than the first category of information in the display information is recorded as the fourth category of information in this application. The fourth category of information is the display information whose viewing times is greater than or equal to the preset times.

[0104] The user has viewed the fourth category of information many times, and it is presumed that the user may have a good understanding of the fourth category of information. The user may not want to view the fourth category of information again during this query. Therefore, the augmented reality display introduction of the fourth category of information may not be displayed during this query. The first viewing control of the fourth category of information may be displayed during this query. The first viewing control is used to display the augmented reality display introduction of the fourth category of information of the target vehicle component after the user triggers the first viewing control, so that if the user wants to view the fourth category of information, he can view the fourth category of information by clicking the first viewing control.

[0105] In one embodiment, if the number of views of the first type of information in the display information is less than a preset number, the method of the present application may further include:

[0106] If the first category of information includes the second category of information and the third category of information, the second category of information is display information with a viewing count of 0, and the third category of information is display information with a viewing count not equal to 0, the second category of information is determined as the target information to be displayed for this query, and the text introduction information of the third category of information is displayed.

[0107] In this embodiment, since the number of views of the second type of information is 0, it means that the user may not know anything about it, so the second type of information is the key content displayed this time.

[0108] The display information in the first category of information except the second category of information is recorded as the third category of information, and text introduction information of the third category of information and a second viewing control of the third category of information are displayed. The second viewing control is used to display an augmented reality display introduction of the third category of information of the target vehicle component after the user triggers the second viewing control.

[0109] Since the number of views of the third type of information is not zero, but the number of views is relatively small, it means that the user may have a certain understanding of this information. Therefore, the third type of information is simply displayed in the form of text introduction, so that the user can understand this type of information through the text introduction.

[0110] In the present application, the display information of the target vehicle parts is filtered through historical query records and the user's identity information. If the user has not queried the target vehicle parts before, all the display information of the target vehicle parts will be displayed; if the user has queried the target vehicle parts before, the display information to be displayed this time can be determined based on the number of times the user has viewed the display information; by filtering the display information, the information displayed this time can be more in line with the user's wishes and the displayed information can be more concise.

[0111] In one possible implementation, since the same vehicle component of different vehicle models may be different, when determining the display information of the target vehicle component, in order to make the determined display information more accurate, in addition to determining the display information based on the component name, the display information can also be determined based on the vehicle information, so that the display information of the target vehicle component is more accurate.

[0112] like Figure 3 Specifically, the implementation process of the above step S103 may include:

[0113] S1031, obtaining vehicle information of the vehicle.

[0114] In this embodiment, the vehicle information may include the vehicle model and / or the vehicle identification code (WIN code), etc. The vehicle identification code is the vehicle identification number, which is determined according to the vehicle management standard. The vehicle identification code includes the vehicle manufacturer, year, model, body type and code, engine code and assembly location, etc.

[0115] S1032: Based on the vehicle information and the component name of the target vehicle component, obtain an augmented reality display introduction of the display information of the target vehicle component.

[0116] In this embodiment, the display information of all vehicle components corresponding to the vehicle is first searched according to the vehicle information; then, the display information of the target vehicle component is searched according to the component name of the target vehicle component in the display information under the vehicle.

[0117] In the present application, the display information of the target vehicle component is determined based on the vehicle information and the component name of the target vehicle component, so as to prevent the display information of the target vehicle component finally queried from being inaccurate due to the difference in display information of the same vehicle component of different models, and make the display information of the target vehicle component finally obtained more accurate.

[0118] In one possible implementation, since there are many parts in a vehicle and the display information of the same part in different models is also different, a large amount of space is required to store the display information of the vehicle parts. In order to alleviate the local memory pressure, the display information is stored in the server. Therefore, when querying the display information, it is necessary to query the display information in the server.

[0119] Specifically, the implementation process of step S1032 may include:

[0120] S301, sending first information to a server, wherein the first information includes the vehicle information and the component name of the target vehicle component, and the first information is used to instruct the server to query display information of the target vehicle component according to the vehicle information and the component name of the target vehicle component.

[0121] In this embodiment, the server pre-stores display information of different vehicle models and different vehicle components, and the display information includes text and pictures, etc. The display information is stored in the form of knowledge vectors.

[0122] Specifically, the display information may include component information and augmented reality display introduction, and the component information may include component name, keywords, vehicle information of the vehicle where the component is located, and performance introduction of the component, etc. The component information may be stored in the form of knowledge vectors in a RAG (Retrieval-Augmented Generation) vector library.

[0123] The augmented reality display introduction of the vehicle parts in the display information can be stored in the server in the form of an electronic manual, wherein the electronic manual can also be stored in a vectorized form. The augmented reality display introduction can include text introduction, picture introduction and AR animation, wherein the text introduction can include the use introduction of the parts, etc.

[0124] As an example, the electronic manual may be in the form of Table 1 below.

[0125] Table 1 Structure of the electronic manual

[0126]

[0127]

[0128] In this embodiment, the first information may also include an image of the target vehicle component. The display information of the target vehicle component is determined according to the vehicle information, the image of the target vehicle component and the component name of the target vehicle component.

[0129] In this embodiment, after receiving the first information, the server searches for component information according to the first information, and then searches for an augmented reality display introduction of the target vehicle component according to the component information.

[0130] When searching for component information according to the first information, a component having a similarity with the target vehicle component greater than a preset value is searched in the server, and the component information of the first component in the server is determined as the component information of the target vehicle component, wherein the first component is a component having a similarity with the target vehicle component greater than a preset value in the server. The preset value can be set as needed, for example, the preset value can be set to 95% or 90%, etc.

[0131] If a part having a similarity with the target vehicle part greater than a preset value is not found in the server, it is determined that the display information of the target vehicle part does not exist in the server, and the server can send a reminder message to the user's terminal device. The reminder message is used to prompt the user that the display information of the target vehicle part has not been retrieved, and prompt the user to take a photo of the vehicle part to be found again.

[0132] S302: Receive display information of the target vehicle component sent by the server.

[0133] In this application, in order to reduce the pressure on local storage, the display information is stored in the server. After obtaining the first information, the first information is sent to the server, and the server is used to search for the display information of the target vehicle parts, thereby reducing the pressure on local storage.

[0134] In a possible implementation, since the terminal device needs to be connected to the Internet to send the image to the server, if the user is in an environment with a poor network, the image cannot be sent to the server. Therefore, in the present application, after obtaining the first image, if the first image is directly sent to the server, and the server is used to determine the display information of the target vehicle component based on the first image, in an environment with a poor network, the first image cannot be transmitted to the server, resulting in the user being unable to obtain the display information of the target vehicle component. Therefore, in order to avoid the situation where the display information of the target vehicle component cannot be obtained using the first image due to network reasons, the present application processes the first image locally and obtains the component name of the target vehicle component based on the first image. Since text transmission can be implemented even in an environment with a poor network, after obtaining the component name, the component name is sent to the server, and the server queries the display information of the target vehicle component based on the component name, which can ensure that the display information of the target vehicle component can be obtained in an environment with a poor network.

[0135] like Figure 4 As shown, specifically, the implementation process of step S102 may include:

[0136] S1021: Input the first image into a locally stored local model, and use the local model to query the component name of the target vehicle component to obtain a query result.

[0137] In this embodiment, the local model is a model deployed in the application APP, and the local model is a model trained using images of vehicle parts as samples. For example, the local model can be an OCR (Optical Character Recognition) small model or a convolutional neural network model.

[0138] In this embodiment, if the local model can identify the target vehicle component in the first image, the component name of the target vehicle component is output, and the corresponding query result is that the query is successful.

[0139] If the local model does not recognize the target vehicle part in the first image, the query fails.

[0140] S1022: If the query result is successful, obtain the component name of the target vehicle component.

[0141] S1023: If the query result is a query failure, the first image is sent to the server; wherein the first image is used to instruct the server to query the component name of the target vehicle component based on the first image using the stored cloud model.

[0142] In this embodiment, the cloud model is deployed in the server, and the cloud model is a model trained using images of vehicle parts as samples. The cloud model has higher computing power than the local model. For example, the cloud model can be a large OCR model.

[0143] S1024: Receive the component name of the target vehicle component sent by the server.

[0144] In the present application, the local model is first used to identify the target vehicle parts in the first image without image transmission. Since the local model operates more quickly, the speed of part recognition is improved. In addition, the local model is used to identify the first image, thereby avoiding image transmission. Image recognition can be completed even in an environment with poor network conditions, and is suitable for various environments.

[0145] like Figure 5 As shown, in a possible implementation manner, the implementation process of step S102 may include:

[0146] S401, identifying the first image, obtaining an image of each vehicle component existing in the first image and position information of each vehicle component in the first image.

[0147] In this embodiment, the first image is identified, and each vehicle component in the first image is segmented to determine the number of vehicle components in the first image and the position information of each vehicle component in the first image.

[0148] After identifying each vehicle component in the first image, each vehicle component is marked with a box, and the position information of each vehicle component in the first image may include the coordinates of the four vertices of the marked box and the distance between the midpoint of the marked box and the midpoint of the first image.

[0149] S402: Obtain a component name of each of the vehicle components based on the image of each of the vehicle components.

[0150] S403: When there are a plurality of the vehicle components in the first image, obtain the target vehicle component and the component name of the target vehicle component among the vehicle components according to the position information of each of the vehicle components.

[0151] In this embodiment, the vehicle component whose position information is in the central area of ​​the first image is taken as the target vehicle component.

[0152] In the present application, when a general user takes a photo of a target vehicle part, he or she usually places the target vehicle part to be queried in the middle of the image. Therefore, the target vehicle part in the first image can be filtered according to the position information of the vehicle part in the image, so that the display information of the target vehicle part finally displayed to the user is more accurate.

[0153] like Figure 6 As shown, in a possible implementation manner, the implementation process of step S403 may include:

[0154] S4031, determining a query score of each of the vehicle components according to the location information of each of the vehicle components, wherein the query score represents a predicted probability of a user querying the vehicle component.

[0155] In this embodiment, people generally place important scenes in the center of the image when taking pictures. Therefore, according to people's shooting habits, the closer to the center of the first image, the more the user wants to query the knowledge information of the vehicle part. Therefore, the closer to the midpoint of the first image, the higher the query score of the vehicle part.

[0156] For example, there are two vehicle parts in the first image. If the distance between vehicle part A and the midpoint of the first image is 4 cm; the distance between vehicle part B and the midpoint of the first image is 7 cm; then the query score of vehicle part A is higher than the query score of vehicle part B.

[0157] In this embodiment, if there are two vehicle parts whose centers are at the same distance from the center of the first image, the distance between each vertex of the marked vehicle part box and the center of the first image is calculated respectively, and then the average distance between the four vertices and the center of the first image is calculated. The average distances of the two vehicle parts are compared, and the larger the average distance, the smaller the query score.

[0158] For example, if the distance between the midpoint of vehicle component C and the midpoint of the first image is 5 cm; the distance between the midpoint of vehicle component D and the midpoint of the first image is 5 cm. Calculate the average distance between the four vertices of the labeled box of vehicle component C and the midpoint of the first image, and calculate the average distance between the four vertices of the labeled box of vehicle component D and the midpoint of the first image. If the average distance corresponding to vehicle component C is 5 cm and the average distance corresponding to vehicle component D is 7 cm, then the query score of vehicle component C is higher than the query score of vehicle component D.

[0159] In another embodiment, if there is a vehicle component in the first image, the vehicle component is a target vehicle component, and the component name of the vehicle component is output.

[0160] S4032, sorting the vehicle parts in descending order of the query scores to obtain a name list, wherein the name list contains the name of each vehicle part and the corresponding image.

[0161] In this embodiment, all vehicle components in the first image are sorted in descending order of query scores to obtain a name list. In order to facilitate the user to determine the target vehicle component to be queried from the name list, an image of the vehicle component is displayed after each component name in the name list.

[0162] The earlier the vehicle part is in the name list, the greater the predicted probability that the user will query the vehicle part.

[0163] S4033, displaying the name list, where the name list is used to prompt the user to select a target vehicle component from the name list.

[0164] S4034: After receiving the first operation acting on the name list, obtain the target vehicle component and the component name of the target vehicle component in the vehicle components.

[0165] In this embodiment, the first operation may be an operation in which the user clicks on a component name in the name list, and the vehicle component corresponding to the component name clicked by the user is the target vehicle component.

[0166] In the present application, the query score of the vehicle part is determined according to the position of the vehicle part in the first image, and then the vehicle parts are sorted according to the query score. The higher the query score, the higher the possibility that the user needs to query the vehicle part. After the vehicle parts are sorted according to the query score, it is easier for the user to determine the vehicle part to be queried according to the name list, which provides convenience for the user.

[0167] In a possible implementation, in order to make the determined query score more accurate, the clarity of the image of the vehicle component may be increased when determining the query score.

[0168] like Figure 7 As shown, specifically, the implementation process of step S4031 may include:

[0169] S501, determining the clarity of each of the vehicle components according to the image of each of the vehicle components.

[0170] In this embodiment, after the image of each vehicle component is segmented, the clarity of the image of each vehicle component is obtained using an evaluation model.

[0171] The evaluation model may be a model determined based on the Tenengrad gradient method. The Tenengrad gradient method uses the Sobel operator to calculate the gradients in the horizontal and vertical directions respectively. The higher the gradient value, the clearer the image. The measurement index is the average gray value of the image processed by the Sobel operator. The larger the value, the clearer the image.

[0172] The evaluation model can also be a model determined based on the variance method. Since the grayscale difference between data of a clearly focused image is greater than that of a blurred image, the variance is used to measure the distribution of the grayscale value of the image. The larger the variance, the better the clarity of the image.

[0173] S502: Determine a query score of each of the vehicle components according to the location information of each of the vehicle components and the clarity of each of the vehicle components.

[0174] In this embodiment, for each vehicle component, the clarity interval of the clarity of the vehicle component is searched, and each clarity interval corresponds to a weight value, and the weight value of the clarity of the vehicle component is obtained. The clearer the image, the greater the weight value. The weight value corresponding to the position information of the vehicle component is searched, and specifically, the distance interval of the distance between the vehicle component and the midpoint of the first image is searched, and different distance intervals correspond to different weight values, and the weight value of the position information of the vehicle component is obtained. The weight value of the clarity of the vehicle component and the weight value of the position information are added to obtain the query score of the vehicle component.

[0175] In the present application, when calculating the query score of a vehicle part, not only the location information of the vehicle part is used, but also the clarity of the vehicle part is added. The clearer the image, the greater the possibility that the user wants to query the vehicle part. Therefore, referring to the clarity of the vehicle part when calculating the query score can make the query score more accurate.

[0176] In one possible implementation, if a user has recently searched for a vehicle part, the user is less likely to search for the vehicle part again. Based on this, in order to make the determined query score more accurate, the user's part query record in the historical time period may be added when determining the query score.

[0177] Specifically, the implementation process of step S4031 may include:

[0178] Acquire the component query records of the user in a historical time period; and determine the query score of each vehicle component according to the component query records and the location information of each vehicle component.

[0179] Specifically, the implementation process of step S502 may include:

[0180] S5021, obtaining the component query record of the user in a historical time period.

[0181] In this embodiment, the historical time period can be set as needed, for example, the historical time period can be one month or two months, etc. The parts query record records the names of vehicle parts that the user has queried within the time period.

[0182] S5022: Determine a query score for each of the vehicle components according to the component query record, the location information of each of the vehicle components, and the clarity of each of the vehicle components.

[0183] In this embodiment, the query record weight value of each vehicle component in the first image is determined based on the component query record. If a vehicle component has been queried in the historical time period, the query record weight value of the vehicle component is lower than the query record weight value of the vehicle component that has not been queried in the historical time period.

[0184] The weight value of the position information and the weight value of the clarity of each vehicle component are obtained.

[0185] The query score of the vehicle part is obtained according to the query record weight value, the location information weight value and the clarity weight value.

[0186] In the present application, when calculating the query score of a vehicle part, not only the location information of the vehicle part and the clarity of the vehicle part are used, but also the query situation of the part in the historical time period is considered. If the vehicle part has been queried in the historical time period, then the possibility of querying the vehicle part again is small. Therefore, referring to the query situation of the part in the historical time period when calculating the query score can make the query score obtained more accurate.

[0187] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0188] Corresponding to the vehicle information query method described in the above embodiment, Figure 8 A structural block diagram of a vehicle information query device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0189] Reference Figure 8 The device 600 may include: an image acquisition module 610, a name search module 620, an information search module 630, a history acquisition module 640, an information screening module 650 and an information display module 660.

[0190] The image acquisition module 610 is used to acquire a first image, wherein the first image includes a target vehicle component to be queried;

[0191] A name search module 620, configured to obtain a component name of the target vehicle component based on the image of the target vehicle component in the first image;

[0192] An information search module 630, for obtaining an augmented reality display introduction of display information of the target vehicle component based on the component name of the target vehicle component;

[0193] The historical record acquisition module 640 is used to acquire historical query records within a historical time period;

[0194] An information screening module 650, configured to determine target information to be displayed for this query from the display information based on the historical query records;

[0195] The information display module 660 is used to display the target information.

[0196] In a possible implementation, the information screening module 650 may be specifically used to:

[0197] Get the user's identity information at the current moment;

[0198] Based on the historical query records and the identity information of the user, target information to be displayed for this query is determined from the display information.

[0199] In a possible implementation, the information screening module 650 may be specifically used to:

[0200] Based on the historical query records, the identity information of the user and the component name, determining whether the user has a query record for the target vehicle component within the historical time period;

[0201] If it is determined that the user does not have a query record for the target vehicle component within the historical time period, all of the display information is determined as target information that needs to be displayed for this query.

[0202] In a possible implementation, the information screening module 650 may be specifically used to:

[0203] If it is determined that the user has a query record for the target vehicle component within the historical time period, obtaining the number of times the user has viewed each display information within the historical time period;

[0204] If the number of views of the first type of information in the display information is less than the preset number, the first type of information is determined as the target information to be displayed in this query.

[0205] In a possible implementation, the information screening module 650 may be specifically used to:

[0206] If the first category of information includes the second category of information and the third category of information, the second category of information is display information with a viewing count of 0, and the third category of information is display information with a viewing count not equal to 0, the second category of information is determined as the target information to be displayed for this query, and the text introduction information of the third category of information is displayed.

[0207] In a possible implementation, the name lookup module 620 may be specifically used to:

[0208] Recognize the first image, obtain an image of each vehicle component existing in the first image and position information of each vehicle component in the first image;

[0209] Based on the image of each of the vehicle components, obtaining a component name of each of the vehicle components;

[0210] When there are a plurality of the vehicle components in the first image, the target vehicle component and the component name of the target vehicle component among the vehicle components are obtained according to the position information of each of the vehicle components.

[0211] In a possible implementation, the name lookup module 620 may be specifically used to:

[0212] Determine a query score for each of the vehicle components according to the location information of each of the vehicle components, wherein the query score represents a predicted probability of a user querying the vehicle component;

[0213] sorting the vehicle parts in descending order of the query scores to obtain a name list, wherein the name list contains the names of the vehicle parts and the corresponding images;

[0214] displaying the name list, wherein the name list is used to prompt the user to select a target vehicle component from the name list;

[0215] After receiving a first operation acting on the name list, the target vehicle component and the component name of the target vehicle component in the vehicle components are obtained.

[0216] In a possible implementation, the name lookup module 620 may be specifically used to:

[0217] determining the definition of each of the vehicle components based on the image of each of the vehicle components;

[0218] A query score of each of the vehicle components is determined according to the location information of each of the vehicle components and the clarity of each of the vehicle components.

[0219] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0220] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0221] An embodiment of the present application also provides a vehicle, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements a method for querying vehicle information when executing the computer program.

[0222] The present application also provides a terminal device, see Fig. 9 The terminal device 700 may include: at least one processor 710, a memory 720, and a computer program stored in the memory 720 and executable on the at least one processor 710. When the processor 710 executes the computer program, the steps in any of the above-mentioned method embodiments are implemented, for example Figure 1 Steps S101 to S107 in the illustrated embodiment. Alternatively, when the processor 710 executes the computer program, the functions of each module / unit in the above-mentioned device embodiments are implemented, for example Figure 8 The functions of the image acquisition module 610 to the information display module 660 are shown.

[0223] Exemplarily, the computer program may be divided into one or more modules / units, one or more modules / units are stored in the memory 720, and executed by the processor 710 to complete the present application. The one or more modules / units may be a series of computer program segments capable of completing specific functions, and the program segments are used to describe the execution process of the computer program in the terminal device 700.

[0224] Those skilled in the art will understand that Fig. 9 It is only an example of a terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components, such as input and output devices, network access devices, buses, etc.

[0225] The processor 710 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0226] The memory 720 may be an internal storage unit of the terminal device, or an external storage device of the terminal device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. The memory 720 is used to store the computer program and other programs and data required by the terminal device. The memory 720 may also be used to temporarily store data that has been output or is to be output.

[0227] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0228] The vehicle information query method provided in the embodiment of the present application can be applied to terminal devices such as computers, tablet computers, laptops, netbooks, personal digital assistants (PDAs), etc. The embodiment of the present application does not impose any restrictions on the specific type of terminal devices.

[0229] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0230] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0231] In the embodiments provided in the present application, it should be understood that the disclosed terminal equipment, devices and methods can be implemented in other ways. For example, the terminal equipment embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0232] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0233] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0234] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by one or more processors, the steps of each of the above-mentioned method embodiments can be implemented.

[0235] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by one or more processors, the steps of each of the above-mentioned method embodiments can be implemented.

[0236] Similarly, as a computer program product, when the computer program product runs on a terminal device, the terminal device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0237] The computer program includes computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer readable media do not include electric carrier signals and telecommunication signals.

[0238] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A vehicle information query method, characterized in that: include: Acquire a first image, wherein the first image includes a target vehicle component to be queried; Based on the image of the target vehicle component in the first image, obtaining a component name of the target vehicle component; Based on the component name of the target vehicle component, obtaining an augmented reality display introduction of display information of the target vehicle component; Get historical query records within the historical time period; Based on the historical query records, determining target information to be displayed for this query from the display information; The target information is displayed.

2. The vehicle information query method according to claim 1, characterized in that: The method further comprises: Get the user's identity information at the current moment; The method further comprises: Based on the historical query records and the identity information of the user, target information to be displayed for this query is determined from the display information.

3. The vehicle information query method according to claim 2, characterized in that: The determining, based on the historical query record and the identity information of the user, target information to be displayed for the current query from the display information includes: Based on the historical query records, the identity information of the user and the component name, determining whether the user has a query record for the target vehicle component within the historical time period; If it is determined that the user does not have a query record for the target vehicle component within the historical time period, all of the display information is determined as target information that needs to be displayed for this query.

4. The vehicle information query method according to claim 3, characterized in that: After determining whether the user has a query record for the target vehicle component within the historical time period based on the historical query record, the user's identity information and the component name, the method further includes: If it is determined that the user has a query record for the target vehicle component within the historical time period, obtaining the number of times the user has viewed each display information within the historical time period; If the number of views of the first type of information in the display information is less than the preset number, the first type of information is determined as the target information to be displayed in this query.

5. The vehicle information query method according to claim 4, characterized in that: If the number of views of the first type of information in the display information is less than a preset number, the method further includes: If the first category of information includes the second category of information and the third category of information, the second category of information is display information with a viewing count of 0, and the third category of information is display information with a viewing count not equal to 0, the second category of information is determined as the target information to be displayed for this query, and the text introduction information of the third category of information is displayed.

6. The vehicle information query method according to any one of claims 1 to 4, characterized in that: The obtaining the component name of the target vehicle component based on the image of the target vehicle component in the first image includes: Recognize the first image, obtain an image of each vehicle component existing in the first image and position information of each vehicle component in the first image; Based on the image of each of the vehicle components, obtaining a component name of each of the vehicle components; When there are a plurality of the vehicle components in the first image, the target vehicle component and the component name of the target vehicle component among the vehicle components are obtained according to the position information of each of the vehicle components.

7. The vehicle information query method according to claim 6, characterized in that: According to the position information of each of the vehicle components, the target vehicle component and the component name of the target vehicle component in the vehicle components are obtained, including: Determine a query score for each of the vehicle components according to the location information of each of the vehicle components, wherein the query score represents a predicted probability of a user querying the vehicle component; sorting the vehicle parts in descending order of the query scores to obtain a name list, wherein the name list contains the names of the vehicle parts and the corresponding images; displaying the name list, wherein the name list is used to prompt the user to select a target vehicle component from the name list; After receiving a first operation acting on the name list, the target vehicle component and the component name of the target vehicle component in the vehicle components are obtained.

8. The vehicle information query method according to claim 7, characterized in that: The method further comprises: determining the definition of each of the vehicle components based on the image of each of the vehicle components; Accordingly, determining the query score of each vehicle component according to the location information of each vehicle component includes: A query score of each of the vehicle components is determined according to the location information of each of the vehicle components and the clarity of each of the vehicle components.

9. A vehicle information query device, characterized in that: include: An image acquisition module, used for acquiring a first image, wherein the first image includes a target vehicle component to be queried; a name search module, configured to obtain a component name of the target vehicle component based on an image of the target vehicle component in the first image; An information search module, used for obtaining an augmented reality display introduction of display information of the target vehicle component based on the component name of the target vehicle component; A historical record acquisition module is used to obtain historical query records within a historical time period; An information screening module, used to determine target information to be displayed for this query from the displayed information based on the historical query records; The information display module is used to display the target information.

10. A vehicle comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the vehicle information query method according to any one of claims 1 to 8 is implemented.

Citation Information

Cited By

  • System, method, and computer program product for retrieval-augmented generation-based product assistant

    US12645742B1