Interface display method and device, equipment, medium and product

Abstract

The invention discloses an interface display method and device, equipment, a medium and a product. The method comprises the following steps: in response to an information query instruction received in a navigation process of a first position, determining an instruction type of the information query instruction; determining an information display element on an information suspension layer above the vehicle-mounted information interface at least according to the instruction type; and displaying a display interface formed by the information display elements on the information suspension layer. The technical problem that information of a certain single point cannot be inquired and visually displayed on the basis of a navigation interface in the prior art is solved, so that information display elements are directly and visually displayed on an information suspension layer on a vehicle-mounted information interface, and the use experience of a user is effectively improved.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction technology, and in particular to an interface display method, apparatus, device, medium, and product. Background Technology

[0002] With the continuous development of human-computer interaction technology, the vehicle navigation system can be directly controlled through human-computer interaction technology during the vehicle navigation process, so that the vehicle navigation system can execute corresponding instructions.

[0003] In existing technologies, vehicle navigation systems only operate on a specific navigation route, meaning they help users enter a defined route but cannot query information about individual points or display it intuitively on the navigation interface, thus reducing the user experience. Summary of the Invention

[0004] This invention provides an interface display method, apparatus, device, medium, and product to solve the technical problem in the prior art that it is impossible to query information at a single point and display it intuitively on the basis of the navigation interface.

[0005] According to one aspect of the present invention, an interface display method is provided, comprising:

[0006] In response to receiving an information query instruction during navigation at the first location, the instruction type of the information query instruction is determined;

[0007] At least the information display elements on the information floating layer above the vehicle information interface are determined according to the instruction type;

[0008] The information floating layer displays a display interface composed of the information display elements.

[0009] According to another aspect of the present invention, an interface display device is provided, comprising:

[0010] The first determining module is used to determine the type of the information query instruction in response to receiving an information query instruction during navigation at the first location;

[0011] The second determining module is used to determine, at least according to the instruction type, the information display elements on the information floating layer above the vehicle information interface;

[0012] The interface display module is used to display a display interface composed of the information display elements on the information floating layer.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] At least one main controller;

[0015] A memory communicatively connected to the at least one main controller; and a central control display screen communicatively connected to the at least one main controller; wherein...

[0016] The central control display screen is used to display the vehicle information interface;

[0017] The memory stores a computer program that can be executed by the at least one main controller, which enables the at least one main controller to perform the interface display method described in any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a main controller to execute and implement the interface display method described in any embodiment of the present invention.

[0019] According to another aspect of the present invention, a computer program product is provided, the computer program product comprising a computer program that, when executed by a main controller, implements the interface display method described in any embodiment of the present invention.

[0020] The technical solution of this invention, during navigation at a first location, if an information query command is received, determines the information display elements on the information floating layer above the vehicle information interface based on the command type of the information query command, and displays a display interface composed of information display elements on the information floating layer. This solves the technical problem in the prior art that it is impossible to query information at a single point and display it intuitively on the navigation interface, thereby realizing the intuitive display of information display elements directly on an information floating layer above the vehicle information interface, effectively improving the user experience.

[0021] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 This is a flowchart of an interface display method provided in an embodiment of the present invention;

[0024] Figure 2 This is a schematic diagram showing the relative position between an in-vehicle information interface and an information floating layer, provided by an embodiment of the present invention.

[0025] Figure 3 This is a schematic diagram of the display interface corresponding to an information floating layer provided in an embodiment of the present invention;

[0026] Figure 4 This is a schematic diagram of the display interface corresponding to another information floating layer provided in an embodiment of the present invention;

[0027] Figure 5 This is a flowchart of another interface display method provided in an embodiment of the present invention;

[0028] Figure 6 This is a schematic diagram of the display interface corresponding to another information floating layer provided in the embodiments of the present invention;

[0029] Figure 7 This is a schematic diagram of the display interface corresponding to another information floating layer provided in the embodiment of the present invention;

[0030] Figure 8 This is a schematic diagram of the display interface corresponding to another information floating layer provided in the embodiment of the present invention;

[0031] Figure 9 This is a schematic diagram illustrating the triggering of a position holding command provided in an embodiment of the present invention;

[0032] Figure 10 This is a schematic diagram of the structure of an interface display device provided in an embodiment of the present invention;

[0033] Figure 11 This is a structural block diagram of a vehicle provided in an embodiment of the present invention. Detailed Implementation

[0034] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0035] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0036] In one embodiment, Figure 1 This is a flowchart of an interface display method provided by an embodiment of the present invention. This embodiment is applicable to situations where information is queried and displayed during vehicle navigation. The method can be executed by an interface display device, which can be implemented in hardware and / or software, and can be configured in the vehicle's in-vehicle system. Figure 1 As shown, the method includes:

[0037] S110, In response to receiving an information query instruction during navigation at the first location, determine the instruction type of the information query instruction.

[0038] In one example, the first location refers to the destination the vehicle is navigating to. It should be noted that the first location can be either the destination the vehicle is navigating to or a point along the route. For example, suppose the user sets the starting point as location 1, the waypoint as location 2, and the destination as location 3, and is navigating to location 2; then the first location is location 2. In one example, navigation to the first location can be performed using the vehicle's built-in embedded navigation system or the online navigation function of the in-vehicle system. This can be understood as displaying the navigation route to the first location on the vehicle's in-vehicle display screen.

[0039] In one example, an information query command refers to an operation command issued by a user to the vehicle's in-vehicle system to obtain specific information. Information query commands can be generated directly by the user through manual operation, that is, the user directly queries on the vehicle's in-vehicle display screen to generate the corresponding information query command; or they can be obtained by the user issuing a voice interaction command so that the vehicle's voice assistant can collect the information.

[0040] In one example, the instruction type refers to the category obtained by classifying information query instructions according to certain classification criteria. For example, instruction types can include: location query instructions and non-location query instructions. In one example, a location query instruction refers to an operation instruction that retrieves location-related information, such as "Which cities do I need to pass through on my way to my destination?"; a non-location query instruction refers to an operation instruction that retrieves information that is not related to location, such as "What are the traffic restrictions today?"

[0041] During navigation to the first location, if an information query instruction is received, the corresponding instruction type can be determined based on the keywords contained in the information query instruction. For example, if the information query instruction contains words that explicitly indicate the concept of location, or geographical words related to location, then the information query instruction may be a location query instruction; if the information query instruction does not contain words that explicitly indicate the concept of location, or geographical words related to location, then the information query instruction may be a non-location query instruction.

[0042] S120. Determine the information display elements on the information floating layer above the vehicle information interface, at least according to the instruction type.

[0043] In one example, an in-vehicle information interface refers to the interface displayed on any of the in-vehicle displays in a vehicle. Exemplarily, the in-vehicle information interface may include a main interface, an entertainment interface, and a navigation interface. For example, the entertainment interface may include, but is not limited to, an audio / video playback interface and an image browsing interface. Each vehicle's in-vehicle displays include at least a central control display; however, some vehicles may also include at least one of the following: a passenger-side display and a rear-seat display. The in-vehicle information interface can be displayed on at least one of the central control display, the passenger-side display, and the rear-seat display. In one example, the central control display may display the main interface, the entertainment interface, and the navigation interface, while the passenger-side display and the rear-seat display may or may not display the entertainment interface. This can be understood as the passenger-side display and the rear-seat display supporting or not supporting the display of the navigation interface.

[0044] In one example, the information overlay refers to a display layer that floats above the in-vehicle information interface and is independent of the content displayed on the in-vehicle information interface. This information overlay can partially or completely cover the content displayed on the in-vehicle information interface below it. Furthermore, the information overlay can be semi-transparent or have a certain degree of transparency, so that while displaying content on the information overlay, the user can also vaguely see the interface elements displayed on the in-vehicle information interface below, ensuring a good perception of the overall interface layout. For example, Figure 2This is a schematic diagram illustrating the relative position display between an in-vehicle information interface and an information floating layer, provided by an embodiment of the present invention. For example... Figure 2 As shown, the information floating layer 20 is located above the in-vehicle information interface 10, and partially covers the in-vehicle information interface 10. The information floating layer 20 also has a certain degree of transparency; for example, setting the transparency of the information floating layer 20 to 43% allows the content displayed on the in-vehicle information interface 10 (e.g., XX Road, XX Street, and XXX Street) to be faintly visible. Of course, the transparency of the information floating layer can also be 0, meaning the content displayed on the in-vehicle information interface cannot be seen through the information floating layer. In one example, the coverage area of ​​the information floating layer on the in-vehicle information interface can be dynamically adjusted, meaning the coverage area is proportional to the amount of content to be displayed on the information floating layer. This allows for a more intuitive display of the response information corresponding to the user's information query commands without affecting the primary navigation experience. Of course, in one example, the coverage area of ​​the information floating layer on the in-vehicle information interface is fixed to reduce the development cost of the display interface corresponding to the information floating layer.

[0045] In one example, information display elements refer to the components of the visual content displayed on the information overlay. These elements may include, but are not limited to, text elements, graphic elements, icon elements, and image elements. In one example, icon elements may include graphic elements; text elements may include text information, numbers, and symbols; graphic elements may include icons, lines, and shapes; and image elements may include static images and animated images. In one example, when the information query command is a location query command, the information display elements on the information overlay include at least text elements, icon elements, and image elements. For example, text elements may be the text response information corresponding to the information query command; icon elements may be key information in the text response information (e.g., service area icons, gas station icons, tollbooth icons), or other information of interest (e.g., icons for returning to the main interface, icons for viewing the map); and image elements may be location-displaying images for the location query command (e.g., navigation routes, navigation maps). In one example, when the information query command is a non-location query command, the information display elements on the information overlay include at least: text elements, for example, the text elements can be the text reply information returned by the non-location query command.

[0046] S130. Display the display interface composed of information display elements in the information floating layer.

[0047] In this embodiment, information display elements are displayed on the display interface corresponding to the information overlay. To facilitate intuitive display of the content on the information overlay, the transparency of the information overlay can be set to 0, meaning the content displayed on the in-vehicle information interface cannot be seen through the information overlay. For example, Figure 3 This is a schematic diagram of the display interface corresponding to an information floating layer provided in an embodiment of the present invention. For example... Figure 3 As shown, assuming the information query command is a location query command, and the location query command is: "Which gas stations are there to reach point A?", then the information display elements on the information floating layer can include: text elements, icon elements, and image elements; and the text elements can include text information, which can be: "On the way to point A, there are a gas stations along the way, namely a gas stations A, b gas stations B, and X gas stations are within the XX service area. The closest is gas station XX. Based on the vehicle's current fuel and battery status, it is recommended to refuel at gas station XX"; icon elements can include, but are not limited to, one of the following: gas station icon, sky The image elements can include gas station icons, toll station icons, route icons, traffic camera icons, charging station icons, and service area icons, etc.; each route to point A can include: routes 1 and 2, route 1 passing through highways 1 and 2, and route 2 passing through highways 3 and 4, as well as the distances between gas stations and the vehicle's current location on route 1, which are "16 km from the current location", "94 km from the current location", and "168 km from the current location"; and the distances between gas stations and the vehicle's current location on route 2, which are "50 km from the current location", "150 km from the current location", and "186 km from the current location".

[0048] For example, Figure 4 This is a schematic diagram of the display interface corresponding to another information floating layer provided in an embodiment of the present invention. For example... Figure 4 As shown, assuming the information query instruction is a non-location query instruction, and the non-location query instruction can be: "What is the traffic restriction number in area A today?", then the information display elements directly on the information floating layer can include: text elements; and the text elements can include text information, which can be: "The traffic restriction numbers in area A today are 3 and 8".

[0049] The technical solution of this embodiment, by receiving an information query command during navigation at the first location, determines the information display elements on the information floating layer above the vehicle information interface according to the command type of the information query command, and displays a display interface composed of information display elements on the information floating layer, solves the technical problem in the prior art that it is impossible to query information at a single point and display it intuitively on the navigation interface. Thus, it realizes the intuitive display of information display elements directly on an information floating layer above the vehicle information interface, effectively improving the user experience.

[0050] In one embodiment, Figure 5 This is a flowchart of another interface display method provided by an embodiment of the present invention. This embodiment, based on the above embodiments, further explains the process of determining the instruction type, the instruction source, the information display elements, and the process of determining image response content and text response information. Figure 5 As shown, the interface display method in this embodiment includes:

[0051] S210, In response to receiving an information query instruction during navigation at the first location, identify and extract the query text information carried in the information query instruction.

[0052] In one example, query text information refers to the text information carried in an information query instruction; generally, query text information can follow the expression form of natural language. This can be understood as an information query instruction also being a query instruction processed in natural language form, i.e., an unstructured query instruction. During navigation at the first location, if an information query instruction is received, and this instruction is processed in natural language form, lexical analysis can be performed, that is, the statement can be broken down into multiple words, and the parts-of-speech tags can be applied to the decomposed words to determine the part of speech of each word, i.e., noun, verb, and adjective, etc.; then syntactic analysis is performed to determine the relationship between each word, so that the query text information contained in the information query instruction can be extracted more accurately.

[0053] S220. Determine the instruction type of the information query instruction based on the location information contained in the query text information.

[0054] In one example, location information inclusion is used to characterize whether the query text information contains location-related information. Location information inclusion includes: containing location information and not containing location information. In this embodiment, determining the instruction type of an information query instruction by whether the query text information contains location information can quickly and easily determine the instruction type of the information query instruction, thus improving the speed of instruction type recognition for information query instructions.

[0055] In one embodiment, determining the instruction type of an information query instruction based on the location information contained in the query text information includes: if the query text information contains location information, then the instruction type of the information query instruction is determined to be a location query instruction; if the query text information does not contain location information, then the instruction type of the information query instruction is determined to be a non-location query instruction. In one example, if the query text information does not contain location information, then the query text information is directly determined to be non-location query text, and the instruction type of the information query instruction associated with the corresponding query text information is a non-location query instruction. In another example, if the query text information contains location information, semantic understanding can be performed on the query text information to determine whether a location query is needed. If a location query is determined to be needed, then the query text information is determined to be location query text, and the instruction type of the information query instruction associated with the corresponding query text information is a location query instruction. This ensures the accuracy of the instruction type identification for the information query instruction, thereby enabling an effective response to the query text information and significantly improving the user experience.

[0056] S230. Determine the source of the information query command.

[0057] In one example, the instruction source is used to characterize the specific location from which the information query instruction originates within the vehicle. In practice, the instruction source can be characterized using different dimensions. For example, it can be characterized by the location of different driving positions, such as the driver's seat, front passenger seat, and rear seat; it can also be characterized by different displays, such as the central control display, front passenger display, and rear seat display; or it can be characterized by different personnel roles, such as the driver, front passenger, and rear passenger. In this embodiment, by determining the instruction source of the information query instruction, and further, by determining the information display elements on the information overlay based on the instruction source, the required information display elements to be displayed on the information overlay can be effectively determined.

[0058] In one embodiment, determining the source of an information query instruction includes:

[0059] The source of an information query command can be determined based on at least one of the following: the signal strength distribution of the query command, the location of the voice acquisition device associated with the query command, the role of the person issuing the query command, and the location of the person issuing the query command. In one example, the signal strength distribution refers to the intensity variation of the query command at different locations and in different directions; that is, the source of the query command can be determined based on its signal strength distribution. Generally, multiple voice acquisition devices (e.g., microphones) can be configured in a vehicle, and these devices can be evenly distributed throughout the vehicle. Therefore, the source of the query command can be determined based on the location of the voice acquisition device that first acquires the query command. For example, if the voice acquisition device that most recently acquired the query command is located in the back seat, the source of the query command could be the back seat. In one example, personnel roles can be categorized according to driving responsibilities, such as driver and passenger. Drivers can include the front passenger and the front passenger. Correspondingly, in this embodiment, personnel roles can include the front passenger, the front passenger, and rear passengers. The role of the person issuing the information query command can be determined by detecting the facial expressions and mouth movements of each person in the vehicle using in-vehicle cameras, further determining the source of the information query command based on the personnel role. In another example, the location of the person issuing the information query command refers to their position within the vehicle. This location can include one of the following: the front passenger seat, the front passenger seat, or the rear passenger seat. The location of the person issuing the information query command can be determined by detecting the facial expressions and mouth movements of each person in the vehicle using in-vehicle cameras, further determining the source of the information query command based on the personnel location. In yet another example, the source of the information query command can be determined based on one or more of the following indicators: the signal strength distribution of the information query command, the location of the voice acquisition device associated with the information query command, the role of the person issuing the information query command, and the location of the person issuing the information query command, thereby improving the accuracy of command source identification.

[0060] S240. Determine the image response content and / or text response information on the information overlay above the vehicle information interface based on the instruction type and / or instruction source.

[0061] In one example, image response content refers to the response information in the form of an image to the query text information; text response information refers to the response information in the form of text to the query text information. For example, image response content refers to content consisting of at least one of image elements, icon elements, and graphic elements; text response information refers to content consisting of text elements. In one example, the image response content and / or text response information displayed on the information overlay above the vehicle information interface can be determined directly based on the instruction type. For instance, when the instruction type is a location query instruction, it can be determined that both image response content and text response information will be displayed on the information overlay above the vehicle information interface; when the instruction type is not a location query instruction, it can be determined that text response information will be displayed on the information overlay above the vehicle information interface.

[0062] In one example, the image response content and / or text response information on the information overlay above the vehicle information interface can be determined based on the instruction type and instruction source.

[0063] In one embodiment, determining the image response content and / or text response information on the information overlay above the vehicle information interface based on the instruction type and instruction source includes:

[0064] Determine the target vehicle display screen corresponding to the vehicle information interface associated with the information floating layer based on the source of the instruction.

[0065] If the instruction type is a location query instruction and the target vehicle display screen is not a rear screen, the image reply content and text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen shall be determined based on the category of the location query instruction.

[0066] If the instruction type is a location query instruction and the target vehicle display screen is a rear screen, determine the text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen based on the category of the location query instruction.

[0067] If the command type is a non-location query command, determine the text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen.

[0068] In one example, the target in-vehicle display screen refers to the display screen that shows information elements on a floating information layer in the vehicle. It should be noted that the target in-vehicle display screen is also related to the number of in-vehicle displays included in the vehicle. Generally, each vehicle includes at least one central control display screen. In one example, if a vehicle includes one central control display screen, the target in-vehicle display screen is the central control display screen; if a vehicle includes one central control display screen and a passenger-side display screen, the target in-vehicle display screen can be at least one of the central control display screen and the passenger-side display screen; if a vehicle includes one central control display screen, a passenger-side display screen, and at least one rear-seat display screen, the target in-vehicle display screen can be at least one of the central control display screen, the passenger-side display screen, and the rear-seat display screen. In one example, non-rear-seat screens can include: the central control display screen and / or the passenger-side display screen.

[0069] In one example, the source of an information query command can be determined based on at least one of the following: the signal strength distribution of the command, the location of the voice acquisition device associated with the command, the role of the person issuing the command, and the location of the person issuing the command. Then, based on the command source, the target in-vehicle display screen corresponding to the in-vehicle information interface associated with the information overlay is determined. If the target in-vehicle display screen is the central control screen and the command type is a location query command, then image and text responses are displayed on the information overlay above the in-vehicle information interface corresponding to the central control screen. Alternatively, image and text responses can also be displayed on the information overlay above the in-vehicle information interfaces corresponding to the passenger-side display and / or rear-seat display screens, allowing each person in the vehicle to view them intuitively for subsequent discussion and improving the user experience. If the target in-vehicle display screen is the passenger-side display screen and the command type is a location query command, then at least the information overlay above the in-vehicle information interface corresponding to the passenger-side display screen... The system displays both image and text responses. Alternatively, it can display the image and text responses on a floating information layer above the vehicle information interface corresponding to the central control display, and on a floating information layer above the vehicle information interface corresponding to the rear-seat display. This allows for easy viewing by all occupants, facilitating subsequent discussions and improving the user experience. If the target vehicle display is a rear-seat display and the command type is a location query command, the text response will be displayed at least on a floating information layer above the vehicle information interface corresponding to the rear-seat display. Alternatively, it can display both image and text responses on floating information layers above the vehicle information interfaces corresponding to the central control display and / or the passenger-side display. This allows for easy viewing by all occupants, facilitating subsequent discussions and improving the user experience. If the command type is not a location query command, the text response will be directly displayed on a floating information layer above the vehicle information interface corresponding to the target vehicle display associated with the command source. By determining the target in-vehicle display screen corresponding to the in-vehicle information interface associated with the information overlay based on the source of the command, it is possible to effectively determine whether the target in-vehicle display screen supports the display of a navigation interface. If it is determined that the target in-vehicle display screen does not support the display of a navigation interface, the text reply information to be displayed on the information overlay can be determined based on the command type and query text information. If it is determined that the target in-vehicle display screen supports the display of a navigation interface, the image reply content and text reply information to be displayed on the information overlay can be determined based on the command type and query text information. This effectively avoids the need to determine the image reply content when the target in-vehicle display screen does not support the display of a navigation interface, thereby greatly improving the reply speed of query text information and thus effectively improving the user's query experience.

[0070] S250. Determine the information display elements on the information floating layer above the vehicle information interface based on the image response content and / or text response information.

[0071] In one example, if the image reply includes a map, the information display elements on the corresponding information overlay will at least include the image elements corresponding to the map. If the map also includes icons such as service areas, gas stations, and charging stations, the information display elements will also include these icon elements. If the map also includes controls such as "View Map," the information display elements will also include graphic elements such as arrows. In another example, if the text reply includes text, the information display elements on the corresponding information overlay will at least include text elements. If the display interface corresponding to the text reply also includes controls such as "View Map," the information display elements will also include graphic elements such as arrows. By determining the target in-vehicle display screen corresponding to the in-vehicle information interface associated with the information overlay based on the source of the command, it is possible to effectively determine whether the target in-vehicle display screen supports the display of a navigation interface. If it is determined that the target in-vehicle display screen does not support the display of a navigation interface, the text reply information to be displayed on the information overlay can be determined based on the command type and query text information. If it is determined that the target in-vehicle display screen supports the display of a navigation interface, the image reply content and text reply information to be displayed on the information overlay can be determined based on the command type and query text information. Then, the information display elements on the information overlay above the in-vehicle information interface can be determined based on the image reply content and / or text reply information. This avoids the need to determine the information display elements corresponding to the image reply content when the target in-vehicle display screen does not support the display of a navigation interface, thus greatly improving the response speed of query text information and effectively improving the user's query experience.

[0072] It should be noted that, in order to more intuitively explain the information display elements on the information overlay, the following is used: Figure 6-8 Taking the example of a floating information layer with a transparency of 0, it means that the content displayed on the vehicle information interface cannot be viewed through the floating information layer.

[0073] In one example, Figure 6 This is a schematic diagram of the display interface corresponding to another information floating layer provided in an embodiment of the present invention. For example... Figure 6 As shown, this information overlay is a schematic diagram displayed on the central control screen. The information overlay includes the following display elements: text elements, graphic elements, and image elements; for example, text elements include the text information "XXXXX", graphic elements include an arrow to view the map, and image elements include a map image.

[0074] In one example, Figure 7This is a schematic diagram of the display interface corresponding to another information floating layer provided in an embodiment of the present invention. For example... Figure 7 As shown, this information overlay is a schematic diagram displayed on the passenger-side screen. The information overlay includes the following display elements: text elements, graphic elements, and image elements; for example, the text element includes the text message "XXXXX", the graphic element includes an arrow pointing to the central control screen for map viewing, and the image element includes a map image.

[0075] In one example, Figure 8 This is a schematic diagram of the display interface corresponding to another information floating layer provided in an embodiment of the present invention. For example... Figure 8 As shown, this information overlay is a schematic diagram displayed on the rear-seat display screen. The information overlay includes the following display elements: text elements and graphic elements; for example, the text element includes the text message "XXXXX", and the graphic element includes an arrow pointing to the central control display screen to view the map.

[0076] S260. Obtain a text response template and an image display template that match the instruction type and instruction source.

[0077] In one example, a text reply template refers to a pre-configured text frame that includes a specific structure, fixed content sections, and reserved variable text areas. This allows text replies to be constructed according to a defined format, improving efficiency and ensuring consistency and accuracy. Similarly, an image display template refers to a pre-configured image display frame that includes a specific structure, fixed image sections, and reserved variable image areas. This allows image display content to be constructed according to a defined format, improving efficiency and ensuring consistency and accuracy.

[0078] In this embodiment, a mapping relationship can be pre-created between each instruction type and a text reply template and an image display template, as well as a mapping relationship between each instruction source and a text reply template and an image display template. After determining the instruction type and source of the information query instruction, matching text reply templates and image display templates are found based on the mapping relationships between the instruction type and source and the text reply template and image display template, respectively.

[0079] In one example, the relative positions of the text reply and the image display on the information overlay can be fixed, for example, the text reply is above and the image display is below; or, the text reply is below and the image display is above.

[0080] S270. Based on text reply templates and image display templates, a display interface composed of information display elements is displayed in the information floating layer.

[0081] In this embodiment, a text reply corresponding to the query text information can be obtained according to a text reply template, and an image display content corresponding to the query text information can be obtained according to an image display template. Simultaneously, based on the relative positions between the text reply information and the image display content, text elements associated with the text reply information are displayed on the corresponding interface, and image elements associated with the image display content are displayed on the corresponding interface, thus obtaining the corresponding display interface.

[0082] By acquiring text reply templates and image display templates that match the command type and command source, and displaying a display interface composed of information display elements on the information overlay according to the text reply templates and image display templates, text reply information can be easily and quickly placed into the variable text area of ​​the text reply template; and / or image reply content can be easily and quickly placed into the variable image area of ​​the image display template, effectively improving the speed of displaying query text information on the information overlay.

[0083] In one embodiment, the interface display method further includes playing the text reply information using a voice broadcast method. Voice playback refers to converting the text reply information into speech and playing it. For example, a voice playback device (e.g., a speaker) in the vehicle can be used to play the text reply information. In actual operation, if the information query command originates from the driver's seat, i.e., the driver initiates the information query, a voice playback device can be used to play the text reply information to ensure vehicle safety. Of course, if the information query command originates from the passenger seat or rear seats, while the target in-vehicle display screen associated with the command source displays the text reply information, it also plays the text reply information using a voice broadcast method. This allows personnel in other locations to obtain the text reply information promptly without having to view the content displayed on the target in-vehicle display screen, improving the effectiveness of information querying and thus enhancing the user experience.

[0084] In one embodiment, if the instruction type is a location query instruction and the category of the location query instruction is a route query, the interface display method further includes: responding to the received location switching instruction by displaying the navigation route of the second location in the information query instruction on the vehicle information interface. In one example, the location switching instruction refers to an operation instruction to adjust the first location during navigation; it can also be understood as an operation instruction to the navigation system to go to the second location. The location switching instruction can be triggered by the user manually clicking the in-vehicle display screen or by the voice assistant in the vehicle. The second location refers to the target location to which navigation will be initiated. The first location and the second location are two different locations. Of course, before switching to the navigation route of the second location, one or more routes to the second location are displayed on the information floating layer. Furthermore, based on the user's historical navigation habits and / or the traffic conditions of different routes, the optimal route can be intelligently recommended to the user for route selection. This not only provides personalized services to users but also improves user travel efficiency and saves user travel time, greatly enhancing the user's travel experience. Furthermore, upon receiving a location switching command from the second location, the system automatically displays the optimal route from the information overlay or the route selected by the user on the in-vehicle information interface, allowing for a simple and quick route switching process.

[0085] In one example, the category of a location query instruction is used to characterize the scope of the location query. Exemplarily, the category of a location query instruction may include one of the following: a single-point query (e.g., a query for a specified location or current location); a single-point query along a route (e.g., a destination, waypoints, or service areas along a route); a route query (e.g., specifying two locations, traffic conditions to the destination, traffic conditions to waypoints, traffic conditions to service areas); a route query (e.g., cities along the route, number of waypoints, toll booths along the route, weather along the route, service areas along the route, gas / charging stations along the route, and road names along the route); and a region query (e.g., querying information about a nearby location, querying what locations of a specified type are within a specified region, querying cities, toll booths, service areas, or roads between two locations).

[0086] In one example, assuming the first location is location 2 and the second location is location 4, during navigation at location 2, if a user's instruction to switch to location 4 is received, the navigation route to location 4 will be automatically displayed on the in-vehicle information interface, thus completing the route switching process quickly and easily.

[0087] In one embodiment, if the instruction type is a location query instruction, and the category of the location query instruction is a route query, the method further includes: closing the display interface of the information floating layer in response to a location hold instruction. In one example, a location hold instruction refers to an operation instruction that does not adjust the first location during navigation; it can also be understood as an operation instruction to the navigation system not to proceed to the second location. The location hold instruction can be triggered by the user manually clicking the in-vehicle display screen or by the voice assistant in the vehicle. In this embodiment, during navigation to the first location, if a location query instruction to proceed to the second location is received, the navigation route to the second location is displayed on the display interface of the information floating layer; if a location hold instruction for the navigation route to the first location is received, the display interface of the information floating layer containing the navigation route to the second location is automatically closed, and the navigation route to the first location continues to be displayed on the in-vehicle information interface. This allows the user to more intuitively view the navigation route to the second location on the in-vehicle display screen without affecting the navigation route to the first location, enabling the user to confirm whether to proceed, effectively improving the user's travel experience.

[0088] In one embodiment, the location hold instruction includes at least one of the following: no route switching instruction is received within a preset time period; a route hold instruction is received; or a click instruction is received at a location on the vehicle information interface other than the information overlay.

[0089] In one example, the preset duration is used to characterize the threshold value for the display time of the navigation route to the second location on the information overlay. For example, the preset duration can be 30 seconds. If the navigation route to the second location has been displayed on the information overlay for 30 seconds and no navigation route to the second location has been received, or no other operation command has been received, the display interface of the information overlay will be automatically closed so that the navigation route to the first location can continue to be displayed on the vehicle information interface. This allows the display interface corresponding to the information overlay to be automatically closed based on user needs while effectively ensuring vehicle driving safety.

[0090] In one example, the route-keeping instruction refers to the user's instruction not to proceed to the second location. For example, the route-keeping instruction can be implemented using a voice assistant (e.g., the user gives a voice command such as "continue to the first location" or "do not proceed to the second location"), or it can be implemented manually by the user (e.g., the user directly closes the display interface of the information overlay). The display interface corresponding to the information overlay can be closed easily and quickly.

[0091] In one example, the display size of the information overlay is smaller than the size of the in-vehicle information interface. While displaying the navigation route to the second location on the information overlay's display screen, if the user manually clicks on a location outside the information overlay's display screen that is also on the in-vehicle information interface, the information overlay's display screen is immediately closed. For example, Figure 9 This is a schematic diagram illustrating the triggering of a position-holding command provided in an embodiment of the present invention. For example... Figure 9 As shown, assuming the first location is location 2 and the second location is location 4, when the navigation route to location 2 is displayed on the vehicle information interface 10, a location query command to location 4 is received. Then, the route to location 4, such as route 1 and route 2, is displayed on the information floating layer 20. If a click operation is received from another location on the vehicle information interface other than the information floating layer 20, the display interface of the information floating layer 20 is directly closed. This can achieve the effect of maintaining the navigation route of the first location on the vehicle information interface from multiple angles.

[0092] In one embodiment, Figure 10 This is a schematic diagram of the structure of an interface display device provided in an embodiment of the present invention. Figure 10 As shown, the device includes: a first determining module 310, a second determining module 320, and an interface display module 330.

[0093] The first determining module 310 is used to determine the type of the information query instruction in response to receiving an information query instruction during navigation at the first location.

[0094] The second determining module 320 is used to determine, at least according to the instruction type, the information display elements on the information floating layer above the vehicle information interface;

[0095] The interface display module 330 is used to display a display interface composed of information display elements on the information floating layer.

[0096] In one embodiment, determining the instruction type of the information query instruction is specifically used for:

[0097] Identify and extract the query text information carried in the information query command;

[0098] The type of information query instruction is determined based on the location information contained in the query text.

[0099] In one embodiment, the instruction type of the information query instruction is determined based on the location information contained in the query text information, specifically for:

[0100] If the query text information contains location information, then the instruction type of the information query instruction is determined to be a location query instruction;

[0101] If the queried text information does not contain location information, then the instruction type of the information query instruction is determined to be a non-location query instruction.

[0102] In one embodiment, the interface display device further includes:

[0103] The third determination module is used to determine the source of the information query command.

[0104] In one embodiment, the third determining module is specifically used for:

[0105] The source of the information query command is determined based on at least one of the following: the signal strength distribution of the information query command, the location of the voice acquisition device associated with the information query command, the role of the person issuing the information query command, and the location of the person issuing the information query command.

[0106] In one embodiment, the second determining module includes:

[0107] The first determining unit is used to determine the image response content and / or text response information on the information floating layer above the vehicle information interface according to the instruction type and / or instruction source.

[0108] The second determining unit is used to determine the information display elements on the information floating layer above the vehicle information interface based on the image response content and / or text response information.

[0109] In one embodiment, the first determining unit includes:

[0110] The first determining subunit is used to determine, based on the category of the location query instruction, the image reply content and text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen, if the instruction type is a location query instruction and the target vehicle display screen is not a rear screen;

[0111] The second determining subunit is used to determine, based on the category of the location query instruction, the text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen, if the instruction type is a location query instruction and the target vehicle display screen is a rear screen.

[0112] The third determining subunit is used to determine, if the instruction type is a non-location query instruction, the text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen.

[0113] In one embodiment, the interface display device further includes:

[0114] The playback module is used to play text reply messages via voice broadcast.

[0115] In one embodiment, the interface display module includes:

[0116] The acquisition unit is used to acquire text response templates and image display templates that match the instruction type and instruction source;

[0117] The display unit is used to display a display interface composed of information display elements on the information floating layer based on text reply templates and image display templates.

[0118] In one embodiment, if the instruction type is a location query instruction and the category of the location query instruction is a route query, the interface display device further includes:

[0119] The route display module is used to respond to the received location switching command and display the navigation route of the second location in the information query command on the vehicle information interface.

[0120] In one embodiment, if the instruction type is a location query instruction and the category of the location query instruction is a route query, the interface display device further includes:

[0121] The interface closing module is used to close the display interface of the information floating layer in response to the position holding command.

[0122] In one embodiment, the location hold instruction includes at least one of the following: no route switching instruction is received within a preset time period; a route hold instruction is received; or a click instruction is received at a location on the vehicle information interface other than the information overlay.

[0123] The interface display device provided in the embodiments of the present invention can execute the interface display method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0124] In one embodiment, Figure 11 This is a structural block diagram of a vehicle provided in an embodiment of the present invention, such as... Figure 11 The diagram illustrates a structural schematic of a vehicle 10 that can be used to implement embodiments of the present invention. The vehicle-mounted system is intended to represent various forms of digital computers, such as laptops, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0125] like Figure 11As shown, the electronic device 10 includes at least one main controller 11, a memory such as a read-only memory (ROM) 12 or a random access memory (RAM) 13 communicatively connected to the at least one main controller 11, and a central control display screen 21 communicatively connected to the at least one main controller 11. The memory stores computer programs executable by the at least one main controller. The main controller 11 can perform various appropriate actions and processes based on the computer programs stored in the read-only memory (ROM) 12 or loaded from storage unit 18 into the random access memory (RAM) 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The main controller 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14. The central control display screen 21 is used to display an in-vehicle information interface.

[0126] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0127] The main controller 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the main controller 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. The main controller 11 performs the various methods and processes described above, such as interface display methods.

[0128] In some embodiments, the interface display method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by main controller 11, one or more steps of the interface display method described above may be performed. Alternatively, in other embodiments, main controller 11 may be configured to execute the interface display method by any other suitable means (e.g., by means of firmware).

[0129] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0130] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0131] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0132] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0133] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0134] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0135] This application also provides a computer program product, including a computer program that, when executed by a main controller, can implement the interface display method provided in any embodiment of this application.

[0136] In the implementation of the computer program product, computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0137] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0138] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for displaying an interface, characterized in that, include: In response to receiving an information query instruction during navigation at the first location, the instruction type of the information query instruction is determined; At least the information display elements on the information floating layer above the vehicle information interface are determined according to the instruction type; The information floating layer displays a display interface composed of the information display elements.

2. The method according to claim 1, characterized in that, The determination of the instruction type for the information query instruction includes: Identify and extract the query text information carried in the information query instruction; The instruction type of the information query instruction is determined based on the location information contained in the query text information.

3. The method according to claim 2, characterized in that, The step of determining the instruction type of the information query instruction based on the location information contained in the query text information includes: If the query text information contains location information, then the instruction type of the information query instruction is determined to be a location query instruction; If the query text information does not contain location information, then the instruction type of the information query instruction is determined to be a non-location query instruction.

4. The method according to claim 1, characterized in that, The method further includes: Determine the source of the information query instruction.

5. The method according to claim 4, characterized in that, The determination of the source of the information query instruction includes: The source of the information query instruction is determined based on at least one of the following: the signal strength distribution of the information query instruction, the location of the voice acquisition device associated with the information query instruction, the role of the person issuing the information query instruction, and the location of the person issuing the information query instruction.

6. The method according to claim 4, characterized in that, At least the determination of the information display elements on the information floating layer above the vehicle information interface based on the instruction type includes: Determine the image response content and / or text response information on the information floating layer above the vehicle information interface based on the instruction type and / or the instruction source; The information display elements on the information floating layer above the vehicle information interface are determined based on the image response content and / or the text response information.

7. The method according to claim 6, characterized in that, The step of determining the image response content and / or text response information on the information floating layer above the vehicle information interface based on the instruction type and the instruction source includes: The target vehicle display screen corresponding to the vehicle information interface associated with the information floating layer is determined based on the source of the instruction. If the instruction type is a location query instruction and the target vehicle display screen is not a rear screen, the image reply content and text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen are determined based on the category of the location query instruction. If the instruction type is a location query instruction and the target vehicle display screen is a rear screen, determine the text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen based on the category of the location query instruction. If the instruction type is a non-location query instruction, determine the text reply information to be displayed on the information floating layer above the vehicle information interface corresponding to the target vehicle display screen.

8. The method according to claim 6, characterized in that, The method further includes: The text reply information is played back using voice broadcasting.

9. The method according to claim 1, characterized in that, The information floating layer displays a display interface composed of the information display elements, including: Obtain a text reply template and an image display template that match the instruction type and the instruction source; Based on the text reply template and the image display template, a display interface composed of the information display elements is displayed on the information floating layer.

10. The method according to any one of claims 1-9, characterized in that, If the instruction type is a location query instruction, and the category of the location query instruction is a route query, the method further includes: In response to the received location switching command, the navigation route for the second location in the information query command is displayed on the vehicle information interface.

11. The method according to any one of claims 1-9, characterized in that, If the instruction type is a location query instruction, and the category of the location query instruction is a route query, the method further includes: In response to the position hold command, the display interface of the information floating layer is turned off.

12. The method according to claim 11, characterized in that, The location hold instruction includes at least one of the following: no route switching instruction is received within a preset time period; a route hold instruction is received; or a click instruction is received at a location on the vehicle information interface other than the information floating layer.

13. An interface display device, characterized in that, include: The first determining module is used to determine the type of the information query instruction in response to receiving an information query instruction during navigation at the first location; The second determining module is used to determine, at least according to the instruction type, the information display elements on the information floating layer above the vehicle information interface; The interface display module is used to display a display interface composed of the information display elements on the information floating layer.

14. A vehicle, characterized in that, The vehicles include: At least one main controller; A memory communicatively connected to the at least one main controller; and a central control display screen communicatively connected to the at least one main controller; wherein... The central control display screen is used to display the vehicle information interface; The memory stores a computer program that can be executed by the at least one main controller, the computer program being executed by the at least one main controller to enable the at least one main controller to perform the interface display method according to any one of claims 1-12.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that are used to cause the main controller to execute the interface display method according to any one of claims 1-12.

16. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by the main controller, implements the interface display method according to any one of claims 1-12.

Images