Display control method, device and equipment and computer readable storage medium
The display control method integrates real scene and associated information to enhance HUD interaction, addressing the limitations of fixed content and improving user experience through enhanced interaction capabilities.
Patent Information
- Application Number
- CN202310651847.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-02
- Publication Date
- 2024-12-03
AI Technical Summary
Existing head-up displays (HUDs) provide limited interaction capabilities, failing to meet user needs in various functional scenarios, resulting in a poor user experience due to fixed and simple display content.
A display control method that fuses real scene information with associated information to generate integrated display content, allowing users to interact with the HUD by operating the fused display information, which includes adjusting viewing angles and displaying operation feedback content based on user interactions.
Enhances user interaction and experience by enriching HUD content and enabling immersive, interactive scenarios, improving the usability and satisfaction of HUD systems.
Smart Images

Figure CN119065621A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of display technology, and in particular to a display control method, device, equipment, and computer-readable storage medium. Background Art
[0002] With the development of intelligent driving technology, while meeting users' travel needs, users' driving experience has gradually received attention.
[0003] For example, a head-up display (HUD) can project important driving data onto the windshield to form a projected virtual image. The virtual image changes in real time as the driving data changes, allowing users to see real-time driving-related information without lowering their heads. As a result, HUD has gradually been widely used.
[0004] However, in the prior art, HUD is merely a display device similar to a display screen, and the content displayed by its projected virtual image is usually relatively simple and fixed, and cannot meet the user's interaction needs in many functional scenarios, resulting in a poor user experience. Summary of the invention
[0005] In order to solve the above technical problems, the present disclosure provides a display control method, device, equipment and computer-readable storage medium to meet the user's interaction needs.
[0006] In a first aspect, an embodiment of the present disclosure provides a display control method, including:
[0007] Controlling the operable display device to display fused display information, wherein the fused display information is obtained by superimposing real scene information around the vehicle and associated information corresponding to the real scene information;
[0008] In response to the user's operation on the fused display information, the head-up display device is controlled to display operation feedback content corresponding to the operation.
[0009] In some embodiments, before controlling the operable display device to display the fused display information, the method further includes:
[0010] Determining a target viewing angle of the fused display information displayed by the operable display device;
[0011] According to the target viewing angle, the associated information is adjusted to obtain the associated information under the target viewing angle;
[0012] The associated information under the target viewing angle is superimposed with the real scene information to obtain fused display information.
[0013] In some embodiments, in response to the user's operation on the fused display information, controlling the head-up display device to display operation feedback content corresponding to the operation includes:
[0014] In response to a first operation of a user on target-related information in the fused display information, determining at least one candidate information corresponding to the target-related information;
[0015] The head-up display device is controlled to display the at least one candidate information.
[0016] In some embodiments, the associated information includes POI information, and the step of controlling the head-up display device to display operation feedback content corresponding to the operation in response to the user's operation on the fused display information further includes:
[0017] In response to a second operation of the user on the POI information, generating a navigation route with the geographical location corresponding to the POI information as a terminal point according to the current location information of the vehicle and the geographical location corresponding to the POI information;
[0018] Control the head-up display device to display the navigation route.
[0019] In some embodiments, in response to the user's operation on the fused display information, controlling the head-up display device to display operation feedback content corresponding to the operation further includes:
[0020] In response to a third operation of the user on the target-related information in the fused display information, determining a preset application corresponding to the target-related information;
[0021] Control the head-up display device to display the interface of the preset application.
[0022] In some embodiments, after determining the preset application corresponding to the target association information, the method further includes:
[0023] Controlling the operable display device to display the interface of the preset application program;
[0024] In response to a fourth operation performed by the user on the interface of the preset application displayed by the operable display device, the head-up display device is controlled to display an operation feedback interface corresponding to the fourth operation.
[0025] In some embodiments, controlling the operable display device to display the interface of the preset application program includes:
[0026] Controlling the operable display device and the head-up display device to synchronously display the interface of the preset application; or,
[0027] The operable display device is controlled to display a brief interface corresponding to a preset application program interface displayed in the head-up display device, wherein the brief interface includes less information than the preset application program interface.
[0028] In some embodiments, the method further comprises:
[0029] In response to a user's display adjustment operation on the fused display information, adjusting display parameters of the fused display information to obtain adjusted fused display information, wherein the display parameters include at least one of the following: a display viewing angle of the fused display information, a rotation angle of the fused display information, and a display size of the fused display information;
[0030] The operable display device is controlled to display the adjusted fused display information.
[0031] In a second aspect, an embodiment of the present disclosure provides an interface interaction device, including:
[0032] A first control module, used to control the operable display device to display fused display information, wherein the fused display information is obtained by superimposing real scene information around the vehicle and associated information corresponding to the real scene information;
[0033] The second control module is used to control the head-up display device to display operation feedback content corresponding to the operation in response to the user's operation on the fused display information.
[0034] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:
[0035] Memory;
[0036] Processor; and
[0037] Computer programs;
[0038] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described in the first aspect.
[0039] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the method described in the first aspect.
[0040] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the display control method as described above is implemented.
[0041] The display control method, apparatus, device and computer-readable storage medium provided by the embodiments of the present disclosure fuse and overlay real scene information with associated information to obtain fused display information and display it on an operable display device, and further control the projection interface of the head-up display device according to the user's operation on the fused display information, so that the user can interact with the interface projected by the head-up display device by operating the fused display information, thereby meeting the user's interaction needs for the interface projected by the head-up display device in more scenarios, greatly enriching the display content of the head-up display device, and effectively improving the user's sense of experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0044] Figure 1 A flow chart of a display control method provided by an embodiment of the present disclosure;
[0045] Figure 2 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;
[0046] Figure 3 A schematic diagram of an interface display provided by another embodiment of the present disclosure;
[0047] Figure 4 A schematic diagram of an interface display provided by another embodiment of the present disclosure;
[0048] Figure 5 A flow chart of a display control method provided by another embodiment of the present disclosure;
[0049] Figure 6 A schematic diagram of the structure of a display control device provided in an embodiment of the present disclosure;
[0050] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0051] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0052] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0053] In the prior art, HUD only provides display functions and function controls related to its system (such as adjustment of display brightness, display height, etc.). However, in many functions or scenarios, users need to interact with the content projected by the HUD to obtain a better user experience.
[0054] In view of the above problems, an embodiment of the present disclosure provides a display control method, which is introduced below in conjunction with a specific embodiment.
[0055] Figure 1 A flow chart of a display control method provided by an embodiment of the present disclosure. The method can be applied to Figure 2 The application scenario shown includes an operable display device 21, a head-up display device 22, and a vehicle computer 23, wherein the operable display device 21 is communicatively connected to the vehicle computer 23 (i.e., the vehicle computer system), the head-up display device 22 is communicatively connected to the vehicle computer 23, and the vehicle computer 23 is used to receive operation information input by the user through the operable display device 21, and control the display information of the operable display device 21 and / or the head-up display device 22. It can be understood that the display control method provided in the embodiment of the present disclosure can also be applied in other scenarios.
[0056] Combine the following Figure 2 The application scenario shown is Figure 1 The display control method shown in the figure is introduced, and the specific steps of the method are as follows:
[0057] S101. Control an operable display device to display fused display information, wherein the fused display information is obtained by superimposing real scene information around a vehicle and associated information corresponding to the real scene information.
[0058] The operable display device can be any interactive device with a display screen, such as a touch screen on a vehicle computer, a central control screen, a vehicle-mounted LCD screen, a smart phone, a PDA, a tablet computer, etc. The operable display device is used to display integrated display information.
[0059] The real-scene information around the vehicle, i.e., the real-time environmental image around the vehicle, can be obtained through the image acquisition device carried by the vehicle. In some embodiments, multiple Advanced Driving Assistance System (ADAS) cameras can be used to collect environmental images at various angles around the vehicle in real time during the driving process of the vehicle, and the environmental images at various angles can be spliced to obtain the real-scene information around the vehicle. Specifically, while the vehicle computer acquires the image captured by any image acquisition device, it can also identify which image acquisition device provides the image. According to the installation location information of the image acquisition device and the calibration information of the image acquisition device itself, the vehicle computer splices the environmental images at various angles around the vehicle provided by multiple image acquisition devices to obtain the real-scene information around the vehicle.
[0060] Optionally, the vehicle-computer system can obtain the environmental image in front of the vehicle captured in real time by a certain image acquisition device, use the environmental image in front of the vehicle as the real-scene information around the vehicle, and superimpose the environmental image in front of the vehicle and the associated information corresponding to objects in the front environment (such as buildings, roads and other places, obstacles such as leading vehicles and pedestrians) to obtain fused display information, and control the operable display device to display the fused display information.
[0061] In some embodiments, part or all of the associated information is also displayed through a head-up display device, that is, the virtual image projected by the head-up display device displays the associated information superimposed with the real scene information around the vehicle. For example, the virtual image displays the associated information superimposed with the real scene information in front of the vehicle (including the left front, the front front, and the right front).
[0062] The associated information corresponding to the real scene information includes real scene fitting information, that is, information that can be fused with objects in the real scene information for augmented reality when displayed, such as POI (point of interest) information, advertising push information, navigation information (such as navigation routes superimposed on roads, intersections, etc., driving indicators (such as driving indicators for indicating straight, turning and U-turn, which are superimposed on roads and intersections respectively)), etc. The associated information is superimposed on the corresponding real scene information, so that the fused display information obtained after superposition has an augmented reality effect, and the above fused display information is displayed on an operable display device.
[0063] For example, if a certain place is included in the real-scene information, the corresponding associated information may be the POI information of the place, including the place name, place type, push advertisements associated with the place, product sales links, contact information, evaluations, and the like.
[0064] S102: In response to a user's operation on the fused display information, control a head-up display device to display operation feedback content corresponding to the operation.
[0065] Since the above-mentioned fused display information is displayed on the operable display device, the user can operate the fused display information by interacting with the operable display device.
[0066] In some embodiments, the operable display device includes a touch screen displaying the above-mentioned fused display information, and the user can directly operate the touch screen to operate the fused display information; in other embodiments, the operable display device includes a display screen displaying the above-mentioned fused display information and an input device, and the user can operate the input device to operate the fused display information finally displayed on the display screen, wherein the input device can be a gesture input device, a voice input device, etc., which is not limited to the embodiments of the present disclosure.
[0067] The user's operation may be clicking, long pressing, dragging, sliding, or other operations on any one or more points in the screen displayed by the operable display device, and different operation feedback content may be obtained according to different user operations.
[0068] Head-up display (HUD), also known as "head-up display". HUD can project the information that needs to be displayed at the moment, such as the above-mentioned related information, operation feedback content, or driving information, such as vehicle speed, speed, endurance, tire pressure, etc., as well as interactive information such as navigation and multimedia, in front of the vehicle windshield. Specifically, HUD projects a virtual image in front of the front windshield and displays this information on the virtual image.
[0069] In the embodiment of the present disclosure, the HUD is used to display operation feedback content corresponding to the user operation in the projected virtual image.
[0070] In some embodiments, the operable display device first displays the fused display information before the user's operation. After the user operates the fused display information displayed on the operable display device, the vehicle computer determines the operation feedback content corresponding to the user operation, and controls the HUD to display the operation feedback content corresponding to the user operation in the projected virtual image.
[0071] The disclosed embodiment obtains fused display information by fusing and superimposing real scene information with associated information and displays it on an operable display device, and further controls the projection interface of the head-up display device (i.e., the virtual image mentioned above) according to the user's operation on the fused display information, so that the user can interact with the interface projected by the head-up display device by operating the fused display information, thereby meeting the user's interaction needs with the interface projected by the head-up display device in more scenarios, greatly enriching the display content of the head-up display device, and effectively improving the user's sense of experience.
[0072] In addition, since the embodiment of the present disclosure fuses and superimposes the real scene information with the associated information to obtain the fused display information, the user's interactive experience is further enhanced compared to pure real scene information.
[0073] On the basis of the above embodiment, before controlling the operable display device to display the fused display information, the method also includes: determining a target viewing angle of the fused display information displayed by the operable display device; adjusting the associated information according to the target viewing angle to obtain the associated information under the target viewing angle; and superimposing the associated information under the target viewing angle with the real scene information to obtain the fused display information.
[0074] The fused display information displayed by the operable display device may be fused display information of any viewing angle, such as the vehicle front viewing angle, the vehicle top overlooking viewing angle, the vehicle rear viewing angle, the vehicle left viewing angle, the vehicle right viewing angle, perspective viewing angle, etc. The user may set or adjust the target viewing angle of the fused display information displayed by the operable display device.
[0075] After determining the target viewing angle of the fused display information displayed by the operable display device, the vehicle computer adjusts the associated information so that the associated information can be displayed at the target viewing angle, that is, the associated information at the target viewing angle is obtained. Further, the vehicle computer superimposes the associated information at the target viewing angle with the real scene information to obtain the fused display information at the target viewing angle.
[0076] In some embodiments, if the user adjusts the target viewing angle of the fused display information displayed by the operating display device, the vehicle computer simultaneously switches the real scene information according to the target viewing angle, obtains the real scene information under the target viewing angle, and superimposes the associated information under the target viewing angle with the real scene information under the target viewing angle to obtain the fused display information under the target viewing angle. For example, when the user's operation is to switch the target viewing angle from the front viewing angle of the vehicle to the top overlooking viewing angle of the vehicle, the vehicle computer system obtains the real scene information corresponding to the top overlooking viewing angle of the vehicle, and superimposes the corresponding associated information on the real scene information to obtain the fused display information and display it on the operable display device. Alternatively, referring to the above embodiment, while the vehicle computer obtains the image captured by any image acquisition device, it can also identify which image acquisition device provides the image, and further directly obtains and uses the real scene information under the target viewing angle captured by the image acquisition device that performs image acquisition from the target viewing angle, that is, the target viewing angle of the fused display information displayed by the operable display device is the shooting viewing angle corresponding to the real scene information in the fused display information.
[0077] In some embodiments, when the target perspective is a perspective perspective, the associated information is consistent with the perspective angle of the real-scene information. For example, when the target perspective is a perspective perspective with a perspective relationship from the driving seat to the front of the vehicle, the associated information superimposed on the real-scene picture is also displayed in a perspective perspective. Therefore, when the fused display information is displayed, the user can view the associated information displayed in the perspective perspective in the fused display information.
[0078] The disclosed embodiment superimposes the related information on the real scene information from a target perspective, which, on the one hand, makes the display effect of the integrated display information better and meets the user's expectations; on the other hand, it enables the user to have a more immersive interactive experience, further improving the user's interactive experience.
[0079] Figure 3 A schematic diagram of an interface display provided for another embodiment of the present disclosure. In some embodiments, in response to a user's operation on the fused display information, controlling the head-up display device to display operation feedback content corresponding to the operation includes: in response to a user's first operation on target-related information in the fused display information, determining at least one candidate information corresponding to the target-related information; and controlling the head-up display device to display the at least one candidate information.
[0080] The target related information in the fused display information refers to the related information in the fused display information that meets the user's intention, that is, the related information that the user is about to select. Figure 3 As shown, the side frame 31 of the operable display device contains target association information, which is displayed as a restaurant icon, indicating that the target association information corresponds to a restaurant in the actual environment.
[0081] The user can initiate a first operation on the target-related information, and the first operation is used to view the detailed information of the target-related information, such as clicking, double-clicking, etc., which is not limited in the present embodiment. In response to the user's first operation, the vehicle computer queries at least one candidate information corresponding to the target-related information, and the at least one candidate information is detailed information related to the target-related information. For example, when the target-related information is displayed as a restaurant icon, the candidate information can be the restaurant's location, contact information, dish information, word-of-mouth reviews, etc. Figure 3 As shown, when the user performs a first operation on the target associated information in the box 31, a plurality of candidate information as shown in the box 32 will be displayed in the virtual image projected by the HUD.
[0082] In some embodiments, after the user performs a first operation on the target-related information in the fused display information displayed in the operable display device, at least one candidate information corresponding to the target-related information will be displayed in the virtual image projected by the HUD, and the operable display device will also synchronously update the display screen to display at least one candidate information based on the original fused display information; or directly display at least one candidate information corresponding to the target-related information for the user to perform the next operation.
[0083] The disclosed embodiment displays at least one piece of candidate information corresponding to the target association information in a virtual image projected by the HUD in response to the user's first operation on the target association information, so that the user can understand the detailed information of the target association information from all directions and angles.
[0084] Figure 4 A schematic diagram of an interface display is provided for another embodiment of the present disclosure. In some embodiments, the associated information includes POI information, and the response to the user's operation on the fused display information, controlling the head-up display device to display the operation feedback content corresponding to the operation, further includes: in response to the user's second operation on the POI information, generating a navigation route with the geographical location corresponding to the POI information as the end point according to the vehicle's current location information and the geographical location corresponding to the POI information; and controlling the head-up display device to display the navigation route.
[0085] POI can be any non-geographically meaningful point on the map, such as a store, bar, gas station, hospital, bus station, etc. POI information refers to the relevant information corresponding to POI in the associated information, such as the display icon, logo text and detailed information of the POI.
[0086] The user can initiate a second operation on the POI information, and the second operation is used to select navigation to the location in the actual environment corresponding to the POI information. For example, the user clicks on the POI information displayed in the operable display device and continues to select the navigation function; or the user clicks on the POI information displayed in the operable display device and initiates a voice command to navigate to the location, etc., which is not limited in the embodiments of the present disclosure.
[0087] The current location information of the vehicle can be obtained by positioning using a global positioning system (GPS) or other positioning systems. Based on the current location information of the vehicle and the geographical location corresponding to the POI information, the vehicle computer can generate at least one navigation route from the current location of the vehicle to the geographical location corresponding to the POI information.
[0088] For example, Figure 4 As shown, the operable display device side box 41 contains POI information. The user first clicks on the POI information in the box 41, and then selects the navigation function in the function menu. The vehicle computer automatically generates at least one navigation route from the vehicle's current location to the geographical location corresponding to the POI information and displays it in the virtual image projected by the HUD.
[0089] Optionally, when the vehicle computer plans multiple navigation routes, the operable display device can be controlled to display multiple navigation routes for the user to select, and the navigation route finally selected by the user is displayed in the virtual image projected by the HUD. It is understandable that the process of the user selecting multiple navigation routes can also be synchronously presented in the virtual image projected by the HUD, and the embodiments of the present disclosure are not limited to this.
[0090] The disclosed embodiment automatically plans and displays a navigation route with the geographical location corresponding to the POI information as the end point in response to the user's second operation on the POI information, and displays it in the virtual image projected by the HUD, thereby facilitating the user's itinerary planning and effectively improving the user's driving experience.
[0091] Figure 5 FIG. 1 is a flow chart of a display control method provided by another embodiment of the present disclosure. Figure 5 As shown, the method includes the following steps:
[0092] S501. Control an operable display device to display fused display information, wherein the fused display information is obtained by superimposing real scene information around a vehicle and associated information corresponding to the real scene information.
[0093] Specifically, the implementation process and principle of S501 and S101 are the same, and will not be repeated here.
[0094] S502: In response to a third operation of the user on the target-related information in the fused display information, determine a preset application corresponding to the target-related information.
[0095] The third operation may be that the user clicks on the target-related information, which will launch the corresponding preset application.
[0096] The target-related information includes product recommendation information (such as product advertisements), and the corresponding preset application program may be a shopping application program, or multimedia information, corresponding entertainment application program, and the like.
[0097] S503: Control the head-up display device to display the interface of the preset application.
[0098] After determining the preset application corresponding to the target association information, the interface of the preset application is displayed in the virtual image projected by the HUD.
[0099] Optionally, the dynamic interface of the preset application from being called up to being opened can be displayed in the virtual image projected by the HUD; or, the interface after the preset application is opened can be directly displayed in the virtual image projected by the HUD, etc., which is not limited to the embodiments of the present disclosure.
[0100] S504: Control the operable display device to display the interface of the preset application.
[0101] After determining the preset application corresponding to the target association information, the interface of the preset application is displayed on the operable display device.
[0102] Optionally, a dynamic interface of a preset application from being called up to being opened may be displayed in the operable display device; or, an interface after the preset application is opened may be directly displayed in the operable display device, etc., which is not limited in the embodiments of the present disclosure.
[0103] It is understandable that the embodiment of the present disclosure does not limit the execution order of S503 and S504. S503 may be executed first, and then S504; or S504 may be executed first, and then S503; or S503 and S504 may be executed simultaneously. Figure 5 For the sake of convenience, it is only taken as an example that S503 is executed first and then S504 is executed, which should not be regarded as a limitation of the embodiments of the present disclosure.
[0104] Specifically, the operable display device is controlled to synchronously display the interface of the preset application with the head-up display device; or, the operable display device is controlled to display a brief interface corresponding to the preset application interface displayed in the head-up display device, and the information contained in the brief interface is less than the information contained in the preset application interface.
[0105] When both the operable display device and the HUD device display the interface of a preset application, the interfaces displayed by the two may be the same or different.
[0106] When the interface displayed by the operable display device is different from that displayed by the HUD device, the HUD device can display a brief interface corresponding to the preset application interface. The brief interface includes some more important information in the preset application interface and omits some other information to reduce obstruction of the vehicle's front field of view.
[0107] Optionally, the information contained in each preset application interface is sorted from high to low in terms of importance. When the HUD device is required to display a brief interface corresponding to the preset application interface, some of the more important information is selected for display, and other less important information is omitted.
[0108] S505: In response to a fourth operation of the user on the interface of the preset application displayed by the operable display device, control the head-up display device to display an operation feedback interface corresponding to the fourth operation.
[0109] Furthermore, after the interface of the preset application is displayed on the operable display device, the user can perform a fourth operation on any information in the interface of the preset application, including but not limited to at least one of selection, confirmation, return, and the like.
[0110] In response to the fourth operation of the user, the operation feedback interface corresponding to the fourth operation is displayed in the virtual image projected by the HUD device. For example, in response to the fourth operation of the user on the purchase button in the interface of the preset application, the order payment result interface is displayed in the virtual image projected by the HUD device; or, in response to the fourth operation of the user on the view evaluation button in the interface of the preset application, the evaluation information details are displayed in the virtual image projected by the HUD device; or, in response to the fourth operation of the user on the video play button in the interface of the preset application, the video screen is displayed in the virtual image projected by the HUD device.
[0111] The disclosed embodiment controls the HUD device to display an application program interface corresponding to the third operation in response to the user's third operation on the fused display information, and further controls the HUD device to display an operation feedback interface corresponding to the fourth operation based on the user's fourth operation on the application program interface, thereby enabling interaction between the user and the application, better meeting the user's usage needs in multiple scenarios, and improving the user experience and satisfaction.
[0112] On the basis of any of the above embodiments, the display control method further includes: in response to a user's display adjustment operation on the fused display information, adjusting display parameters of the fused display information to obtain adjusted fused display information, wherein the display parameters include at least one of the following: a display viewing angle of the fused display information, a rotation angle of the fused display information, and a display size of the fused display information; and controlling the operable display device to display the adjusted fused display information.
[0113] Under normal circumstances, the fused display information is presented to the user at the target viewing angle. However, the display parameters of the fused display information are not fixed, but can be adjusted and updated according to the user's display adjustment operation. The user's display adjustment operation includes but is not limited to: selecting, confirming, returning, dragging, pinching, rotating, etc. of the fused display information.
[0114] Specifically, the display parameters of the fused display information include at least one of the following: a display viewing angle of the fused display information, a rotation angle of the fused display information, and a display size of the fused display information.
[0115] The display perspective of the fusion display information includes at least one of the following: the front perspective of the vehicle, the left perspective of the vehicle, the right perspective of the vehicle, the rear perspective of the vehicle, the perspective perspective, and the top perspective of the vehicle. The user can switch the display perspective of the fusion display information at will to view the real scene information under the corresponding perspective and the corresponding superimposed related information.
[0116] The rotation angle of the fused display information may be any angle, and the user's display adjustment operation may also change the rotation angle of the current fused display information to any angle.
[0117] The display size of the fused display information may be of any scale, and the user's display adjustment operation may also scale the display size of the current fused display information to any scale.
[0118] The disclosed embodiment provides a method for users to adjust display parameters of fused display information, so that the fused display information in the virtual image projected by the HUD device can be displayed in the display method desired by the user, thereby improving the flexibility of the display control method and further optimizing the user experience.
[0119] Figure 6 The structure diagram of the display control device provided in the embodiment of the present disclosure. The display control device may be the vehicle computer as described in the above embodiment, or the display control device may be a component or assembly in the vehicle computer. The display control device provided in the embodiment of the present disclosure may execute the processing flow provided in the display control method embodiment, such as Figure 6As shown, the display control device 60 includes: a first control module 61 and a second control module 62; the first control module 61 is used to control the operable display device to display fused display information, wherein the fused display information is obtained by superimposing the real-scene information around the vehicle and the associated information corresponding to the real-scene information; the second control module 62 is used to respond to the user's operation on the fused display information, and control the head-up display device to display the operation feedback content corresponding to the operation.
[0120] In some embodiments, the display control device 60 also includes a determination module 63, a first adjustment module 64, and an overlay module 65; the determination module 63 is used to determine the target viewing angle of the fused display information displayed by the operable display device; the first adjustment module 64 is used to adjust the associated information according to the target viewing angle to obtain the associated information under the target viewing angle; the overlay module 65 is used to overlay the associated information under the target viewing angle with the real scene information to obtain the fused display information.
[0121] In some embodiments, the second control module 62 includes a first determination unit 621 and a control unit 622; the first determination unit 621 is used to determine at least one candidate information corresponding to the target association information in response to a user's first operation on the target association information in the fused display information; the control unit 622 is used to control the head-up display device to display the at least one candidate information.
[0122] In some embodiments, the associated information includes POI information, and the second control module 62 includes a generation unit 623; the generation unit 623 is used to respond to the user's second operation on the POI information, and generate a navigation route with the geographical location corresponding to the POI information as the end point according to the vehicle's current position information and the geographical location corresponding to the POI information; the control unit 622 is used to control the head-up display device to display the navigation route.
[0123] In some embodiments, the second control module 62 includes a second determination unit 624; the second determination unit 624 is used to determine a preset application corresponding to the target association information in response to a third operation of the user on the target association information in the fused display information; the control unit 622 is used to control the head-up display device to display the interface of the preset application.
[0124] In some embodiments, the control unit 622 is also used to control the operable display device to display the interface of the preset application; in response to a fourth operation of the user on the interface of the preset application displayed by the operable display device, control the head-up display device to display an operation feedback interface corresponding to the fourth operation.
[0125] In some embodiments, the control unit 622 is specifically used to control the operable display device and the head-up display device to synchronously display the interface of the preset application; or, to control the operable display device to display a brief interface corresponding to the preset application interface displayed in the head-up display device, and the information contained in the brief interface is less than the information contained in the preset application interface.
[0126] In some embodiments, the display control device 60 also includes a second adjustment module 66, which is used to adjust the display parameters of the fused display information in response to the user's display adjustment operation on the fused display information to obtain the adjusted fused display information, wherein the display parameters include at least one of the following: the display viewing angle of the fused display information, the rotation angle of the fused display information, and the display size of the fused display information; the first control module 61 is also used to control the operable display device to display the adjusted fused display information.
[0127] Figure 6 The display control device of the illustrated embodiment can be used to execute the technical solution of the above-mentioned method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.
[0128] Figure 7 The electronic device provided in the embodiment of the present disclosure can execute the processing flow provided in the display control method embodiment, such as Figure 7 As shown, the electronic device 70 includes: a memory 71, a processor 72, a computer program and a communication interface 73; wherein the computer program is stored in the memory 71 and is configured so that the processor 72 executes the display control method as described above.
[0129] In addition, an embodiment of the present disclosure further provides a computer-readable storage medium on which a computer program is stored. The computer program is executed by a processor to implement the display control method described in the above embodiment.
[0130] In addition, an embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the display control method as described above is implemented.
[0131] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0132] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0133] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0134] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:
[0135] Controlling the operable display device to display fused display information, wherein the fused display information is obtained by superimposing real scene information around the vehicle and associated information corresponding to the real scene information;
[0136] In response to the user's operation on the fused display information, the head-up display device is controlled to display operation feedback content corresponding to the operation.
[0137] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0138] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0139] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.
[0140] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0141] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0142] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0143] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A display control method, characterized in that: The method comprises: Controlling the operable display device to display fused display information, wherein the fused display information is obtained by superimposing real scene information around the vehicle and associated information corresponding to the real scene information; In response to the user's operation on the fused display information, the head-up display device is controlled to display operation feedback content corresponding to the operation.
2. The method according to claim 1, characterized in that Before controlling the operable display device to display the fused display information, the method further includes: Determining a target viewing angle of the fused display information displayed by the operable display device; According to the target viewing angle, the associated information is adjusted to obtain the associated information under the target viewing angle; The associated information under the target viewing angle is superimposed with the real scene information to obtain fused display information.
3. The method according to claim 1, characterized in that In response to the user's operation on the fused display information, controlling the head-up display device to display operation feedback content corresponding to the operation includes: In response to a first operation of a user on target-related information in the fused display information, determining at least one candidate information corresponding to the target-related information; The head-up display device is controlled to display the at least one candidate information.
4. The method according to claim 1, characterized in that The associated information includes POI information, and the control of the head-up display device to display operation feedback content corresponding to the operation in response to the user's operation on the fused display information also includes: In response to a second operation of the user on the POI information, generating a navigation route with the geographical location corresponding to the POI information as a terminal point according to the current location information of the vehicle and the geographical location corresponding to the POI information; Control the head-up display device to display the navigation route.
5. The method according to claim 1, characterized in that In response to the user's operation on the fused display information, controlling the head-up display device to display operation feedback content corresponding to the operation also includes: In response to a third operation of the user on the target-related information in the fused display information, determining a preset application corresponding to the target-related information; Control the head-up display device to display the interface of the preset application.
6. The method according to claim 5, characterized in that After determining the preset application corresponding to the target association information, the method further includes: Controlling the operable display device to display the interface of the preset application program; In response to a fourth operation performed by the user on the interface of the preset application displayed by the operable display device, the head-up display device is controlled to display an operation feedback interface corresponding to the fourth operation.
7. The method according to claim 6, characterized in that The controlling the operable display device to display the interface of the preset application program includes: Controlling the operable display device and the head-up display device to synchronously display the interface of the preset application; or, The operable display device is controlled to display a brief interface corresponding to a preset application program interface displayed in the head-up display device, wherein the brief interface includes less information than the preset application program interface.
8. The method according to claim 1, characterized in that The method further comprises: In response to a user's display adjustment operation on the fused display information, adjusting display parameters of the fused display information to obtain adjusted fused display information, wherein the display parameters include at least one of the following: a display viewing angle of the fused display information, a rotation angle of the fused display information, and a display size of the fused display information; The operable display device is controlled to display the adjusted fused display information.
9. A display control device, characterized in that: include: A first control module, used to control the operable display device to display fused display information, wherein the fused display information is obtained by superimposing real scene information around the vehicle and associated information corresponding to the real scene information; The second control module is used to control the head-up display device to display operation feedback content corresponding to the operation in response to the user's operation on the fused display information.
10. An electronic device, characterized in that: include: Memory; processor; as well as Computer programs; The computer program is stored in the memory and is configured to be executed by the processor to implement the method according to any one of claims 1 to 8.
11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.
