Information display method and device, storage medium and electronic equipment

Abstract

The invention relates to the technical field of vehicle electronics, in particular to an information display method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a new message to be processed, and identifying a data source of the new message; and when the data source of the new message is the target data source, triggering to display the new message in a floating window of a graphical user interface of the HUD. According to the scheme, the floating window can be provided in the graphical user interface of the HUD equipment, and the interaction information of the application program can be displayed.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle electronic technology, and in particular to an information display method, an information display device, a storage medium and an electronic device. Background Art

[0002] HUD (Head Up Display) devices have been widely used in vehicles, and can display navigation information, driving information and other content in the HUD display interface. However, the display content of existing HUD devices is relatively simple and fixed, generally displaying navigation information and driving information such as vehicle speed; during driving, the driver will not have other interactive content with the display information of the HUD device.

[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0004] The present disclosure provides an information display method, an information display device, a storage medium and an electronic device, which can provide a floating window in a graphical user interface of a HUD device and display interactive information of an application.

[0005] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0006] According to a first aspect of the present disclosure, there is provided an information display method, the method comprising:

[0007] Obtain a new message to be processed, and identify a data source of the new message;

[0008] When the data source of the new message is the target data source, it is triggered to display the new message in a floating window of the graphical user interface of the HUD.

[0009] In some exemplary embodiments, the method further comprises:

[0010] In response to a selection operation on a target application identifier corresponding to the target data source in a floating window of a graphical user interface of the HUD, obtaining an application type of the target data source;

[0011] A display mode of the new message is determined according to the application type of the target data source.

[0012] In some exemplary embodiments, determining the display mode of the new message according to the application type of the target data source includes:

[0013] When the application type of the target data source is a communication type application, triggering a secondary window of the floating window to be displayed in the graphical user interface of the HUD, and displaying the message content of the new message in the secondary window; or

[0014] When the application type of the target data source is other types of applications, a function interface of the application corresponding to the target data source is triggered to be displayed in the graphical user interface of the HUD.

[0015] In some exemplary embodiments, the method further comprises:

[0016] Get the current running status of the target function;

[0017] The display position of the secondary window in the graphical user interface of the HUD is configured based on the current operating status identification result of the target function.

[0018] In some exemplary embodiments, configuring the display position of the secondary window in the graphical user interface of the HUD based on the current running state recognition result of the target function includes:

[0019] When the target function is running, displaying the secondary window at a preset position of the floating window; or

[0020] When at least one of the target functions is not running, displaying the secondary window at a preset position corresponding to the target function that is not running; or

[0021] When the target function is not running, the secondary window is displayed at a target preset position.

[0022] In some exemplary embodiments, the method further comprises:

[0023] Obtaining object position information of an object in front of the vehicle;

[0024] Based on the comparison between the object position information and the projection position information of the secondary window, a display strategy of the secondary window in the graphical user interface of the HUD is configured according to the position information comparison result.

[0025] In some exemplary embodiments, configuring a display strategy of the secondary window in a graphical user interface of the HUD according to the position information comparison result includes:

[0026] When the object position information overlaps with the projection position of the secondary window, at least one of the projection position of the secondary window and the transparency of the secondary window is reconfigured.

[0027] In some exemplary embodiments, the method further comprises:

[0028] When the application type of the target data source is a communication type application, obtaining current speed data;

[0029] When it is identified that the current speed data meets the preset speed condition, a secondary window of the floating window is triggered to be displayed in the graphical user interface of the HUD, and the message content of the new message is displayed in the secondary window.

[0030] In some exemplary embodiments, the method further comprises:

[0031] The window monitoring task for the secondary window is triggered and executed, and when there is no triggering operation for the secondary window within a preset time period, the secondary window is closed.

[0032] In some exemplary embodiments, displaying the new message in a floating window of a graphical user interface of the HUD includes:

[0033] In the target application identifier corresponding to the target data source in the floating window, the target application identifier is marked according to the new message.

[0034] In some exemplary embodiments, when obtaining a new message to be processed, the method further includes:

[0035] Get the window status of the floating window of the HUD graphical user interface;

[0036] When the window state of the floating window is enabled, displaying the new message in the floating window; or,

[0037] When the window status of the floating window is not enabled, window status prompt information is displayed in the HUD graphical user interface.

[0038] In some exemplary embodiments, the method further comprises:

[0039] In response to the selection operation of the application, the application identifier corresponding to the currently selected application is added to the floating window of the graphical user interface of the HUD and displayed.

[0040] According to a second aspect of the present disclosure, there is provided an information display device, the device comprising:

[0041] An information processing module, used to obtain a new message to be processed and identify a data source of the new message;

[0042] The display control module is used to trigger the display of the new message in a floating window of the HUD graphical user interface when the data source of the new message is the target data source.

[0043] According to a third aspect of the present disclosure, there is provided a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned information display method is implemented.

[0044] According to a fourth aspect of the present disclosure, there is provided an electronic device, including:

[0045] Processor; and

[0046] A memory, configured to store executable instructions of the processor;

[0047] Wherein, the processor is configured to implement the above-mentioned mutual information display method by executing the executable instructions.

[0048] An information display method provided by an embodiment of the present disclosure pre-configures the message types that can be displayed in the floating window of the HUD graphical user interface, so that after obtaining a new message, the data source of the new message can be first identified, and then when the data source of the new message is determined to be the target data source, the new message is triggered to be displayed in the floating window of the HUD graphical user interface; thereby, a specific window is used in the HUD graphical user interface to display messages of a specified type, which is convenient for the driver to view information using the HUD device during driving, and can minimize the driver's behavior of checking the mobile phone or lowering his head during driving, thereby improving the safety factor of the driving process.

[0049] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0051] Figure 1 A schematic diagram schematically illustrates an information display method in an exemplary embodiment of the present disclosure;

[0052] Figure 2 A schematic diagram schematically shows a display effect of a floating window in a HUD graphical user interface in an exemplary embodiment of the present disclosure;

[0053] Figure 3 A schematic diagram schematically shows a display effect of a floating window in a HUD graphical user interface in an exemplary embodiment of the present disclosure;

[0054] Figure 4A schematic diagram schematically shows a display effect of floating window multitasking in a HUD graphical user interface in an exemplary embodiment of the present disclosure;

[0055] Figure 5 A schematic diagram schematically shows a display effect of floating window multitasking in a HUD graphical user interface in an exemplary embodiment of the present disclosure;

[0056] Figure 6 A schematic diagram schematically shows a display effect of displaying a no-message prompt message in a floating window in an exemplary embodiment of the present disclosure;

[0057] Figure 7 A schematic diagram schematically shows a display effect of a secondary window in an exemplary embodiment of the present disclosure;

[0058] Figure 8 A schematic diagram schematically shows a display effect of a secondary window in an exemplary embodiment of the present disclosure;

[0059] Fig. 9 A schematic diagram schematically shows a display effect of a secondary window in an exemplary embodiment of the present disclosure;

[0060] Fig.10 A schematic diagram schematically shows the display effect of another secondary window in an exemplary embodiment of the present disclosure;

[0061] Fig.11 A schematic diagram schematically shows the display effect of another secondary window in an exemplary embodiment of the present disclosure;

[0062] Fig.12 A schematic diagram schematically shows the display effect of another secondary window in an exemplary embodiment of the present disclosure;

[0063] Fig.13 A schematic diagram schematically shows a display effect of entertainment information in an exemplary embodiment of the present disclosure;

[0064] Fig.14 A schematic diagram schematically illustrates a floating window display control method in an exemplary embodiment of the present disclosure;

[0065] Fig.15 A schematic diagram schematically illustrates a method for displaying a message in a floating window in an exemplary embodiment of the present disclosure;

[0066] Fig.16 A schematic diagram schematically illustrates a method for displaying content of a secondary window in an exemplary embodiment of the present disclosure;

[0067] Fig.17 A schematic diagram schematically illustrates a method for configuring a display position of a floating window in an exemplary embodiment of the present disclosure;

[0068] Fig.18 A schematic diagram schematically shows the composition of an information display device in an exemplary embodiment of the present disclosure;

[0069] Fig.19 The diagram schematically shows the components of an electronic device in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0070] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0071] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0072] In view of the shortcomings and deficiencies of the prior art, this example embodiment provides an information display method that can be applied to HUD devices and AR-HUD devices on vehicles. A floating window can be provided in the HUD graphical user interface to display new messages of a specific application, making it easier for the driver to handle these new messages. Figure 1 As shown in , the above information display method may include:

[0073] Step S11, obtaining a new message to be processed, and identifying a data source of the new message;

[0074] Step S12, when the data source of the new message is the target data source, triggering display of the new message in a floating window of the graphical user interface of the HUD.

[0075] The information display method provided in the present example implementation method pre-configures the message types that can be displayed in the floating window of the HUD's graphical user interface, so that after a new message is acquired, the data source of the new message can be first identified, and then when the data source of the new message is determined to be the target data source, the new message is triggered to be displayed in the floating window of the HUD's graphical user interface; thereby, a specific window is used in the HUD's graphical user interface to display messages of a specified type, which makes it convenient for the driver to view information using the HUD device while driving, and can minimize the driver's behavior of checking the mobile phone or lowering his head while driving, thereby improving the driving safety level.

[0076] Below, each step of the information display method in this example implementation will be described in more detail with reference to the accompanying drawings and embodiments.

[0077] In step S11, a new message to be processed is obtained, and a data source of the new message is identified.

[0078] In this example implementation, the above method can be applied to a vehicle terminal device, an intelligent vehicle system, a HUD device, an AR-HUD device, or an intelligent mobile terminal device that communicates data with the vehicle system. Specifically, taking the vehicle system as an example, applications with different functions can be pre-installed in the vehicle system, such as instant messaging applications, navigation applications, music applications, etc. For example, the instant messaging application can be an application such as WeChat, QQ, SMS, and phone. Among them, the above new message can be a real-time message of an application installed and running in the vehicle system. During the process of network operation, the application can receive new messages in real time and display them in the vehicle system. Alternatively, the above new message can also be a new message received in real time by the terminal device. For example, the vehicle system is connected to the user's intelligent terminal device, and when the terminal device receives a new message, it can be synchronously displayed in the interactive interface of the vehicle system. The user can process, operate, and view these new messages in the vehicle system; or, when the user processes new messages on a terminal device, such as a mobile phone, the operation process and results of the new messages can be synchronously displayed in the vehicle system. When the vehicle system receives a new message to be processed, it can first confirm which application is the data source of the new message. For example, when the new message is an instant messaging message, it can be confirmed whether the current new message is a WeChat message or a text message based on the identifier, source, message format, etc. of the new message.

[0079] In this example implementation, the method further includes: in response to a user's selection operation on an application, adding and displaying an application identifier corresponding to the currently selected application in a floating window of the graphical user interface of the HUD.

[0080] Specifically, in the interactive interface of the vehicle system, or in the interactive interface of the user intelligent terminal device associated with the vehicle system, the user can customize the application that needs to display information using a floating window in the graphical user interface of the HUD; and customize whether to enable the function of displaying application information using a floating window. Among them, the HUD device can be an AR-HUD device or a W-HUD device. In the graphical user interface of the HUD device, that is, in the HUD projection interface, a floating window can be provided, which can be used to display the information corresponding to the application selected by the user. Specifically, the image generation unit (Picture Generation Unit, PGU) of the HUD device can be used for imaging operations, which can specifically include: importing the project in the imaging control unit, using the list box control, and displaying the data source information written to the database in real time, such as the icon style and name of the application. And set the scrolling item in the list box to realize the selection between application icons (application identifiers). Configure the trigger in the project. When the project receives a signal that meets the trigger condition, the jump action is triggered, so that the function page jumps to the secondary window page, and returns to the primary window (floating window) page through the condition set in the trigger. The entire operation is completed in the project. Export the project to the control unit and call the project through the program. Calculate the graphics of the HUD graphical user interface, which includes a floating window and auxiliary driving information. Specifically, an application form can be configured for the floating window, and the application selected by the user can be added to the application form. When a new message to be processed is received, the identifier of the new message can be compared with the identity identifiers of each application in the application form; and when there is a match in the comparison, the data source of the new message is used as the target data source, and the current new message is determined to be a new message that can be displayed in the floating window.

[0081] In this example implementation, when obtaining a new message to be processed, the method further includes: obtaining the window status of a floating window of the HUD's graphical user interface; when the window status of the floating window is enabled, displaying the new message in the floating window; or, when the window status of the floating window is not enabled, displaying window status prompt information in the HUD's graphical user interface.

[0082] Specifically, in the interactive interface of the vehicle system, or in the interactive interface of the user's intelligent terminal device associated with the vehicle system, the user can also customize whether to enable the function of displaying application information using a floating window. When the vehicle system receives a new message, it can also identify whether the function of displaying information in the floating window is currently enabled, for example, by reading the function in the system; and only when the floating window function is enabled, can the application identifier of the application corresponding to the new message be displayed in the floating window. Alternatively, if the current floating window function is not enabled, a prompt message indicating that the corresponding floating window function is not enabled can be displayed.

[0083] In step S12, when the data source of the new message is the target data source, it is triggered to display the new message in a floating window of the graphical user interface of the HUD.

[0084] In this example implementation, when it is determined that the current new message is a new message that can be displayed in a floating window, a new message display task can be triggered, and the new message display task can be sent to the HUD device. The GPU of the HUD device performs projection image calculations, so that the new message can be displayed in the graphical user interface of the HUD.

[0085] For example, when the application form corresponding to the floating window includes only one application, that is, when the floating window contains only one application, or when only one application has new messages in the current period, if the application receives a new message, refer to Figure 2 As shown, the application logo and the message content of the current new message can be displayed in the floating window. At this time, the floating window is displayed in the middle of the graphical user interface; the graphical user interface can also display navigation information, speed information, ADAS (Advanced Driving Assistance System) information, and other content.

[0086] Alternatively, refer to Figure 3 As shown, when the application form corresponding to the floating window includes multiple applications and the application identifier corresponding to the application that receives the new message does not fill the entire floating window, the application identifiers are arranged in sequence according to the time when the message is received, for example, in a left-aligned manner and added from right to left, so that the application identifier corresponding to the latest new message is always arranged on the far left.

[0087] Alternatively, refer to Figure 4As shown, the application form corresponding to the floating window includes multiple applications, and the application identifier corresponding to the application that received the new message fills the entire floating window and still not all the application identifiers are displayed, a right arrow icon can be displayed on the right side of the floating window to prompt the driver that there are more applications with new messages; when the driver selects to the far right through the control button on the steering wheel and there is no application identifier on the right, refer to Figure 5 As shown, a left-pointing arrow may appear on the left side of the floating window, reminding the driver that the application logo to the left may be selected through the steering wheel control buttons.

[0088] In addition, when there is no new message, the floating window can be hidden. When the driver opens the floating window through the steering wheel control button, a prompt message can pop up, such as Figure 6 When the information in the floating window is viewed, the application logo will be cleared from the floating window. Therefore, when all new messages are viewed, the floating window will be opened again using the steering wheel control button. Figure 6 The prompt message shown.

[0089] In this example implementation, the method further includes: marking the target application identifier in the target application identifier corresponding to the target data source in the floating window according to the new message.

[0090] For example, refer to Figure 3 or Figure 4 In the floating window, when an application has unread messages, an unread mark can be added to the image of the corresponding application logo in the floating window, such as a red dot, a mark with the word "unread", etc. Alternatively, if an application currently includes multiple unread new messages, different colors can be used to mark them on the application logo, or the number of new messages can be marked on the application logo.

[0091] In this example implementation, the method further includes: obtaining an application type of the target data source in response to a selection operation on a target application identifier corresponding to the target data source in a floating window of the HUD graphical user interface; and determining a display method for the new message based on the application type of the target data source.

[0092] Specifically, for the applications in the application form corresponding to the floating window, based on the specific information format and style of the new message, different display modes can be pre-configured for messages of different types of applications. For example, for new messages of instant messaging applications, which are generally text messages, the text content can be displayed in the secondary window. Specifically, the driver can select the specific message content of the new message in the floating window to be viewed by controlling the control buttons on the steering wheel of the car; for example, view the text content of the WeChat message. Specifically, it may include: when the driver operates on the control buttons on the steering wheel, the car system triggers the corresponding up, down, left, right, entry and exit operation signals; when the imaging control unit receives the operation signal and transmits the signal to the data source of the corresponding project, the project will select the application identifier and jump to the page according to the conditions set in the trigger.

[0093] In this example implementation, determining the display mode of the new message according to the application type of the target data source includes:

[0094] When the application type of the target data source is a communication type application, triggering a secondary window of the floating window to be displayed in the graphical user interface of the HUD, and displaying the message content of the new message in the secondary window; or

[0095] When the application type of the target data source is other types of applications, a function interface of the application corresponding to the target data source is triggered to be displayed in the graphical user interface of the HUD.

[0096] Specifically, the driver can select the specific message content of the new message in the floating window to be viewed by controlling the control button on the car steering wheel. When the driver selects an application identifier through the control button on the car steering wheel, the type identification task of the application corresponding to the application identifier can be triggered to determine whether the application corresponding to the application identifier is an instant messaging type application. If so, the secondary window can be triggered to display the specific message content in the secondary window. Alternatively, it can also be a task to identify the message type of the new message. If it is a text message, the secondary window can also be triggered.

[0097] In this example implementation, the method further includes: acquiring a current operating state of the target function; and configuring a display position of the secondary window in the graphical user interface of the HUD based on an identification result of the current operating state of the target function.

[0098] Specifically, the above-mentioned target functions may include navigation function, ADAS function, etc. Under different operating conditions, the secondary window may also be configured to have different display positions in the HUD graphical user interface.

[0099] In the present example implementation, the display position of the secondary window in the graphical user interface of the HUD is configured based on the current running status identification result of the target function, including: when the target function is running, displaying the secondary window at a preset position of the floating window; or, when at least one of the target functions is not running, displaying the secondary window at a preset position corresponding to the non-running target function; or, when the target function is not running, displaying the secondary window at the target preset position.

[0100] Specifically, when the driver selects an instant messaging application logo through the control button on the steering wheel, the driver can enter the message viewing page, that is, the secondary window corresponding to the floating window, or the secondary window can also be the secondary window of the application. Figure 7 As shown, if it is currently determined that both the navigation function and the ADAS function are turned on, the control will cover the secondary window above the floating window. In order not to block the screen, only two messages can be displayed. The display principle is the same as the display principle of the application logo, and the latest message is at the top. When a new message is received, the application logo is displayed on the left side of the floating window as a prompt, and the application logo is added to the floating window. Reference Figure 8 As shown in the figure, when there are multiple messages, a downward arrow will be displayed below the secondary window to remind the driver that more messages can be viewed through the steering wheel control buttons. Fig. 9 As shown, when there are multiple messages and the driver has checked all the messages, the driver is reminded that he can scroll back to view the upper message through the steering wheel control buttons.

[0101] Alternatively, refer to Fig.10 As shown, when it is determined that the navigation function is not turned on but the ADAS function is turned on, the control displays the secondary window at the original navigation function position, and the information is played in a loop, and disappears automatically after the playback ends. As a primary window, the floating window can maintain the original display position, and when a new message is received, the primary window is displayed.

[0102] Alternatively, refer to Fig.11 As shown in the figure, if it is determined that the current ADAS function is not turned on but the navigation function is turned on, the control will display the secondary window at the original ADAS function position, and the information will be played in a loop and disappear automatically after the playback ends. The floating window as the primary window can maintain the original display position, and when a new message is received, the primary window will be displayed.

[0103] Alternatively, refer to Fig.12 As shown, if it is determined that the current navigation and ADAS functions are not turned on, the control will give priority to displaying the secondary window at the position of the original navigation function, and the information will be played in a loop and disappear automatically after the playback ends.

[0104] In this example implementation, when the driver selects an application identifier in the floating window through the control button on the steering wheel that corresponds to an entertainment application, the function module corresponding to the entertainment application can be opened. It should be noted that when multiple new messages are received, selecting the application identifier only jumps to open the latest message content. For example, refer to Fig.13 As shown, when the entertainment application is a music player software, in the graphical user interface of this solution, the music function and the floating window are displayed at the same position. In order to ensure that the driver receives new messages in time, the priority of the floating window can be pre-configured to be higher than the music function, that is, when the music function is turned on and the floating window signal is triggered at the same time, only the floating window is displayed in the center position just above the graphical user interface until the floating window disappears and then the music function is displayed.

[0105] In this example implementation, the method further includes: when the application type of the target data source is a communication type application, obtaining current speed data;

[0106] When it is identified that the current speed data meets the preset speed condition, a secondary window of the floating window is triggered to be displayed in the graphical user interface of the HUD, and the message content of the new message is displayed in the secondary window.

[0107] Specifically, in order not to affect the driver's safe driving, the display of the secondary window can only be opened when the vehicle speed is 0 or the speed drops to a preset range. When the user's trigger operation on the secondary window is recognized, it can first determine whether the current vehicle speed meets the preset requirements, and only display the secondary window when the speed requirements are met.

[0108] In this example implementation, the method further includes: triggering and executing a window monitoring task for the secondary window, and when there is no triggering operation for the secondary window within a preset time period, closing the secondary window.

[0109] Specifically, the display timer task of the secondary window can be set, for example, 3 seconds. When the message display time in the secondary window reaches 3 seconds, the message content of the new message is cleared in the secondary window.

[0110] In this example implementation, the process running in the imaging control unit will obtain the corresponding optical parameters in advance, such as the downward viewing angle, the field of view, the virtual image distance, etc., as well as the position of the eye point in the vehicle body coordinate system (x 1 ,y 1 ,z 1 ) and the position of the target object in the ADAS coordinate system (x 2 ,y 2 ,z 2), the project running in the imaging control unit also has its own coordinate system (x, y, z). In general, the body coordinate system takes the center of the front of the vehicle as the origin, the left side of the body is configured as the positive direction of the Y axis, the front of the vehicle is configured as the positive direction of the X axis, and the ground is configured as the positive direction of the Z axis. The ADAS coordinate system is also a right-handed coordinate system, and the origin of the coordinates is usually on the ground at the center of the rear axle of the car. The coordinate system of the project in the imaging control unit is configured as the x-axis as the left and right direction, with the right as positive; the y-axis is configured as the up and down direction, with the top as positive; the z-axis is configured as the front and back direction, with the back as positive. The project running in the imaging control unit needs to convert the position of the eye point in the body coordinate system and the position of the target object in the ADAS coordinate system to its own coordinate system. The conversion process may include: 1) Setting the origin of the project's coordinate system to the same ADAS origin. 2) Converting the eye point position in the project. For example, the position of the eye point in the body coordinate system is (x1, y1, z1), assuming that the center of the front of the vehicle is a meter in front of the ground at the center of the rear axle, b meters in front of the top, and 0 meters on the left and right. The conversion in engineering is x=-y 1 +0, y=z 1 +b,z=-(x 1 +a). 3) Convert the target object position to the project. For example, the position of the eye point in the vehicle body coordinate system is (x 2 ,y 2 ,z 2 ), the conversion in engineering is x=-y 2 ,y=z 2 、z=-x 2 4) Set the optical parameters for the eye point in the project file. Set the viewing angle and field angle for the eye point to control the display range of the target object in the virtual image.

[0111] In this example implementation, the object position information of the object in front of the vehicle can be obtained, and the object position information can be compared with the projection position information of the secondary window, and the display strategy of the secondary window in the HUD graphical user interface can be configured according to the position information comparison result.

[0112] In this example implementation, the display strategy of configuring the secondary window in the graphical user interface of the HUD based on the position information comparison result includes: when the object position information overlaps with the projection position of the secondary window, reconfiguring the projection position of the secondary window and / or configuring the transparency of the secondary window.

[0113] Specifically, when the position of the target object is within the visible range of the eye point, and the trigonometric function is used to calculate the corresponding target position on the left, right and middle of the secondary window in the virtual image. Then add the trigger condition in the project. When the target object is in the center position of the corresponding secondary window, determine whether there is a target object on the left or right side of the secondary window. If it is determined that there is no vehicle on the left or right side of the secondary window, the secondary window will move to the left or right side for display. If it is determined that there are vehicles or objects in the entire row of the secondary window, the overall transparency of the secondary window (bottom frame and icon or message content) will be increased, but it will not disappear. Only when it is determined that there is no obstruction to the front vehicle or object, the transparency of the secondary window will be reduced and normal display will be restored.

[0114] In this example implementation, reference Fig.14As shown, in step S1, the user can open the first-level window / active window (i.e., floating window) in the central control of the vehicle. This operation must be turned on to use the floating window. Step S2, determine whether at least one software (application) has been added to the floating window setting; wherein, the floating window switch is not necessarily all open, and can only be turned on normally when at least one application has been added to the floating window setting. Step S3, if the floating window fails to open, it is necessary to return to the floating window setting interface to add the application, and then try to reopen it. Step S4, the floating window switch is successfully turned on, and the next step can be continued. Step S5, the user can view the content in the floating window by clicking the square control (steering wheel control button); wherein, after the floating window function is turned on, you can try to click on the steering wheel control button to open the floating window. Step S6, determine whether you can respond to the operation of the steering wheel control button to enter the floating window. Step S7, when no new message sent by any software is received at this time, the floating window displays: No information has been received yet. Step S8, after receiving the message sent by the software, you can click the steering wheel control button to move left and right to select the application logo. Step S9: After the selected application needs to be viewed, click the steering wheel control button to confirm and view the detailed content that the software has sent. Step S10: It can trigger to determine whether the software currently sending the message is a communication software; if it is, it will jump to the corresponding secondary window, if not, it will enter another type of judgment. Step S11: When it is determined to be a communication software, it will immediately jump to the corresponding secondary window to display the text information. Step S12: Whether to click the square control to exit the floating window; specifically, after viewing the text information of the communication software, you can choose to exit the floating window with the steering wheel controller. Step S13: After clicking the exit button in the steering wheel control button, the floating window will exit immediately. Step S14: If the driver does not perform any operation on the text display interface, the floating window will automatically disappear after 3 seconds of display. Step S15: When it is determined to be non-communication software, it means that it is entertainment software at this time, and it will immediately jump to the function interface of the entertainment software. Step S16: If the driver wants to exit the play function during the entertainment function, he can select the exit button in the steering wheel controller to exit the floating window. Step S17, after clicking the exit key in the steering wheel controller, the floating window will exit immediately. If the driver does not perform any operation, the recommended entertainment information will automatically exit after the playback ends.

[0115] In this example implementation, reference Fig.15As shown, step S20, when the corresponding software receives a new message, it is necessary to execute the next step to check the floating window / active window. Step S21, check whether a floating window pops up, and display the application logo and message content. Step S22, if the floating window cannot be successfully displayed, it is necessary to check whether the software logo has been successfully added in the detailed floating window settings or whether the floating window switch has been successfully turned on. Step S23, if the floating window is displayed normally, you can choose to exit the floating window. Step S24, if the driver does not perform any operation, the floating window will automatically disappear after being displayed for 3 seconds.

[0116] In this example implementation, reference Fig.16 As shown, step S30: when it is determined that the application of the received new message is a communication type, and the driver clicks the application logo through the steering wheel control button to view the message. Step S31, after the driver clicks the application logo, it is determined whether the navigation function and the ADAS function are turned on at the same time. Step S32, when it is determined that at least one function is not turned on, the secondary window will be controlled to be displayed at the position of the function, and the information received by the application will be automatically played until it disappears automatically after the playback ends. When it is recognized that both the navigation and ADAS functions are not turned on, it will be displayed preferentially at the position of the original navigation function. Step S33, if it is determined that both the navigation and ADAS functions are turned on, the secondary window will cover the primary window (i.e., floating window) and only display two messages. The driver can view the messages by adjusting the steering wheel controller up and down. Step S34, when the secondary window covers the position of the primary window (i.e., floating window), the driver can automatically exit the secondary window by clicking the exit key of the steering wheel control button or waiting for 3 seconds.

[0117] In this example implementation, reference Fig.17 As shown, in step S40, the application added to the floating window / active window setting list receives the message and controls the display of the floating window. Step S41, after collecting the position data of the vehicle and object in front of the vehicle, determine whether the floating window at this time blocks the vehicle and object in front. Step S42, if it is determined that there is no blockage in front, the entire floating window style is displayed directly above the HUD layout and centered. Step S43, if it is determined that there is a blockage in front, then determine whether there is a vehicle or object on the left or right side of the floating window. Step S44, if it is determined that there is no vehicle on the left or right side of the floating window, the floating window will move to the left or right side for display. Step S45, if it is determined that there are vehicles or objects in a whole row of floating windows, the overall opacity of the floating window (bottom frame and icon or message content) is reduced to 40%. Only when it is determined that there is no blockage of the front vehicle or object, the opacity of the floating window is restored to 100% again.

[0118] In this example implementation, the floating window can be pre-configured to be located in the area of ​​the HUD projection display area where the element content is not displayed, and changes with the change of the area occupied by the display element content (for example, directly above the layout and displayed in the center), and the floating window uses 4 pixel rounded corners. The size of the active sub-window, i.e., the secondary window, used to display detailed information is larger than the floating window used to display the software icon. Since the display area of ​​the active sub-window is relatively large, in order to reduce the impact of blocking the driver's line of sight, the active sub-window can be configured to use white with an opacity of 20%, and the text content is white with an opacity of 100%. When the information acquisition module of the vehicle receives the signal sent by each module and sends it to the control unit, the control unit determines the software type corresponding to the received signal through the program, and controls the page to jump to after clicking the icon in the floating window through the type. For example: when the communication software receives a message, click the communication software icon in the floating window, the control unit will determine it as a communication software through the program, and will immediately jump to the text information display module. Another example: when an entertainment software receives a message (such as music recommendation), click the corresponding software icon in the floating window, the control unit recognizes the software type as entertainment through the program, and immediately opens the software for playback, until the information (music) is played and then automatically closed, or you can choose to click the floating window exit key in the steering wheel controller to close the entertainment information playback at any time. When the floating window in the previous state disappears (automatically disappears in 3 seconds or exits by clicking the steering wheel controller), and the information acquisition module does not receive any information, the floating window prompts in the HUD: No information has been received yet. After receiving only one software message, the control unit module obtains the text information received by the software, pops up the floating window and displays the corresponding software icon and text information. The text information includes chat content, introduction to recommended information, etc. Click the steering wheel controller to enter the icon, you can view this text information or jump to the video or music window. In a certain period of time, when the same software receives multiple messages and other software does not receive any messages, only the corresponding logo and the latest text prompt of this software are displayed in the floating window. Click the icon to enter the communication software, and you can further view all the received text messages in the active subwindow. Click to view the entertainment software, and you can only play the latest video or music, or view the relevant lyrics in the active subwindow. Due to the limitation of the floating window size, the number of software icons displayed in the floating window at the same time is limited, and a maximum of 5 can be displayed at the same time. The control unit determines the order in which different software receive messages based on the timestamp of the received signal, and displays the software icon of the latest received message in the leftmost sub-area of ​​the floating window according to the order of the timestamps corresponding to each software. Each sub-area is used to display a software icon. If the information acquisition module receives the message of the 6th software or more, a left shift indicator icon will appear in the floating window, and you can select the software icon you want to view by clicking the steering wheel controller to move left and right.

[0119] The information display method provided by the present disclosure, when the driver obtains the information sent by the software that he wants to pay attention to during driving, it will be displayed in real time in the floating window of the HUD. If the messages sent by multiple software are received in sequence at this time, they will be displayed in sequence according to the time sorting requirements of the message sending, and the following messages directly cover the previous messages. The last message disappears after being displayed for 3 seconds. When the vehicle is paused or the speed drops to a preset range, the floating window can be activated in the steering wheel controller, and the message details page (active subwindow or secondary window) can be entered by clicking the icon of the software that sends the message. When viewing the message, you can click the steering wheel controller at any time to exit the floating window, or when the driver has not operated for 3 seconds, close the floating window, so that the driver can enter the driving state as soon as possible. This method can not only display the prompt information of multiple software, but also retain the prompted information for a short time, minimizing the frequency of the driver's head down during driving.

[0120] It should be noted that the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0121] For further reference, Fig.18 As shown, in the embodiment of this example, an information display device 180 is also provided, including: an information processing module 1801 and a display control module 1802.

[0122] The information processing module can be used to obtain a new message to be processed and identify a data source of the new message.

[0123] The display control module shown can be used to trigger display of the new message in a floating window of the graphical user interface of the HUD when the data source of the new message is the target data source.

[0124] In this exemplary embodiment, the device further includes: a new message display mode determination module.

[0125] The new message display mode determination module can be used to obtain the application type of the target data source in response to a selection operation on a target application identifier corresponding to the target data source in a floating window of the HUD graphical user interface; and determine the display mode of the new message according to the application type of the target data source.

[0126] In this exemplary embodiment, the new message display mode determination module can be used to trigger the display of a secondary window of the floating window in the HUD graphical user interface when the application type of the target data source is a communication type application, and display the message content of the new message in the secondary window; or

[0127] When the application type of the target data source is other types of applications, a function interface of the application corresponding to the target data source is triggered to be displayed in the graphical user interface of the HUD.

[0128] In this exemplary embodiment, the device further includes: a secondary window position configuration module.

[0129] The secondary window position configuration module can be used to obtain the current operating status of the target function; and configure the display position of the secondary window in the graphical user interface of the HUD based on the current operating status identification result of the target function.

[0130] In this exemplary embodiment, the secondary window position configuration module may further include: displaying the secondary window at a preset position of the floating window when the target function is running; or

[0131] When at least one of the target functions is not running, displaying the secondary window at a preset position corresponding to the target function that is not running; or

[0132] When the target function is not running, the secondary window is displayed at a target preset position.

[0133] In this exemplary embodiment, the device further includes: a display policy configuration module.

[0134] The display strategy configuration module can be used to obtain the object position information of the object in front of the vehicle; based on the comparison of the object position information with the projection position information of the secondary window, the display strategy of the secondary window in the HUD graphical user interface is configured according to the position information comparison result.

[0135] In this exemplary embodiment, the display strategy configuration module may include: when the object position information overlaps with the projection position of the secondary window, reconfiguring at least one of the projection position of the secondary window and the transparency of the secondary window.

[0136] In this exemplary embodiment, the device further includes: a speed analysis module.

[0137] The speed analysis module can be used to obtain current speed data when the application type of the target data source is a communication type application; when it is identified that the current speed data meets the preset speed condition, it triggers the display of a secondary window of the floating window in the HUD graphical user interface, and displays the message content of the new message in the secondary window.

[0138] In this exemplary embodiment, the device further includes: a secondary window status monitoring module.

[0139] The secondary window state monitoring module can be used to trigger and execute the window monitoring task for the secondary window, and close the secondary window when there is no triggering operation for the secondary window within a preset time period.

[0140] In this exemplary embodiment, the device further includes: a new message marking module.

[0141] The new message marking module may be used to mark the target application identifier corresponding to the target data source in the floating window according to the new message.

[0142] In this exemplary embodiment, the apparatus further includes: a window state analysis module.

[0143] The window status analysis module can be used to obtain the window status of the floating window of the HUD graphical user interface when obtaining a new message to be processed; when the window status of the floating window is enabled, display the new message in the floating window; or when the window status of the floating window is not enabled, display window status prompt information in the HUD graphical user interface.

[0144] In this exemplary embodiment, the apparatus further includes: a selection response module.

[0145] The selection response module may be configured to, in response to a selection operation on an application program, add and display an application identifier corresponding to a currently selected application program in a floating window of a graphical user interface of the HUD.

[0146] The specific details of each module in the above-mentioned information display device 180 have been described in detail in the corresponding information display method, so they will not be repeated here.

[0147] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0148] Fig.19 A schematic diagram of an electronic device suitable for implementing an embodiment of the present invention is shown.

[0149] It should be noted that Fig.19 The electronic device 1000 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0150] like Fig.19 As shown, the electronic device 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage part 1008 to the random access memory (RAM) 1003. In the RAM 1003, various programs and data required for system operation are also stored. The CPU 1001, ROM 1002 and RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0151] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.

[0152] In particular, according to an embodiment of the present invention, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a storage medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part 1009, and / or installed from a removable medium 1011. When the computer program is executed by a central processing unit (CPU) 1001, various functions defined in the system of the present application are executed.

[0153] Specifically, the electronic device may be a smart mobile electronic device such as a mobile phone, a tablet computer or a laptop computer, or may be a smart electronic device such as a desktop computer.

[0154] It should be noted that the storage medium shown in the embodiment of the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any storage medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the storage medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0155] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0156] The units involved in the embodiments of the present invention may be implemented by software or hardware, and the units described may also be arranged in a processor. The names of these units do not, in some cases, limit the units themselves.

[0157] It should be noted that, as another aspect, the present application also provides a storage medium, which can be included in an electronic device; or it can exist independently without being installed in the electronic device. The above storage medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the following embodiments. For example, the electronic device can implement the following Figure 1 The steps shown.

[0158] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0159] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0160] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An information display method, characterized in that: The method comprises: Obtain a new message to be processed, and identify a data source of the new message; When the data source of the new message is the target data source, it is triggered to display the new message in a floating window of the graphical user interface of the HUD.

2. The information display method according to claim 1, characterized in that: The method further comprises: In response to a selection operation on a target application identifier corresponding to the target data source in a floating window of a graphical user interface of the HUD, obtaining an application type of the target data source; A display mode of the new message is determined according to the application type of the target data source.

3. The information display method according to claim 2, characterized in that: The determining, according to the application type of the target data source, a display mode of the new message includes: When the application type of the target data source is a communication type application, triggering a secondary window of the floating window to be displayed in the graphical user interface of the HUD, and displaying the message content of the new message in the secondary window; or When the application type of the target data source is other types of applications, a function interface of the application corresponding to the target data source is triggered to be displayed in the graphical user interface of the HUD.

4. The information display method according to claim 3, characterized in that: The method further comprises: Get the current running status of the target function; The display position of the secondary window in the graphical user interface of the HUD is configured based on the current operating status identification result of the target function.

5. The information display method according to claim 4, characterized in that: The configuring the display position of the secondary window in the graphical user interface of the HUD based on the current running state recognition result of the target function includes: When the target function is running, displaying the secondary window at a preset position of the floating window; or When at least one of the target functions is not running, displaying the secondary window at a preset position corresponding to the target function that is not running; or When the target function is not running, the secondary window is displayed at a target preset position.

6. The information display method according to claim 3, characterized in that: The method further comprises: Obtaining object position information of an object in front of the vehicle; Based on the comparison between the object position information and the projection position information of the secondary window, a display strategy of the secondary window in the graphical user interface of the HUD is configured according to the position information comparison result.

7. The information display method according to claim 6, characterized in that: The configuring the display strategy of the secondary window in the HUD graphical user interface according to the position information comparison result includes: When the object position information overlaps with the projection position of the secondary window, at least one of the projection position of the secondary window and the transparency of the secondary window is reconfigured.

8. The information display method according to claim 3, characterized in that: The method further comprises: When the application type of the target data source is a communication type application, obtaining current speed data; When it is identified that the current speed data meets the preset speed condition, a secondary window of the floating window is triggered to be displayed in the graphical user interface of the HUD, and the message content of the new message is displayed in the secondary window.

9. The information display method according to claim 3, characterized in that: The method further comprises: The window monitoring task for the secondary window is triggered and executed, and when there is no triggering operation for the secondary window within a preset time period, the secondary window is closed.

10. The information display method according to claim 1, characterized in that: The displaying of the new message in a floating window of the HUD graphical user interface comprises: In the target application identifier corresponding to the target data source in the floating window, the target application identifier is marked according to the new message.

11. The information display method according to claim 1, characterized in that: When obtaining a new message to be processed, the method further includes: Get the window status of the floating window of the HUD graphical user interface; When the window state of the floating window is enabled, displaying the new message in the floating window; or, When the window status of the floating window is not enabled, window status prompt information is displayed in the HUD graphical user interface.

12. The information display method according to claim 1, characterized in that: The method further comprises: In response to the selection operation of the application, the application identifier corresponding to the currently selected application is added to the floating window of the graphical user interface of the HUD and displayed.

13. An information display device, characterized in that: The device comprises: An information processing module, used to obtain a new message to be processed and identify a data source of the new message; The display control module is used to trigger the display of the new message in a floating window of the HUD graphical user interface when the data source of the new message is the target data source.

14. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the information display method according to any one of claims 1 to 12 is implemented.

15. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the information display method according to any one of claims 1 to 12 by executing the executable instructions.

Images