Auxiliary function module display method, human machine interaction system, and related apparatus

Abstract

The present application discloses an auxiliary function module display method, a human machine interaction system, and a related apparatus. The method comprises: when a current core function module among a plurality of core function modules is displayed on a human machine interface, if a user wishes to view auxiliary information, acquiring an auxiliary information viewing operation executed on the human machine interface; if the auxiliary information viewing operation executed on the human machine interface has been acquired, during the auxiliary information viewing operation, switching and transitioning the current core function module displayed on the human machine interface to an auxiliary function module on the basis of a first direction corresponding to the auxiliary information viewing operation; and when the auxiliary information viewing operation satisfies a first preset condition, displaying the auxiliary function module on the human machine interface, thereby switching the current core function module displayed on the human machine interface to the auxiliary function module, so that the user can view the auxiliary information provided by the auxiliary function module. Therefore, the display effect of the auxiliary function module is improved, and the convenience and efficiency of viewing the auxiliary information are improved.

Description

Display methods for auxiliary function modules, human-computer interaction systems and related devices

[0001] This application claims priority to Chinese Patent Application No. 2024115364057, filed on October 30, 2024, entitled “Method for Displaying Auxiliary Function Modules, Human-Computer Interaction System and Related Devices”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of computer technology, and in particular to the display of auxiliary function modules and human-computer interaction. Background Technology

[0003] Human Machine Interface (HMI), also known as human-computer interface, is the medium for interaction and information exchange between human-computer interaction systems and users. Human-computer interaction systems provide various functions, and HMI, as the user interface, enables users to easily access these functions.

[0004] HMI can include core functional modules and auxiliary functional modules. Currently, auxiliary functional modules are mainly displayed through three-dimensional (3D) animations or 2D cards.

[0005] However, HMI has more high-quality content and functions (such as core functional modules) that need to be displayed, so the display area for auxiliary functional modules is relatively limited. When displaying auxiliary functional modules, key auxiliary information of the auxiliary functional modules can only be displayed in the remaining limited area while the core functional modules are displayed. If more auxiliary information is to be viewed, it is necessary to enter the secondary page of the auxiliary functional module, which affects the display effect of the auxiliary functional modules and the convenience and efficiency of viewing auxiliary information. Summary of the Invention

[0006] To address the aforementioned technical issues, this application provides a method for displaying auxiliary function modules, a human-computer interaction system, and related devices. When viewing auxiliary information, users only need to interact within the same space and at the same level to switch from the currently displayed core function module to the fully displayed auxiliary function module on the human-computer interface. This eliminates the need to switch between interfaces at different levels, improving the display effect of auxiliary function modules and enhancing the convenience and efficiency of viewing auxiliary information.

[0007] The embodiments of this application disclose the following technical solutions:

[0008] On one hand, embodiments of this application provide a method for displaying an auxiliary function module, the method comprising:

[0009] Display the current core functional module among multiple core functional modules on the human-computer interface;

[0010] If an auxiliary information viewing operation is obtained on the human-machine interface, during the execution of the auxiliary information viewing operation, the current core function module displayed on the human-machine interface is switched to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

[0011] When the auxiliary information viewing operation meets the first preset condition, the auxiliary function module is displayed on the human-machine interface.

[0012] On one hand, embodiments of this application provide a method for displaying an auxiliary function module, the method comprising:

[0013] The current core functional module for obtaining the viewfinder of the virtual camera is one of multiple core functional modules. The multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space. The auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space.

[0014] If an auxiliary information viewing operation is detected on the human-machine interface, during the execution of the auxiliary information viewing operation, the virtual camera framing function module is controlled to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

[0015] If it is determined that the auxiliary information viewing operation meets the first preset condition, the virtual camera is controlled to view the auxiliary function module so as to display the auxiliary function module on the human-machine interface.

[0016] On one hand, this application provides a human-computer interaction system, which includes a human-computer interface, multiple core functional modules, auxiliary functional modules, and a virtual camera. The multiple core functional modules are arranged in a ring shape in a three-dimensional virtual space associated with the human-computer interface. The virtual camera is located at the center of the ring space, and the auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space.

[0017] The human-machine interface is used to display one of the multiple core functional modules and receive auxiliary information viewing operations, the auxiliary information viewing operations corresponding to the first direction;

[0018] The virtual camera is used to switch from the current core function module of the viewfinder to the auxiliary function module in response to the auxiliary information viewing operation, according to the first direction;

[0019] The human-machine interface is also used to switch the currently displayed core function module to the auxiliary function module in response to the auxiliary information viewing operation.

[0020] On one hand, embodiments of this application provide a display device for auxiliary function modules, the device including a display unit and a switching unit:

[0021] The display unit is used to display the current core functional module among multiple core functional modules on the human-machine interface;

[0022] The switching unit is used to, if an auxiliary information viewing operation is obtained on the human-machine interface, switch the current core function module displayed on the human-machine interface to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation during the execution of the auxiliary information viewing operation.

[0023] The display unit is also used to display the auxiliary function module on the human-machine interface when the auxiliary information viewing operation meets the first preset condition.

[0024] On one hand, embodiments of this application provide a display device for auxiliary function modules, the device including an acquisition unit and a control unit:

[0025] The acquisition unit is used to acquire the current core functional module of the virtual camera. The current core functional module is one of multiple core functional modules. The multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space. The auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space.

[0026] The control unit is configured to, if an auxiliary information viewing operation is detected on the human-machine interface, control the virtual camera framing function module to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation during the execution of the auxiliary information viewing operation.

[0027] The control unit is further configured to, if it is determined that the auxiliary information viewing operation meets the first preset condition, control the virtual camera to view the auxiliary function module so as to display the auxiliary function module on the human-machine interface.

[0028] On one hand, embodiments of this application provide a computer device, the computer device including a processor and a memory:

[0029] The memory is used to store computer programs and to transfer the computer programs to the processor;

[0030] The processor is configured to execute the method described in any of the foregoing aspects according to instructions in the computer program.

[0031] In one aspect, embodiments of this application provide a computer-readable storage medium for storing a computer program that, when executed by a processor, causes the processor to perform the methods described in any of the foregoing aspects.

[0032] On one hand, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the method described in any of the foregoing aspects.

[0033] As can be seen from the above technical solution, this application integrates the functions of the human-machine interface into a complete three-dimensional virtual space, where the core functional modules and auxiliary functional modules belong to the same level. The human-machine interface displays one functional module at a time, either a core functional module or an auxiliary functional module. When the current core functional module is displayed on the human-machine interface, if the user wishes to view auxiliary information, they can perform an auxiliary information viewing operation on the human-machine interface. During the execution of the auxiliary information viewing operation, the current core functional module displayed on the human-machine interface can be switched to an auxiliary functional module according to the first direction corresponding to the auxiliary information viewing operation. When the auxiliary information viewing operation meets the first preset condition, the auxiliary functional module is displayed on the human-machine interface, thereby switching the currently fully displayed core functional module on the human-machine interface to a fully displayed auxiliary functional module, allowing the user to view the auxiliary information provided by the auxiliary functional module. In this application, the auxiliary function module and multiple core function modules are in the same three-dimensional virtual space and at the same level. When viewing auxiliary information, users only need to interact within the same space and at the same level to switch the current core function module fully displayed on the human-computer interface to the auxiliary function module fully displayed, without having to jump between interfaces at different levels. This improves the display effect of the auxiliary function module and enhances the convenience and efficiency of viewing auxiliary information. Attached Figure Description

[0034] Figures 1a and 1b are example interface diagrams of the auxiliary function modules provided by the related technologies;

[0035] Figure 2 is an application scenario architecture diagram of a method for displaying an auxiliary function module provided in an embodiment of this application;

[0036] Figure 3 is an example diagram of a ring space composed of multiple core functional modules and auxiliary functional modules provided in the embodiments of this application;

[0037] Figure 4 is a flowchart of a method for displaying an auxiliary function module provided in an embodiment of this application;

[0038] Figure 5 is a schematic diagram of an interface that displays the current core functional modules on a human-machine interface according to an embodiment of this application;

[0039] Figure 6 is a schematic diagram of an interface for switching from the current core functional module to the auxiliary functional module according to an embodiment of this application;

[0040] Figure 7 is a schematic diagram of an interface for displaying auxiliary function modules on a human-machine interface according to an embodiment of this application;

[0041] Figure 8 is a schematic diagram of another interface for displaying auxiliary function modules on a human-machine interface provided in an embodiment of this application;

[0042] Figure 9 is a flowchart of another method for displaying auxiliary function modules provided in an embodiment of this application;

[0043] Figure 10 is a schematic diagram of the principle and display effect of displaying the current core functional modules on the human-machine interface according to an embodiment of this application;

[0044] Figure 11 is a schematic diagram of the principle and display effect of displaying auxiliary function modules on a human-machine interface according to an embodiment of this application;

[0045] Figure 12 is a schematic diagram illustrating the calculation principle of an angle threshold provided in an embodiment of this application;

[0046] Figure 13 is a signaling interaction diagram of an auxiliary function module display method provided in an embodiment of this application;

[0047] Figure 14 is a structural diagram of an auxiliary function module display device provided in an embodiment of this application;

[0048] Figure 15 is a structural diagram of a display device for another auxiliary function module provided in an embodiment of this application;

[0049] Figure 16 is a structural diagram of a terminal provided in an embodiment of this application;

[0050] Figure 17 is a structural diagram of a server provided in an embodiment of this application. Detailed Implementation

[0051] The embodiments of this application will now be described with reference to the accompanying drawings.

[0052] In related technologies, when displaying auxiliary function modules, rendering technologies such as Unity (a real-time 3D interactive content creation and operation platform) and Open Graphics Library (OpenGL) are used to display these modules through 3D animations or 2D cards. Referring to Figures 1a and 1b, in Figure 1a, the HMI displays a lot of information, but only the area shown as 101 displays the auxiliary function module (e.g., the weather module). In Figure 1b, the HMI displays a 3D scene and 2D cards; on the 2D cards, the area shown as 102 displays the auxiliary function module (e.g., the weather module).

[0053] However, HMI has more high-quality content and functions (such as core functional modules) that need to be displayed, so the display area for auxiliary functional modules is relatively limited. When displaying auxiliary functional modules, key auxiliary information of the auxiliary functional modules can only be displayed in the remaining limited area while the core functional modules are displayed. If more auxiliary information is to be viewed, it is necessary to enter the secondary page of the auxiliary functional module, which affects the display effect of the auxiliary functional modules and the convenience and efficiency of viewing auxiliary information.

[0054] To address the aforementioned technical problems, this application provides a method for displaying auxiliary function modules. This method integrates the functions of a human-computer interface into a complete three-dimensional virtual space, where core function modules and auxiliary function modules belong to the same level. Since the auxiliary function modules and multiple core function modules reside in the same three-dimensional virtual space and at the same level, when viewing auxiliary information, users only need to interact within the same space and level to switch from the currently displayed core function module to the fully displayed auxiliary function module on the human-computer interface. This eliminates the need to switch between interfaces at different levels, improving the display effect of auxiliary function modules and enhancing the convenience and efficiency of viewing auxiliary information.

[0055] It should be noted that the auxiliary function module display method provided in this application embodiment can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, autonomous driving, and assisted driving. Specifically, it can be various scenarios with human-computer interaction systems, where interaction is performed using an HMI based on the human-computer interaction system, especially scenarios where auxiliary function modules need to be displayed on the HMI.

[0056] The method for displaying auxiliary function modules provided in this application embodiment can be executed by a computer device, which can be a terminal. Terminals include, but are not limited to, in-vehicle terminals, intelligent interactive devices, smart home devices, industrial machines, medical devices, and financial service devices.

[0057] As shown in Figure 2, Figure 2 illustrates an application scenario architecture diagram of an auxiliary function module display method. This application scenario takes a computer device as an in-vehicle terminal as an example.

[0058] This application scenario may include an in-vehicle terminal 201, which can be a terminal located on a vehicle 202. The in-vehicle terminal 201 is the front-end device of the vehicle's human-machine interface (HMI), and the HMI is a crucial component of the in-vehicle terminal 201, used to enable interaction between humans and machines (i.e., the in-vehicle terminal 201). The screen of the in-vehicle terminal 201, as a key display element of the HMI, provides a clear, easy-to-read, and navigable interface, enabling drivers and passengers to easily access the necessary information and perform corresponding operations. This relationship collectively constitutes the core functionality of the in-vehicle terminal 201, providing drivers and passengers with a wealth of infotainment and driving assistance functions.

[0059] The HMI also includes multiple functional modules to provide drivers and passengers with a wealth of infotainment and driver assistance features. These modules can be categorized into core functional modules and auxiliary functional modules based on their importance. Core functional modules are those used to display and interact with core functional information, while auxiliary functional modules are those used to display and interact with auxiliary information. The core and auxiliary functional modules included in the HMI may differ depending on the computer device used. For example, when the computer device is the in-vehicle terminal 201 in Figure 2, the multiple core functional modules included in the HMI may be essential for vehicle operation or frequently used functional modules, such as navigation, audio-visual entertainment, and vehicle control modules. The auxiliary functional modules included in the HMI may be those that assist with travel, such as weather and notification modules.

[0060] This application integrates the functions of the human-computer interface into a complete three-dimensional virtual space, where core functional modules and auxiliary functional modules belong to the same level. The human-computer interface displays one or more functional modules, such as core functional modules or auxiliary functional modules, at a time. When displaying the current core functional module among multiple core functional modules on the human-computer interface, taking the audio-visual module as an example, the display effect of the human-computer interface can be seen in Figure 2, 203.

[0061] When multiple core functional modules are displayed on the human-machine interface (HMI), if the user wishes to view auxiliary information, they can perform an auxiliary information viewing operation on the HMI. If this auxiliary information viewing operation is received, the HMI can switch between the current core functional module and the auxiliary functional module according to the first direction corresponding to the auxiliary information viewing operation. For example, if the current core functional module is the audio / entertainment module and the auxiliary functional module is the weather module, the transition interface from the current core functional module to the auxiliary functional module can be seen in Figure 2, 204.

[0062] When the auxiliary information viewing operation meets the first preset condition, the auxiliary function module is displayed on the human-machine interface, thereby switching the current core function module fully displayed on the human-machine interface to the auxiliary function module, so that the user can view the auxiliary information provided by the auxiliary function module. Taking the weather module as an example, the display effect of the human-machine interface at this time can be seen in Figure 2, 205.

[0063] Figure 2 illustrates the example of a computer device as the terminal. In some possible implementations, the method for displaying auxiliary function modules provided in this embodiment also requires related background processing support. Therefore, the computer device can also be a server, which performs the related background processing, such as a function module controlling the virtual camera's framing. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0064] It should be noted that in the specific implementation of this application, the entire process may involve user information and other related data. When the above embodiments of this application are applied to specific products or technologies, separate consent or permission from the user is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0065] Next, the display method of the auxiliary function module provided in the embodiments of this application will be described in detail from both the front-end visualization perspective and the back-end technical perspective, in conjunction with the accompanying drawings. First, the display method of the auxiliary function module provided in the embodiments of this application will be described in detail from the front-end visualization perspective.

[0066] Since the auxiliary function module display method provided in this application embodiment is based on the human-computer interaction system provided in this application embodiment, the human-computer interaction system will be introduced first before introducing the auxiliary function module display method from the perspective of front-end visualization.

[0067] The human-computer interaction system includes a human-computer interface, multiple core functional modules, auxiliary functional modules, and a virtual camera. The multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space, and the auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space.

[0068] It is understandable that human-computer interaction systems can be implemented through various computer devices capable of interacting with users, such as in-vehicle terminals, industrial machines, medical equipment, and financial service devices. The human-computer interface (HMI), as a crucial component of the HMI, enables information exchange and interaction between the user and the machine. An HMI system may include multiple functional modules, each providing corresponding functions. The HMI, as the user interface, allows users to easily access these functions.

[0069] Human-computer interaction systems provide a variety of functions. Some of these functions are important and are the core functions of the human-computer interaction system, while others may be relatively unimportant and are auxiliary functions of the human-computer interaction system. The core functions can be called core function modules, and the auxiliary functions can be called auxiliary function modules. In the embodiments of this application, a ring space is formed by multiple core function modules, and the auxiliary function modules are located above or below the ring space in the three-dimensional virtual space.

[0070] Taking a vehicle-mounted terminal as an example of a computer device that implements a human-computer interaction system, the vehicle-mounted terminal may include functional modules that provide many functions, such as an audio-visual entertainment module, a vehicle control module, a navigation module, a notification module, and a weather module. Among these, audio-visual entertainment, vehicle control, and navigation are the core functions of the vehicle-mounted terminal, while notification and weather functions are auxiliary functions. In this embodiment, the multiple core functional modules constituting the annular space can be functional modules that provide the core functions. In this case, the multiple core functional modules are the audio-visual entertainment module, the vehicle control module, and the navigation module. The annular space formed by the multiple core functional modules can be seen in the annular shape in Figure 3. The position of the audio-visual entertainment module in the annular space can be seen in Figure 3 at 301, the position of the vehicle control module in the annular space can be seen in Figure 3 at 302, and the position of the navigation module in the annular space can be seen in Figure 3 at 303. Taking the weather module as an auxiliary functional module located above the annular space as an example, the position of the weather module in the three-dimensional virtual space can be seen in Figure 3 at 304.

[0071] It is understood that each core functional module in the annular space is an arc surface of the annular space. There can be a certain gap between two adjacent arc surfaces, or they can be closely adjacent. This application does not limit this.

[0072] Therefore, by switching functions, the annular space can be controlled to rotate around a rotation axis that passes through the center and is perpendicular to the bottom surface of the annular space. That is, from the top view of the annular space, the circle corresponding to the top view rotates around the center, thereby controlling the virtual camera at the center to view the corresponding core functional module, thus enabling the switching of the core functional modules displayed on the HMI. Auxiliary functional modules reside in the same three-dimensional virtual space as multiple core functional modules; however, the auxiliary functional modules are located above or below the annular space in the three-dimensional virtual space, so that they are not displayed when the core functional modules are displayed. Correspondingly, rotating the annular space may not control the virtual camera to view the auxiliary functional modules. Therefore, in this embodiment, the tilt angle of the virtual camera can be adjusted to switch the virtual camera from viewing the core functional modules to viewing the auxiliary functional modules, enabling the switching of the functional modules displayed on the HMI from core functional modules to auxiliary functional modules. When displaying core functional modules on the HMI, auxiliary functional modules can be viewed at the same level through interaction within the same space.

[0073] In other words, in a human-computer interaction system, the human-computer interface can be used to display one of multiple core functional modules, and to receive auxiliary information viewing operations. Specifically, the human-computer interface displays one functional module at a time, such as a core functional module or an auxiliary functional module. When the human-computer interface displays the current core functional module, the user can perform auxiliary information viewing operations across the entire interface.

[0074] The virtual camera is positioned at the center of the annular space. Based on the above description of the positional relationship between the annular space and the auxiliary function modules, the virtual camera is used to switch from the currently displayed core function module to the auxiliary function module in response to auxiliary information viewing operations. The virtual camera can be seen at 305 in Figure 3. The function module (core or auxiliary function module) captured by the virtual camera is the same as the function module displayed on the human-machine interface. Therefore, the human-machine interface is also used to switch from the currently displayed core function module to the auxiliary function module in response to auxiliary information viewing operations, enabling viewing of the auxiliary function module while the current core function module is being displayed.

[0075] In addition to viewing auxiliary information, the human-machine interface can also be used to switch functions. That is, the human-machine interface can also be used to receive function switching operations, and the virtual camera can also respond to the function switching operation and frame different core function modules among multiple core function modules, so that the human-machine interface can switch and display different core function modules in response to the function switching operation.

[0076] Based on the aforementioned human-computer interaction system, the auxiliary function module is displayed. The following is a detailed description of the auxiliary function module display method provided in this application embodiment from a front-end visualization perspective. Referring to Figure 4, Figure 4 shows a flowchart of an auxiliary function module display method, which may include steps S401-S403, as detailed below:

[0077] S401. Display the current core function module among multiple core function modules on the human-machine interface.

[0078] The human-computer interface can display one functional module completely at a time. Before the auxiliary functional modules are displayed, a functional module, which is a part of the content in the three-dimensional virtual space, has already been displayed on the human-computer interface.

[0079] In this embodiment, the functional module displayed on the current human-machine interface can be the current core functional module among multiple core functional modules. Taking the multiple core functional modules as an example, which are an audio-visual module, a vehicle control module, and a navigation module, and the current core functional module is the audio-visual module, the interface diagram showing the current core functional module on the human-machine interface can be seen in Figure 5.

[0080] It should be noted that the core functional modules displayed on the human-machine interface may differ depending on the circumstances. If it is the first time entering the human-machine interface, i.e., the first time the human-machine interaction system is started, the core functional modules displayed on the human-machine interface will be the core functional modules displayed when the human-machine interface is first entered. If at least one function switching operation has been performed, the core functional modules displayed on the human-machine interface can be the core functional modules obtained after the previous switching.

[0081] It should be noted that the core functional modules displayed when first entering the human-machine interface can be randomly selected from multiple core functional modules, or they can be pre-set default core functional modules from multiple core functional modules. The default core functional module can be the core functional module that the user prefers to display on the human-machine interface. In some cases, the default core functional module can be set based on the frequency or importance of the core functional module's use; however, this application embodiment does not limit this.

[0082] For example, the core functional modules are the audio entertainment module, the vehicle control module, and the navigation module. Since users spend most of their time using the audio entertainment module, it can be set as the default core functional module.

[0083] If the core functional module displayed when entering the human-machine interface is the default core functional module, then the way to display the current core functional module among multiple core functional modules on the human-machine interface is in response to the system startup operation, displaying the default core functional module as the current core functional module on the human-machine interface. The system startup operation can be the operation of opening the human-machine interaction system or the first entry into the human-machine interface.

[0084] The embodiments of this application display the default core function modules when the user first enters the human-machine interface, thereby quickly and directly displaying the core function modules that the user prefers, avoiding unnecessary function switching operations for the user, and improving the user experience.

[0085] Understandably, switching core functional modules based on function switching operations can be achieved by displaying a first core functional module among multiple core functional modules on the human-machine interface (HMI), which then serves as the current core functional module. When the first core functional module displayed on the HMI no longer meets the user's needs, the user can switch core functional modules. Specifically, the user can perform a function switching operation on the HMI, which will switch the first core functional module displayed on the HMI to a second core functional module, which can then be used as the current core functional module.

[0086] During the function switching operation, the first core function module gradually switches to the second core function module. The entire process of this transition can be displayed on the human-machine interface. Specifically, if a function switching operation is detected on the human-machine interface, the transition occurs according to the target direction of the operation, with a circular rotation effect on the human-machine interface, moving from the first core function module to the second core function module among multiple core function modules. The first core function module gradually exits the human-machine interface, while the second core function module gradually enters. The circular space represents the arrangement of the multiple core function modules in the three-dimensional virtual space associated with the human-machine interface.

[0087] Function switching operations can be various actions that switch between function modules. These can be directional or non-directional. Directional operations include swiping (single-finger swipe, two-finger swipe, etc.), while non-directional operations include long presses. The target direction can be the direction corresponding to the function switching operation. This target direction can be fixed; for example, regardless of the function switching operation, the target direction is always from right to left on the user interface. Alternatively, the target direction can change with the direction of the function switching operation. For example, if the function switching operation is a swipe, and the swipe is from left to right on the user interface, the target direction can be from left to right. If the swipe is from right to left on the user interface, the target direction can be from right to left.

[0088] It should be noted that, in the embodiments of this application, when switching core functional modules, the core functional modules can be switched one by one. For example, a single function switching operation only switches to the next core functional module adjacent to the currently displayed core functional module, thereby facilitating the sequential viewing of each core functional module and avoiding missing the core functional module that the user wants to use. In this case, the second core functional module can be the next core functional module adjacent to the first core functional module in the annular space, according to the direction of rotation in the annular space.

[0089] In some cases, there may be a large number of core functional modules. If the core functional module that the user wants to switch to is far from the first core functional module, in order to quickly switch to the core functional module that the user wants to use, multiple core functional modules can be switched at once in this embodiment. In this case, the second core functional module is a functional module that is located after the first core functional module in the annular space according to the direction of rotation of the annular space, and is separated from the first core functional module by at least one core functional module.

[0090] It should be noted that the number of core functional modules between the second core functional module and the first core functional module (i.e., the number of core functional modules switched at one time) can be related to the strength of the function switching operation. The stronger the function switching operation, the more core functional modules are switched at one time, and vice versa.

[0091] In this application embodiment, each function switching operation can switch multiple core function modules, thereby facilitating a quick switch to the core function module that the user wants to use and improving the switching efficiency of core function modules.

[0092] S402. If an auxiliary information viewing operation is obtained on the human-machine interface, during the execution of the auxiliary information viewing operation, the current core function module displayed on the human-machine interface is switched to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

[0093] When displaying the current core functional module on the human-machine interface, users may need to know some auxiliary information, such as weather information or notification information. Users can then view this auxiliary information. Specifically, users can perform an auxiliary information viewing operation on the human-machine interface, which will switch the currently displayed core functional module to an auxiliary functional module in response to the auxiliary information viewing operation.

[0094] During the auxiliary information viewing process, the current core function module gradually switches to the auxiliary function module. The entire process of switching from the current core function module to the auxiliary function module can be displayed on the human-machine interface. That is, according to the first direction corresponding to the auxiliary information viewing operation, the current core function module displayed on the human-machine interface switches to the auxiliary function module, the current core function module gradually exits the human-machine interface, and the auxiliary function module gradually enters the human-machine interface.

[0095] Taking a scenario where the core functional modules are an audio-visual entertainment module, a vehicle control module, and a navigation module, and the current core functional module is the audio-visual entertainment module while the auxiliary functional module is the weather module, Figure 6 illustrates the interface transition from the current core functional module to the auxiliary functional module on the human-machine interface. In Figure 6, 601 shows the current core functional module (audio-visual entertainment module) gradually exiting the human-machine interface, and 602 shows the auxiliary functional module (weather module) gradually entering the human-machine interface.

[0096] Assistive information viewing operations can be various operations that allow viewing assistive information. These can be directional or non-directional operations. Directional operations include swiping (including single-finger swiping and two-finger swiping), while non-directional operations include long-press operations. The first direction can be the direction corresponding to the assistive information viewing operation. This first direction can be fixed; for example, regardless of the assistive information viewing operation, the first direction is always from the top to the bottom of the human-machine interface. Alternatively, the first direction can change according to the direction of the assistive information viewing operation. For example, if the assistive information viewing operation is a swipe, and the swipe is from the top to the bottom of the human-machine interface (i.e., a swipe down), then the first direction can be from the top to the bottom of the human-machine interface. If the swipe is from the bottom to the top of the human-machine interface (i.e., a swipe up), then the first direction can be from the bottom to the top of the human-machine interface.

[0097] It should be noted that, based on the aforementioned human-computer interaction system, since the auxiliary function module is located above or below the annular space formed by the core function module in the three-dimensional virtual space, in order to make this positional relationship visible on the human-computer interface, in this embodiment, the left and right swiping operation can be used as the function switching operation, the target direction for switching different core function modules is determined as the horizontal direction of the human-computer interface (i.e., from the left side to the right side of the human-computer interface, or from the right side to the left side of the human-computer interface), the up and down swiping operation is used as the auxiliary information viewing operation, and the first direction for switching between the current core function module and the auxiliary function module is determined as the vertical direction of the human-computer interface (i.e., from the top to the bottom of the human-computer interface, or from the bottom to the top of the human-computer interface).

[0098] It is understood that in the embodiments of this application, the auxiliary function module is located above or below the annular space. In one implementation, the auxiliary function module can be located above or below a specific core function module, such as the target core function module, included in the annular space, so that the auxiliary function module can always be synchronized with the target core function module. Since the annular space can rotate around a rotation axis, the target core function module will also rotate along with the auxiliary function module. When the current core function module displayed on the human-machine interface is not the target core function module, it may be difficult to make the auxiliary function module appear within the virtual camera's field of view simply by adjusting the tilt angle of the virtual camera. In this case, S402 can be implemented as follows: if an auxiliary information viewing operation is obtained on the human-machine interface, and the current core function module is the target core function module, during the auxiliary information viewing operation, the current core function module displayed on the human-machine interface is switched to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

[0099] In other words, under the aforementioned human-computer interaction system, auxiliary information viewing operations need to be performed when the target core functional modules are displayed on the human-computer interface in order to display auxiliary functional modules on the human-computer interface and enable the viewing of auxiliary information, thereby avoiding affecting the display of other core functional modules and impacting the user experience.

[0100] For example, the core functional modules include an audio-visual entertainment module, a vehicle control module, and a navigation module, while the auxiliary functional module is a weather module. Since the navigation and vehicle control modules are crucial for vehicle control, users don't want other information to interfere with their use of these core functional modules. Therefore, the weather module can be positioned above or below the audio-visual entertainment module (the target core functional module). This way, the weather module can only be displayed through the auxiliary information viewing operation when the audio-visual entertainment module is shown on the human-machine interface. When the navigation or vehicle control module is shown on the human-machine interface, restricting users from viewing information provided by other auxiliary functional modules allows them to focus on viewing the relevant information provided by the navigation or vehicle control module, thus avoiding interference with the display of other core functional modules and impacting the user experience.

[0101] In another possible implementation, the auxiliary function module is fixed above or below the annular space in the 3D virtual space, and the horizontal viewing angle of the virtual camera is always such that the width of the auxiliary function module is fully displayed. That is, the auxiliary function module is always directly facing the virtual camera and does not rotate with the rotation of the annular space. In this way, when the current core function module displayed on the human-machine interface is any one of multiple core function modules, if the user performs an auxiliary information viewing operation, the auxiliary function module can be displayed on the human-machine interface to view the auxiliary information. This improves the convenience of viewing auxiliary information.

[0102] S403. When the auxiliary information viewing operation meets the first preset condition, the auxiliary function module is displayed on the human-machine interface.

[0103] When the auxiliary information viewing operation meets the first preset condition, it indicates that the user indeed wants to switch the current core function module on the human-machine interface to the auxiliary function module. Therefore, the switch from the current core function module to the auxiliary function module can be completed directly, and the auxiliary function module will be fully displayed on the human-machine interface. Taking multiple core function modules, namely the audio-visual module, vehicle control module, and navigation module, and the weather module as an example, the interface diagram for displaying the auxiliary function module on the human-machine interface can be seen in Figure 7.

[0104] In this embodiment, the content displayed on the human-machine interface may differ depending on the auxiliary function module being displayed. If the auxiliary function module is a weather module, the specific content displayed may include weather information. To make the weather information more vivid and engaging, the displayed content may also include a weather animation corresponding to the weather information; alternatively, it may include both weather information and its corresponding weather animation. That is, when the auxiliary information viewing operation meets the first preset condition, the auxiliary function module can be displayed on the human-machine interface by showing at least one of the following: weather information provided by the weather module and its corresponding weather animation.

[0105] Weather information can be related to describing weather conditions, such as temperature, weather type, and weather changes over a future period. Weather information can be derived from actual weather conditions, such as a temperature of 20℃ and a sunny weather type. Weather changes over a future period can reflect the temperature and weather type at different times; for example, at 14:00 the temperature is 30℃ and the weather type is cloudy; at 15:00 the temperature is 24℃ and the weather type is overcast; at 16:00 the temperature is 30℃ and the weather type is overcast, and so on.

[0106] Weather animations can be animations that reflect the current weather type. As time changes, if the weather type changes, the displayed weather animation can also change accordingly. For example, if the weather type is rainy, the entire background of the human-computer interface can display a rain animation effect. See Figure 8, which not only displays weather information similar to that in Figure 7, but also shows a rain animation effect in the background of the human-computer interface.

[0107] In this embodiment, the method for determining whether the auxiliary information viewing operation meets the first preset condition may differ, and consequently, the method of displaying the auxiliary function module on the human-machine interface when the auxiliary information viewing operation meets the first preset condition may differ. In one possible implementation, it can be determined whether the auxiliary information viewing operation meets the first preset condition based on whether the auxiliary information viewing operation has ended. In this case, when the auxiliary information viewing operation meets the first preset condition, the method of displaying the auxiliary function module on the human-machine interface may be: if the auxiliary information viewing operation ends, determine that the auxiliary information viewing operation meets the first preset condition, and then display the auxiliary function module on the human-machine interface. This allows the viewing of the auxiliary function module to be based on the user's operation, which is more in line with the user's intention.

[0108] In another possible implementation, it can be determined whether the auxiliary information viewing operation meets the first preset condition based on whether the progress of the switching transition reaches the preset progress. In this case, when the auxiliary information viewing operation meets the first preset condition, the auxiliary function module can be displayed on the human-machine interface if the progress of the switching transition from the current core function module to the auxiliary function module reaches the preset progress, and the auxiliary function module is then displayed on the human-machine interface.

[0109] Understandably, during the transition from the current core functional module to the auxiliary functional module, the current core functional module gradually exits the human-machine interface (HMI), while the auxiliary functional module gradually enters the HMI. Based on this, in one possible implementation, the transition progress can be the proportion of the current core functional module exiting the HMI or the proportion of the auxiliary functional module entering the HMI. Therefore, reaching a preset transition progress can be achieved when either the proportion of the current core functional module exiting the HMI or the proportion of the auxiliary functional module entering the HMI reaches a certain threshold.

[0110] In this embodiment, if the transition from the current core function module to the auxiliary function module reaches a preset progress, it indicates that the proportion of the auxiliary function module entering the human-machine interface is relatively large, and the system will automatically switch to the next auxiliary function module, thereby simplifying user operation and improving the viewing efficiency of the auxiliary function module.

[0111] Understandably, users may only view auxiliary information for a short period, primarily using the core functional modules. Therefore, when the auxiliary information viewing operation meets the first preset condition, after displaying the auxiliary functional module on the human-machine interface, if the user has finished viewing the relevant auxiliary information and needs to return to the core functional module, the user can perform an auxiliary information exit operation on the human-machine interface. If an auxiliary information exit operation is detected on the human-machine interface, during the exit operation, the auxiliary functional module displayed on the human-machine interface is switched back to the current core functional module according to the second direction corresponding to the exit operation. When the auxiliary information exit operation meets the second preset condition, the current core functional module is displayed again on the human-machine interface.

[0112] The exit operation for assistive information can be any operation that exits the assistive function module. This can be a directional operation or a non-directional operation. Directional operations include swiping (including single-finger swipes and two-finger swipes), while non-directional operations include long presses. The second direction can be the direction corresponding to the exit operation. This second direction can be fixed; for example, regardless of the exit operation, the second direction is always from the bottom to the top of the user interface. Alternatively, the second direction can change with the direction of the exit operation. For example, if the exit operation is a swipe, and the swipe is from the top to the bottom of the user interface (i.e., a swipe down), then the second direction can be from the top to the bottom. If the swipe is from the bottom to the top of the user interface (i.e., a swipe up), then the second direction can be from the bottom to the top. For example, the second direction can be the opposite of the first direction mentioned above.

[0113] In one possible implementation, the auxiliary information exit operation and the auxiliary information viewing operation can be opposite operations. For example, the auxiliary information viewing operation is a swipe down operation, that is, a swipe operation from the top to the bottom of the human-machine interface. Then the auxiliary information exit operation can be an swipe up operation, that is, a swipe operation from the bottom to the top of the human-machine interface.

[0114] As can be seen from the above technical solution, this application integrates the functions of the human-machine interface into a complete three-dimensional virtual space, where the core functional modules and auxiliary functional modules belong to the same level. The human-machine interface displays one functional module at a time, either a core functional module or an auxiliary functional module. When the current core functional module is displayed on the human-machine interface, if the user wishes to view auxiliary information, they can perform an auxiliary information viewing operation on the human-machine interface. During the execution of the auxiliary information viewing operation, the current core functional module displayed on the human-machine interface can be switched to an auxiliary functional module according to the first direction corresponding to the auxiliary information viewing operation. When the auxiliary information viewing operation meets the first preset condition, the auxiliary functional module is displayed on the human-machine interface, thereby switching the currently fully displayed core functional module on the human-machine interface to a fully displayed auxiliary functional module, allowing the user to view the auxiliary information provided by the auxiliary functional module. In this application, the auxiliary function module and multiple core function modules are in the same three-dimensional virtual space and at the same level. When viewing auxiliary information, users only need to interact within the same space and at the same level to switch the current core function module fully displayed on the human-computer interface to the auxiliary function module fully displayed, without having to jump between interfaces at different levels. This improves the display effect of the auxiliary function module and enhances the convenience and efficiency of viewing auxiliary information.

[0115] In addition, since a functional module is fully displayed on the human-machine interface at a time, users can perform auxiliary information viewing operations on the entire human-machine interface, rather than just clicking on the area where the auxiliary functional module is displayed on the human-machine interface, which improves the accuracy of operation and thus improves the accuracy of auxiliary information viewing.

[0116] When the human-machine interface is located on the vehicle's in-vehicle terminal, the method provided in this application can help users grasp vehicle information more intuitively and quickly, and operate the vehicle more safely and accurately. At the same time, it presents a more technologically advanced and futuristic visual experience, helping to create an overall immersive and technologically advanced atmosphere within the cockpit.

[0117] After introducing the method for displaying auxiliary function modules provided in this application embodiment from a front-end visualization perspective, since the display of auxiliary function modules in the front-end visualization requires back-end technology support, the method for displaying auxiliary function modules provided in this application embodiment will now be introduced from the perspective of back-end technology. Referring to Figure 9, Figure 9 shows a flowchart of a method for displaying auxiliary function modules. The method may include S901-S903, as detailed below:

[0118] S901. Obtain the current core functional module for the virtual camera to capture the view. The current core functional module is one of multiple core functional modules. The multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space. The auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space.

[0119] It should be noted that, under the premise of the human-computer interaction system described above, in the embodiment corresponding to Figure 4, which core functional module is displayed on the human-computer interface depends on which core functional module the virtual camera is viewing. If the virtual camera is viewing the first core functional module, then the first core functional module is displayed on the human-computer interface; if the virtual camera is viewing the second core functional module, then the second core functional module is displayed on the human-computer interface. The core functional module currently being viewed by the virtual camera can be called the current core functional module.

[0120] Therefore, before demonstrating the auxiliary function modules, it is necessary to determine which core function module is currently displayed on the human-machine interface. The core function module currently displayed on the human-machine interface is the core function module of the current virtual camera viewfinder. Therefore, we can first obtain the current core function module of the virtual camera viewfinder for subsequent use.

[0121] Among them, the current core functional module is one of multiple core functional modules. These multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space. The auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space, which will not be elaborated here.

[0122] Taking the audio-visual entertainment module, vehicle control module, and navigation module as examples, with the audio-visual entertainment module as the current core module, a top view of the annular space formed by the multiple core functional modules can be seen in Figure 10(a). The audio-visual entertainment module, vehicle control module, and navigation module each serve as an arc surface of the annular space. A certain gap can be maintained between adjacent arc surfaces, for example, the gap length is 50 pixels (px). The arc length of the audio-visual entertainment module is L1, the arc length of the vehicle control module is L2, and the arc length of the navigation module is L3. In S901, the virtual camera views the audio-visual entertainment module, meaning the audio-visual entertainment module appears within the field of view of the virtual camera, thus enabling its display on the human-machine interface. In Figure 10(a), the screen represented by the dashed line can represent the screen of the human-machine interface. When the audio-visual entertainment module is displayed on the human-machine interface, the corresponding display effect can be seen in Figure 10(b).

[0123] It should be noted that the current core functional module of the virtual camera viewfinder may differ depending on the circumstances. If at least one function switch operation has been performed, the current core functional module of the virtual camera viewfinder is the core functional module obtained after the previous function switch. If it is the first time entering the human-computer interface, i.e., the first time the human-computer interaction system is started, the current core functional module of the virtual camera viewfinder is the core functional module of the virtual camera viewfinder at the time of the first entry into the human-computer interface.

[0124] Understandably, during the function switching process, since the sizes of different core functional modules may be different, when switching to different core functional modules, the virtual camera's perspective can be adjusted according to the size of the switched core functional module, so that the corresponding core functional module can be fully displayed on the human-machine interface.

[0125] In one possible implementation, the different core functional modules constituting the annular space have the same height but may have different widths. Therefore, the way to adjust the virtual camera's viewing angle according to the size of the switched core functional module is to adjust the virtual camera's lateral viewing angle according to the width of the switched core functional module.

[0126] Assuming the corresponding core functional modules are fully displayed on the human-computer interface, calculate the horizontal viewing angle of the virtual camera when framing any core functional module. The calculation method can be (1) calculate the total perimeter c of the annular space; (2) calculate the radius r of the annular space, r = c / 2π; (3) calculate the viewing angle n of the virtual camera, n = (the arc length of the core functional module after switching / 2πR) * 360°.

[0127] Referring to Figure 10(a), the core functional modules are the audio-visual entertainment module, the vehicle control module, and the navigation module. The core functional module after switching is the audio-visual entertainment module. If the arc length of the audio-visual entertainment module is L1, the arc length of the vehicle control module is L2, and the arc length of the navigation module is L3, and the gap length between two adjacent arcs is 50px, then the total perimeter of the annular space c = L1 + L2 + L3 + 50 × 3, and the radius of the annular space r = c / 2π. According to the formula (arc length of the core functional module after switching / 2πR) * 360°, the lateral viewing angle of the virtual camera n = (L1 / 2πR) * 360° is calculated.

[0128] It should be noted that the core functional module for virtual camera framing when first entering the human-machine interface can be a randomly selected core functional module from multiple core functional modules, or it can be a pre-set default core functional module from multiple core functional modules. The default core functional module can be the core functional module that the user most wants to display on the human-machine interface. In some cases, the default core functional module can be set based on the frequency or importance of the core functional module's use; however, this application embodiment does not limit this.

[0129] For example, the core functional modules are the audio entertainment module, the vehicle control module, and the navigation module. Since users spend most of their time using the audio entertainment module, it can be set as the default core functional module.

[0130] If the core function module for virtual camera framing is the default core function module when entering the human-computer interface, the way to obtain the current core function module for virtual camera framing is to detect whether the human-computer interaction system of the human-computer interface is being started for the first time. If it is detected that the human-computer interaction system of the human-computer interface is being started for the first time, the default core function module among multiple core function modules is determined to be the current core function module for virtual camera framing, and then the current core function module is obtained.

[0131] In this embodiment, when the user first enters the human-machine interface, the virtual camera is controlled to view the default core function module. This allows the user to quickly and directly display the core function module that they prefer on the human-machine interface, avoiding unnecessary function switching operations and improving the user experience.

[0132] S902. If an auxiliary information viewing operation is detected on the human-machine interface, during the execution of the auxiliary information viewing operation, the virtual camera framing function module is controlled to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

[0133] When the core functional modules are displayed on the human-machine interface, if the user needs to view auxiliary information, such as weather information or notification information, the user can perform an auxiliary information viewing operation on the human-machine interface. Specifically, the user can perform an auxiliary information viewing operation on the human-machine interface, thereby switching the function module that controls the virtual camera to view the view from the current core functional module to the auxiliary functional module in response to the auxiliary information viewing operation.

[0134] During the auxiliary information viewing operation, the virtual camera framing function module gradually switches from the current core function module to the auxiliary function module. This entire process involves controlling the virtual camera framing function module to transition from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

[0135] Assistive information viewing operations can be various operations that allow viewing assistive information. These can be directional or non-directional operations. Directional operations include swiping (including single-finger swiping and two-finger swiping), while non-directional operations include long-press operations. The first direction can be the direction corresponding to the assistive information viewing operation. This first direction can be fixed; for example, regardless of the assistive information viewing operation, the first direction is always from the top to the bottom of the human-machine interface. Alternatively, the first direction can change according to the direction of the assistive information viewing operation. For example, if the assistive information viewing operation is a swipe, and the swipe is from the top to the bottom of the human-machine interface (i.e., a swipe down), then the first direction can be from the top to the bottom of the human-machine interface. If the swipe is from the bottom to the top of the human-machine interface (i.e., a swipe up), then the first direction can be from the bottom to the top of the human-machine interface.

[0136] It should be noted that, based on the aforementioned human-computer interaction system, since the auxiliary function module is located above or below the annular space formed by the core function module in the three-dimensional virtual space, in order to make this positional relationship visible on the human-computer interface, in this embodiment, the left and right swiping operation can be used as the function switching operation, the target direction for switching different core function modules is determined as the horizontal direction of the human-computer interface (i.e., from the left side to the right side of the human-computer interface, or from the right side to the left side of the human-computer interface), the up and down swiping operation is used as the auxiliary information viewing operation, and the first direction for switching between the current core function module and the auxiliary function module is determined as the vertical direction of the human-computer interface (i.e., from the top to the bottom of the human-computer interface, or from the bottom to the top of the human-computer interface).

[0137] It is understood that in the embodiments of this application, the auxiliary function module is located above or below the annular space. In one implementation, the auxiliary function module is located above or below a specific core function module, such as the target core function module, included in the annular space in the three-dimensional virtual space, so that the auxiliary function module can always be synchronized with the target core function module. Since the annular space can rotate around a rotation axis, the target core function module will also rotate with the auxiliary function module. When the current core function module captured by the virtual camera is not the target core function module, it may be difficult to make the auxiliary function module appear in the field of view of the virtual camera simply by adjusting the tilt angle of the virtual camera. In this case, S902 can be implemented as follows: if an auxiliary information viewing operation is detected on the human-machine interface, and the current core function module is the target core function module, during the auxiliary information viewing operation, the tilt angle of the virtual camera is controlled to change according to the first direction corresponding to the auxiliary information viewing operation; during the change of the tilt angle of the virtual camera, the function module captured by the virtual camera switches from the current core function module to the auxiliary function module.

[0138] In other words, under the aforementioned human-computer interaction system, the auxiliary information viewing operation needs to be performed when the virtual camera is focused on the target core functional module. This is to enable the virtual camera to be focused on the auxiliary functional module by adjusting its tilt angle, thereby displaying the auxiliary functional module on the human-computer interface and enabling the viewing of auxiliary information. This avoids affecting the display of other core functional modules and impacting the user experience.

[0139] For example, the core functional modules include an audio-visual entertainment module, a vehicle control module, and a navigation module, while the auxiliary functional module is a weather module. Since the navigation and vehicle control modules are crucial for vehicle control, users don't want other information to interfere with their use of these core functional modules. Therefore, the weather module can be positioned above or below the audio-visual entertainment module (the target core functional module). This way, the weather module can only be displayed when the virtual camera is focused on the audio-visual entertainment module, allowing users to view auxiliary information. When the virtual camera is focused on the navigation or vehicle control module, users are restricted from viewing information provided by other auxiliary functional modules, allowing them to focus on the relevant information provided by those modules and avoiding interference with the display of other core functional modules, thus impacting the user experience.

[0140] In another possible implementation, the auxiliary function module is fixed above or below the annular space in the three-dimensional virtual space, and the lateral viewing angle of the virtual camera is always the angle that fully displays the width of the auxiliary function module. That is, the auxiliary function module is always directly facing the virtual camera and does not rotate with the rotation of the annular space. Thus, when the current core function module being viewed by the virtual camera is any one of multiple core function modules, the implementation of S902 can be as follows: if an auxiliary information viewing operation is detected on the human-machine interface, during the auxiliary information viewing operation, the tilt angle of the virtual camera is controlled to change according to the first direction corresponding to the auxiliary information viewing operation; as the tilt angle of the virtual camera changes, the function module being viewed by the virtual camera switches from the current core function module to the auxiliary function module. In other words, in the above case, when the current core function module being viewed by the virtual camera is any one of multiple core function modules, if the user performs an auxiliary information viewing operation, the tilt angle of the virtual camera can be adjusted to switch the function module being viewed from the current core function module to the auxiliary function module, thereby enabling the viewing of auxiliary information. This improves the ease of viewing supplementary information.

[0141] S903. If it is determined that the auxiliary information viewing operation meets the first preset condition, control the virtual camera to view the auxiliary function module so as to display the auxiliary function module on the human-machine interface.

[0142] When the auxiliary information viewing operation meets the first preset condition, it means that the user does want to switch the current core function module on the human-machine interface to the auxiliary function module. Therefore, the switch from the current core function module to the auxiliary function module can be completed directly, and the virtual camera can be controlled to view the auxiliary function module so as to display the auxiliary function module on the human-machine interface.

[0143] Continuing with the example of the annular space shown in Figure 10(a), the core functional modules constituting the annular space are the audio-visual module, the vehicle control module, and the navigation module. Currently, the core functional module is the audio-visual module, and the auxiliary functional module is the weather module. The weather module is fixed above or below the annular space in the three-dimensional virtual space, and the horizontal view of the virtual camera is always the view that fully displays the width of the auxiliary functional module. At this time, the side view of the audio-visual module, the weather module, and the virtual camera in the three-dimensional virtual space can be seen in Figure 11(a). When the virtual camera is viewing the audio-visual module, see the dashed line in Figure (a); when the virtual camera is viewing the weather module, see the solid line in Figure (a). Therefore, when the weather module is displayed on the human-machine interface, the corresponding display effect of the human-machine interface can be seen in Figure 11(b).

[0144] In this embodiment, the method for determining whether the auxiliary information viewing operation meets the first preset condition may differ, and consequently, the method for controlling the virtual camera to view the auxiliary function module may also differ if the auxiliary information viewing operation meets the first preset condition. In one possible implementation, the auxiliary information viewing operation causes a change in the pitch angle of the virtual camera, resulting in a change angle. Whether the auxiliary information viewing operation meets the first preset condition can be reflected by the magnitude of the change angle. Therefore, in this embodiment, the change angle is calculated during the change of the virtual camera's pitch angle. The larger the change angle, the greater the progress of the transition from the current core function module to the auxiliary function module, indicating that the auxiliary information viewing operation is more likely to meet the first preset condition. In this case, if the auxiliary information viewing operation meets the first preset condition, the method for controlling the virtual camera to view the auxiliary function module may be that if the change angle reaches an angle threshold, the auxiliary information viewing operation meets the first preset condition, and the virtual camera is controlled to view the auxiliary function module.

[0145] The calculation method for the changed angle may differ depending on the auxiliary information viewing operation. For example, if the auxiliary information viewing operation is a swipe, the changed angle can be calculated based on the swipe distance.

[0146] It should be noted that the embodiments of this application do not limit the setting of the angle threshold. In one possible implementation, the angle threshold can be a pre-set fixed value. In another possible implementation, the auxiliary function module is located above or below the annular space. Therefore, the pitch angles are different when the virtual camera views the auxiliary function module and when it views the core function module. Thus, the angle threshold can be determined based on the pitch angle of the virtual camera viewing the auxiliary function module, which can be called the target pitch angle. For example, a certain percentage of the target pitch angle can be used as the angle threshold. This certain percentage can be any percentage, such as 1 / 3.

[0147] In the above scenario, the angle threshold can be determined by calculating a first angle based on the height of the auxiliary function module and the distance from the virtual camera to the auxiliary function module; calculating a second angle based on the height of the current core function module and the distance from the virtual camera to the current core function module; determining the target pitch angle when the virtual camera views the auxiliary function module based on the first and second angles; and then using the target pitch angle to determine the angle threshold. The first angle can be half the longitudinal viewpoint of the virtual camera to the auxiliary function module, and the second angle can be half the longitudinal viewpoint of the virtual camera to the current core function module. The longitudinal viewpoint is the viewpoint of the virtual camera along the height direction of the function module when the height of the function module (e.g., the auxiliary function module or the current core function module) is completely within the shooting range of the virtual camera. When multiple core function modules are arranged in a ring-shaped pattern in a three-dimensional virtual space, the height mentioned here can be the vertical distance of the auxiliary function module relative to the ring-shaped space in that three-dimensional virtual space.

[0148] The following example, using an angle threshold of 1 / 3 of the target pitch angle, illustrates how to determine whether a change in angle reaches the angle threshold. Referring to Figure 12, the auxiliary function module is the weather module, with height 'a'. Multiple core function modules share height 'b'. The current core function module is any one of these modules, such as the audio / video module. The distance from the virtual camera to a function module, such as the current core module or the auxiliary function module, is 'c'. The lower edge of the weather module is very close to the upper edge of the music module, even touching it. In this case, the first angle ∠A and the second angle ∠B can be calculated, thus determining the target pitch angle as the sum of ∠A and ∠B.

[0149] Taking a weather module with a height 'a' of 1080px, an audio-visual module with a height 'b' of 900px, and a virtual camera distance 'c' of 1850px from a functional module (such as the audio-visual module) as an example, as shown in Figure 12, according to the inverse trigonometric function, we have: tanA = 0.5a / c = 0.5 × 1080 / 1850 = 27 / 92.5, therefore ∠A = arctan(0.29) ≈ 16°. Similarly, we get tanA = 0.5b / c = 0.5 × 900 / 1850 = 450 / 1850, therefore ∠B = arctan(450 / 1850) ≈ 13°. Therefore, the target pitch angle is ∠N2, ∠N2 = ∠A + ∠B = 16° + 13° = 29°. The angle threshold is 1 / 3 of the target pitch angle, therefore the angle threshold ≈ 10°. Therefore, when the virtual camera changes angle by 10°, the virtual camera is controlled to directly view the weather module.

[0150] When the distance between the lower edge of the weather module and the upper edge of the music module is relatively large, when calculating the target pitch angle, the additional angle formed between the lower edge of the weather module and the upper edge of the music module can be considered. In this case, the target pitch angle is the sum of the first angle, the second angle, and the additional angle.

[0151] In this embodiment, when the angle change reaches the angle threshold, it indicates that the virtual camera's viewpoint is closer to the auxiliary function module, and the system automatically switches to the auxiliary function module, thereby simplifying user operation and improving the efficiency of viewing auxiliary information.

[0152] In another possible implementation, it can be determined whether the auxiliary information viewing operation meets the first preset condition based on whether the auxiliary information viewing operation has ended. If it is determined that the auxiliary information viewing operation meets the first preset condition, the way to control the virtual camera to view the auxiliary function module is to determine that the auxiliary information viewing operation meets the first preset condition and control the virtual camera to view the auxiliary function module if the auxiliary information viewing operation is detected to have ended.

[0153] In this embodiment, the sizes of different functional modules may vary, and the required shooting range differs depending on the size of the functional module. The shooting range is related to the virtual camera's viewing angle. Therefore, after controlling the virtual camera to frame the auxiliary functional module, to ensure the auxiliary functional module can be fully displayed on the human-machine interface, the virtual camera's viewing angle can be adjusted according to the size of the auxiliary functional module. This adjusts the shooting range of the virtual camera, ensuring the auxiliary functional module is completely captured and thus fully displayed on the human-machine interface.

[0154] In some possible implementations, if the virtual camera's framing function module can be switched from the current core function module to the auxiliary function module simply by adjusting the virtual camera's tilt angle, especially when the auxiliary function module is fixed above or below the annular space in the three-dimensional virtual space, and the virtual camera's horizontal viewing angle is always the viewing angle that fully displays the width of the auxiliary function module, then adjusting the virtual camera's viewing angle according to the size of the auxiliary function module can specifically be adjusting the virtual camera's vertical viewing angle according to the height of the auxiliary function module, so that its vertical viewing angle is adjusted to be able to fully display the height of the auxiliary function module.

[0155] In this embodiment, the longitudinal viewpoint that the virtual camera captures the view of the auxiliary function module and that allows the height of the auxiliary function module to be fully displayed can be represented by N1. N1 is twice the first angle. Therefore, the first angle can be calculated first to obtain the longitudinal viewpoint that can fully display the height of the auxiliary function module.

[0156] Continuing with the side view shown in Figure 12 as an example, the first angle ∠A = arctan(0.29) ≈ 16°. Therefore, the vertical viewing angle N1 = 2 * ∠A = 32° is sufficient for the virtual camera to fully display the height of the auxiliary function module. Thus, when the virtual camera is framing the auxiliary function module, its vertical viewing angle can be adjusted to 32°.

[0157] In this embodiment, the virtual camera's viewing angle can be dynamically adjusted according to the size of the functional module being viewed, so as to fully display the auxiliary functional module being viewed on the human-computer interface, avoid missing content of the auxiliary functional module, and ensure user experience.

[0158] Understandably, users may only view auxiliary information for a short period, and primarily use the core functional modules. Therefore, when the auxiliary information viewing operation meets the first preset condition, after controlling the virtual camera to view the auxiliary functional module, if the user has finished viewing the relevant auxiliary information and needs to return to the core functional module, the user can perform an auxiliary information exit operation on the human-machine interface. If an auxiliary information exit operation is detected on the human-machine interface, during the auxiliary information exit operation, the function module controlled by the virtual camera to view the auxiliary functional module will switch from the current core functional module according to the second direction corresponding to the auxiliary information exit operation. If it is determined that the auxiliary information exit operation meets the second preset condition, the virtual camera will re-view the current core functional module to redisplay the current core functional module on the human-machine interface.

[0159] The exit operation for assistive information can be any operation that exits the assistive function module. This can be a directional operation or a non-directional operation. Directional operations include swiping (including single-finger swipes and two-finger swipes), while non-directional operations include long presses. The second direction can be the direction corresponding to the exit operation. This second direction can be fixed; for example, regardless of the exit operation, the second direction is always from the bottom to the top of the user interface. Alternatively, the second direction can change with the direction of the exit operation if it is directional. For example, if the exit operation is a swipe, and the swipe is from the top to the bottom of the user interface (i.e., a swipe down), then the second direction can be from the top to the bottom of the user interface. If the swipe is from the bottom to the top of the user interface (i.e., a swipe up), then the second direction can be from the bottom to the top of the user interface.

[0160] In one possible implementation, the auxiliary information exit operation and the auxiliary information viewing operation can be opposite operations. For example, the auxiliary information viewing operation is a swipe down operation, that is, a swipe operation from the top to the bottom of the human-machine interface. Then the auxiliary information exit operation can be an swipe up operation, that is, a swipe operation from the bottom to the top of the human-machine interface.

[0161] As can be seen from the above technical solution, this application integrates the functions of the human-machine interface into a complete three-dimensional virtual space. Multiple core functional modules are arranged in a ring-shaped pattern within the three-dimensional virtual space associated with the human-machine interface. The virtual camera is positioned at the center of this ring, and auxiliary functional modules are located above or below the ring in the three-dimensional virtual space. By controlling the virtual camera to view different functional modules, auxiliary information can be viewed. Specifically, the current core functional module viewed by the virtual camera is obtained. If the user wishes to view auxiliary information, an auxiliary information viewing operation can be performed on the human-machine interface. If an auxiliary information viewing operation is detected on the human-machine interface, during the operation, the function module viewed by the virtual camera can be switched from the current core functional module to the auxiliary functional module according to the first direction corresponding to the auxiliary information viewing operation. When the auxiliary information viewing operation meets the first preset condition, the virtual camera is controlled to view the auxiliary functional module, so that the auxiliary functional module can be displayed on the human-machine interface for the user to view the auxiliary information provided by the auxiliary functional module. In this application, the auxiliary function module and multiple core function modules are in the same three-dimensional virtual space and at the same level. When viewing auxiliary information, the user only needs to interact within the same space and at the same level. By controlling the virtual camera to switch from framing to the current core function module to framing to the auxiliary function module, the user can switch the current core function module fully displayed on the human-computer interface to the auxiliary function module fully displayed. There is no need to jump between interfaces at different levels, which improves the display effect of the auxiliary function module and enhances the convenience and efficiency of viewing auxiliary information.

[0162] Understandably, when the human-machine interface (HMI) is located on an in-vehicle terminal, the display of the entire auxiliary function module involves multi-sided interactions. These multi-sided interactions include the user, the vehicle infotainment system, the HMI, the data terminal, and the server. The user interacts with the vehicle infotainment system or HMI; the vehicle infotainment system refers to the in-vehicle infotainment product installed in the vehicle, which can be an in-vehicle terminal, constituting the vehicle's HMI interaction system; the data terminal stores various data, and the server retrieves the corresponding data from the data terminal and provides it to the HMI so that the corresponding function modules can be displayed on the HMI according to the data.

[0163] In this case, the signaling interaction diagram of the auxiliary function module display method can be seen in Figure 13, and the method includes:

[0164] S1301, In response to the user's vehicle infotainment system startup operation, load system content.

[0165] Since the vehicle's infotainment system constitutes the human-machine interface (HMI) system, the vehicle startup operation can be considered a system startup operation, thereby activating the HMI system. The loaded system content can include all the necessary information for the HMI system, such as resolution data. Resolution data may include the display area width of the HMI, the curvature length of the audio-visual module, the curvature length of the vehicle control module, the curvature length of the navigation module, etc., for subsequent calculations and HMI display.

[0166] S1302, Provide resolution data to the human-machine interface through the vehicle's infotainment system.

[0167] The vehicle's infotainment system provides resolution data to the human-machine interface (HMI) for display and subsequent calculations.

[0168] S1303, Obtain various data from the data source through the server.

[0169] Various types of data can include the data required for the human-machine interface to provide various functions, such as audio sources, vehicle data, weather data, etc.

[0170] S1304. Provide data from the audio-visual module to the human-machine interface via the server.

[0171] When the vehicle's infotainment system is turned on and the human-machine interface (HMI) is accessed for the first time, the HMI can display the audio / entertainment module by default. Therefore, in order for the audio / entertainment module to be displayed on the HMI, the server can provide the HMI with data from the audio / entertainment module. This data can include various data required by the audio / entertainment module to provide corresponding functions, such as playlist covers, artist names, and movie covers.

[0172] S1305, The server provides the viewpoint of the virtual camera to the human-machine interface.

[0173] S1306. The human-machine interface obtains auxiliary information viewing operations performed by the user.

[0174] If a user wants to view auxiliary information, such as weather information, on the human-machine interface, the user can perform an auxiliary information viewing operation on the human-machine interface to display auxiliary function modules, such as the weather module, thereby realizing the viewing of auxiliary information.

[0175] S1307 The server provides the human-machine interface with temperature, weather type, weather animation, etc. for multiple time periods.

[0176] The server can provide various weather information to the human-computer interface, including temperature, weather type, and corresponding weather animations, thereby displaying temperature, weather type, and weather animations for multiple time periods on the human-computer interface.

[0177] S1308, The human-machine interface obtains the function switching operation performed by the user.

[0178] When core functional modules are displayed on the human-machine interface (HMI), users can perform function switching operations within the HMI to change the displayed core functional module. In one possible implementation, a single function switching operation can switch to the next adjacent core functional module. In an in-vehicle infotainment system (IVS) scenario, the next core functional module could be the vehicle control module.

[0179] S1309, The human-machine interface requests data from the next core functional module.

[0180] S1310, The server provides data from the vehicle control module to the human-machine interface.

[0181] The server provides data from the vehicle control module to the human-machine interface (HMI) so that the vehicle control module can be displayed on the HMI based on this data. This allows for a function switching operation, allowing the audio-visual module to be switched to the vehicle control module. The data from the vehicle control module provides the necessary information for its various functions, such as vehicle model and vehicle status data.

[0182] This application integrates the entire HMI functionality into a complete three-dimensional virtual space, arranging the three core functional modules—audio entertainment, vehicle control, and navigation—in a 360° surround layout. The display and switching of different core functional modules are achieved by changing the view of the core modules through a virtual camera. Additionally, auxiliary functional modules are located above or below the circular space in the three-dimensional virtual space. When displaying core functional modules on the human-machine interface, switching between core and auxiliary functional modules via the virtual camera view allows for the viewing of auxiliary information. Thus, users only need to interact within the same space and at the same level, eliminating the need to switch between different interface levels. This improves the display effect of auxiliary functional modules, enhances the convenience and efficiency of viewing auxiliary information, and increases the accuracy and efficiency of switching between core functional modules. The method provided by this application helps users grasp vehicle information more intuitively and quickly, and operate the vehicle more safely and accurately. Simultaneously, it presents a more technologically advanced and forward-looking experience, helping to create an overall immersive and technologically advanced feel within the cockpit.

[0183] It should be noted that, based on the implementation methods provided in the above aspects, this application can be further combined to provide more implementation methods.

[0184] Based on the auxiliary function module display method provided in the foregoing embodiments, this application also provides an auxiliary function module display device 1400. Referring to FIG14, the auxiliary function module display device 1400 includes a display unit 1401 and a switching unit 1402:

[0185] The display unit 1401 is used to display the current core functional module among multiple core functional modules on the human-machine interface.

[0186] The switching unit 1402 is used to, if an auxiliary information viewing operation is obtained on the human-machine interface, switch the current core function module displayed on the human-machine interface to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation during the execution of the auxiliary information viewing operation.

[0187] The display unit 1401 is also used to display the auxiliary function module on the human-machine interface when the auxiliary information viewing operation meets the first preset condition.

[0188] In one possible implementation, the switching unit 1402 is configured to:

[0189] If an auxiliary information viewing operation is obtained on the human-machine interface, and the current core function module is the target core function module, during the execution of the auxiliary information viewing operation, the current core function module displayed on the human-machine interface is switched to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

[0190] In one possible implementation, the current core functional module is any one of the plurality of core functional modules.

[0191] In one possible implementation, the display unit 1401 is used for:

[0192] If the auxiliary information viewing operation ends, it is determined that the auxiliary information viewing operation meets the first preset condition, and the auxiliary function module is displayed on the human-machine interface.

[0193] In one possible implementation, the display unit 1401 is used for:

[0194] If the progress of switching from the current core function module to the auxiliary function module reaches a preset progress, it is determined that the auxiliary information viewing operation meets the first preset condition, and the auxiliary function module is displayed on the human-machine interface.

[0195] In one possible implementation, the display unit 1401 is further configured to, when the auxiliary information viewing operation meets the first preset condition, after displaying the auxiliary function module on the human-machine interface, if an auxiliary information exit operation executed on the human-machine interface is obtained, during the execution of the auxiliary information exit operation, switch the auxiliary function module displayed on the human-machine interface back to the current core function module according to the second direction corresponding to the auxiliary information exit operation; and when the auxiliary information exit operation meets the second preset condition, re-display the current core function module on the human-machine interface.

[0196] In one possible implementation, the auxiliary function module is a weather module, and the display unit 1401 is used for:

[0197] When the auxiliary information viewing operation meets the first preset condition, at least one of the weather information provided by the weather module and the weather animation corresponding to the weather information is displayed on the human-machine interface.

[0198] As can be seen from the above technical solution, this application integrates the functions of the human-machine interface into a complete three-dimensional virtual space, where the core functional modules and auxiliary functional modules belong to the same level. The human-machine interface displays one functional module at a time, either a core functional module or an auxiliary functional module. When the current core functional module is displayed on the human-machine interface, if the user wishes to view auxiliary information, they can perform an auxiliary information viewing operation on the human-machine interface. During the execution of the auxiliary information viewing operation, the current core functional module displayed on the human-machine interface can be switched to an auxiliary functional module according to the first direction corresponding to the auxiliary information viewing operation. When the auxiliary information viewing operation meets the first preset condition, the auxiliary functional module is displayed on the human-machine interface, thereby switching the currently fully displayed core functional module on the human-machine interface to a fully displayed auxiliary functional module, allowing the user to view the auxiliary information provided by the auxiliary functional module. In this application, the auxiliary function module and multiple core function modules are in the same three-dimensional virtual space and at the same level. When viewing auxiliary information, users only need to interact within the same space and at the same level to switch the current core function module fully displayed on the human-computer interface to the auxiliary function module fully displayed, without having to jump between interfaces at different levels. This improves the display effect of the auxiliary function module and enhances the convenience and efficiency of viewing auxiliary information.

[0199] Based on the auxiliary function module display method provided in the foregoing embodiments, this application embodiment also provides another auxiliary function module display device 1500. Referring to FIG15, the auxiliary function module display device 1500 includes an acquisition unit 1501 and a control unit 1502:

[0200] The acquisition unit 1501 is used to acquire the current core functional module of the virtual camera framing. The current core functional module is one of multiple core functional modules. The multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space. The auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space.

[0201] The control unit 1502 is configured to, if an auxiliary information viewing operation is detected on the human-machine interface, control the virtual camera framing function module to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation during the execution of the auxiliary information viewing operation.

[0202] The control unit 1502 is further configured to, if it is determined that the auxiliary information viewing operation meets the first preset condition, control the virtual camera to view the auxiliary function module so as to display the auxiliary function module on the human-machine interface.

[0203] In one possible implementation, the auxiliary function module is located above or below the target core function module included in the annular space in the three-dimensional virtual space, and the control unit 1502 is used for:

[0204] If an auxiliary information viewing operation is detected on the human-machine interface, and the current core function module is the target core function module, during the execution of the auxiliary information viewing operation, the tilt angle of the virtual camera is controlled to change in accordance with the first direction corresponding to the auxiliary information viewing operation.

[0205] As the pitch angle of the virtual camera changes, the virtual camera's framing function module switches from the current core function module to the auxiliary function module.

[0206] In one possible implementation, the auxiliary function module is fixed above or below the annular space in the three-dimensional virtual space, and the horizontal viewing angle of the virtual camera is always a viewing angle that fully displays the width of the auxiliary function module. Then, the current core function module is any one of the multiple core function modules.

[0207] The control unit 1502 is used for:

[0208] If an auxiliary information viewing operation is detected on the human-machine interface, during the execution of the auxiliary information viewing operation, the tilt angle of the virtual camera is controlled to change in accordance with the first direction corresponding to the auxiliary information viewing operation.

[0209] As the pitch angle of the virtual camera changes, the virtual camera's framing function module switches from the current core function module to the auxiliary function module.

[0210] In one possible implementation, the device further includes a computing unit:

[0211] The calculation unit is used to calculate the changing angle as the pitch angle of the virtual camera changes.

[0212] The control unit 1502 is used for:

[0213] If it is determined that the changed angle reaches the angle threshold, it is determined that the auxiliary information viewing operation meets the first preset condition, and the virtual camera is controlled to view the auxiliary function module.

[0214] In one possible implementation, the device further includes a computing unit:

[0215] The calculation unit is configured to calculate a first angle based on the height of the auxiliary function module and the distance from the virtual camera to the auxiliary function module; calculate a second angle based on the height of the current core function module and the distance from the virtual camera to the current core function module; determine the target pitch angle when the virtual camera views the auxiliary function module based on the first angle and the second angle; and determine the angle threshold using the target pitch angle.

[0216] In one possible implementation, the control unit 1502 is configured to:

[0217] If the auxiliary information viewing operation is detected to have ended, it is determined that the auxiliary information viewing operation meets the first preset condition, and the virtual camera is controlled to view the auxiliary function module.

[0218] In one possible implementation, the device further includes an adjustment unit:

[0219] The adjustment unit is used to adjust the viewing angle of the virtual camera according to the size of the auxiliary function module after controlling the virtual camera to view the auxiliary function module if it is determined that the auxiliary information viewing operation meets the first preset condition.

[0220] In one possible implementation, the control unit 1502 is further configured to, if it is determined that the auxiliary information viewing operation meets a first preset condition, control the virtual camera to view the auxiliary function module, and if an auxiliary information exit operation is detected on the human-machine interface, during the execution of the auxiliary information exit operation, control the virtual camera to switch from the auxiliary function module to the current core function module according to the second direction corresponding to the auxiliary information exit operation; if it is determined that the auxiliary information exit operation meets a second preset condition, control the virtual camera to re-view the current core function module so as to re-display the current core function module on the human-machine interface.

[0221] As can be seen from the above technical solution, this application integrates the functions of the human-machine interface into a complete three-dimensional virtual space. Multiple core functional modules are arranged in a ring-shaped pattern within the three-dimensional virtual space associated with the human-machine interface. The virtual camera is positioned at the center of this ring, and auxiliary functional modules are located above or below the ring in the three-dimensional virtual space. By controlling the virtual camera to view different functional modules, auxiliary information can be viewed. Specifically, the current core functional module viewed by the virtual camera is selected. If the user wishes to view auxiliary information, they can perform an auxiliary information viewing operation on the human-machine interface. During the auxiliary information viewing operation, the function module viewed by the virtual camera can be switched from the current core functional module to the auxiliary functional module according to the first direction corresponding to the auxiliary information viewing operation. When the auxiliary information viewing operation meets the first preset condition, the virtual camera is controlled to view the auxiliary functional module, so that the auxiliary functional module is displayed on the human-machine interface, allowing the user to view the auxiliary information provided by the auxiliary functional module. In this application, the auxiliary function module and multiple core function modules are in the same three-dimensional virtual space and at the same level. When viewing auxiliary information, the user only needs to interact within the same space and at the same level. By controlling the virtual camera to switch from framing to the current core function module to framing to the auxiliary function module, the user can switch the current core function module fully displayed on the human-computer interface to the auxiliary function module fully displayed. There is no need to jump between interfaces at different levels, which improves the display effect of the auxiliary function module and enhances the convenience and efficiency of viewing auxiliary information.

[0222] This application also provides a computer device capable of executing a method for displaying auxiliary function modules. This computer device can be a terminal; Figure 16 shows a structural diagram of a terminal provided in this application. In Figure 16, a smartphone is used as an example of the terminal:

[0223] Referring to Figure 16, a smartphone includes components such as: a radio frequency (RF) circuit 1610, a memory 1620, an input unit 1630, a display unit 1640, a sensor 1650, an audio circuit 1660, a Wi-Fi module 1670, a processor 1680, and a power supply 1690. The input unit 1630 may include a touch panel 1631 and other input devices 1632, the display unit 1640 may include a display panel 1641, and the audio circuit 1660 may include a speaker 1661 and a microphone 1662. It is understood that the smartphone structure shown in Figure 16 does not constitute a limitation on the smartphone, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0224] The memory 1620 can be used to store software programs and modules. The processor 1680 executes various functions and data processing of the smartphone by running the software programs and modules stored in the memory 1620. The memory 1620 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the smartphone (such as audio data, phonebook, etc.). In addition, the memory 1620 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0225] The processor 1680 is the control center of the smartphone, connecting various parts of the smartphone via various interfaces and lines. It performs various functions and processes data by running or executing software programs and / or modules stored in the memory 1620 and by accessing data stored in the memory 1620. Optionally, the processor 1680 may include one or more processing units; preferably, the processor 1680 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 1680.

[0226] In this embodiment, the processor 1680 in the smartphone can execute the display method of the auxiliary function module provided in the various embodiments of this application.

[0227] The computer device provided in this application embodiment can also be a server. Please refer to Figure 17, which is a structural diagram of the server 1700 provided in this application embodiment. The server 1700 can vary significantly due to different configurations or performance, and may include one or more processors, such as a Central Processing Unit (CPU) 1722, and a memory 1732, and one or more storage media 1730 (e.g., one or more mass storage devices) for storing application programs 1742 or data 1744. The memory 1732 and storage media 1730 can be temporary or persistent storage. The program stored in the storage media 1730 may include one or more modules (not shown in the figure), each module may include a series of instruction operations on the server. Furthermore, the CPU 1722 may be configured to communicate with the storage media 1730 and execute the series of instruction operations in the storage media 1730 on the server 1700.

[0228] Server 1700 may also include one or more power supplies 1726, one or more wired or wireless network interfaces 1750, one or more input / output interfaces 1758, and / or one or more operating systems 1741, such as Windows Server. TM Mac OS X TM Unix TM Linux TM FreeBSD TM etc.

[0229] In this embodiment, the central processing unit 1722 in the server 1700 can execute the display method of the auxiliary function module provided in the various embodiments of this application.

[0230] According to one aspect of this application, a computer-readable storage medium is provided for storing a computer program for executing the method of displaying auxiliary function modules described in the foregoing embodiments.

[0231] According to one aspect of this application, a computer program product is provided, comprising a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the methods provided in various optional implementations of the above embodiments.

[0232] The descriptions of the processes or structures corresponding to the above figures each have their own emphasis. For parts of a process or structure that are not described in detail, please refer to the relevant descriptions of other processes or structures.

[0233] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0234] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between apparatuses or units through some interfaces, and may be electrical, mechanical, or other forms.

[0235] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0236] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0237] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a terminal, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing computer programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0238] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0239] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for displaying an auxiliary function module, the method being executed by a computer device, the method comprising: Display the current core functional module among multiple core functional modules on the human-computer interface; If an auxiliary information viewing operation is obtained on the human-machine interface, during the execution of the auxiliary information viewing operation, the current core function module displayed on the human-machine interface is switched to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation. When the auxiliary information viewing operation meets the first preset condition, the auxiliary function module is displayed on the human-machine interface.

2. The method according to claim 1, wherein if an auxiliary information viewing operation is obtained on the human-machine interface, during the execution of the auxiliary information viewing operation, the current core function module displayed on the human-machine interface is switched to an auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation, comprising: If an auxiliary information viewing operation is obtained on the human-machine interface, and the current core function module is the target core function module, during the execution of the auxiliary information viewing operation, the current core function module displayed on the human-machine interface is switched to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation.

3. The method according to claim 1, wherein the current core functional module is any one of the plurality of core functional modules.

4. The method according to claim 1, wherein when the auxiliary information viewing operation satisfies the first preset condition, displaying the auxiliary function module on the human-machine interface includes: If the auxiliary information viewing operation ends, it is determined that the auxiliary information viewing operation meets the first preset condition, and the auxiliary function module is displayed on the human-machine interface.

5. The method according to claim 1, wherein when the auxiliary information viewing operation satisfies the first preset condition, displaying the auxiliary function module on the human-machine interface includes: If the progress of switching from the current core function module to the auxiliary function module reaches a preset progress, it is determined that the auxiliary information viewing operation meets the first preset condition, and the auxiliary function module is displayed on the human-machine interface.

6. The method according to any one of claims 1-5, wherein after the auxiliary information viewing operation satisfies the first preset condition and the auxiliary function module is displayed on the human-machine interface, the method further includes: If an auxiliary information exit operation is obtained on the human-machine interface, during the execution of the auxiliary information exit operation, the auxiliary function module displayed on the human-machine interface is switched back to the current core function module according to the second direction corresponding to the auxiliary information exit operation. When the auxiliary information exit operation meets the second preset condition, the current core function module is displayed again on the human-machine interface.

7. The method according to any one of claims 1-5, wherein the auxiliary function module is a weather module, and the step of displaying the auxiliary function module on the human-machine interface when the auxiliary information viewing operation satisfies a first preset condition includes: When the auxiliary information viewing operation meets the first preset condition, at least one of the weather information provided by the weather module and the weather animation corresponding to the weather information is displayed on the human-machine interface.

8. A method for displaying an auxiliary function module, the method comprising: The current core functional module for obtaining the viewfinder of the virtual camera is one of multiple core functional modules. The multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space. The auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space. If an auxiliary information viewing operation is detected on the human-machine interface, during the execution of the auxiliary information viewing operation, the virtual camera framing function module is controlled to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation. If it is determined that the auxiliary information viewing operation meets the first preset condition, the virtual camera is controlled to view the auxiliary function module so as to display the auxiliary function module on the human-machine interface.

9. The method according to claim 8, wherein the auxiliary function module is located above or below the target core function module included in the annular space in the three-dimensional virtual space, and if an auxiliary information viewing operation is detected on the human-machine interface, during the execution of the auxiliary information viewing operation, the function module for framing the virtual camera is controlled to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation, comprising: If an auxiliary information viewing operation is detected on the human-machine interface, and the current core function module is the target core function module, during the execution of the auxiliary information viewing operation, the tilt angle of the virtual camera is controlled to change in accordance with the first direction corresponding to the auxiliary information viewing operation. As the pitch angle of the virtual camera changes, the virtual camera's framing function module switches from the current core function module to the auxiliary function module.

10. According to claim 8, the auxiliary function module is fixed above or below the annular space in the three-dimensional virtual space, and the horizontal viewing angle of the virtual camera is always a viewing angle that fully displays the width of the auxiliary function module, then the current core function module is any one of the plurality of core function modules. If an auxiliary information viewing operation is detected on the human-machine interface, during the execution of the auxiliary information viewing operation, the virtual camera framing function module is controlled to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation, including: If an auxiliary information viewing operation is detected on the human-machine interface, during the execution of the auxiliary information viewing operation, the tilt angle of the virtual camera is controlled to change in accordance with the first direction corresponding to the auxiliary information viewing operation. As the pitch angle of the virtual camera changes, the virtual camera's framing function module switches from the current core function module to the auxiliary function module.

11. The method according to claim 9 or 10, further comprising: Calculate the changing angle as the pitch angle of the virtual camera changes; If it is determined that the auxiliary information viewing operation meets the first preset condition, the step of controlling the virtual camera to view the auxiliary function module includes: If it is determined that the changed angle reaches the angle threshold, it is determined that the auxiliary information viewing operation meets the first preset condition, and the virtual camera is controlled to view the auxiliary function module.

12. The method according to claim 11, further comprising: The first angle is calculated based on the height of the auxiliary function module and the distance from the virtual camera to the auxiliary function module; Calculate the second angle based on the height of the current core functional module and the distance from the virtual camera to the current core functional module; Based on the first angle and the second angle, determine the target pitch angle when the virtual camera views the auxiliary function module; The angle threshold is determined using the target pitch angle.

13. The method according to claim 8, wherein if it is determined that the auxiliary information viewing operation satisfies a first preset condition, the step of controlling the virtual camera to view the auxiliary function module includes: If the auxiliary information viewing operation is detected to have ended, it is determined that the auxiliary information viewing operation meets the first preset condition, and the virtual camera is controlled to view the auxiliary function module.

14. The method according to any one of claims 7-10, wherein after determining that the auxiliary information viewing operation satisfies the first preset condition and controlling the virtual camera to view the auxiliary function module, the method further includes: The virtual camera's viewing angle is adjusted according to the size of the auxiliary function module.

15. The method according to any one of claims 7-10, wherein after determining that the auxiliary information viewing operation satisfies the first preset condition and controlling the virtual camera to view the auxiliary function module, the method further includes: If an auxiliary information exit operation is detected on the human-machine interface, during the execution of the auxiliary information exit operation, the virtual camera framing function module is controlled to switch from the auxiliary function module to the current core function module according to the second direction corresponding to the auxiliary information exit operation. If the auxiliary information exit operation is determined to meet the second preset condition, the virtual camera is controlled to re-focus on the current core function module so as to re-display the current core function module on the human-machine interface.

16. A human-computer interaction system, the human-computer interaction system comprising a human-computer interface, multiple core functional modules, auxiliary functional modules, and a virtual camera, wherein the multiple core functional modules are arranged in a ring shape in a three-dimensional virtual space associated with the human-computer interface, the virtual camera is located at the center of the ring space, and the auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space: The human-machine interface is used to display one of the multiple core functional modules and receive auxiliary information viewing operations, the auxiliary information viewing operations corresponding to the first direction; The virtual camera is used to switch from the current core function module of the viewfinder to the auxiliary function module in response to the auxiliary information viewing operation, according to the first direction; The human-machine interface is also used to switch the currently displayed core function module to the auxiliary function module in response to the auxiliary information viewing operation.

17. A display device for an auxiliary function module, the device comprising a display unit and a switching unit: The display unit is used to display the current core functional module among multiple core functional modules on the human-machine interface; The switching unit is used to, if an auxiliary information viewing operation is obtained on the human-machine interface, switch the current core function module displayed on the human-machine interface to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation during the execution of the auxiliary information viewing operation. The display unit is also used to display the auxiliary function module on the human-machine interface when the auxiliary information viewing operation meets the first preset condition.

18. A display device for auxiliary function modules, the device comprising an acquisition unit and a control unit: The acquisition unit is used to acquire the current core functional module of the virtual camera. The current core functional module is one of multiple core functional modules. The multiple core functional modules are arranged in a ring shape in the three-dimensional virtual space associated with the human-computer interface. The virtual camera is set at the center of the ring space. The auxiliary functional modules are located above or below the ring space in the three-dimensional virtual space. The control unit is configured to, if an auxiliary information viewing operation is detected on the human-machine interface, control the virtual camera framing function module to switch from the current core function module to the auxiliary function module according to the first direction corresponding to the auxiliary information viewing operation during the execution of the auxiliary information viewing operation. The control unit is further configured to, if it is determined that the auxiliary information viewing operation meets the first preset condition, control the virtual camera to view the auxiliary function module so as to display the auxiliary function module on the human-machine interface.

19. A computer device, the computer device comprising a processor and a memory: The memory is used to store computer programs and to transfer the computer programs to the processor; The processor is configured to execute the method according to any one of claims 1-7 or 8-15 according to instructions in the computer program.

20. A computer-readable storage medium for storing a computer program that, when executed by a processor, causes the processor to perform the method of any one of claims 1-7 or 8-15.

21. A computer program product comprising a computer program that, when executed by a processor, implements the method of any one of claims 1-7 or 8-15.

Images