Display method and device and vehicle

Abstract

The embodiment of the invention provides a display method and device and a vehicle. The method comprises the steps that a first interface is displayed through a vehicle-mounted display screen; when it is detected that the distance between the hand of the user and a first area in the vehicle-mounted display screen is smaller than or equal to a first preset distance, and / or when it is detected that the sight line of the user is in the first area, one or more interface elements are displayed on the first interface; wherein the first interface comprises the first area, and the first area comprises a display area of the one or more interface elements. The embodiment of the invention can be applied to an intelligent automobile or an electric automobile, and human-computer interaction experience of a user can be improved.

Description

Display method, device and vehicle Technical Field

[0001] Embodiments of the present application relate to the field of human-computer interaction, and more specifically, to a display method, device, and vehicle. Background Art

[0002] The automotive industry is currently experiencing rapid growth, with cabin aesthetics, technology, and user experience becoming core competitive advantages. Limited cabin space limits the size of in-car displays. Therefore, ensuring a satisfying user experience in the user experience has become a pressing issue.

[0003] Summary of the Invention

[0004] The embodiments of the present application provide a display method, device, and vehicle, which help ensure driving safety and also help improve the user's human-computer interaction experience.

[0005] In the embodiments of the present application, a vehicle may include one or more different types of vehicles or movable objects that operate or move on land (e.g., roads, highways, railways, etc.), water (e.g., waterways, rivers, oceans, etc.), or space. For example, a vehicle may include a car, bicycle, motorcycle, train, subway, airplane, ship, aircraft, robot, or other types of vehicles or movable objects. The following method embodiments are described using a vehicle as an example.

[0006] In a first aspect, a display method is provided, the method comprising: displaying a first interface through a vehicle-mounted display screen; when it is detected that the distance between the user's hand and a first area in the vehicle-mounted display screen is less than or equal to a first preset distance, and / or when it is detected that the user's line of sight is in the first area, displaying one or more interface elements on the first interface; wherein the first interface includes the first area, and the first area includes a display area of ​​the one or more interface elements.

[0007] In an embodiment of the present application, when the user does not need to operate one or more interface elements, the vehicle-mounted display screen may not display one or more interface elements on the first interface, thereby avoiding the obstruction of the content displayed on the first interface by one or more interface elements, and also allowing the user to view more display content through the first interface. For example, when the first interface is a navigation interface, the user can see more navigation content, which helps to ensure driving safety; when the user needs to operate one or more interface elements, the user can place the hand close to the first area of ​​the display screen and / or look at the first area, so that one or more interface elements are displayed on the first interface, which is convenient for the user to operate one or more interface elements and helps to improve the user's human-computer interaction experience. In some possible implementations, displaying one or more interface elements on the first interface includes: automatically popping up the one or more interface elements on the first interface.

[0008] In some possible implementations, detecting that the distance between the user's hand and the first area in the vehicle-mounted display screen is less than or equal to a first preset distance includes: detecting that the distance between the user's finger and the first area in the vehicle-mounted display screen is less than or equal to the first preset distance.

[0009] In some possible implementations, the first preset distance is greater than 0. Exemplarily, the first preset distance is 15 cm.

[0010] In an embodiment of the present application, the first preset distance can be set as a critical point at which the vehicle determines that the user needs to operate an interface element and the vehicle determines that the user does not need to operate the interface element. In this way, when it is detected that the distance between the user's hand and the first area of ​​the vehicle display screen is less than or equal to the first preset distance, the vehicle can display one or more interface elements on the first interface to facilitate the user to operate the one or more interface elements; and when the distance between the user's hand and the first area of ​​the vehicle display screen is greater than the first preset distance, the vehicle can determine that the user does not need to operate the interface, and thus will not display one or more interface elements on the first interface, thereby avoiding the pop-up interface elements from blocking the content displayed on the first interface when the distance between the hand and the first area is large, which helps to ensure driving safety.

[0011] In some possible implementations, detecting that the distance between the user's hand and the first area in the vehicle-mounted display screen is less than or equal to a first preset distance includes: detecting that the distance between the user's hand and the first area in the vehicle-mounted display screen is less than or equal to the first preset distance and greater than or equal to a fourth preset distance, and the fourth preset distance is less than the first preset distance.

[0012] In some possible implementations, the fourth preset distance is greater than 0. Exemplarily, the fourth preset distance is 8 cm.

[0013] In the embodiment of the present application, the fourth preset distance can be set to be greater than 0 and less than the first preset distance, so that one or more interface elements can be displayed through the first interface before the user's hand touches the vehicle-mounted display screen. This eliminates the need for the user to tap the vehicle-mounted display screen to trigger the display of the one or more interface elements, avoiding tedious user operations and helping to enhance the user's human-computer interaction experience.

[0014] In some possible implementations, detecting that the distance between the user's hand and the first area in the vehicle-mounted display screen is less than or equal to a first preset distance includes: detecting that the distance between the user's hand and the first area in the vehicle-mounted display screen is less than or equal to the first preset distance for a duration that is greater than or equal to the first preset duration.

[0015] The above description is based on the example of an on-board display screen in a vehicle. The technical solution provided in the embodiments of the present application can also be applied to display screens in other means of transportation.

[0016] The above description uses an in-vehicle display screen as an example. The technical solutions provided in the embodiments of this application can also be applied to projection-type displays, such as heads-up displays (HUDs). Exemplarily, the method includes: displaying a first virtual image on the HUD, the first virtual image including navigation image information; and upon detecting a user's hand approaching the windshield, displaying the first virtual image and a second virtual image on the HUD, the second virtual image including instrument panel image information.

[0017] The above first preset distance can be set by the user, or it can be set when the vehicle leaves the factory; or, the first preset distance can also change with the system upgrade; or, during the user's use, the vehicle can also set the first preset distance according to the user's usage habits.

[0018] In combination with the first aspect, in some implementations of the first aspect, the method further includes: hiding the one or more interface elements on the first interface when it is detected that the distance between the user's hand and the first area is greater than or equal to a second preset distance.

[0019] In an embodiment of the present application, when a user needs to operate one or more interface elements, the user can move their hand close to the first area of ​​the display screen and / or look at the first area, so that the one or more interface elements are displayed on the first interface, making it convenient for the user to operate the one or more interface elements; and when the user does not need to operate one or more interface elements, the user can move their hand away from the first area, and the vehicle display screen can hide the one or more interface elements, thereby avoiding the interface elements from blocking the content displayed on the first interface and allowing the user to view more display content through the first interface. In this way, the vehicle display screen can display or hide one or more interface elements according to the user's needs, which helps to enhance the user's human-computer interaction experience.

[0020] In some possible implementations, when it is detected that the distance between the user's hand and the first area is greater than or equal to a second preset distance, and / or when it is detected that the user's line of sight is not in the first area, the one or more interface elements are hidden on the first interface.

[0021] In some possible implementations, detecting that the distance between the user's hand and the first area is greater than or equal to a second preset distance includes: detecting that the distance between the user's hand and the first area is greater than or equal to the second preset distance for a duration that is greater than or equal to the second preset duration.

[0022] The above first preset distance and the second preset distance may be equal or unequal, and this is not specifically limited in the embodiment of the present application.

[0023] The above second preset distance can be set by the user, or it can be set when the vehicle leaves the factory; or, the second preset distance can also change with the system upgrade; or, during the user's use, the vehicle can also set the second preset distance according to the user's usage habits.

[0024] In combination with the first aspect, in certain implementations of the first aspect, one or more interface elements are displayed on the first interface, including: when it is detected that the user's hand approaches the vehicle-mounted display screen from the first side of the vehicle-mounted display screen, the one or more interface elements are displayed in an area on the first interface close to the first side.

[0025] In an embodiment of the present application, by detecting the user's hand approaching the vehicle-mounted display screen from the first side of the vehicle-mounted display screen, one or more interface elements can be displayed in an area close to the first side on the first interface, which helps the user to operate one or more interface elements more conveniently and helps to improve the user's human-computer interaction experience.

[0026] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: when it is detected that the distance between the user's hand and the second area in the vehicle-mounted display screen is less than or equal to the third preset distance, expanding the size of the first interface element from the first size to the second size; wherein the one or more interface elements include the first interface element, the first interface includes the second area, and the second area includes the display area of ​​the first interface element.

[0027] In an embodiment of the present application, when it is detected that the distance between the user's hand and the second area of ​​the vehicle-mounted display screen is less than or equal to a third preset distance, the size of the first interface element can be expanded. In this way, after the size of the first interface element is expanded, the user can operate the first interface element more conveniently and accurately, which helps to avoid the user accidentally touching other interface elements due to the small size of the interface element or the close distance between the interface elements, thereby improving the user's human-computer interaction experience.

[0028] In some possible implementations, the method further includes: when it is detected that the distance between the user's hand and the second area in the vehicle-mounted display screen is greater than the third preset distance, restoring the size of the first interface element from the second size to the first size.

[0029] In some possible implementations, the first preset distance may be greater than the third preset distance.

[0030] In some possible implementations, if the one or more interface elements are one interface element, the first area and the second area may be the same area.

[0031] The above third preset distance can be set by the user, or it can be set when the vehicle leaves the factory; or, the third preset distance can also change with the system upgrade; or, during the user's use, the vehicle can also set the third preset distance according to the user's usage habits.

[0032] In combination with the first aspect, in certain implementations of the first aspect, the first interface includes a floating icon, the floating icon is associated with one or more applications, and one or more interface elements are displayed on the first interface, including: displaying icons of the one or more applications on the first interface.

[0033] In an embodiment of the present application, when a user needs to view one or more applications associated with a floating icon, the user can move his hand close to the first area of ​​the display screen and / or look at the first area, so that the icons of the one or more applications associated with the floating icon are displayed on the first interface. This helps to avoid tedious operations in the process of viewing the icons of one or more applications associated with the floating icon, improves the efficiency of the user in viewing the icons of one or more applications, and thus helps to improve the user's human-computer interaction experience.

[0034] In combination with the first aspect, in some implementations of the first aspect, the first interface is a display interface of a first application.

[0035] In an embodiment of the present application, when a user is viewing the display interface of a first application, if the user needs to operate one or more interface elements, the user can move his hand close to the first area of ​​the display screen and / or look at the first area, so that one or more interface elements are displayed on the display interface of the first application, making it convenient for the user to operate one or more interface elements; and when the user does not need to operate one or more interface elements, the user can move his hand away from the first area, and the vehicle-mounted display screen can hide one or more interface elements, thereby avoiding the interface elements from blocking the content displayed on the display interface of the first application, and also allowing the user to view more display content through the display interface of the first application.

[0036] In some possible implementations, the method further includes: in response to displaying the display interface of the first application, starting an interface element automatic control function (for example, an interface element automatic pop-up and hiding function), wherein, when the interface element automatic control function is started and the distance between the user's hand and the first area in the vehicle-mounted display screen is less than or equal to the first preset distance, the vehicle-mounted display screen can display the one or more interface elements.

[0037] In an embodiment of the present application, when the vehicle display screen does not display the display interface of the application (for example, the vehicle display screen displays the desktop), the interface element automatic control function can be automatically turned off, so that the interface elements can always be displayed on the vehicle display screen without blocking the displayed content. When the vehicle display screen displays the display interface of the first application, the vehicle can automatically start the interface element automatic control function, so that the vehicle display screen can display or hide one or more interface elements according to the user's needs, which helps to improve the user's human-computer interaction experience. The interface element automatic control function can be automatically turned on or off according to different scenarios, without the user having to manually turn on or off the function, which helps to improve the degree of automation of the vehicle.

[0038] In combination with the first aspect, in some implementations of the first aspect, the first application includes a navigation application, a video application, a music application, or a game application.

[0039] In an embodiment of the present application, when the vehicle-mounted display screen displays the display interface of the navigation application, if the user needs to operate one or more interface elements, the vehicle-mounted display screen can display one or more interface elements on the display interface of the navigation application, making it convenient for the user to operate one or more interface elements; and when the user does not need to operate one or more interface elements, the vehicle-mounted display screen can hide one or more interface elements, thereby avoiding the interface elements from blocking the navigation content on the display interface of the navigation application, and also allowing the user to view more navigation content through the display interface of the navigation application.

[0040] In combination with the first aspect, in certain implementations of the first aspect, the one or more interface elements include a second interface element related to a second application, and the method further includes: when detecting that a user clicks on the second interface element, displaying the display interface of the first application and the second application through the vehicle-mounted display screen.

[0041] In an embodiment of the present application, when it is detected that the user clicks on the second interface element, the display interfaces of the first application and the second application are displayed through the vehicle-mounted display screen. This makes it convenient for the user to view the display interface of the second application and the display interface of the first application respectively through the vehicle-mounted display screen.

[0042] In combination with the first aspect, in certain implementations of the first aspect, when the operation of the user clicking the second interface element is detected, the display interfaces of the first application and the second application are displayed through the vehicle-mounted display screen, including: when the operation of the user located on the second side of the vehicle-mounted display screen clicking the second interface element is detected, the display interface of the second application is displayed through the third area of ​​the vehicle-mounted display screen and the display interface of the first application is displayed through the fourth area of ​​the vehicle-mounted display screen; wherein, the third area is the area close to the second side, and the fourth area is the area away from the second side.

[0043] In an embodiment of the present application, when it is detected that a user located on the second side of the vehicle-mounted display screen clicks on the second interface element, the display interface of the newly launched second application can be displayed in an area close to the second side and the display interface of the previously launched first application can be displayed in an area away from the second side. This makes it convenient for the user located on the second side of the vehicle-mounted display screen to view the display interface of the newly launched second application, which helps to improve the user's human-computer interaction experience.

[0044] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: detecting that the user starts an automatic control function of an interface element, wherein, when the automatic control function of the interface element is started and the distance between the user's hand and the first area in the vehicle display screen is less than or equal to the first preset distance, the vehicle display screen can display the one or more interface elements.

[0045] In the embodiment of the present application, the automatic control function of the interface elements can be turned on or off according to the user's settings, so that the user can choose whether to turn on the function according to his or her needs.

[0046] In combination with the first aspect, in certain implementations of the first aspect, displaying one or more interface elements on the first interface includes: when a user gesture is detected, displaying the one or more interface elements corresponding to the gesture.

[0047] In an embodiment of the present application, different gestures can be associated with different interface elements. When a user gesture is detected, one or more interface elements corresponding to the gesture can be displayed on the first interface. In this way, when the user wishes to view certain interface elements, the corresponding gesture can be used to trigger the display of the corresponding interface element, avoiding the user from searching through multiple interface elements for the interface element they wish to view, thereby helping to enhance the user's human-computer interaction experience.

[0048] In combination with the first aspect, in certain implementations of the first aspect, displaying the first interface through the vehicle-mounted display screen includes: displaying the first interface and the second interface through the vehicle-mounted display screen; wherein, the method also includes: when it is detected that the distance between the user's hand and the fifth area in the vehicle-mounted display screen is less than or equal to the first preset distance, and / or when it is detected that the user's line of sight is in the fifth area, displaying the one or more interface elements on the second interface; wherein, the second interface includes the fifth area, and the fifth area includes the display area of ​​the one or more interface elements.

[0049] In an embodiment of the present application, the vehicle-mounted display screen can simultaneously display the first interface and the second interface. When it is detected that the user's hand is close to the first area of ​​the display screen and / or the user's line of sight is fixed on the first area, one or more interface elements can be displayed on the first interface. At this time, the second interface can continue to maintain the original display content, thereby avoiding the influence of one or more interfaces on the display content on the second interface; when it is detected that the user's hand is close to the fifth area and / or the user's line of sight is fixed on the fifth area, one or more interface elements can be displayed on the second interface. At this time, the first interface can continue to maintain the original display content, thereby avoiding the influence of one or more interfaces on the display content on the first interface.

[0050] In combination with the first aspect, in some implementations of the first aspect, the one or more interface elements include cards and / or application icons.

[0051] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when detecting an operation of the user's finger clicking on the sixth area, hiding the one or more interface elements on the first interface, the sixth area being the area on the first interface other than the first area.

[0052] In an embodiment of the present application, when a user clicks on an area other than the first area on the first interface, one or more interface elements can be hidden. This prevents one or more interface elements from obstructing the content displayed on the first interface and allows the user to view more content displayed on the first interface.

[0053] In a second aspect, a display device is provided, which is located in a vehicle and includes a display unit and a detection unit, wherein the display unit is used to display a first interface; the display unit is also used to display one or more interface elements on the first interface when the detection unit detects that the distance between the user's hand and the first area in the display unit is less than or equal to a first preset distance, and / or when the detection unit detects that the user's line of sight is in the first area; wherein the first interface includes a first area, and the first area includes a display area of ​​the one or more interface elements.

[0054] In combination with the second aspect, in certain implementations of the second aspect, the display unit hides the one or more interface elements on the first interface when the detection unit detects that the distance between the user's hand and the first area is greater than or equal to a second preset distance.

[0055] In combination with the second aspect, in certain implementations of the second aspect, the display unit is specifically used to: when the detection unit detects that the user's hand approaches the display unit from the first side of the display unit, display the one or more interface elements in an area close to the first side on the first interface.

[0056] In combination with the second aspect, in certain implementations of the second aspect, the display unit is further used to expand the size of the first interface element from the first size to the second size when the detection unit detects that the distance between the user's hand and the second area in the display unit is less than or equal to the third preset distance; wherein the one or more interface elements include the first interface element, the first interface includes the second area, and the second area includes the display area of ​​the first interface element.

[0057] In combination with the second aspect, in some implementations of the second aspect, the first interface includes a floating icon, which is associated with one or more applications, and the display unit is specifically used to: display the icons of the one or more applications on the first interface.

[0058] In combination with the second aspect, in some implementations of the second aspect, the first interface is a display interface of the first application.

[0059] In combination with the second aspect, in some implementations of the second aspect, the first application includes a navigation application.

[0060] In combination with the second aspect, in certain implementations of the second aspect, the one or more interface elements include a second interface element related to the second application, and the display unit is also used to: display the display interface of the first application and the second application when the detection unit detects that the user clicks on the second interface element.

[0061] In combination with the second aspect, in certain implementations of the second aspect, the display unit is specifically used to: when the detection unit detects that a user located on the second side of the display unit clicks on the second interface element, display the display interface of the second application through the third area and display the display interface of the first application through the fourth area; wherein the third area is an area close to the second side, and the fourth area is an area away from the second side.

[0062] In combination with the second aspect, in certain implementations of the second aspect, the detection unit is also used to detect that the user has started the automatic control function of the interface element, wherein, when the automatic control function of the interface element is started and the distance between the user's hand and the first area is less than or equal to the first preset distance, the display unit can display the one or more interface elements.

[0063] In combination with the second aspect, in some implementations of the second aspect, the display unit is specifically used to: when the detection unit detects a user gesture, display the one or more interface elements corresponding to the gesture.

[0064] In combination with the second aspect, in certain implementations of the second aspect, the display unit is specifically used to: display the first interface and the second interface; wherein, the display unit is also used to display the one or more interface elements on the second interface when the detection unit detects that the distance between the user's hand and the fifth area in the display unit is less than or equal to the first preset distance, and / or when the detection unit detects that the user's line of sight is in the fifth area; wherein, the second interface includes the fifth area, and the fifth area includes the display area of ​​the one or more interface elements.

[0065] In combination with the second aspect, in some implementations of the second aspect, the one or more interface elements include cards and / or application icons.

[0066] In combination with the second aspect, in some implementations of the second aspect, the display unit is also used to hide the one or more interface elements on the first interface when the detection unit detects that the user's finger clicks on the sixth area, and the sixth area is the area on the first interface other than the first area.

[0067] In a third aspect, a device is provided, comprising a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit, so that the device performs any possible method in the first aspect.

[0068] Optionally, the above-mentioned processing unit may include at least one processor, and the above-mentioned storage unit may be a memory, wherein the memory may be a storage unit within the chip (for example, a register, a cache, etc.), or a storage unit located outside the chip within the vehicle (for example, a read-only memory, a random access memory, etc.).

[0069] In a fourth aspect, a vehicle is provided, which comprises the device described in any one of the second or third aspects above.

[0070] In combination with the fourth aspect, in certain implementations of the fourth aspect, the transportation vehicle is a vehicle.

[0071] In a fifth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute any possible method in the first aspect.

[0072] It should be noted that the above-mentioned computer program code can be stored in whole or in part on the first storage medium, wherein the first storage medium can be packaged together with the processor or separately packaged with the processor, and the embodiments of the present application do not specifically limit this.

[0073] In a sixth aspect, a computer-readable medium is provided, wherein the computer-readable medium stores a program code, and when the computer program code is run on a computer, the computer is enabled to execute any possible method in the first aspect.

[0074] In the seventh aspect, an embodiment of the present application provides a chip system, which includes a processor for calling a computer program or computer instructions stored in a memory so that the processor executes any possible method of the first aspect above.

[0075] In combination with the seventh aspect, in a possible implementation, the processor is coupled to the memory through an interface.

[0076] In combination with the seventh aspect, in a possible implementation, the chip system also includes a memory, in which a computer program or computer instructions are stored.

[0077] In an eighth aspect, a control device is provided, which includes at least one processor and an interface circuit, and the processor communicates with a display device through the interface circuit; the at least one processor is used to execute any possible method of the first aspect above, thereby controlling the display interface of the display device.

[0078] In some possible implementations, the display device is a vehicle-mounted display screen.

[0079] In an embodiment of the present application, when a user needs to operate one or more interface elements, the user can place his hand close to the first area of ​​the display screen and / or look at the first area, so that one or more interface elements are displayed on the first interface, which makes it convenient for the user to operate one or more interface elements and helps to improve the user's human-computer interaction experience.

[0080] When the user does not need to operate one or more interface elements, they can move their hand away from the first area, and the in-vehicle display screen can hide one or more interface elements, thereby preventing the interface elements from blocking the content displayed on the first interface and allowing the user to view more displayed content on the first interface. In this way, the in-vehicle display screen can display or hide one or more interface elements according to the user's needs, which helps to enhance the user's human-computer interaction experience.

[0081] By displaying the one or more interface elements in the area close to the first side on the first interface, the user can operate the one or more interface elements more conveniently, thereby improving the user's human-computer interaction experience.

[0082] By detecting that the distance between the user's hand and the second area of ​​the vehicle display screen is less than or equal to a third preset distance, the size of the first interface element can be expanded. This allows the user to operate the first interface element more conveniently and accurately, helping to avoid accidental touches of other interface elements due to small interface elements or close distances between interface elements, thereby improving the user's human-computer interaction experience.

[0083] By determining the display content on the first interface, the automatic control function of the interface elements is automatically started or turned off, without the user having to manually turn the function on or off, which helps to improve the degree of automation of the vehicle.

[0084] By displaying the display interface of the newly launched second application in an area close to the second side and displaying the display interface of the previously launched first application in an area away from the second side, it is convenient for users on the second side of the vehicle-mounted display screen to view the display interface of the newly launched second application, which helps to improve the user's human-computer interaction experience.

[0085] By triggering the display of corresponding interface elements through corresponding gestures, the user avoids the process of searching for the interface element he wants to view from multiple interface elements, thereby helping to improve the user's human-computer interaction experience.

[0086] When the vehicle-mounted display screen displays the first interface and the second interface, by detecting that the user's hand is close to the first area of ​​the display screen and / or the user's eyes are fixed on the first area, one or more interface elements can be displayed on the first interface, thereby avoiding the influence of one or more interface elements on the display content on the second interface. BRIEF DESCRIPTION OF THE DRAWINGS

[0087] FIG1 is a functional block diagram of a vehicle provided in an embodiment of the present application.

[0088] FIG2 is a graphical user interface GUI provided in an embodiment of the present application.

[0089] FIG3 is a set of GUIs provided in an embodiment of the present application.

[0090] FIG4 is another set of GUIs provided in an embodiment of the present application.

[0091] FIG5 is another set of GUIs provided in an embodiment of the present application.

[0092] FIG6 is another set of GUIs provided in an embodiment of the present application.

[0093] FIG7 is another set of GUIs provided in an embodiment of the present application.

[0094] FIG8 is another set of GUIs provided in an embodiment of the present application.

[0095] FIG9 is another set of GUIs provided in an embodiment of the present application.

[0096] FIG10 is another set of GUIs provided in an embodiment of the present application.

[0097] FIG11 is another set of GUIs provided by an embodiment of the present application.

[0098] FIG12 is another set of GUIs provided by an embodiment of the present application.

[0099] FIG13 is another set of GUIs provided by an embodiment of the present application.

[0100] FIG14 is another set of GUIs provided by an embodiment of the present application.

[0101] FIG15 is another set of GUIs provided by an embodiment of the present application.

[0102] FIG16 is another set of GUIs provided by an embodiment of the present application.

[0103] FIG17 is another set of GUIs provided by an embodiment of the present application.

[0104] FIG18 is another set of GUIs provided by an embodiment of the present application.

[0105] FIG19 is a schematic flow chart of a display method provided in an embodiment of the present application.

[0106] FIG20 is another schematic flowchart of the display method provided in an embodiment of the present application.

[0107] FIG21 is another set of GUIs provided by an embodiment of the present application.

[0108] FIG22 is another set of GUIs provided by an embodiment of the present application.

[0109] Figure 23 is a schematic block diagram of a display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0110] The following describes the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents "or." For example, A / B can represent A or B. "And / or" in this document is merely a description of the association relationship between associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, or B exists alone.

[0111] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary restriction. In addition, in the description of this embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

[0112] FIG1 is a functional block diagram of a vehicle 100 provided in an embodiment of the present application. The vehicle 100 may include a perception system 120, a display device 130, and a computing platform 150, wherein the perception system 120 may include several sensors for sensing information about the environment surrounding the vehicle 100. For example, the perception system 120 may include a positioning system, which may be a global positioning system (GPS), a BeiDou system or other positioning systems, or an inertial measurement unit (IMU). For another example, the perception system 120 may also include one or more of an eye tracker, a laser radar, a millimeter-wave radar, an ultrasonic radar, and a camera device.

[0113] Some or all functions of vehicle 100 may be controlled by computing platform 150. Computing platform 150 may include processors 151 to 15n (n is a positive integer). A processor is a circuit capable of processing signals. In one implementation, the processor may be a circuit capable of reading and executing instructions, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor may implement certain functions through the logical relationships of hardware circuits. The logical relationships of the hardware circuits may be fixed or reconfigurable. For example, the processor may be a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 150 can also include a memory for storing instructions. Some or all of the processors 151 to 15n can call the instructions in the memory and execute the instructions to achieve corresponding functions.

[0114] The display devices 130 in the cockpit are primarily divided into two categories: the first is the onboard display screen; the second is the projection display screen. An onboard display screen is a physical display screen and a crucial component of the in-vehicle infotainment system. Multiple displays can be installed in the cockpit, including the digital instrument panel, the center console, the display in front of the front passenger (also known as the front passenger), the display in front of the left rear passenger, and the display in front of the right rear passenger. Even the vehicle windows can function as display screens. A head-up display, also known as a head-up display system, primarily displays driving information such as speed and navigation on a display device in front of the driver (e.g., the windshield). This reduces the driver's gaze shift time, avoids pupil changes caused by this shift, and improves driving safety and comfort. HUDs can include combined head-up displays (C-HUD), windshield heads-up displays (W-HUD), and augmented reality heads-up displays (AR-HUD).

[0115] Please refer to FIG. 2 , which is a graphical user interface (GUI) provided in an embodiment of the present application.

[0116] The vehicle display screen includes a content display area 201 and a function bar 202. As shown in FIG2 , the current content display area 201 displays the navigation interface of the in-vehicle map application. This navigation interface includes an avatar 2011 of the user account logged into the vehicle, a Bluetooth function icon 2012, a Wi-Fi function icon 2013, a cellular network signal icon 2014, an in-vehicle map application search box 2015, cards 203 corresponding to services and applications, a card 204 corresponding to the in-vehicle music application, a card 205 corresponding to the vehicle's remaining battery power and remaining mileage, and a card 206 corresponding to the vehicle's 360-degree (°) surround view function. The in-vehicle map application search box 2015 may include a user-configured home control 20151 and a go to work control 20152. The function bar 202 includes an icon 2021 for switching to the desktop display, a vehicle internal circulation icon 2022, a driver's seat heating function icon 2023, a driver's area air-conditioning temperature display icon 2024, a passenger area air-conditioning temperature display icon 2025, a passenger seat heating function icon 2026 and a volume setting icon 2027.

[0117] The card in the embodiment of the present application can be understood as a type of interface element.

[0118] Cards can be associated with certain applications installed on the vehicle. For example, card 204 can be associated with an in-vehicle music application. Card 204 can display the artist's name, lyrics, a playback progress bar, a like button, a control for switching to the previous song, a pause / play button, a control for switching to the next song, and so on. When the vehicle detects that a user has clicked on card 204, the vehicle can display the display interface of the in-vehicle music application in the content display area 201.

[0119] The text information (e.g., the singer's name, lyrics information) and control information (e.g., a play progress bar, a like control, etc.) displayed in the above card 204 can be set by the user. For example, the user can also set the card 204 to display only the lyrics information and the play progress bar.

[0120] The card 204 may display text information and control information, or may display only the icon of the application program. For example, the card 204 may display only the icon of the in-car music application.

[0121] Cards can also be associated with some local functions of the vehicle. For example, card 205 can be associated with the vehicle's remaining power and the corresponding range information of the remaining power. When the vehicle detects that the user clicks on card 205, the vehicle can display the vehicle's remaining power and the corresponding range display interface of the remaining power through the content display area 201. For another example, card 206 can be associated with the vehicle's 360-degree surround view function. When the vehicle detects that the user clicks on card 206, the vehicle can display a 360-degree surround view display interface through the content display area 201.

[0122] Cards can also be linked to the display interfaces of certain application functions. For example, a card can be linked to the payment function in a payment application. When the vehicle detects that a user has tapped the card, it can directly display the payment-related display interface in the payment application instead of the homepage of the payment application.

[0123] Cards can also be associated with display lists of multiple applications. For example, card 203 can be associated with display lists of multiple applications. When the vehicle detects that the user clicks on card 203, the vehicle can display the display interfaces of multiple applications installed on the vehicle through content display area 201.

[0124] The above cards 203-206 can be displayed on the content display area 201 according to the user's settings. For example, the user can edit the cards they want to display on the content display area 201 through the settings function. Alternatively, the cards 203-206 can also be set when the vehicle leaves the factory and cannot be edited by the user.

[0125] The above content display area 201 is described by taking the four cards 203-206 as an example. The content display area 201 may also include a greater or lesser number of cards, which is not limited in this embodiment of the present application.

[0126] As mentioned above, some interface elements displayed on the current vehicle-mounted display screen are fixedly arranged and occupy a certain imaging space, but these interface elements will not be used by the user in real time during driving. If the display content that the user hopes to see through the display screen is blocked by these interface elements, then the display content seen by the user will be reduced, which will affect driving safety and user experience. For example, while driving a vehicle, the user hopes to see the navigation interface displayed in the content display area 201 and the user may not operate cards 203-206 during this process. If cards 203-206 are always displayed on the navigation interface, part of the navigation content on the navigation interface will be blocked by cards 203-206, resulting in a waste of display resources. At the same time, the reduction in navigation content seen by the user will also affect the user's navigation process, which may in turn affect the user's driving safety.

[0127] The embodiments of the present application provide a display method, device, and vehicle. When a user needs to operate one or more interface elements, the user can move his hand close to the first area of ​​the display screen and / or look at the first area, so that the one or more interface elements are displayed on the first interface, which facilitates the user to operate the one or more interface elements. When the user does not need to operate one or more interface elements, the user can move his hand away from the first area and / or not look at the first area, and the vehicle display screen can hide the one or more interface elements, thereby avoiding the interface elements from blocking the content displayed on the first interface and allowing the user to view more display content through the first interface. In this way, the vehicle display screen can display or hide one or more interface elements according to the user's needs, which helps to enhance the user's human-computer interaction experience.

[0128] FIG3 shows a set of GUIs provided by an embodiment of the present application.

[0129] As shown in FIG3 (a), when the vehicle detects that the user has not interacted with the display screen through the sensor, the navigation interface can be displayed through the content display area 201 without displaying the cards 203-206. In this way, since the cards 203-206 are hidden, the user can see more navigation content through the content display area 201.

[0130] In one embodiment, the vehicle's detection of the user's non-interaction with the display screen by a sensor includes: the vehicle detecting that the user's hand is greater than a first preset distance from the display screen; the vehicle detecting that the user's line of sight is not directed at the display screen; or the vehicle not detecting the user issuing a voice command to eject a card. For example, the first preset distance may be 10 centimeters (cm).

[0131] As shown in (b) of FIG3 , when the vehicle detects that the user's hand is approaching the display screen through the sensor, cards 203 - 206 may be automatically popped up on the navigation interface.

[0132] In one embodiment, the vehicle detects through a sensor that the user's hand is approaching the display screen, including: detecting that the distance between the user's hand and the display screen is less than or equal to the first preset distance.

[0133] In one embodiment, the vehicle may provide the user with different display modes in the navigation interface, such as display mode 1, display mode 2, and display mode 3.

[0134] For example, in display mode 1, if the vehicle detects that the user has not interacted with the display screen, cards 203-206, user account avatar information 2011, Bluetooth function icon 2012, Wi-Fi function icon 2013, cellular network signal icon 2014, and in-vehicle map application search box 2015 may all be automatically hidden. When the user's hand is detected approaching the display screen, cards 203-206, user account avatar information 2011, Bluetooth function icon 2012, Wi-Fi function icon 2013, cellular network signal icon 2014, and in-vehicle map application search box 2015 may be automatically popped up.

[0135] For another example, in display mode 2, if the vehicle detects that the user has not interacted with the display screen, cards 203-206 and the in-vehicle map application search box 2015 may be automatically hidden, while the user account avatar information 2011, Bluetooth function icon 2012, Wi-Fi function icon 2013, and cellular network signal icon 2014 may remain displayed on the navigation interface. When the user's hand is detected approaching the display screen, cards 203-206 and the in-vehicle map application search box 2015 may be automatically popped up.

[0136] For example, in display mode 3, if the vehicle detects that the user is not interacting with the display screen, cards 203-206 are automatically hidden, while the user account avatar information 2011, Bluetooth function icon 2012, Wi-Fi function icon 2013, cellular network signal icon 2014, and in-vehicle map application search box 2015 may remain displayed on the navigation interface. Cards 203-206 may be automatically popped up when the user's hand is detected approaching the display screen.

[0137] It should be understood that display mode 1, display mode 2, and display mode 3 are merely illustrative and are not limited to the embodiments of the present application. More or fewer display modes may be provided on the navigation interface. The following embodiments will be described using display mode 3 as an example.

[0138] It should also be understood that the above description uses the example of dividing different display modes in the navigation interface. In the embodiments of the present application, different display modes can be divided for the display interfaces of different applications, and the types or numbers of interface elements that automatically pop up or hide in different display modes can be different. The types or numbers of interface elements that automatically pop up or hide in different modes can also be determined based on user settings.

[0139] In one embodiment, detecting that the distance between the user's hand and the display screen is less than or equal to the first preset distance includes: detecting that the distance between the user's hand and the first area in the display screen is less than or equal to the first preset distance.

[0140] As shown in FIG. 3( c ) , the content display area may be divided into area 1 and area 2 , wherein cards 203 - 206 may be located in area 2 .

[0141] In one embodiment, the first area may be the display area of ​​the navigation interface; or, the first area may be the display area of ​​cards 203-206; or, the first area may be area 2 shown in (c) in FIG3 above; or, taking into account the error in detecting the first area, the first area may be an area larger than area 2. For example, the first area may be the area after area 2 is enlarged by a preset multiple (for example, 1.1 times). For another example, the first area may be the area after area 2 is expanded outward by 2 cm in height and width, respectively. In this way, when detecting the distance between the hand and the first area, a certain detection error can be guaranteed, so that the display screen can be more easily triggered to automatically pop up one or more interface elements.

[0142] FIG3 (b) above is merely an example of a user's hand approaching the display screen from the bottom, and the present invention is not limited thereto. For example, when the user's hand approaches the display screen from the left side, the content display area 201 may automatically pop up display cards 203-206; or, when the user's hand approaches the display screen from the right side, the content display area 201 may automatically pop up display cards 203-206.

[0143] It should be understood that FIG3 above is an example of a hand approaching the display screen to trigger the automatic pop-up of cards 203-206 on the navigation interface. The embodiments of the present application are not limited to this, and the automatic pop-up of cards 203-206 on the navigation interface can also be triggered by voice commands. For example, when the vehicle detects the user's voice command "show card", the card 203-206 can be automatically popped up through the display screen; it can also be triggered by detecting whether the user's line of sight is in the first area. For example, when the vehicle detects that the user's line of sight is in the first area through a camera or an eye tracker, the card 203-206 can be automatically popped up through the display screen.

[0144] It should also be understood that the vehicle can also trigger the automatic pop-up or hiding of cards 203-206 on the navigation interface by combining one or more of the distance between the hand and the display screen, voice commands, or the user's line of sight. For example, when the user's hand is detected approaching a first area on the display screen and the user's line of sight is detected within the first area, the cards 203-206 can be automatically popped up through the display screen. In the following embodiments, the determination of whether to automatically pop-up or hide interface elements can also be made by combining one or more of the distance between the hand and the display screen, voice commands, or the user's line of sight.

[0145] It should also be understood that detecting the user's hand approaching the first area on the display screen includes detecting the user's finger approaching the first area on the display screen. The following embodiments are described using the user's finger as an example. The embodiments of the present application are not limited thereto; for example, the user's hand may also be the user's palm or the back of the user's hand.

[0146] In one embodiment, detecting that the distance between the user's hand and the first area of ​​the vehicle-mounted display screen is less than or equal to a first preset distance includes: detecting that the distance between the user's hand and the first area of ​​the vehicle-mounted display screen is less than or equal to the first preset distance and greater than or equal to a fourth preset distance, the fourth preset distance being less than the first preset distance. Exemplarily, the fourth preset distance is 8 cm.

[0147] The process of automatically popping up cards 203 - 206 through the display screen is described above in conjunction with FIG. 3 . The process of automatically hiding cards 203 - 206 through the display screen is described below in conjunction with FIG. 4 and FIG. 5 .

[0148] FIG4 shows another set of GUIs provided by an embodiment of the present application.

[0149] As shown in FIG4(a), when the vehicle detects that the user's finger is approaching the display screen, the vehicle can control the display screen to display cards 203-206 in the content display area. When the vehicle detects that the user's finger is approaching the display screen but does not interact with the display screen, the vehicle can continue to display cards 203-206 on the display screen. When the vehicle detects that the user's finger is moving away from the display screen (for example, the finger moves downward and away from the display screen), the GUI shown in FIG4(b) can be displayed on the display screen.

[0150] As shown in FIG4( b ), in response to detecting that the user's finger moves away from the display screen from a position close to the display screen, the vehicle can automatically hide cards 203-206 through the display screen. In this way, when the user's finger moves away from the display screen, the vehicle can determine that the user does not want to operate cards 203-206, and thus hide cards 203-206, allowing the user to see more navigation content through the display screen.

[0151] In one embodiment, the vehicle detects that the user's finger moves away from the display screen from a position close to the display screen, including: the vehicle detects that the distance between the user's finger and the first area of ​​the display screen changes from less than or equal to the first preset distance to greater than or equal to the second preset distance.

[0152] In the embodiment of the present application, the first preset distance and the second preset distance may be equal or unequal.

[0153] In one embodiment, the second preset distance may be greater than the first preset distance. For example, the second preset distance may be 15 cm.

[0154] In one embodiment, if the first preset distance and the second preset distance are equal, then when it is detected that the distance between the user's finger and the first area is less than or equal to the first preset distance, cards 203-206 may be automatically popped up on the navigation interface. When it is detected that the distance between the user's finger and the first area is greater than the second preset distance, cards 203-206 may be automatically hidden on the navigation interface.

[0155] FIG5 shows another set of GUIs provided by an embodiment of the present application.

[0156] As shown in FIG5(a), when the vehicle detects that the user's finger is approaching the display screen, cards 203-206 may be automatically popped up in the content display area. If the vehicle detects that the user's finger is approaching the display screen but does not interact with the display screen, the vehicle may continue to display cards 203-206 on the display screen. If the vehicle detects that the user's finger is tapping a display area other than cards 203-206, the vehicle may display a GUI as shown in FIG5(b) on the display screen.

[0157] As shown in FIG5(b), in response to detecting a click operation of the user's finger on a display area other than cards 203-206, the vehicle can hide cards 203-206 through the display screen. In this way, when the vehicle detects a user operation in a non-card display area, the vehicle can determine that the user does not want to operate on cards 203-206, and thus hide cards 203-206, allowing the user to see more navigation content through the content display area.

[0158] In one embodiment, as shown in (c) of FIG3 , the content display area may be divided into area 1 and area 2, wherein cards 203 - 206 may be located in area 2. The vehicle detecting a click operation of a user's finger on a display area other than cards 203 - 206 includes: the vehicle detecting a click operation of the user on area 1.

[0159] The above describes the process of the card automatically popping up and automatically hiding in conjunction with Figures 3 to 5. The following describes the process of the user operating the card after the card automatically pops up in conjunction with Figures 6 and 7.

[0160] FIG6 shows another set of GUIs provided by an embodiment of the present application.

[0161] As shown in FIG6 (a), when the vehicle detects that the user's finger approaches the display screen through the sensor, the vehicle can automatically pop up cards 203-206 through the display screen. When the vehicle detects that the user clicks on card 204, the vehicle can display the GUI shown in FIG6 (b) through the display screen.

[0162] As shown in (b) of FIG6 , in response to detecting a user clicking on the card 204 , the vehicle may switch from displaying the navigation interface to displaying the in-car music application display interface 601 through the content display area of ​​the display screen.

[0163] When the vehicle detects that the user clicks on card 204, it can switch to displaying the display interface of the in-car music application; alternatively, it can display the navigation interface and the display interface of the in-car music application in a zoned manner. FIG7 shows another set of GUIs provided by an embodiment of the present application.

[0164] As shown in (a) of FIG. 7 , when the vehicle detects that the user clicks on the card 204 , the vehicle may display a GUI as shown in (b) of FIG. 7 through the display screen.

[0165] As shown in FIG7( b ), in response to detecting a user click on card 204 , the vehicle may display the display interface of the in-vehicle music application and the navigation interface in separate regions. For example, the display interface of the in-vehicle music application may be displayed in region 701 and the navigation interface may be displayed in region 702 .

[0166] In one embodiment, the vehicle may further display the display interface and navigation interface of the in-vehicle music application based on the region in which the user who clicked the card 204 is located. For example, when the vehicle detects that the user in the main driving zone has clicked the card 204, the vehicle may display the display interface of the newly launched in-vehicle music application on the side closer to the main driving zone (e.g., region 701) and the navigation interface of the previously launched in-vehicle map application on the side farther from the main driving zone (e.g., region 702).

[0167] For example, when the vehicle detects that a user in the passenger seat area clicks on card 204, the vehicle can display the display interface of the newly launched in-vehicle music application on the side close to the passenger seat area (for example, area 702) and the navigation interface of the previously launched in-vehicle map application on the side away from the passenger seat area (for example, area 701) through the display screen.

[0168] In an embodiment of the present application, upon detecting a user click on a card on the display screen, the vehicle can display the display interface of the newly launched application and the display interface of the previously launched application in a split-screen manner. Simultaneously, the vehicle can display the newly launched application on the side closest to the user via the display screen, making it easier for the user to view the display interface of the newly launched application.

[0169] The following describes the process of automatically opening or closing the card automatic pop-up and hide function in different scenarios with reference to Figure 8. Figure 8 shows another set of GUIs provided by an embodiment of the present application.

[0170] As shown in (a) of FIG8 , the vehicle displays a desktop on a display screen. The desktop includes wallpaper information, cards 203-205, a card 207 corresponding to the in-vehicle map application, and a function bar 202. At this time, if the vehicle does not detect that the user has started any application, the vehicle can disable the automatic pop-up and hide functions of the cards. As a result, cards 203-205 and card 207 will not automatically pop up as the user's finger approaches the display screen, nor will they automatically hide as the user's finger moves away from the display screen. Cards 203-205 and card 207 can be displayed in the content display area 201 at all times.

[0171] As shown in FIG8( b ), when the vehicle detects that the user clicks on the card 207 , a GUI as shown in FIG8( c ) may be displayed on the display screen.

[0172] As shown in FIG8(c), in response to detecting a user clicking card 207, the vehicle can display the interface of the in-vehicle map application via content display area 201 on the display screen. At this point, the vehicle can automatically activate the card pop-up and hide function. Thus, when the vehicle's sensors detect that the user is not interacting with the display screen, the vehicle can automatically hide cards 203-205 and card 207 via the display screen.

[0173] Whether the above vehicle starts the automatic card pop-up and hide function can be determined by whether the vehicle is currently displaying the display interface of a certain application through the display screen. For example, when the vehicle is not displaying the display interface of a certain application through the display screen, the vehicle can turn off the automatic card pop-up and hide function, and the card can be always displayed in the content display area 201; when the vehicle detects that the user starts an application and the vehicle displays the display interface of the application, the vehicle can start the automatic card pop-up and hide function, and the card can automatically pop up as the user's finger approaches the display screen, or automatically hide as the user's finger moves away from the display screen. The embodiments of the present application are not limited to this. The vehicle can also determine whether to start the automatic card pop-up and hide function based on the type of application. For example, when the vehicle displays the navigation interface of the in-vehicle map application, the vehicle can start the automatic card pop-up and hide function. For another example, when the vehicle displays the display interface of the in-vehicle music application, the vehicle can turn off the automatic card pop-up and hide function.

[0174] The following GUI shown in FIG9 illustrates how, after a card is automatically popped up, the vehicle can further enlarge or restore the card's display size based on the distance between the user's finger and the second area on the display screen, thereby further enhancing the user's human-computer interaction experience. FIG9 illustrates another set of GUIs provided in an embodiment of the present application.

[0175] As shown in FIG9(a), when the vehicle detects that the distance L1 between the user's finger and the first area of ​​the display screen is less than or equal to a first preset distance, the vehicle can automatically pop up cards 203-206 through the display screen. In this case, the display size of cards 203-206 can be a first size (e.g., a card height of 160 pixels).

[0176] As shown in FIG9( b ), when the vehicle detects that the distance L2 between the user's finger and the second area of ​​the display screen is less than or equal to a third preset distance, the vehicle can enlarge the display size of card 204 via the display screen. The second area may include the display area of ​​card 204. For example, the vehicle can enlarge the size of card 204 from the first size to the second size (e.g., increasing the height of the card to 240 pixels). This facilitates user operation of card 204 and helps enhance the user's human-computer interaction experience. For example, the third preset distance can be 8 cm.

[0177] In one embodiment, the second area may be the display area of ​​the navigation interface; or the second area may be the display area of ​​card 204; or the second area may be an area larger than the display area of ​​card 204. For example, the second area may be the area after the display area of ​​card 204 is expanded by a preset multiple (e.g., 1.1 times). For another example, the second area may be the area after card 204 is expanded outward by 2 cm in both the height and width directions.

[0178] The above description of the process of expanding the size of a card from a first size to a second size uses the example of increasing the height of the card by 1.5 times, but the embodiments of the present application are not limited to this. The width of the card 204 at the first size and the second size can be the same; alternatively, the width of the card 204 can also be increased during the process of expanding the size of the card 204 from the first size to the second size. For example, the width of the card 204 at the second size can be 1.1 times the width of the card 204 at the first size.

[0179] In one embodiment, cards 203-206 may also be always displayed on the display screen. When the vehicle detects that the distance L2 between the user's finger and the second area on the display screen is less than or equal to the third preset distance, the vehicle may enlarge the display size of card 204.

[0180] In one embodiment, when it is detected that the distance between the user's finger and the second area on the display screen is greater than the third preset distance, the size of card 204 can be restored from the second size to the first size through the display screen. When it is detected that the distance between the user's finger and the first area on the display screen is greater than the first preset distance, cards 203-206 can be automatically hidden.

[0181] The following describes the process of automatically popping up a card based on the direction of the user's finger approaching the display screen, using the GUI shown in Figure 10. This allows the card to be displayed in different locations as the user's finger approaches the display screen from different directions, making it easier for the user to manipulate the card and enhancing the user's human-computer interaction experience. Figure 10 illustrates another GUI provided in an embodiment of the present application.

[0182] As shown in (a) of FIG10 , when the vehicle detects through a sensor that the user has not interacted with the display screen, the navigation interface may be displayed in the content display area without displaying the card.

[0183] As shown in FIG10( b ), when the vehicle detects that the user's finger is approaching the display screen from the right side, cards 203-206 may be automatically popped out on the right side of the display screen. This allows the user to directly operate the cards displayed on the right side of the display screen, thereby improving the user's human-computer interaction experience.

[0184] The above detection by the vehicle that the user's finger approaches the display screen from the right side of the display screen can be understood as the detection by the vehicle that the user's finger approaches the display screen from the right side to the left side.

[0185] The cards 203 - 206 may be arranged in one column on the right side of the display screen, or may be arranged in multiple columns on the right side of the display screen.

[0186] In one embodiment, when the vehicle detects that the user's finger approaches the display screen from the left side of the display screen, the cards 203 - 206 may be automatically popped out on the left side of the display screen.

[0187] In this embodiment of the present application, when a user in the driver's seat wants to operate a card, they generally choose to approach the display screen from the left side. At this time, the vehicle can automatically eject the card through the display screen and display the card on the left side of the display, which makes it easier for the user in the driver's seat to operate the card. When a user in the passenger seat wants to operate a card, they generally choose to approach the display screen from the right side of the display screen. At this time, the vehicle can automatically eject the card through the display screen and display the card on the right side of the display, which makes it easier for the user in the passenger seat to operate the card.

[0188] The following describes the process of determining whether the floating icon on the display screen is expanded or collapsed by judging whether the user's finger is close to the display screen in an embodiment of the present application in conjunction with Figure 11. Figure 11 shows another set of GUIs provided in an embodiment of the present application.

[0189] As shown in FIG11(a), when the vehicle's sensors detect that the user is not interacting with the display screen, the navigation interface and floating icon 1101 can be displayed in the content display area. Floating icon 1101 is associated with one or more applications. For example, floating icon 1101 can be associated with a game application, a weather application, and an in-car music application.

[0190] As shown in FIG11(b), when the vehicle detects that the user's finger is approaching the display screen, the display screen may display an application list 1102 after the floating icon 1101 is expanded (the display area of ​​the application list 1102 is the gray sector area shown in FIG11(b)). The application list 1102 includes the floating icon 1101, an icon for a game application, an icon for a weather application, and an icon for an in-car music application.

[0191] In one embodiment, when the vehicle detects that the distance between the user's finger and the first area on the display screen is less than or equal to a first preset distance, a floating icon 1101 may be automatically popped up through the display screen, and the first area includes the display area of ​​the floating icon 1101. When the vehicle detects that the distance between the user's finger and the first area is less than or equal to a third preset distance, the application list corresponding to the floating icon 1101 may be automatically opened through the display screen, and the third preset distance is less than the first preset distance. Exemplarily, the first area may be the area where the floating icon 1101 is located; or, the first area may be an area larger than the area where the floating icon 1101 is located. For example, the first area may be the area where the display area of ​​the floating icon 1101 is enlarged by a preset multiple (for example, 1.1 times).

[0192] In one embodiment, the vehicle may determine the location where the floating icon 1101 automatically pops up based on the direction of the user's finger approaching. Exemplarily, the location where the floating icon automatically pops up may include the lower left corner or the lower right corner of the content display area. When the vehicle detects that the user's finger is approaching the display screen from the left side, the floating icon 1101 may automatically pop up in the lower left corner of the content display area. Exemplarily, when the vehicle detects that the user's finger is approaching the display screen from the right side, the floating icon 1101 may automatically pop up in the lower right corner of the content display area.

[0193] In one embodiment, when the vehicle detects a user's finger approaching the display screen through a sensor, the vehicle may continue to display the application list while also displaying the floating icon 1101. Thus, when the vehicle detects a user clicking on the floating icon 1101, the application list 1102 may be retracted; or, when the vehicle detects a user clicking on a display area other than the application list 1102, the application list 1102 may be retracted; or, when the vehicle detects a user's finger moving away from the display screen, the application list 1102 may be retracted.

[0194] For another example, the floating icon 1101 can be associated with a game application, a weather application, an in-car music application, a settings function, and an address book. As shown in (c) of Figure 11 , when the vehicle detects that the user's finger is approaching the display screen through the sensor, the display screen can display an expanded application list 1103 of the floating icon 1101 (the display area of ​​the application list 1103 is the gray sector area shown in (c) of Figure 11 ). The application list 1103 includes icons for the game application, the weather application, the in-car music application, the settings function, and the address book.

[0195] The one or more applications associated with the above floating icon 1101 may be set by the user, or may be one or more applications recently opened by the user.

[0196] FIG12 shows another set of GUIs provided by an embodiment of the present application.

[0197] As shown in FIG12(a), when the vehicle detects that the distance L1 between the user's finger and the second area on the display screen is less than or equal to a third preset distance, the vehicle may enlarge the size of card 203 from the first size to the second size. The second area may include the display area of ​​card 203. For example, the second area may be the display area of ​​the navigation interface; or the second area may be the display area of ​​card 203; or the second area may be an area larger than the display area of ​​card 203. For example, the second area may be the area after the display area of ​​card 203 is enlarged by a preset multiple (e.g., 1.1 times). For another example, the second area may be the area after card 203 is expanded outward by 2 cm in both the height and width directions.

[0198] As shown in FIG12(b), when the vehicle detects that the distance L2 between the user's finger and the second area of ​​the display screen is less than or equal to a fifth preset distance, the vehicle may display an application list 1201 corresponding to the services and applications on the display screen, wherein the fifth preset distance is less than the third preset distance. Exemplarily, the fifth preset distance is 5 cm. Application list 1201 includes icons for an in-vehicle navigation application, a weather application, a settings icon, an address book icon, and an in-vehicle music application.

[0199] In one embodiment, cards 203-206 may be always displayed on the display screen. When the vehicle detects that the distance L1 between the user's finger and the second area on the display screen is less than or equal to a third preset distance, the display size of card 203 may be enlarged through the display screen.

[0200] In one embodiment, cards 203-206 may also automatically pop up as the user's finger approaches the display screen. For example, when the distance between the user's finger and a first area on the display screen is greater than a first preset distance, the vehicle may hide cards 203-206 through the display screen. When the distance between the user's finger and the first area on the display screen is less than or equal to the first preset distance, the vehicle may automatically pop up cards 203-206 through the display screen. The description of this first area can be found in the description of the embodiment corresponding to the GUI shown in FIG. 3 above, and will not be repeated here.

[0201] In one embodiment, when it is detected that the distance between the user's finger and the second area on the display screen changes from less than or equal to the fifth preset distance to greater than the fifth preset distance and less than or equal to the third preset distance, the application list 1201 can be collapsed through the display screen. When it is detected that the distance between the user's finger and the second area on the display screen is greater than the third preset distance, the size of the card 203 can be restored from the second size to the first size through the display screen.

[0202] In an embodiment of the present application, when the distance between the user's finger and the second area of ​​the display screen is less than the third preset distance, the vehicle can enlarge the card corresponding to the service and application, which makes it easier for the user to click on the card; when the distance between the user's finger and the second area of ​​the display screen is less than or equal to the fifth preset distance, the vehicle can automatically display the submenu corresponding to the service and application, which makes it easier for the user to operate the icon of a certain application in the submenu directly on the navigation interface without switching to the display interface of the service and application, helping to avoid the user frequently switching the display interface on the display screen, thereby helping to improve the user's driving safety. At the same time, after the user's finger is away from the display screen, the vehicle can also automatically hide the card, thereby preventing the card from blocking the navigation interface that the user wants to see, helping to improve the imaging effect of the display screen.

[0203] It should be understood that the first preset distance, the second preset distance, the third preset distance, the fourth preset distance and the fifth preset distance involved in the embodiments of the present application can be set by the user, or can be set before the vehicle leaves the factory.

[0204] The following describes how to automatically pop up and hide interface elements by collecting the user's gaze direction through a camera or an eye tracker in conjunction with Figure 13. Figure 13 shows another set of GUIs provided by an embodiment of the present application.

[0205] As shown in FIG13( a ), when the vehicle detects through a camera or eye tracker that the user's gaze is not on the display screen, the navigation interface can be displayed in the content display area 201 without displaying cards 203 to 206. In this way, since cards 203 to 206 are hidden, the user can see more navigation content in the content display area 201.

[0206] As shown in (b) of FIG13 , when the vehicle detects through a camera that the user's gaze is on the display screen, cards 203 - 206 may be automatically popped up in the content display area 201 .

[0207] In one embodiment, the content display area 201 can be divided into area 1 and area 2 as shown in (c) in Figure 3. When it is detected that the user's line of sight is on the display screen, cards 203-206 can be automatically popped up in the content display area 201, including: when the vehicle detects that the user's line of sight is on area 2, cards 203-206 can be automatically popped up in the content display area 201. In this way, when the vehicle determines that the user's line of sight is in area 2, the vehicle can automatically pop up a card in the content display area 201, thereby facilitating the user to operate the card; and when it determines that the user's line of sight is in area 1, the vehicle can determine that the user's line of sight is looking at the navigation interface, so that the card may not be popped up. In this way, by judging the area where the line of sight is located, the accuracy of the vehicle in judging whether a card will be automatically popped up can be improved, and the process of automatically popping up and hiding the card can be more in line with the user's intention.

[0208] In one embodiment, if the vehicle does not detect the user's operation on the card 203-206 within a preset time period after the card 203-206 pops up, the card 203-206 can be automatically hidden through the display screen.

[0209] In the above embodiment, the interface element is a card. The present application is not limited to this. The following describes the human-computer interaction process when the interface element is a message prompt box, a human-computer interaction model, and other types of cards in conjunction with the GUI shown in Figures 14 and 15.

[0210] FIG14 shows another set of GUIs provided by an embodiment of the present application.

[0211] As shown in FIG14( a ), the vehicle may display a navigation interface of an in-vehicle map application through the content display area 201. When the vehicle receives a message from a social application, a GUI as shown in FIG14( b ) may be displayed through the display screen.

[0212] As shown in (b) of Figure 14, in response to receiving the message, the vehicle can display a message prompt box 1401 in the content display area 201, wherein the size of the message prompt box 1401 is the third size (for example, the height of the message prompt box is 160 pixels). The message prompt box 1401 includes the name of the social application, the avatar and nickname of the user sending the message (for example, "daughter"), and the content of the message (for example, "What time will I arrive home"). When the vehicle detects that the user's finger is approaching the display screen, the GUI shown in (c) of Figure 14 can be displayed on the display screen.

[0213] As shown in (c) of Figure 14 , in response to detecting that the user's finger is approaching the display screen, the vehicle can enlarge the size of the message prompt box 1401 from the third size to the fourth size (for example, the height of the message prompt box 1401 at the fourth size is 240 pixels). In this way, by detecting that the user's finger is approaching the display screen, the vehicle can determine that the user wants to view the message and thus enlarge the size of the message prompt box. Enlarging the size of the message prompt box helps improve the convenience of the user clicking on the message prompt box, thereby helping to enhance the user's human-computer interaction experience.

[0214] FIG15 shows another set of GUIs provided by an embodiment of the present application.

[0215] As shown in (a) of FIG15 , the vehicle can display the navigation interface of the in-vehicle map application and the human-computer interaction model 1501 through the content display area 201. The size of the human-computer interaction model is the fifth size.

[0216] As shown in FIG15( b ), when the vehicle receives a user's voice command including the wake-up word "Xiao A Xiao A" through the microphone, the vehicle can respond to the voice command through the human-computer interaction model 1501 (for example, the human-computer interaction model 1501 can reply "Here, master!"). While responding through the human-computer interaction model 1501, the vehicle can enlarge the size of the human-computer interaction model 1501 from the fifth size to the sixth size.

[0217] As shown in FIG15( c ), when the vehicle receives the user's voice command "Help me set an alarm" through the microphone, the vehicle can respond to the voice command through the human-computer interaction model 1501 (for example, the human-computer interaction model 1501 can reply "The alarm has been created") and create an alarm card 1502, wherein the size of the alarm card 1502 is the seventh size. While responding through the human-computer interaction model 1501, the vehicle can enlarge the size of the human-computer interaction model 1501 from the fifth size to the sixth size.

[0218] In one embodiment, the voice command "Help me set an alarm" contains the user's intent and the slot information corresponding to the intent is missing (for example, the alarm's ringing time information is missing), then the vehicle can create an alarm card 1502 on the content display area 201. If the voice command contains the user's intent and the slot information corresponding to the intent is complete, then the vehicle may not display the card 1502 in the content display area 201, but directly execute the operation corresponding to the intent in the background. For example, when the vehicle receives the user's voice command "Help me create an alarm for 3:30 pm" through the microphone, the vehicle can determine the user's intent and the corresponding slot information, so that the operation of creating an alarm for 3:30 pm can be executed in the background.

[0219] When the vehicle detects that the user's finger approaches the display screen, a GUI as shown in (d) in FIG. 15 may be displayed through the display screen.

[0220] As shown in FIG15( d ), in response to detecting the user's finger approaching the display screen, the vehicle can enlarge the size of the alarm card 1502 from the seventh size to the eighth size. Thus, by detecting the user's finger approaching the display screen, the vehicle can determine that the user wishes to set an alarm and, accordingly, enlarge the size of the alarm card. Enlarging the size of the alarm card helps improve the user's convenience in clicking on the alarm card, thereby enhancing the user's human-computer interaction experience.

[0221] As shown in (e) to (f) of FIG15 , in response to detecting a user clicking on an alarm card 1502, the vehicle may display an alarm setting interface and a navigation interface in different regions. For example, the vehicle may display the alarm setting interface in region 1503 of the content display region 201 and the navigation interface in region 1504.

[0222] In one embodiment, when the vehicle detects that the user in the driver's seat has clicked the alarm card 1502 with their finger, the alarm setting interface can be displayed in area 1503 and the navigation interface can be displayed in area 1504, thereby facilitating the user in the driver's seat to set the alarm. When the vehicle detects that the user in the passenger seat has clicked the alarm card 1502 with their finger, the alarm setting interface can be displayed in area 1504 and the navigation interface can be displayed in area 1503, thereby facilitating the user in the passenger seat to set the alarm.

[0223] In the embodiment of the present application, in addition to triggering the automatic pop-up of a card by approaching the display screen with a finger, different interface elements can also be triggered to pop up through different gestures. Figure 16 shows another set of GUIs provided by the embodiment of the present application.

[0224] As shown in (a) of FIG16 , when the vehicle detects that a user is approaching the display screen with an air gesture 1 (e.g., an OK gesture or a gesture when raising three fingers), the vehicle can automatically pop up a card 206 in the content display area 201 through the display screen, and the card 206 can be displayed on the navigation interface. In this way, the vehicle can automatically pop up the card 206 when it detects the air gesture 1, avoiding the user from selecting the required card from multiple cards, making it convenient for the user to operate the card 206 in a timely manner, thereby helping to enhance the user's human-computer interaction experience.

[0225] As shown in FIG16( b ), when the vehicle detects that a user is approaching the display screen with an air gesture 2 (e.g., a "V" gesture or a gesture of raising two fingers), the vehicle can automatically pop up a card 204 in the content display area 201 through the display screen, and the card 204 can be displayed on the navigation interface. In this way, the vehicle can automatically pop up the card 204 when it detects the air gesture 2, avoiding the user from selecting the required card from multiple cards, making it convenient for the user to operate the card 204 in a timely manner, thereby helping to enhance the user's human-computer interaction experience.

[0226] In one embodiment, the correspondence between the air gesture and the pop-up card may be set when the vehicle leaves the factory; or, it may be set by the user himself, which is not limited in this embodiment of the present application.

[0227] The above embodiment is described by dividing the display screen into the content display area 201 and the function bar 202. The content display area 201 and the function bar 202 can be two independent areas. Alternatively, the function bar 202 can be displayed on the content display area 201. Figure 17 shows another set of GUIs provided in an embodiment of the present application.

[0228] As shown in (a) of FIG17 , when it is detected that the user has not interacted with the display screen, the navigation interface can be displayed through the content display area 201 without displaying the cards 203-206 and the function bar 202. In this way, since the cards 203-206 and the function bar 202 are hidden, the user can see more navigation content through the content display area 201.

[0229] As shown in FIG17( b ), when the vehicle detects that the user's finger is approaching the display screen from the bottom, the vehicle can display a function bar 202 on the navigation interface. Thus, by detecting that the finger is approaching the display screen from the bottom, the function bar 202 is displayed on the content display area 201, making it easier for the user to operate the functions in the function bar 202 and helping to enhance the user's human-computer interaction experience.

[0230] As shown in FIG17( c ), upon detecting that a user's finger is approaching the display screen from the left side, the vehicle can automatically pop up cards 203-206 on the content display area 201. Thus, by detecting that a finger is approaching the display screen from the left side, cards 203-206 are displayed on the content display area 201, making it easier for the user to operate on the cards in cards 203-206, thereby improving the user's human-computer interaction experience.

[0231] In one embodiment, when the user's finger is detected approaching the display screen from the left side of the display screen, the vehicle can automatically pop up cards 203-206 on the navigation interface and the cards 203-206 can be displayed on the left side of the navigation interface in a column arrangement.

[0232] In one embodiment, when the vehicle detects through a sensor that the user's finger approaches the display screen from the right side of the display screen, the vehicle can automatically pop up cards 203-206 on the navigation interface.

[0233] In one embodiment, when the vehicle detects that the user's finger approaches the display screen from the right side of the display screen through a sensor, the vehicle can automatically pop up cards 203-206 on the navigation interface and the cards 203-206 can be displayed on the right side of the navigation interface in a column arrangement.

[0234] The following describes the process of users manually setting the automatic pop-up and hiding functions of cards to be enabled or disabled, and manually setting the correspondence between air gestures and cards, in conjunction with the GUI shown in Figure 18.

[0235] As shown in FIG18(a), the vehicle displays a desktop on a display screen. The desktop includes a card 1801, which displays an icon for a setting function. When the vehicle detects that a user clicks on card 1801, the display screen may display a GUI as shown in FIG18(b).

[0236] As shown in FIG18(b), in response to detecting a user clicking on card 1801, the vehicle may display a display interface for settings functions on the display screen, where the settings functions include language and date, display function, sports mode, battery, and update functions. When the vehicle detects a user clicking on a display function, the vehicle may display a GUI as shown in FIG18(c).

[0237] As shown in (c) of FIG18 , in response to detecting that the user clicks on the display function, the vehicle can display a display interface of the display function through the display screen, wherein the display interface includes settings for screen brightness, function bar, card editing, and automatic card pop-up and hide functions, as well as an introduction to the automatic card pop-up and hide functions. For example, the function introduction is “When the automatic card pop-up and hide function is activated, if the finger is far away from the display screen during the operation of the application, the card will be automatically hidden; if the finger is close to the display screen, the card will be automatically popped up.” When the vehicle detects that the user slides the control 1802 from the left to the right, the automatic card pop-up and hide function can be activated.

[0238] As shown in (d) of Figure 18, the display interface also includes a function for setting the correspondence between air gestures and cards. When the vehicle detects that the user clicks on this function, a GUI as shown in (e) of Figure 18 can be displayed.

[0239] As shown in (e) of Figure 18, in response to detecting the user clicking on the function, the vehicle can display the display interface of the function of setting the correspondence between air gestures and cards through the display screen. On this setting interface, the user can set the correspondence between the card and the air gesture corresponding to the card. For example, when the vehicle detects the user's click operation in the rectangular frame 1803, the correspondence between the air gesture 1 and the 360° surround can be set. In this way, as shown in (a) of Figure 16, when it is detected that the user approaches the display screen with the air gesture 1, the vehicle can automatically pop up the card 206 in the content display area 201 through the display screen.

[0240] In one embodiment, a single air gesture can be associated with multiple cards. For example, an air gesture 1 can be associated with a 360° surround view and an in-car music application. Thus, upon detecting a user approaching the display screen with air gesture 1, the vehicle can control the display screen to automatically pop up cards 204 and 206 in content display area 201.

[0241] FIG19 shows a schematic flow chart of a display method 1900 provided in an embodiment of the present application. The method 1900 can be applied to a system including a sensor, a display screen, and a computing platform; or, the method 1900 can be applied to a vehicle. As shown in FIG19 , the method 1900 includes:

[0242] S1901, displaying a first interface on a display screen.

[0243] In one embodiment, displaying the first interface through the display screen includes: displaying a display interface of the first application through the display screen.

[0244] In one embodiment, displaying the display interface of the first application through the display screen includes: displaying the display interface of the first application in response to detecting an operation of the user starting the first application.

[0245] Exemplarily, the first application may be the aforementioned navigation application.

[0246] S1902: Determine whether the user's hand is close to the display screen, and / or determine whether the user's sight is on the display screen.

[0247] If it is detected that the user's finger is close to the display screen and / or the user's line of sight is on the display screen, execute S1903; if it is detected that the user's finger is not close to the display screen and the user's line of sight is not on the display screen, return to continue executing S1901.

[0248] In one embodiment, determining whether the user's hand is close to the display screen includes determining whether the user's finger is close to the display screen.

[0249] In one embodiment, determining whether a user's finger is close to a display screen includes determining whether the distance between the user's hand and a first area on the display screen is less than or equal to a first preset distance. The first area may be the display area of ​​the first interface; or the first area may be the display area of ​​one or more interface elements, for example, the first area may be the display area of ​​cards 203-206 in FIG. 2 ; or, taking the one or more interface elements as cards 203-206 in FIG. 2 as an example, the first area may be area 2 shown in (c) of FIG. 3 ; or, taking into account the error in detecting the first area, the first area may be an area larger than area 2. For example, the first area may be area 2 expanded by a preset multiple (e.g., 1.1 times). In another example, the first area may be area 2 expanded outward by 2 cm in both the height and width directions. In this way, a certain detection error can be maintained when detecting the distance between the hand and the first area, thereby making it easier for the display screen to trigger the automatic pop-up of one or more interface elements.

[0250] The following uses the user's hand as an example to illustrate the process of determining whether the user's finger is close to the display screen by combining one or more sensors.

[0251] In the embodiments of the present application, the hardware used to determine whether the user's finger is close to the display screen includes but is not limited to a radio transceiver on the display screen or at the edge of the display screen (including but not limited to millimeter-wave radar or centimeter-wave radar), an infrared sensing device integrated on the display screen or at the edge of the display screen (including but not limited to infrared rangefinders, laser rangefinders), a camera sensor integrated or installed on the display screen or a camera sensor installed inside the vehicle cabin (including but not limited to red, green, blue (RGB) cameras, red, green, blue infrared (RGB infrared radiation, RGB IR) cameras, time of flight (TOF) cameras), a laser radar integrated or installed on the display screen or installed inside the vehicle cabin, an ultrasonic transceiver integrated or installed on the display screen or installed inside the vehicle cabin (including but not limited to microphone sensors or microphone sensor arrays), an eye tracker, etc.

[0252] In one embodiment, the process of detecting a finger approaching a display screen using the aforementioned sensor includes: when the distance between the finger and a first area on the display screen is detected to be less than or equal to a first preset distance, one or more interface elements automatically pop up. When the distance between the finger and the first area on the display screen is detected to be greater than a second preset distance, one or more interface elements are hidden. The first area includes the display area of ​​the one or more interface elements.

[0253] In one embodiment, the process of detecting a finger approaching the display screen by the sensor further includes: when the distance between the finger and a second area on the display screen is detected to be less than or equal to a third preset distance, expanding the size of a first interface element, wherein the one or more interface elements include the first interface element, and the second area includes the display area of ​​the first interface element.

[0254] Exemplarily, the process of determining whether a finger is close to the display screen by a radio transceiver is as follows: the antenna layout of the radio transceiver (such as a millimeter-wave radar or a centimeter-wave radar) is based on the layout position of the interface element, and the antenna can be installed at the center of the corresponding display screen frame; if the interface element is at a corner of the screen, the antenna is installed at the corresponding corner of the display screen. The radio transceiver sends a pulse signal and sends the received echo signal to the computing platform. The computing platform can determine the orientation of the finger relative to the radio transceiver based on the echo signal. The computing platform can determine whether the finger is close to or away from the display screen based on the signal strength and / or signal quality changes of the echo signal. Exemplarily, when the signal strength of the detected echo signal gradually increases, it can be determined that the finger is approaching the display screen; when the signal strength of the detected echo signal gradually weakens, it indicates that the finger is away from the display screen.

[0255] At the same time, the computing platform can also determine the distance between the finger and the radio transceiver based on the signal strength of the echo signal. For example, when it is detected that the distance between the finger and a first area on the display screen is less than or equal to a first preset distance, the computing platform can send a command to the display screen, which can be used to instruct the pop-up of an interface element, where the first area includes the display area of ​​the one or more interface elements. After receiving the command, the display screen can automatically pop up the interface element.

[0256] It should be understood that the radio transceiver can transmit the echo signal to a computing platform within the vehicle, thereby determining the distance between the finger and the first area via the computing platform within the vehicle. Alternatively, the computing platform can be located in a cloud server, and after acquiring the echo signal, the radio transceiver can transmit the echo signal to the cloud server, which then calculates the distance between the finger and the first area. After calculating the distance, the cloud server can transmit the distance information to the vehicle. After receiving the distance between the finger and the first area, the vehicle can determine whether to pop up one or more interface elements.

[0257] For another example, when the distance between the finger and the second area of ​​the display screen is detected to be less than or equal to a third preset distance, the computing platform may send an instruction to the display screen, which may be used to instruct the first interface element to be enlarged, where the second area includes the display area of ​​the first interface element. After receiving the instruction, the display screen may enlarge the size of the first interface element.

[0258] For another example, when it is detected that the distance between the finger and the first area of ​​the display screen is greater than or equal to a second preset distance, the computing platform can send an instruction to the display screen, which can be used to instruct the interface element to hide. After receiving the instruction, the display screen can automatically hide the interface element.

[0259] The first preset distance and the second preset distance may be equal or unequal, and this embodiment of the present application does not limit this.

[0260] The computing platform can determine the distance between the finger and the first area by the signal quality or signal strength of the echo signal. Alternatively, the computing platform can determine the distance between the user's finger and the first area by performing a fast Fourier transform (FFT) on the echo signal.

[0261] Exemplarily, the process of using a camera to determine whether a finger is close to the display screen is as follows: The camera can be installed in the same position as a radio transceiver, at the center of an edge of the display screen, or it can be another camera in the cabin that can simultaneously sense the front passenger's hand and the display screen. The camera captures images of the front passenger (or rear passenger) in the cabin in real time. When the camera is an RGB camera or an RGB IR camera, the camera can send the collected image information to the computing platform, and the computing platform can perform hand detection on the passenger in the image information. When a hand is detected, the minimum enveloping rectangle of the hand is taken, and the center pixel coordinates and area of ​​the rectangle are recorded.

[0262] When the minimum enveloping rectangle of the hand is detected to be gradually increasing in size or the center coordinates of the rectangle are gradually approaching the display screen, the computing platform can determine that the hand is approaching the display screen. When the area of ​​the minimum enveloping rectangle is greater than a first area threshold or the distance between the hand and the first area is less than or equal to a first preset distance, the computing platform can send a command to the display screen, which can be used to instruct the interface element to pop up.

[0263] When the minimum enveloping rectangle for detecting the hand gradually decreases, or the center coordinates of the rectangle gradually move away from the display screen, the computing platform can determine that the hand is moving away from the display screen. When the area of ​​the minimum enveloping rectangle is less than or equal to a second area threshold, or the distance between the hand and the first area is greater than or equal to a second preset distance, the computing platform can send a command to the display screen, which can be used to instruct the interface element to hide.

[0264] When the camera is a TOF camera, the TOF camera can send the collected image information to the computing platform. The computing platform can output the spatial three-dimensional position coordinates of the hand in the camera coordinate system based on the image information. The positional relationship between the camera coordinate system and the display screen coordinate system can be obtained through camera calibration technology or mechanical measurement. When it is detected that the distance between the finger and the first area is less than or equal to the first preset distance, the computing platform can send an instruction to the display screen, which can be used to instruct the interface element to pop up. When it is detected that the distance between the finger and the first area is greater than or equal to the second preset distance, the computing platform can send an instruction to the display screen, which can be used to instruct the interface element to hide.

[0265] Exemplarily, the process of determining whether a finger is close to the display screen by using a laser radar is as follows: the laser radar sends the collected point cloud data to the computing platform. The computing platform can output the spatial three-dimensional position coordinates of the hand in the laser radar coordinate system based on the point cloud data. The positional relationship between the laser radar coordinate system and the display screen coordinate system can be obtained through calibration technology or mechanical measurement. When it is detected that the distance between the finger and the first area is less than or equal to the first preset distance, the computing platform can send an instruction to the display screen, which can be used to instruct the interface element to pop up. When it is detected that the distance between the finger and the first area is greater than or equal to the second preset distance, the computing platform can send an instruction to the display screen, which can be used to instruct the interface element to hide.

[0266] Exemplarily, the process of determining whether a finger is close to a display screen using an infrared sensing device is as follows: the infrared sensing device (including but not limited to an infrared rangefinder or a laser rangefinder) can be placed at the border of the display screen according to the layout position of the interface element; if the interface element is located in a corner of the display screen, it can be installed at the corresponding corner of the display screen. The infrared sensing device can send the measurement result to the computing platform, and the computing platform can obtain the distance between the user's hand and the first area based on the measurement result.

[0267] Exemplary processes for determining whether a finger is close to a display screen using an ultrasonic transceiver are as follows: an array of ultrasonic transceivers (including but not limited to microphones) can be installed on one or both sides of the corresponding display screen frame, depending on the layout of the interface elements. When the ultrasonic transceiver detects a Doppler response from the finger's echo, it can send this Doppler response to a computing platform. The computing platform can then determine the distance between the finger and the display screen based on this Doppler response.

[0268] For example, through data collected by a camera or an eye tracker, the computing platform can determine whether the user's gaze is in the first area based on gaze estimation technology.

[0269] It should be understood that the embodiments of the present application are not limited to using only one of the above sensors to detect whether a finger is approaching the display screen. When the sensing range of a certain sensor cannot fully cover the necessary detection area, a comprehensive judgment can be made by integrating multiple sensors.

[0270] For example, data collected by an eye tracker and millimeter-wave radar can be used to determine whether to pop up one or more interface elements. When the computing platform determines, based on data collected by the eye tracker, that the user's gaze is in a first area, and based on data collected by the millimeter-wave radar, that the distance between the finger and the first area is less than or equal to a first preset distance, the computing platform can send a command to the display screen, which can be used to instruct the interface element to pop up. Upon receiving the command, the display screen can automatically pop up the interface element.

[0271] For example, data collected by the camera and millimeter-wave radar can be used to determine whether to pop up one or more interface elements. When the computing platform determines through data collected by the millimeter-wave radar that the distance between an object and the first area is less than or equal to a sixth preset distance (the sixth preset distance is greater than the first preset distance, for example, the sixth preset distance can be 40 cm), the camera can be controlled to turn on and capture an image of the object.

[0272] If the computing platform determines that the object is the user's hand (e.g., finger) through the image captured by the camera, the computing platform can continue to determine the distance between the finger and the first area using data collected by the millimeter-wave radar. When it is detected that the distance between the finger and the first area is less than or equal to a first preset distance, the computing platform can send a command to the display screen, which can be used to instruct the interface element to pop up. After receiving the command, the display screen can automatically pop up the interface element.

[0273] If the computing platform determines through the image captured by the camera that the object is not the user's hand (for example, the object is the user's elbow), the computing platform may stop calculating the distance between the user's elbow and the first area.

[0274] S1903: When it is detected that the user's hand is close to the display screen, and / or when it is detected that the user's sight is on the display screen, display one or more interface elements on the first interface.

[0275] In one embodiment, detecting that the user's finger is approaching the display screen includes: detecting that the distance between the user's finger and the first area is less than or equal to a first preset distance.

[0276] In one embodiment, detecting that the user's gaze is on the display screen includes: detecting that the user's gaze is in the first area.

[0277] S1904: Determine whether the user clicks on the one or more interface elements.

[0278] If it is detected that the user clicks on one of the one or more interface elements, execute S1905; otherwise, execute S1906.

[0279] S1905: If it is detected that the user clicks on a first interface element among the one or more interface elements, an operation corresponding to the first interface element is executed.

[0280] Exemplarily, the first interface element is associated with the second application, and the execution of the operation corresponding to the first interface element includes: switching from the display interface displaying the first application to the display interface displaying the second application; or, switching from the display interface displaying the first application to the display interface displaying the first application and the second application.

[0281] Exemplarily, the first interface element is associated with an application list, and then executing the operation corresponding to the first interface element includes: displaying the application list on the first interface.

[0282] S1906: Determine whether the user clicks on an area of ​​the first interface other than the area where the one or more interface elements are located.

[0283] If it is detected that the user clicks on an area of ​​the first interface other than the area where the one or more interface elements are located, execute S1908; otherwise, execute S1903.

[0284] In the embodiment of the present application, while performing the judgment in S1904, the judgment in S1907 can also be performed.

[0285] S1907: Determine whether the user's hand is away from the display screen, and / or determine whether the user's sight is not on the display screen.

[0286] In one embodiment, when the user's hand approaches the display screen in S1902, one or more interface elements are displayed on the first interface. When the user's hand moves away from the display screen in S1907, S1908 is executed; otherwise, S1903 is executed.

[0287] In one embodiment, when the user's gaze is fixed on the display screen in S1902, one or more interface elements are displayed on the first interface; when the user's gaze is not fixed on the display screen in S1907, or when the user's gaze is fixed on the display screen for a preset period of time and no user operation on one or more interface elements is detected, S1908 is executed; otherwise, S1903 is executed.

[0288] In one embodiment, when it is determined in S1902 that the user's hand is close to the display screen and the user's line of sight is on the display screen, one or more interface elements are displayed on the first interface; when the user's hand is away from the display screen and / or the user's line of sight is not on the display screen in S1907, S1908 is executed; otherwise, S1903 is executed.

[0289] In one embodiment, determining whether the user's hand is away from the display screen includes determining whether the distance between the user's finger and the first area of ​​the display screen is greater than or equal to a second preset distance.

[0290] In one embodiment, determining whether the user's sight line is not on the display screen includes: determining whether the user's sight line is not in the first area.

[0291] It should be understood that the process of determining whether the user's finger is away from the display screen and the process of determining whether the user's line of sight is not on the display screen in S1907 can refer to the description in the above S1902. For the sake of brevity, they will not be repeated here.

[0292] S1908: Hide the one or more interface elements on the first interface.

[0293] In an embodiment of the present application, when a user needs to operate one or more interface elements, the user can move their hand close to the first area of ​​the display screen and / or look at the first area, so that the one or more interface elements are displayed on the first interface, making it convenient for the user to operate the one or more interface elements; and when the user does not need to operate one or more interface elements, the user can move their hand away from the first area, and the display screen can hide the one or more interface elements, thereby avoiding the interface elements from blocking the content displayed on the first interface and allowing the user to view more display content through the first interface. In this way, the display screen can display or hide one or more interface elements according to the user's needs, which helps to enhance the user's human-computer interaction experience.

[0294] FIG20 shows a schematic flow chart of a display method 2000 provided in an embodiment of the present application. As shown in FIG20 , the method includes:

[0295] S2010: Displaying a first interface via the vehicle display screen.

[0296] Exemplarily, the first interface may be a desktop.

[0297] It should be understood that the desktop can be the main interface of the vehicle display screen, or the desktop can also be a display interface of wallpaper or animation.

[0298] Exemplarily, the first interface may be a display interface of a first application. For example, as shown in (a) of FIG3 , the first application may be a navigation application.

[0299] Optionally, if the first interface is a display interface of a first application, the method further includes: in response to displaying the display interface of the first application, activating an automatic interface element control function, wherein when the automatic interface element control function is activated and the distance between the user's hand and the first area of ​​the vehicle display screen is less than or equal to the first preset distance, the vehicle display screen is capable of displaying the one or more interface elements. In this way, the automatic interface element control function can be turned on or off according to different scenarios, without the user having to manually turn the function on or off, which helps to improve the degree of automation of the vehicle.

[0300] S2020, when it is detected that the distance between the user's hand and the first area in the vehicle-mounted display screen is less than or equal to a first preset distance, and / or when it is detected that the user's line of sight is in the first area, one or more interface elements are displayed on the first interface; wherein, the first interface includes the first area, and the first area includes the display area of ​​the one or more interface elements.

[0301] The above method 2000 is described using the vehicle-mounted display screen in a vehicle as an example, and the embodiments of the present application are not limited to this. Exemplarily, it can also be the display screen of other terminal devices (for example, a mobile phone, a tablet, a personal computer (PC), a watch, etc.). For example, the method includes: displaying a video playback interface through the display screen of the terminal device; when it is detected that the distance between the user's hand and the first area of ​​the display screen is less than or equal to a first preset distance, and / or when it is detected that the user's line of sight is in the first area, displaying one or more interface elements on the video playback interface; wherein, the video playback interface includes the first area, and the first area includes the display area of ​​the one or more interface elements. In one embodiment, the one or more interface elements include but are not limited to one or more of a pause / play control, a progress bar, a control for switching to playing the previous video, and a control for switching to playing the next video.

[0302] It should be understood that the above description is based on the example of displaying a video playback interface, and the embodiments of the present application are not limited to this.

[0303] For example, a picture browsing interface can also be displayed on the display screen; when it is detected that the distance between the user's hand and the first area is less than or equal to a preset distance, and / or when it is detected that the user's line of sight is in the first area, one or more interface elements can be displayed on the picture browsing interface, wherein the picture browsing interface includes the first area, and the first area includes a display area for the one or more interface elements. In one embodiment, the one or more interface elements include but are not limited to one or more of a picture editing control, a picture detailed information display control (the control can be used to trigger the display of information such as the shooting time and location of the picture), a sharing control, a like control, and a delete control.

[0304] For another example, a call interface may be displayed on a display screen; when the distance between the user's hand and the first area is detected to be less than or equal to a preset distance, and / or when the user's gaze is detected in the first area, one or more interface elements may be displayed on the call interface, wherein the call interface includes the first area, and the first area includes the display area of ​​the one or more interface elements. In one embodiment, the one or more interface elements include, but are not limited to, one or more of a background blur control, a hang-up control, a microphone on / off control, and a speaker on / off control.

[0305] Optionally, the first area may be the display area of ​​the first interface; or, the first area may be the display area of ​​one or more interface elements, for example, the first area may be the display area of ​​cards 203-206 in FIG2 ; or, taking one or more interface elements as cards 203-206 in FIG2 as an example, the first area may be area 2 shown in (c) in FIG3 above; or, taking into account the error in detecting the first area, the first area may be an area larger than area 2. For example, the first area may be the area after area 2 is enlarged by a preset multiple (for example, 1.1 times). For another example, the first area may be the area after area 2 is expanded outward by 2 cm in height and width, respectively.

[0306] For example, as shown in (b) of FIG3 , when it is detected that the distance between the user's finger and the first area is less than or equal to the first preset distance, cards 203 - 206 may be automatically popped up on the display interface of the navigation application.

[0307] For example, as shown in (b) in FIG11 , when it is detected that the distance between the user's finger and the first area is less than or equal to the first preset distance, icons of the game application, weather application, and music application may be automatically popped up on the display interface of the navigation application.

[0308] Optionally, the method further includes: hiding the one or more interface elements on the first interface when it is detected that the distance between the user's hand and the first area is greater than or equal to a second preset distance.

[0309] Exemplarily, as shown in (b) of FIG4 , when it is detected that the distance between the user's finger and the first area is greater than or equal to a second preset distance, cards 203 - 206 may be hidden on the display interface of the navigation application.

[0310] Optionally, displaying one or more interface elements on the first interface includes: when detecting that the user's hand approaches the vehicle-mounted display screen from the first side of the vehicle-mounted display screen, displaying the one or more interface elements in an area close to the first side on the first interface.

[0311] For example, as shown in FIG10( b ), when a user's hand is detected approaching the display screen from the right side, cards 203 - 206 may be displayed on the right side of the navigation application's display interface. This helps the user more conveniently operate one or more interface elements, thereby improving the user's human-computer interaction experience.

[0312] Optionally, the method also includes: when it is detected that the distance between the user's hand and the second area in the vehicle-mounted display screen is less than or equal to the third preset distance, expanding the size of the first interface element from the first size to the second size; wherein, the one or more interface elements include the first interface element, the first interface includes the second area, and the second area includes the display area of ​​the first interface element.

[0313] Optionally, the second area may be the display area of ​​the first interface; or, the second area may be the display area of ​​the first interface element; or, the second area may be the area after the display area of ​​the first interface element is enlarged by a certain multiple; or, taking the card 204 shown in (b) in Figure 9 as an example, the second area may be the area after the card 204 is expanded outward by 1 cm in the height and width directions respectively.

[0314] For example, as shown in FIG9( b ), when it is detected that the distance between the user's finger and the second area of ​​the display screen is less than or equal to a third preset distance, the size of the card 204 can be enlarged from the first size to the second size, and the second area includes the display area of ​​the card 204. In this way, the user can operate the card 204 more conveniently and accurately, which helps to avoid the user accidentally touching other cards due to small card size or too close distance between cards, and helps to improve the user's human-computer interaction experience.

[0315] Optionally, when the one or more interface elements are displayed in a row on the first interface, the size of the first interface element is expanded from the first size to the second size, including: expanding the height of the first interface element from the first height to the second height. The width of the first interface element can remain unchanged, or the expansion multiple of the width of the first interface element can be less than the expansion multiple of the height of the first interface element. This helps to ensure that after the size of the first interface element is expanded, one or more interface elements can continue to be displayed completely on the first interface.

[0316] Optionally, when the one or more interface elements are displayed in a column arrangement on the first interface, the size of the first interface element is expanded from the first size to the second size, including: expanding the width of the first interface element from the first width to the second width. The height of the first interface element can remain unchanged, or the expansion multiple of the height of the first interface element can be less than the expansion multiple of the width of the first interface element. This helps to ensure that after the size of the first interface element is expanded, the one or more interface elements can continue to be displayed completely on the first interface.

[0317] Optionally, the first interface includes a floating icon, the floating icon is associated with one or more applications, and displaying one or more interface elements on the first interface includes: displaying icons of the one or more applications on the first interface.

[0318] For example, as shown in (a) of FIG11 , the floating icon may be icon 1101. When it is detected that the distance between the user's finger and the first area on the display screen is less than or equal to a first preset distance and / or the user's line of sight is in the first area, an application list 1102 may be automatically popped up through the display screen, and the application list 1102 includes icons of multiple applications associated with the floating icon.

[0319] Optionally, the one or more interface elements include a second interface element related to a second application, and the method further includes: when detecting that the user clicks on the second interface element, displaying the display interface of the first application and the second application through the vehicle-mounted display screen.

[0320] Optionally, when it is detected that the user clicks on the second interface element, the display interfaces of the first application and the second application are displayed through the vehicle-mounted display screen, including: when it is detected that the user located on the second side of the vehicle-mounted display screen clicks on the second interface element, the display interface of the second application is displayed through the third area of ​​the vehicle-mounted display screen and the display interface of the first application is displayed through the fourth area of ​​the vehicle-mounted display screen; wherein, the third area is an area close to the second side, and the fourth area is an area away from the second side.

[0321] For example, as shown in (b) in Figure 7, when the vehicle detects that a user in the main driving area clicks on card 204, the vehicle can display the display interface of the newly launched in-vehicle music application on the side close to the main driving area (for example, area 701) and display the navigation interface of the previously launched in-vehicle map application on the side away from the main driving area (for example, area 702) through the display screen.

[0322] The above display method can be automatically started, for example, after the user turns on the vehicle or turns on the vehicle display or turns on the first application. Alternatively, the user is provided with a choice, that is, when the user chooses to turn it on, the above display method is started. For example, the function that implements the above display method is called the interface element automatic control function (for example, the interface element automatic pop-up and hiding function). When it is detected that the user turns on this function, the display method in the above or following embodiments is executed. Alternatively, the above display method is started when the vehicle display screen displays certain specific applications. For example, when the vehicle display screen displays the display interface of the navigation application, the display method in the above or following embodiments is executed; and when the vehicle display screen displays the display interface of other applications (for example, music applications) other than the navigation application, the display method may not be executed. The specific applications mentioned above may be one or more applications that are set by default when the vehicle leaves the factory, or may be one or more applications selected by the user. The name of the interface element automatic pop-up and hiding function is only an example, which represents a control method for displaying and / or hiding interface elements.

[0323] For example, the method also includes: detecting that the user starts the automatic control function of the interface element, wherein, when the automatic control function of the interface element is started and the distance between the user's hand and the vehicle display screen is less than or equal to the first preset distance, the vehicle display screen displays the one or more interface elements.

[0324] For example, as shown in (c) of FIG18 , when the vehicle detects that the user slides the control 1802 from the left to the right, the card automatic pop-up and hide function can be activated.

[0325] Optionally, displaying one or more interface elements on the first interface includes: when a user gesture is detected, displaying the one or more interface elements corresponding to the gesture.

[0326] For example, as shown in (a) and (b) of FIG16 , by detecting different air gestures, different cards can be displayed on the display screen. When a user is detected approaching the display screen with an OK gesture, card 206 can be automatically popped up on the display screen. When a user is detected approaching the display screen with a Y-sign gesture, card 204 can be automatically popped up on the display screen.

[0327] Optionally, displaying the first interface through the vehicle-mounted display screen includes: displaying the first interface and the second interface through the vehicle-mounted display screen; wherein, the method also includes: when it is detected that the distance between the user's hand and the fifth area in the vehicle-mounted display screen is less than or equal to the first preset distance, and / or when it is detected that the user's line of sight is in the fifth area, displaying the one or more interface elements on the second interface; wherein, the second interface includes the fifth area, and the fifth area includes the display area of ​​the one or more interface elements.

[0328] The technical solution of the embodiment of the present application can also be applied to the scenario where the vehicle display screen is a long screen (or, it can also be called a long continuous screen). Figure 21 shows another set of GUIs provided by the embodiment of the present application.

[0329] As shown in FIG21(a), the central control screen and the passenger screen in the vehicle's cockpit can be the same screen 2100. Screen 2100 can be divided into two display areas: area 2101 and area 2102. Area 2101 can be the display area closest to the driver, while area 2102 is the display area closest to the passenger. Area 2101 can display the navigation application interface, and area 2102 can display the video playback interface of a video application. When it is detected that the distance between the user's finger and the first area is less than or equal to a first preset distance, the vehicle can display the GUI shown in FIG21(b) on the display screen. In this case, the first area can be area 2101; alternatively, area 2101 can be divided into area 1 and area 2 as shown in FIG3(c) above. The first area can be area 2 within area 2101; alternatively, the first area can be a larger area than area 2 within area 2101 (for example, the first area can be an area magnified 1.1 times from area 2 within area 2101).

[0330] As shown in (b) of FIG21 , the vehicle may display cards 203 - 206 in area 2101 , while area 2102 may continue to display the video playback interface.

[0331] In one embodiment, when it is detected that the distance between the user's finger and the fifth area is less than or equal to a first preset distance, the vehicle may display cards 203-206 through area 2102. In this case, the fifth area may be area 2102; alternatively, area 2102 may be divided into area 1 and area 2 as shown in FIG3(c) above. The fifth area may be area 2 within area 2102; alternatively, the fifth area may be an area larger than area 2 within area 2102 (for example, the fifth area may be an area magnified 1.1 times by area 2 within area 2102).

[0332] The above areas 2101 and 2102 can automatically pop up the same interface elements (e.g., cards 203-206) after detecting that the user's hand is approaching the corresponding areas. In an embodiment of the present application, areas 2101 and 2102 can also display different interface elements after detecting that the user's hand is approaching the corresponding areas.

[0333] FIG. 22 shows another set of GUIs provided in an embodiment of the present application.

[0334] As shown in FIG22(a), when it is detected that the distance between the user's finger and the fifth area is less than or equal to the first preset distance, the vehicle may display the GUI shown in FIG22(b) on the display screen. In this case, the fifth area may be area 2102; alternatively, area 2102 may be divided into area 1 and area 2 as shown in FIG3(c) above. The fifth area may be area 2 within area 2102; alternatively, the fifth area may be a larger area than area 2 within area 2102 (for example, the fifth area may be area 2 within area 2102 magnified 1.1 times).

[0335] As shown in (b) of FIG. 22 , in response to detecting that the distance between the user's finger and the fifth area is less than or equal to the first preset distance, the vehicle may display cards 2201 - 2203 through area 2102 .

[0336] Optionally, while cards 2201-2203 are displayed via area 2102, the video content displayed on the video playback interface may be in a paused state. When it is detected that the distance between the user's finger and the fifth area is greater than or equal to a second preset distance, cards 2201-2203 may be automatically hidden and the video content may automatically switch from the paused state to the play state.

[0337] In an embodiment of the present application, the interface elements displayed through area 2101 (e.g., cards 203-206) and the interface elements displayed through area 2102 (e.g., cards 2201-2203) can be set by the user as needed, or can be set when the vehicle leaves the factory.

[0338] Optionally, the one or more interface elements include cards and / or application icons.

[0339] Optionally, the method further includes: when detecting an operation of the user's finger clicking on a sixth area, hiding the one or more interface elements on the first interface, the sixth area being an area on the first interface excluding the first area.

[0340] For example, as shown in (b) of FIG. (5), when a click operation of the user in area 1 is detected, cards 203-206 may be hidden on the display interface of the navigation application.

[0341] An embodiment of the present application also provides a device for implementing any of the above methods. For example, a device is provided that includes units (or means) for implementing each step performed by a vehicle or a system composed of sensors, a computing platform, and a display screen in any of the above methods.

[0342] For example, please refer to Figure 23, which is a schematic diagram of a display device 2300 provided in an embodiment of the present application, wherein the device includes a display unit 2310 and a detection unit 2320. The display unit 2310 is configured to display a first interface; the display unit 2310 is further configured to display one or more interface elements on the first interface when the detection unit 2320 detects that the distance between the user's hand and a first area in the display unit 2310 is less than or equal to a first preset distance, and / or when the detection unit 2320 detects that the user's line of sight is in the first area; the first interface includes a first area, and the first area includes a display area for the one or more interface elements.

[0343] Optionally, the display unit 2310 is further used to hide the one or more interface elements on the first interface when the detection unit 2320 detects that the distance between the user's hand and the first area is greater than or equal to a second preset distance.

[0344] Optionally, the display unit 2310 is specifically used to: when the detection unit 2320 detects that the user's hand approaches the display unit 2310 from a first side of the display unit 2310, display the one or more interface elements in an area close to the first side on the first interface.

[0345] Optionally, the display unit 2310 is also used to expand the size of the first interface element from the first size to the second size when the detection unit 2320 detects that the distance between the user's hand and the second area in the display unit 2310 is less than or equal to the third preset distance; wherein the one or more interface elements include the first interface element, the first interface includes the second area, and the second area includes the display area of ​​the first interface element.

[0346] Optionally, the first interface includes a floating icon, which is associated with one or more applications. The display unit 2310 is specifically used to display the icons of the one or more applications on the first interface.

[0347] Optionally, the first interface is a display interface of a first application.

[0348] Optionally, the first application includes a navigation application, a video application, a music application, or the like.

[0349] Optionally, the one or more interface elements include a second interface element related to a second application, and the display unit 2310 is further used to display the display interface of the first application and the second application when the detection unit 2320 detects that the user clicks on the second interface element.

[0350] Optionally, the display unit 2310 is specifically used to: when the detection unit 2320 detects that the user located on the second side of the display unit 2310 clicks on the second interface element, display the display interface of the second application through the third area and display the display interface of the first application through the fourth area; wherein the third area is the area close to the second side, and the fourth area is the area away from the second side.

[0351] Optionally, the detection unit 2320 is also used to detect that the user has started the automatic control function of the interface element, wherein, when the automatic control function of the interface element is started and the distance between the user's hand and the display unit 2310 is less than or equal to the first preset distance, the display unit 2310 can display the one or more interface elements.

[0352] Optionally, the display unit 2310 is specifically configured to: when the detection unit 2320 detects a user gesture, display the one or more interface elements corresponding to the gesture.

[0353] Optionally, the display unit 2310 is specifically used to: display the first interface and the second interface; wherein, the display unit 2310 is also used to display the one or more interface elements on the second interface when the detection unit 2320 detects that the distance between the user's hand and the fifth area in the display unit 2310 is less than or equal to the first preset distance, and / or when the detection unit 2320 detects that the user's line of sight is in the fifth area; wherein the second interface includes the fifth area, and the fifth area includes the display area of ​​the one or more interface elements.

[0354] Optionally, the one or more interface elements include cards and / or application icons.

[0355] Optionally, the display unit 2310 is also used to hide the one or more interface elements on the first interface when the detection unit 2320 detects that the user's finger clicks on the sixth area, and the sixth area is the area on the first interface other than the first area.

[0356] It should be understood that the division of the various units in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. Furthermore, the units in the device may be implemented in the form of a processor calling software; for example, the device includes a processor connected to a memory storing instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or the functions of the various units in the device, where the processor is, for example, a general-purpose processor such as a CPU or a microprocessor, and the memory is a memory within the device or a memory external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented through the design of the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units may be implemented through the design of the logical relationships between the components within the circuits. In another implementation, the hardware circuit may be implemented using a PLD, such as an FPGA, which may include a large number of logic gate circuits, and the connections between the logic gate circuits may be configured using a configuration file to implement the functions of some or all of the above units. All units of the above apparatus may be implemented entirely in the form of software called by a processor, or entirely in the form of hardware circuits, or partially in the form of software called by a processor and the rest in the form of hardware circuits.

[0357] In an embodiment of the present application, a processor is a circuit with the ability to process signals. In one implementation, the processor may be a circuit with the ability to read and execute instructions, such as a CPU, a microprocessor, a GPU, or a DSP. In another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit may be fixed or reconfigurable, such as a hardware circuit implemented by an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the configuration of the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as an NPU, TPU, DPU, etc.

[0358] It can be seen that each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0359] In addition, the various units in the above devices can be fully or partially integrated together, or can be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-a-chip (SOC). The SOC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the device. The type of the at least one processor can be different, for example, including a CPU and FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.

[0360] An embodiment of the present application also provides a device, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit so that the device executes the method or steps performed by the above embodiment.

[0361] Optionally, if the device is located in a vehicle, the processing unit may be the processors 151 - 15n shown in FIG. 1 .

[0362] An embodiment of the present application further provides a vehicle, which may include the above-mentioned display device 2300.

[0363] Optionally, the transportation vehicle may be a vehicle.

[0364] An embodiment of the present application further provides a computer program product, which includes: computer program code, which enables the computer to execute the above method when the computer program code is run on a computer.

[0365] An embodiment of the present application further provides a computer-readable medium, wherein the computer-readable medium stores a program code. When the computer program code is run on a computer, the computer executes the above method.

[0366] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0367] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.

[0368] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0369] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0370] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0371] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0372] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0373] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0374] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0375] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be covered and fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A display method, characterized in that: include: Displaying the first interface through the vehicle display screen; When it is detected that the distance between the user's hand and the first area of ​​the vehicle-mounted display screen is less than or equal to a first preset distance, and / or when it is detected that the user's line of sight is in the first area, displaying one or more interface elements on the first interface; The first interface includes the first area, and the first area includes a display area of ​​the one or more interface elements.

2. The method according to claim 1, wherein The method further comprises: When it is detected that the distance between the user's hand and the first area is greater than or equal to a second preset distance, the one or more interface elements are hidden on the first interface.

3. The method according to claim 1 or 2, wherein: The displaying of one or more interface elements on the first interface includes: When it is detected that the user's hand approaches the in-vehicle display screen from a first side of the in-vehicle display screen, the one or more interface elements are displayed in an area close to the first side on the first interface.

4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: When it is detected that the distance between the user's hand and the second area of ​​the vehicle-mounted display screen is less than or equal to a third preset distance, expanding the size of the first interface element from the first size to the second size; The one or more interface elements include the first interface element, the first interface includes the second area, and the second area includes the display area of ​​the first interface element.

5. The method according to any one of claims 1 to 4, characterized in that The first interface includes a floating icon, the floating icon is associated with one or more applications, and the one or more interface elements displayed on the first interface include: Displaying icons of the one or more application programs on the first interface.

6. The method according to any one of claims 1 to 5, characterized in that The first interface is a display interface of a first application.

7. The method according to claim 6, wherein The first application includes a navigation application.

8. The method according to claim 6 or 7, wherein: The one or more interface elements include a second interface element related to a second application, and the method further includes: When it is detected that the user clicks on the second interface element, the display interfaces of the first application and the second application are displayed through the vehicle-mounted display screen.

9. The method according to claim 8, wherein The method of displaying the display interfaces of the first application and the second application on the vehicle display screen when detecting that the user clicks the second interface element includes: When detecting that a user located on the second side of the vehicle display screen clicks on the second interface element, displaying the display interface of the second application in the third area of ​​the vehicle display screen and displaying the display interface of the first application in the fourth area of ​​the vehicle display screen; The third area is an area close to the second side, and the fourth area is an area far from the second side.

10. The method according to any one of claims 1 to 9, characterized in that The displaying of one or more interface elements on the first interface includes: When a user gesture is detected, the one or more interface elements corresponding to the gesture are displayed.

11. The method according to any one of claims 1 to 10, characterized in that Displaying the first interface through the vehicle-mounted display screen includes: Displaying the first interface and the second interface through the vehicle-mounted display screen; The method further comprises: When it is detected that the distance between the user's hand and the fifth area of ​​the vehicle-mounted display screen is less than or equal to the first preset distance, and / or when it is detected that the user's line of sight is in the fifth area, displaying the one or more interface elements on the second interface; The second interface includes the fifth area, and the fifth area includes a display area for the one or more interface elements.

12. The method according to any one of claims 1 to 11, characterized in that The one or more interface elements include cards and / or application icons.

13. The method according to claim 1, wherein The method further comprises: When it is detected that the user's finger clicks on the sixth area, the one or more interface elements are hidden on the first interface, and the sixth area is an area on the first interface other than the first area.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: It is detected that a user starts an automatic control function of an interface element, wherein when the automatic control function of the interface element is started, the steps according to any one of claims 1 to 13 are executed.

15. A display device, characterized in that: The display device is located in a vehicle and includes a display unit and a detection unit, wherein: The display unit is configured to display the first interface; The display unit is further configured to display one or more interface elements on the first interface when the detection unit detects that the distance between the user's hand and the first area of ​​the display unit is less than or equal to a first preset distance, and / or when the detection unit detects that the user's line of sight is in the first area; The first interface includes a first area, and the first area includes a display area of ​​the one or more interface elements.

16. The device according to claim 15, characterized in that The display unit is further used to hide the one or more interface elements on the first interface when the detection unit detects that the distance between the user's hand and the first area is greater than or equal to a second preset distance.

17. The device according to claim 15 or 16, characterized in that The display unit is specifically used for: When the detection unit detects that the user's hand approaches the display unit from a first side of the display unit, the one or more interface elements are displayed in an area close to the first side on the first interface.

18. The device according to any one of claims 15 to 17, characterized in that The display unit is further configured to expand the size of the first interface element from the first size to the second size when the detection unit detects that the distance between the user's hand and the second area of ​​the display unit is less than or equal to a third preset distance; The one or more interface elements include the first interface element, the first interface includes the second area, and the second area includes the display area of ​​the first interface element.

19. The device according to any one of claims 15 to 18, characterized in that The first interface includes a floating icon, the floating icon is associated with one or more applications, and the display unit is specifically configured to: Displaying icons of the one or more application programs on the first interface.

20. The device according to any one of claims 15 to 19, characterized in that The first interface is a display interface of a first application.

21. The device according to claim 20, characterized in that The first application comprises a navigation application.

22. The device according to claim 20 or 21, characterized in that The one or more interface elements include a second interface element related to a second application, and the display unit is further configured to: When the detection unit detects that the user clicks the second interface element, the display interfaces of the first application and the second application are displayed.

23. The device according to claim 22, wherein The display unit is specifically used for: When the detection unit detects that the user located at the second side of the display unit clicks the second interface element, the display interface of the second application is displayed in the third area and the display interface of the first application is displayed in the fourth area; The third area is an area close to the second side, and the fourth area is an area far from the second side.

24. The device according to any one of claims 15 to 23, characterized in that The display unit is specifically used for: When the detection unit detects a user's gesture, the one or more interface elements corresponding to the gesture are displayed.

25. The device according to any one of claims 15 to 24, characterized in that The display unit is specifically configured to: display the first interface and the second interface; The display unit is further configured to display the one or more interface elements on the second interface when the detection unit detects that the distance between the user's hand and the fifth area of ​​the display unit is less than or equal to the first preset distance, and / or when the detection unit detects that the user's line of sight is in the fifth area; The second interface includes the fifth area, and the fifth area includes a display area for the one or more interface elements.

26. The device according to any one of claims 15 to 25, characterized in that The one or more interface elements include cards and / or application icons.

27. The device according to claim 15, wherein The display unit is further used to hide the one or more interface elements on the first interface when the detection unit detects that the user's finger clicks on the sixth area, and the sixth area is the area on the first interface other than the first area.

28. The device according to any one of claims 15 to 27, characterized in that The detection unit is also used to detect that the user has started the automatic control function of the interface element, wherein when the automatic control function of the interface element is started and the distance between the user's hand and the first area is less than or equal to the first preset distance, the display unit displays the one or more interface elements.

29. A control device, characterized in that: The device includes at least one processor and an interface circuit, wherein the processor communicates with the display device via the interface circuit; The at least one processor is configured to execute the method according to any one of claims 1 to 14 to control the display interface of the display device.

30. A vehicle, characterized in that: A device comprising the apparatus of any one of claims 15 to 29.

31. A computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a computer, the method according to any one of claims 1 to 14 is implemented.

32. A chip, characterized in that: The chip includes a processor and a data interface, and the processor reads instructions stored in a memory through the data interface to execute the method according to any one of claims 1 to 14.

Images