Interface control method, device, electronic device and readable storage medium

Abstract

The embodiment of the present application provides an interface control method, device, electronic device and readable storage medium, the method is applied to a vehicle computer in a vehicle, the vehicle computer is connected to a mechanical component, the method comprises: detecting the user's operation on the mechanical component; in response to the operation, switching the focus window on the vehicle computer interface from a first window to a second window, the vehicle computer interface is the interface of the terminal device projected to the vehicle computer. In the embodiment of the present application, after the terminal device projects the screen to the vehicle computer, the user can operate the mechanical component on the vehicle in a short time, and the interface of the vehicle computer can be controlled, the user's operation efficiency is high, and the user's driving safety is improved.

Description

Technical Field

[0001] Embodiments of the present application relate to screen projection control technology, and more particularly, to an interface control method, device, electronic device, and readable storage medium. Background Art

[0002] There are few applications in the car computer, which leads to limited functions that can be realized by the car computer. At present, the interface of the terminal device can be projected to the car computer, that is, the functions of the terminal device can be expanded to the car computer, thereby enriching the functions of the car computer.

[0003] The user can control the interface of the vehicle computer by touching it. During driving, the user's touch operation on the vehicle computer interface is inefficient, which will affect the user's driving safety. Especially when there are many elements on the vehicle computer interface, the user needs to spend a long time to perform touch operations, which is not conducive to safe driving. Summary of the invention

[0004] The embodiments of the present application provide an interface control method, device, electronic device and readable storage medium, which have high user operation efficiency and can improve user driving safety.

[0005] In the first aspect, an embodiment of the present application provides an interface control method, which is applied to a vehicle computer in a vehicle. The vehicle computer is connected to a mechanical component, and the mechanical component is included in the vehicle. The method includes: the vehicle computer can detect the user's operation on the mechanical component, and the vehicle computer switches the focus window on the interface of the vehicle computer from the first window to the second window in response to the operation, and the interface of the vehicle computer is the interface of the terminal device projected to the vehicle computer. It should be understood that a window is an area on the interface of the vehicle computer, and a window may include at least one icon. In one embodiment, the interface of the vehicle computer may be the same as or different from the interface of the terminal device. The difference between the interface of the vehicle computer and the interface of the terminal device can be reflected in that the interface of the vehicle computer may include elements on the interface of the terminal device, as well as elements not included in the interface of the terminal device, such as projection controls, voice assistant controls, etc.

[0006] In this method, when the interface of the terminal device is projected onto the vehicle computer, the user can control the interface of the vehicle computer by operating the mechanical component. Among them, the user controls the interface of the vehicle computer by operating the mechanical component, which essentially triggers the interaction between the vehicle computer and the terminal device through the mechanical component, thereby enabling the terminal device to control the interface of the vehicle computer, thereby enabling the switching of the focus window on the interface of the vehicle computer. Compared with the current technical solution, the current technical solution can realize the switching of icons within the focus window, but cannot realize cross-window switching. In this application, cross-window switching operations can be realized. In addition, because the user spends a short time operating the mechanical component, the user's operating efficiency is high, which can improve the user's driving safety.

[0007] The following describes the process of a user operating a mechanical component to trigger the interaction between the vehicle computer and the terminal device:

[0008] The vehicle computer detects the user's operation on the mechanical component, and can generate a mechanical event based on the operation, and send the mechanical event to the terminal device. In a possible implementation, the vehicle computer can store a mapping relationship between operations and events, and the mapping relationship can include a mapping relationship between operations and events, and a mapping relationship between mechanical operations and events. The vehicle computer can use the event mapped by the operation as a mechanical event based on the user's operation on the mechanical component and the mapping relationship. In one scenario, the operation is a rotation operation on the mechanical component. The vehicle computer can detect the speed of the rotation operation. If the speed of the rotation operation is greater than or equal to the preset speed, the vehicle computer can generate a rapid rotation event, and the rapid rotation event includes a rapid left rotation event or a rapid right rotation event.

[0009] After receiving the mechanical event, the terminal device can parse the mechanical event and obtain the target window switching operation corresponding to the mechanical event. In a possible implementation, the terminal device can store a mapping relationship between the mechanical event and the window switching operation, and the terminal device can use the window switching operation mapped by the mechanical event from the vehicle computer as the target window switching operation. After the terminal device determines the target window switching operation, it can determine whether there is a new focus window on the interface of the vehicle computer based on the target window switching operation, and the new focus window is the second window.

[0010] In a possible implementation, the operation is a rotation operation on a mechanical component, and the speed of the rotation operation is greater than or equal to a preset speed; the mechanical event is a fast left-rotation event, and the target window switching operation is switching the window to the left; or, the mechanical event is a fast right-rotation event, and the target window switching operation is switching the window to the right. Among them, the terminal device can determine whether the second window exists based on the target window switching operation, the position of the first window, and the positions of other windows on the interface of the vehicle computer. It should be understood that the position of the window on the interface of the vehicle computer is determined by the four values ​​of the left, right, top and bottom of the window. The left, right, top and bottom of the window can be regarded as the four sides of the window.

[0011] The following takes the target window switching operation of switching windows to the left as an example to illustrate the manner in which the terminal device determines whether the second window exists:

[0012] The first method: the terminal device obtains the difference between the left value of the first window and the left value of the other windows; if there is a positive difference, the terminal device uses the other window corresponding to the smallest positive difference as the second window; if there is no positive difference, the terminal device determines that the second window does not exist.

[0013] The second method: the terminal device determines whether there is a window with a left value smaller than the first window among the other windows; if so, the terminal device obtains the difference between the window with a left value smaller than the first window and the left value of the first window, and takes the window with the smallest difference as the second window; if not, the terminal device determines that the second window does not exist.

[0014] It should be understood that if the target window switching operation is to switch the window to the right (or up or down), the "left value" in the above first and second methods can be replaced with the "right value (or up value, or down value)" to determine whether there is a second window on the interface of the vehicle computer.

[0015] According to the above two methods, when the rapid rotation event is a rapid left rotation event, the second window is: the window closest to the first window and located on the left side of the first window; when the rapid rotation event is a rapid right rotation event, the second window is: the window closest to the first window and located on the right side of the first window.

[0016] Wherein, if the terminal device determines that the second window exists on the interface of the vehicle computer, the terminal device draws the interface of the vehicle computer with the focus window as the second window; the terminal device sends the interface of the vehicle computer with the focus window as the second window to the vehicle computer. Correspondingly, the vehicle computer can receive the interface of the vehicle computer with the focus window as the second window from the terminal device, and then display the interface of the vehicle computer with the focus window as the second window to achieve the switching of the focus window on the interface of the vehicle computer. In one embodiment, when drawing the interface of the vehicle computer with the focus window as the second window, the terminal device can adapt to the shape and size of the display interface of the vehicle computer, adjust the drawn interface of the vehicle computer with the focus window as the second window, and then send the adjusted interface of the vehicle computer with the focus window as the second window to the vehicle computer, and the vehicle computer displays the adjusted interface. Alternatively, in one embodiment, when the vehicle computer receives the interface of the vehicle computer with the focus window as the second window from the terminal device, it can adapt to the shape and size of the display interface of the vehicle computer, adjust the interface of the vehicle computer with the focus window as the second window, and then display the adjusted interface. It should be understood that the terminal device or the vehicle computer adjusts the interface of the vehicle computer with the focus window as the second window by: adjusting the size of the interface of the vehicle computer with the focus window as the second window, or adjusting the layout of elements in the interface of the vehicle computer with the focus window as the second window, so that the adjusted interface of the vehicle computer with the focus window as the second window adapts to the shape and size of the display interface of the vehicle computer.

[0017] In a second aspect, an embodiment of the present application provides an interface control method, which is applied in a terminal device, and the method includes: receiving a mechanical event from a vehicle computer; parsing the mechanical event, and obtaining a target window switching operation corresponding to the mechanical event; based on the target window switching operation, determining that the focus window on the interface of the vehicle computer is switched from a first window to a second window, and sending the vehicle computer interface with the focus window as the second window to the vehicle computer.

[0018] In one possible implementation, determining that the focus window on the interface of the vehicle computer is switched from the first window to the second window based on the target window switching operation includes: determining that the focus window on the interface of the vehicle computer is switched from the first window to the second window based on the target window switching operation, the position of the first window, and the positions of other windows on the interface of the vehicle computer.

[0019] In one possible implementation, the mechanical event is generated by the vehicle computer based on the user's rotation operation of the mechanical component, and the speed of the rotation operation is greater than or equal to a preset speed; the mechanical event is a fast left rotation event, and the target window switching operation is switching the window to the left; or, the mechanical event is a fast right rotation event, and the target window switching operation is switching the window to the right.

[0020] In a possible implementation, before sending the vehicle computer interface in which the focus window is the second window to the vehicle computer, the method further includes: modifying the focus attribute of the second window, wherein the modified focus attribute of the second window is used to indicate that the second window is the focus window.

[0021] In a third aspect, an embodiment of the present application provides an interface control device, which can be the vehicle computer or a chip or processor in the vehicle computer as described in the first aspect. The vehicle computer is connected to a mechanical component, and the device includes: a mechanical component management module, which is used to detect the user's operation on the mechanical component; and a display module, which is used to switch the focus window on the interface of the vehicle computer from the first window to the second window, and the interface of the vehicle computer is the interface projected from the terminal device to the vehicle computer.

[0022] In a possible implementation, the mechanical component management module is also used to generate a mechanical event based on the operation and send the mechanical event to the terminal device; the display module is also used to receive the interface of the vehicle computer whose focus window is the second window from the terminal device, and to display the interface of the vehicle computer whose focus window is the second window.

[0023] In one possible implementation, the operation is a rotation operation on the mechanical component; the mechanical component management module is also used to detect the speed of the rotation operation; in response to the speed of the rotation operation being greater than or equal to a preset speed, a rapid rotation event is generated, and the rapid rotation event includes a rapid left-rotation event or a rapid right-rotation event.

[0024] In a possible implementation, when the rapid rotation event is a rapid left-rotation event, the second window is: the window closest to the first window and located on the left side of the first window; when the rapid rotation event is a rapid right-rotation event, the second window is: the window closest to the first window and located on the right side of the first window.

[0025] In a fourth aspect, an embodiment of the present application provides an interface control device, which may be the terminal device described in the second aspect or a chip or processor in the terminal device. The vehicle machine is connected to a mechanical component, and the device includes:

[0026] The second window management module is used to receive mechanical events from the vehicle computer, parse the mechanical events, obtain the target window switching operation corresponding to the mechanical event, and send the target window switching operation to the window management service module; the window management service module is used to determine that the focus window on the interface of the vehicle computer is switched from the first window to the second window based on the target window switching operation, and send the vehicle computer interface with the focus window as the second window to the vehicle computer.

[0027] In a possible implementation, the window management service module is specifically used to determine whether the focus window on the interface of the vehicle computer is switched from the first window to the second window based on the target window switching operation, the position of the first window, and the positions of other windows on the interface of the vehicle computer.

[0028] In one possible implementation, the mechanical event is generated by the vehicle computer based on the user's rotation operation of the mechanical component, and the speed of the rotation operation is greater than or equal to a preset speed; the mechanical event is a fast left rotation event, and the target window switching operation is switching the window to the left; or, the mechanical event is a fast right rotation event, and the target window switching operation is switching the window to the right.

[0029] In a possible implementation, the window management service module is further used to modify a focus attribute of the second window, and the modified focus attribute of the second window is used to indicate that the second window is a focus window.

[0030] In a fifth aspect, an embodiment of the present application provides an electronic device, which may be the vehicle computer of the first aspect. The electronic device may include: a processor and a memory. The memory is used to store computer executable program code, and the program code includes instructions; when the processor executes the instructions, the electronic device executes the method in the first aspect or each possible implementation of the first aspect. The electronic device may also include a transceiver and a display, the display is used to display the interface of the vehicle computer, and the transceiver is used to perform the transceiver action of the above-mentioned first aspect.

[0031] In a sixth aspect, an embodiment of the present application provides an electronic device, which may be a terminal device in the second aspect. The electronic device may include: a processor and a memory. The memory is used to store computer executable program code, and the program code includes instructions; when the processor executes the instructions, the electronic device executes the method in each possible implementation of the second aspect or the second aspect. The electronic device may also include a transceiver, which is used to perform the transceiver action of the second aspect.

[0032] In a seventh aspect, an embodiment of the present application provides an interface control device, including a unit, module or circuit for executing the method provided in the first aspect or any possible implementation of the first aspect. The interface control device may be a vehicle computer, or a module applied to a vehicle computer, for example, a chip applied to a vehicle computer.

[0033] In an eighth aspect, an embodiment of the present application provides a control device for an interface, including a unit, module or circuit for executing the method provided in the second aspect or each possible implementation method of the second aspect. The control device of the interface can be a terminal device, or a module applied to a terminal device, for example, a chip applied to a terminal device.

[0034] In a ninth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method in the above-mentioned first aspect or various possible implementations of the first aspect.

[0035] In a tenth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method in the above-mentioned second aspect or various possible implementations of the second aspect.

[0036] In the eleventh aspect, an embodiment of the present application provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer executes the method in the above-mentioned first aspect or various possible implementations of the first aspect.

[0037] In the twelfth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores instructions. When the computer-readable storage medium is run on a computer, it enables the computer to execute the method in the above-mentioned second aspect or various possible implementations of the second aspect.

[0038] In a thirteenth aspect, an embodiment of the present application provides a vehicle, which includes a mechanical component and a vehicle computer as described in the fifth aspect above, and the vehicle computer and the mechanical component are connected.

[0039] The beneficial effects of the possible implementation methods of the second to thirteenth aspects mentioned above can be referred to the beneficial effects brought about by the first aspect mentioned above, and will not be elaborated here.

[0040] The embodiment of the present application provides an interface control method, device, electronic device and readable storage medium, the method is applied to a vehicle computer in a vehicle, the vehicle computer is connected to a mechanical component, the method comprises: detecting the user's operation on the mechanical component; in response to the operation, switching the focus window on the vehicle computer interface from a first window to a second window, the vehicle computer interface is the interface of the terminal device projected to the vehicle computer. In the embodiment of the present application, after the terminal device projects the screen to the vehicle computer, the user can operate the mechanical component on the vehicle in a short time, and the interface of the vehicle computer can be controlled, the user's operation efficiency is high, and the user's driving safety is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A schematic diagram of an application scenario applicable to the embodiment of the present application;

[0042] Figure 2 A schematic diagram of an interface change of a vehicle computer;

[0043] Figure 3 This is another schematic diagram of the interface change of the vehicle computer;

[0044] Figure 4 A schematic diagram of a system architecture applicable to an embodiment of the present application;

[0045] Figure 5 A schematic diagram of interaction between a vehicle machine and a terminal device provided in an embodiment of the present application;

[0046] Figure 6 A schematic diagram of a window in a window management service module provided in an embodiment of the present application;

[0047] Figure 7 A schematic diagram of an interface change of a vehicle computer provided in an embodiment of the present application;

[0048] Figure 8 A schematic diagram of the state attributes of a window provided in an embodiment of the present application;

[0049] Fig. 9A schematic diagram of window changes for switching windows provided in an embodiment of the present application;

[0050] Fig.10 A schematic diagram of another interface change of a vehicle computer provided in an embodiment of the present application;

[0051] Fig.11 A schematic diagram of the system software structure applicable to the embodiments of the present application;

[0052] Fig.12 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] Figure 1 This is a schematic diagram of a scenario applicable to the embodiment of the present application. Figure 1 As shown, the scenario includes a terminal device 10 and an in-vehicle infotainment system 20 (IVI). The in-vehicle infotainment system 20 may also be referred to as a vehicle computer. The terminal device 10 may be connected to the vehicle computer 20. Figure 1 In the example, the terminal device 10 is a mobile phone. The connection between the mobile phone and the vehicle computer can be, but is not limited to, wireless connection or wired connection. For example, the mobile phone is connected to the vehicle computer via a Universal Serial Bus (USB), or the mobile phone and the vehicle computer are connected via Bluetooth.

[0054] The mobile phone can be projected to the car computer, that is, the car computer can display the projection interface of the mobile phone. Figure 1 As shown, the mobile phone interface can display the mobile phone information and application icons. The mobile phone information can include the mobile phone network connection information (such as Figure 1 ), the battery information of the mobile phone, and the time of the mobile phone. Application icons, such as the icons of five applications, namely, application 1, application 2, application 3, application 4, and application 5. In one embodiment, the interface of the vehicle computer can be the same as the interface of the terminal device, such as the network connection information of the mobile phone, the battery information of the mobile phone, and the time of the mobile phone, as well as the icons of five applications, namely, application 1, application 2, application 3, application 4, and application 5, can be displayed on the vehicle computer.

[0055] In one embodiment, the interface of the vehicle machine may be different from the interface of the terminal device. For example, the interface of the vehicle machine may include elements in the interface of the terminal device, as well as elements not included in the interface of the terminal device. Exemplarily, when the mobile phone is projected to the vehicle machine, the interface of the vehicle machine may display a taskbar window (dock area) 201, a content level window (tab area) 202, and a content level window 203. It should be understood that a window is an area on the interface of the vehicle machine. Optionally, the window may include icons of multiple applications. Among them, the dock area 201 may include a home icon 201a, a navigation icon 201b, a phone icon 201c, a music icon 201d, and a vehicle power icon 201e. The dock area 201 may be an interface for projecting the HiCar application on the mobile phone to the vehicle machine, wherein the HiCar application is an application that extends the applications and services of the mobile phone to the vehicle machine, and can be used to control the projection of the interface of the mobile phone to the vehicle machine. In one embodiment, the HiCar application may be one of the five applications displayed on the mobile phone interface. The content level window 202 may include a voice assistant area 202a and a mobile phone information area 202b. The voice assistant area 202a may include an icon of a voice assistant on the mobile phone, which is used to implement voice interaction with the user. The mobile phone information area 202b may include the network connection information of the mobile phone, the battery information of the mobile phone, and the time of the mobile phone. The content secondary window 203 may display icons of application 1, application 2, application 3, and application 4. Figure 1 The display interface of the vehicle computer 10 is shown in an enlarged interface.

[0056] The reason why the icon of application 5 is not displayed on the vehicle interface is that the mobile phone can store a whitelist of applications, which can include the identification of the application, and the identification of the application can be the icon or name of the application, etc. The applications in the whitelist can be projected to the vehicle, and the applications not stored in the whitelist cannot be projected to the vehicle. When the mobile phone projects the screen to the vehicle, the mobile phone can determine the target application to be projected to the vehicle based on the whitelist, and then project the target application to the vehicle. For example, Figure 1 The icons of application 1 to application 5 are displayed on the mobile phone interface. The mobile phone determines that application 1 to application 4 are applications in the white list, that is, target applications, according to the white list. The mobile phone can project the icons of application 1 to application 4 to the vehicle computer and filter application 5 which is not stored in the white list.

[0057] The Android system includes an input service management module (input manager service). The input service management module is used to collect user operations on the terminal device, or the user's operations on an external device. Correspondingly, the input service management module can receive events reported from the processor in the terminal device or the external device. In the embodiment of the present application, the operating system of the terminal device is taken as an example of the Android system. When the terminal device is turned on, the terminal device starts the input service management module, that is, the terminal device starts event monitoring. When the car computer and the terminal device are connected successfully, the input module in the car computer can establish a connection with the input service management module in the terminal device, and the car computer can be used as an external device of the terminal device. The input module in the car computer is used to collect user operations on the car computer, and report the user's operations on the car computer to the terminal device in the form of reporting events.

[0058] Currently, users can control the interface of the vehicle computer through touch operation. For example, Figure 2 As shown, when the user clicks the icon of application 1 on the interface 301 of the vehicle computer, the interface displayed on the vehicle computer can jump from interface 301 to interface 302. Interface 301 is similar to the above-mentioned Figure 1 The interface 302 may display the main page of application 1. Figure 2 In the description, application 1 is taken as an example of a navigation application. In one possible implementation, the vehicle computer can display the main page of application 1 in the area corresponding to the secondary content window, or the vehicle computer can display the main page of application 1 on the entire vehicle computer interface, or the vehicle computer can display the main page of application 1 in the area corresponding to the primary content window and the secondary content window. The embodiment of the present application does not limit the manner in which the vehicle computer displays the display interface when the user clicks the icon of application 1. Interface 302 takes the display of the main page of application 1 in the area corresponding to the secondary content window on the vehicle computer as an example. It should be noted that the interface of the terminal device can jump to the main page of application 1, or the terminal device can remain as shown. Figure 1 The interface shown in this application embodiment does not limit the interface changes of the terminal device.

[0059] In one embodiment, if Figure 3As shown, when the user slides up (or slides down) in the content secondary window 203, interface 301 can jump to interface 303. Unlike interface 301, the content secondary window 203 in interface 303 can display application icons in the form of cards. Exemplarily, application 1-application 4 are displayed in the form of cards in interface 303. Because the area of ​​the content secondary window 203 is small, the icon of application 1 and the icon of application 2 are displayed in the form of cards on interface 303. In interface 303, application 1 is a navigation application and application 2 is an audio playback application as an example. If the user slides to the right in the content secondary window 203 area in interface 303, the user can see the icon of application 3 and the icon of application 4 in the form of cards.

[0060] Above Figure 2 and Figure 3 The example shows that the user can control the interface of the vehicle computer by touching it. During driving, the user's operation efficiency of touching the interface of the vehicle computer is low, which will affect the user's driving safety. In particular, when there are many elements on the interface of the vehicle computer, the user needs to spend a long time to perform touch operations, which is not conducive to safe driving.

[0061] In the embodiment of the present application, an interface control method is provided, and the user can realize the interaction between the vehicle computer and the terminal device by operating the mechanical components provided on the vehicle, such as buttons, knobs or joysticks, and then realize the control of the interface of the vehicle computer by the terminal device. During driving, because the user can operate the mechanical components in a short time, the operation efficiency is high, and the driving safety of the user is improved. In the embodiment of the present application, the setting position of the mechanical components is not limited, such as the mechanical components can be set on the steering wheel, below the display of the vehicle computer, or in the area between the main and co-driver's cabs.

[0062] In one embodiment, the mechanical component can be set within the user's driving field of view. The driving field of view refers to the field of view of the user when looking forward while driving. In this way, the user can operate the mechanical component without turning his head, thereby realizing the interface of controlling the vehicle computer, further improving driving safety.

[0063] Figure 4 Schematic diagram of a system architecture applicable to the embodiment of the present application. Figure 4 As shown, the vehicle computer may include a first window management module, a mechanical component management module, and a display module. The terminal device may include a second window management module, a window management service module, and a window drawing module. The first window management module is used to collect user touch operations, generate touch events, and then report the touch events to the second window management module to achieve Figure 2-Figure 3The mechanical component management module is used to collect the user's operation on the mechanical component, generate mechanical events, and then report the mechanical events to the second window management module to realize the interaction between the vehicle and the terminal device. In one embodiment, the input module in the vehicle may include a first window management module and a mechanical component management module. The service management module may include a second window management module. It should be understood that Figure 4 The system architecture shown is applied in a vehicle, and the vehicle may include a vehicle computer and a mechanical component, and the vehicle computer may be connected to the mechanical component. Specifically, the mechanical component management module may be connected to the mechanical component.

[0064] Combine the following Figure 4 , explaining the interaction process between the vehicle computer and the terminal device. Figure 5 A schematic diagram of the interaction between a vehicle computer and a terminal device provided in an embodiment of the present application. Figure 5 The interaction methods shown may include:

[0065] S501, the mechanical component management module detects the user's operation on the mechanical component and generates a mechanical event.

[0066] In a possible implementation, the mechanical component provided on the vehicle may be, but is not limited to, a button, a knob, or a rocker. In this manner, the mechanical component may report the user's operation on the mechanical component, and accordingly, the mechanical component management module may detect the operation from the mechanical component, and then generate a mechanical event according to the user's operation. If the mechanical component is a button, the user's operation on the mechanical component may be pressing. If the mechanical component is a knob, the user's operation on the mechanical component may be left rotation or right rotation. If the mechanical component is a rocker, the user's operation on the mechanical component may be pushing up, pushing down, pushing to the left, pushing to the right, etc.

[0067] In a possible implementation, a mechanical component is provided in a vehicle. The mechanical component management module may store a first mapping relationship, and the first mapping relationship is used to characterize the mapping relationship between the user's operation and the mechanical event. The mechanical component management module may generate a mechanical event according to the user's operation and the first mapping relationship. It should be understood that the mechanical component management module may also store the first mapping relationship in a database format or an extensible markup language (XML) format. Table 1 is an example of a format, and Table 1 is described by taking the mechanical component in the vehicle as a knob as an example.

[0068] Table 1

[0069] operate Mechanical events Left-handed KEYCODE_UPAD_LEFT Right KEYCODE_UPAD__RIGHT Quick left turn KEYCODE_XXX_LEFT Quick right turn KEYCODE_XXX_RIGHT

[0070] For example, as shown in Table 1, if the mechanical component management module detects that the user's operation on the knob is "left rotation", the generated mechanical event may be "KEYCODE_UPAD_LEFT" corresponding to "left rotation" in Table 1. For left rotation and fast left rotation, as well as right rotation and fast right rotation, the mechanical component management module may determine whether it is "left rotation" or "fast left rotation", or "right rotation" or "fast right rotation" according to the user's operation speed.

[0071] Taking "quick left rotation" and "left rotation" as examples, the mechanical component management module can collect the user's operation on the mechanical component and the user's operation speed. Among them, quick left rotation means that the user rotates the knob to the left, and the speed at which the user rotates the knob is greater than or equal to the preset speed, and left rotation means that the user rotates the knob to the left, and the speed at which the user rotates the knob is less than the preset speed. If the mechanical component management module detects that the user's operation on the knob is left rotation, and detects that the speed at which the user rotates the knob is greater than the preset speed, it determines that the user's operation is "quick left rotation". Therefore, the mechanical component management module can generate the mechanical event "KEYCODE_XXX_LEFT" corresponding to "quick left rotation" according to Table 1 above.

[0072] It should be understood that the preset speed can be predefined. Alternatively, the preset speed can be set by the user, such as the user can set the preset speed on the vehicle computer and store it in the mechanical component management module. Alternatively, the preset speed can be obtained by the mechanical component management module through an artificial intelligence learning algorithm based on the operating speed of the user's historical operation of the mechanical component. For example, the mechanical component management module can divide the operating speed of the user's historical operation of the mechanical component into an operating speed interval corresponding to "left rotation" and an operating speed interval corresponding to "fast left rotation", and then use the speed between the two operating speed intervals as the preset speed. Among them, when the mechanical component management module obtains the preset speed through the artificial intelligence learning algorithm, the mechanical component management module can obtain the preset speed at preset intervals according to the user's operating habits to match the user's operating habits and improve the user experience. In the embodiment of the present application, the mechanical event corresponding to "fast left rotation" can be called a fast left rotation event, and the mechanical event corresponding to "fast right rotation" can be called a fast right rotation event. The fast rotation event can include a fast left rotation event and a fast right rotation event.

[0073] In a possible implementation, at least two mechanical components may be provided on the vehicle, and the user may operate different mechanical components using the same operation, and the mechanical events generated by the mechanical component management module may be different. In this manner, the mechanical component management module may generate a mechanical event based on the mechanical component and operation operated by the user. Optionally, the mechanical component management module may store a second mapping relationship, which is used to characterize the mapping relationship between the mechanical component, the operation, and the mechanical event, as shown in Table 2. The mechanical component management module may generate a mechanical event based on the mechanical component operated by the user, the user's operation, and the second mapping relationship.

[0074] Table 2

[0075]

[0076] Exemplarily, as shown in Table 2, if the mechanical component management module detects that the mechanical component operated by the user is a "joystick" and the operation is to push the joystick upward, a mechanical event "KEYCODE_XXX_UP" is generated according to the mechanical component "joystick", the user's operation "push upward", and the second mapping relationship.

[0077] It should be understood that the fields of the mechanical events shown in Table 2 above are examples. For example, if the mechanical event corresponding to the joystick is "KEYCODE_XXX_UP", the mechanical event can also be "KEYCODE_ROCKER_UP", where "ROCKER" can represent the joystick. Similarly, if the mechanical event corresponding to the knob is "KEYCODE_XXX_LEFT", the mechanical event can also be "KEYCODE_KNODE_LEFT", where "KNODE" can represent the knob.

[0078] S502: The mechanical component management module sends a mechanical event to the second window management module.

[0079] In a possible implementation, the mechanical component management module may send a mechanical event to the second window management module. Correspondingly, the second window management module may call the dispatchUnhandledKey method to receive the mechanical event from the mechanical component management module.

[0080] S503: The second window management module parses the mechanical event and obtains the target window switching operation mapped by the mechanical event.

[0081] The second window management module receives the mechanical event from the mechanical component management module and can call the handleHicarExtraKeys method to parse the mechanical event. It should be understood that the second window management module parsing the mechanical event can be understood as: the second window management module stores the mapping relationship between the mechanical event and the window switching operation, and the second window management module uses the window switching operation mapped by the mechanical event in the mapping relationship as the target window switching operation based on the mechanical event from the mechanical component management module and the mapping relationship between the mechanical event and the window switching operation. Exemplarily, the mapping relationship between the mechanical event and the window switching operation can be shown in the following Table 3:

[0082] Table 3

[0083]

[0084]

[0085] As shown in Table 3 above, the window switching operation "navigation key, left" represents switching elements to the left in the focus window, and "navigation key, right" represents switching elements to the right in the focus window. In the window switching operation, switching windows in a certain direction is used to represent: switching the focus window to the window in the direction of the focus window. For example, "switch window to the left" represents switching the focus window to the window on the left of the focus window.

[0086] The second window management module can obtain the target window switching operation mapped by the mechanical event according to the mechanical event and the mapping relationship between the mechanical event and the window switching operation as shown in Table 3. For example, if the mechanical event is "KEYCODE_XXX_LEFT", the target window switching operation mapped by the mechanical event is "switch window to the left".

[0087] In a possible implementation, the above window switching operation may be represented by symbols such as numbers, letters, or a combination.

[0088] S504: The second window management module sends a target window switching operation to the window management service module.

[0089] Exemplarily, the second window management module may send “switch window to the left” to the window management service module, so that the window management service module can determine that the corresponding window switching operation is “switch window to the left”.

[0090] In a possible implementation, the window switching operation corresponds to an identifier, and the second window management module can send the identifier of the target window switching operation to the window management service module. In this way, the window management service module stores a mapping relationship between the window switching operation and the identifier of the window switching operation, and the window management service module can determine the target window switching operation based on the identifier of the target window switching operation and the mapping relationship between the window switching operation and the identifier of the window switching operation. Exemplarily, if the target switching operation is "switch the window to the left", the identifier corresponding to the target switching operation is "LEFT", and the second window management module can send "LEFT" to the window management service module. The window management service module can determine that "LEFT" means "switch the window to the left" based on the mapping relationship between the window switching operation and the identifier of the window switching operation.

[0091] S505, the window management service module determines the focus window according to the attribute information of the window on the interface of the vehicle computer.

[0092] The window management service module may store window information, which may include window information on the interface of the terminal device and window information on the interface of the vehicle computer. In a possible implementation, the window information is stored in the root window container in the window management service module. The window information may include window attribute information and information about elements in the window. It should be understood that elements in the window include, but are not limited to, text, pictures, and boxes displayed in the window.

[0093] The attribute information of a window may include the display identity document (display ID) of the window, the visible attribute of the window (i.e., whether the user can see the window on the interface), the focus attribute of the window (i.e., whether the window is the focus window), and the state attribute of the window (window state). The window in the terminal device and the window in the vehicle computer can be distinguished by different identifiers, and the identifier is not limited to numbers, characters, etc. In the embodiment of the present application, the display ID is used to distinguish the window in the terminal device and the window in the vehicle computer. It should be understood that windows with the same display ID are windows of the same device (vehicle computer or terminal device). The visible attribute of the window, for example, can be represented in the attribute information as visible (visible) or invisible (invisible). The focus attribute of the window, for example, can be represented in the attribute information as a value corresponding to focus, such as yes (yes) indicates that the window is the focus window, and no (no) indicates that the window is not the focus window.

[0094] The state attributes of a window can include the position of the window. The position of a window is determined by the coordinates of the upper left and lower right points of the window. The state attributes of a window can be identified by the four values ​​of the left, top, right, and bottom of the window. The left, top, right, and bottom of the window can be regarded as the left, top, right, and bottom edges of the window, respectively. For example, the state attributes of window 4 can be (left200, top40, right500, bottom800). Figure 6 The information of the elements in the window may include the coordinates of the elements in the window on the interface.

[0095] Figure 6 A schematic diagram of a window in a window management service module provided in an embodiment of the present application. Figure 6 for Figure 1 The window diagram on the interface of the terminal device and the vehicle computer is shown. Figure 6 In the example, the display ID of the window in the terminal device is 1, and the display ID of the window in the vehicle computer is 2. Figure 6 As shown, the window management service module can store four windows, namely, window 1, window 2, window 3 and window 4. It should be understood that the window management service module can number or not number the stored windows. Figure 6 For the purpose of explanation, the windows are numbered, such as numbering the windows as window 1 to window 4. Window 1 is a window in the terminal device, and window 1 may include information of icons of application 1 to application 4, such as icons of application 1 to application 4, and coordinates of application 1 to application 4 on the interface of the terminal device. Window 2 to window 4 are windows in the vehicle computer, and window 2 is a taskbar window. Window 2 may include information of the home icon 201a, navigation icon 201b, phone icon 201c, music icon 201d, and vehicle power icon 201e, such as icons of 201a, 201b, 201c, 201d, and 201, and coordinates of each icon on the interface of the vehicle computer. Window 3 is a content level window, and window 3 includes information of the voice assistant area 202a and the mobile phone information area 202b, such as the coordinates of the elements in 202a and 202b on the interface of the vehicle computer. Window 4 is a secondary content window, and includes information about the icons of application 1 to application 4, such as the icons of application 1 to application 4, and the coordinates of the icons of application 1 to application 4 on the interface of the vehicle computer. It should be understood that Figure 6The display ID is represented by the abbreviated ID, I represents invisible, V represents visible, F represents focus, L represents left, R represents right, T represents top, and B represents bottom. In one embodiment, the display ID of the window in the terminal device is 0, and the display ID of the vehicle computer connected to the terminal device is 1. In this embodiment, for each electronic device connected to the terminal device, the display ID of the electronic device can be increased by 1 based on the "display ID is 1", such as the display ID of the electronic device is 2.

[0096] Exemplarily, if the value corresponding to focus in window 4 is (yes), the current focus window is window 4. The window management service module can determine that the focus window is window 4 according to the attribute information of the window displayed on the interface of the vehicle computer.

[0097] S506, the window management service module determines whether there is a new focus window according to the target window switching operation and the state attributes of each window on the vehicle computer interface. If so, execute S507; if not, execute S511.

[0098] After the window management service module determines the focus window, it can obtain the next focus window, that is, the new focus window, according to the target window switching operation or the identifier of the target window switching operation. Among them, if the window management service module can obtain the next focus window, it is determined that there is a new focus window. If the window management service module does not obtain the next focus window, it is determined that there is no new focus window. The status attributes of each window on the vehicle computer interface include the status attributes of the focus window, and the status attributes of other windows on the vehicle computer interface. Among them, in order to facilitate the distinction between the focus window and the new focus window in the embodiment of the present application, the focus window can be called the first window, and the new focus window can be called the second window. The following description takes the "focus window" and the "new focus window" as examples.

[0099] Among them, the window management service module can obtain a new focus window according to the state attributes of the focus window, the state attributes of other windows in the vehicle computer, and the target window switching operation. Exemplarily, if the target window switching operation is to switch the window to the left, in a possible implementation, the window management service module can determine whether there is a third window in the vehicle computer whose left value is less than the left value of the focus window. If there is a third window, the third window can be used as the new focus window. If there are multiple third windows, the difference between the left value of each third window and the focus window can be obtained, and the third window with the smallest difference can be used as the new focus window.

[0100] For example, Figure 7 As shown, the difference between interface 701 and interface 301 is that the user clicks the icon of application 1, and the icon of application 1 in the content secondary window is in a selected state. In interface 701, the icon of application 1 surrounded by a selection box is used as an example to indicate that application 1 is in a selected state. Figure 7 The selection box is represented by a dotted box. The focus window in interface 701 is the secondary content window to which the icon of application 1 belongs, that is, window 4. When the user quickly turns the knob to the left, according to the above description, the window management service module can determine that the target window switching operation is "switch window to the left". The window management service module determines whether there is a third window with a left value less than 200 in the car computer based on the left value of the focus window 200. Figure 8 As shown, the window management service module can query the left values ​​of window 2 and window 3, and determine that only the left value of window 2 (dock area) is 20, which is less than the left value of window 4, which is 200. Then, the window management service module can determine that there is a new focus window, and the new focus window is window 2.

[0101] In this implementation, if the target window switching operation is to switch the window to the right, the window management service module can determine whether there is a third window in the vehicle computer whose right value is less than the right value of the focus window. If so, the third window with the smallest difference in right value is used as the new focus window. If the target window switching operation is to switch the window upward, the window management service module can determine whether there is a third window in the vehicle computer whose top value is less than the top value of the focus window. If so, the third window with the smallest difference in top value is used as the new focus window. If the target window switching operation is to switch the window downward, the window management service module can determine whether there is a third window in the vehicle computer whose bottom value is less than the bottom value of the focus window. If so, the third window with the smallest difference in bottom value is used as the new focus window.

[0102] If the target window switching operation is to switch the window to the left, in a possible implementation, the window management service module can obtain the left (left) value of the focus window minus the difference of the left (left) values ​​of other windows in the car computer, and then use the difference as a positive value, and the window with the smallest positive value as the new focus window. If there is no positive value in the difference, it is determined that there is no new focus window. Exemplarily, the focus window is window 4, then the left (left) value of window 4 is obtained by subtracting the difference of the left (left) values ​​of window 2 and window 3. Among them, the difference between window 4 and window 2 is (200-20), which is 180, and the difference between window 4 and window 3 is (200-400), which is -200, then window 2 with a positive difference can be used as the new focus window.

[0103] Similarly, if the target window switching operation is to switch the window to the right, the window management service module obtains the difference between the right value of the focus window and the right value of other windows in the car computer, and takes the difference as a positive value, and the window with the smallest positive value as the new focus window. If the target window switching operation is to switch the window upward, the window management service module can obtain the difference between the top value of the focus window and the top value of other windows in the car computer, and take the difference as a positive value, and the window with the smallest positive value as the new focus window. If the target window switching operation is to switch the window downward, the window management service module can obtain the difference between the bottom value of the focus window and the bottom value of other windows in the car computer, and take the difference as a positive value, and the window with the smallest positive value as the new focus window.

[0104] It can be understood that, if the target window switching operation is to switch the window to the left, in a possible implementation, the window management service module can obtain the difference between the left value of other windows in the vehicle computer and the left value of the focus window, and then use the window with a negative difference and the smallest absolute value of the negative value as the new focus window. If there is no negative value in the difference, it is determined that there is no new focus window. When the target window switching operation is to switch the window to the right (or up, or down), the operation of determining the new focus window by the window management service module is the same as the target window switching operation being to switch the window to the left.

[0105] In one embodiment, the window management service module can determine a new focus window based on the target window switching operation. Exemplarily, if the target window switching operation is to switch the window to the left, the window management service module can determine whether there is a window on the left side of the focus window based on the layout of the interface of the vehicle computer. If it exists, the first window on the left side of the focus window is used as the new focus window. If it does not exist, it is determined that there is no new focus window. It should be understood that when the target window switching operation is to switch the window to the left, the window management service module determines whether there is a window on the right side of the focus window, when the target window switching operation is to switch the window upward, the window management service module determines whether there is a window above the focus window, and when the target window switching operation is to switch the window downward, the window management service module determines whether there is a window below the focus window.

[0106] In one embodiment, S506 may be replaced by: the window management service module determines whether there is a new focus window according to the target window switching operation and the positions of each window on the vehicle computer interface. If so, execute S507; if not, execute S511.

[0107] S507, the window management service module sends a drawing instruction to the window drawing module, where the drawing instruction is used to instruct the window drawing module to draw the interface of the vehicle computer switched to the new focus window.

[0108] If the window management service module determines that there is a new focus window, it can send a drawing instruction to the window drawing module. The drawing instruction is used to instruct the window drawing module to draw the interface of the vehicle computer that switches to the new focus window. Among them, because the target window switching operation is to switch the focus window to the new focus window, the focus window changes. The window management service module can call the setFocusStack method to modify the properties of the window. Change the value corresponding to focus in the attribute information of the new focus window from (no) to (yes), and the window management service module can change the value corresponding to focus in the attribute information of the original focus window from (yes) to (no) to indicate that the new focus window is window 2. Fig. 9 As shown, the window information stored in the window management service module changes from a to b, wherein: Fig. 9 The a in the above Figure 6 It should be understood that Fig. 9 The focus attribute of the window change in the window information is represented by underlining.

[0109] In a possible implementation, the window management service module can call the updateFocusedWindowLocked method to send a drawing instruction to the window drawing module, and the drawing instruction can be used to indicate the new focus window. For example, the drawing instruction can include the display ID of the new focus window, such as the display ID is 2, to notify the window drawing module to draw the interface of the vehicle computer switched to the new focus window 2.

[0110] S508, the window drawing module draws the interface of the vehicle computer switched to the new focus window according to the drawing instruction.

[0111] The window drawing module may store information of the vehicle computer interface. The interface information may include elements in the interface and the layout of the elements. It should be understood that "the vehicle computer interface switched to the new focus window" may be the vehicle computer interface whose focus window is the second window.

[0112] In one possible implementation, the window drawing module can delete the selection box surrounding the icon of application 1 in the interface of the vehicle computer before switching to the new focus window, and draw a selection box surrounding window 2 (dock area) to obtain the interface of the vehicle computer switched to the new focus window.

[0113] In a possible implementation, the window drawing module may also switch to the interface of the vehicle computer before the new focus window, and redraw the interface of the vehicle computer switched to the new focus window according to the drawing instruction. The interface of the vehicle computer switched to the new focus window is compared with the interface of the vehicle computer before switching to the new focus window, and a selection box is drawn around Window 2 (dock area).

[0114] S509, the window drawing module sends the interface of the vehicle computer switched to the new focus window to the display module.

[0115] S510, the display module displays the interface of the vehicle computer switched to a new focus window.

[0116] When the display module receives the interface of the vehicle computer switched to the new focus window, it can display the interface of the vehicle computer switched to the new focus window. Figure 7 As shown, when the interface of the vehicle computer switches from interface 701 to interface 702, the selection box in interface 702 surrounds window 2 (dock area) to indicate that the focus window switches to the dock area.

[0117] In one possible implementation, the first icon (such as the home icon) in the dock area may be surrounded by a selection box in the interface 702 to indicate that the current window is switched to the dock area. Alternatively, any icon in the dock area may be surrounded by a selection box in the interface 702 to indicate that the current window is switched to the dock area.

[0118] It should be understood that Figure 7 The mechanical components are described as knobs, rockers or buttons as examples.

[0119] In one embodiment, when the mechanical component management module detects the user's operation on the mechanical component, the focus window on the interface of the vehicle computer can be switched from the first window to the second window, such as Figure 7 Among them, the first window can be a content secondary window, and the second window can be a taskbar window.

[0120] In one embodiment, when the terminal device draws the interface of the vehicle computer with the focus window as the second window, it can adapt to the shape and size of the display interface of the vehicle computer, adjust the drawn interface of the vehicle computer with the focus window as the second window, and then send the adjusted interface of the vehicle computer with the focus window as the second window to the vehicle computer, and the vehicle computer displays the adjusted interface of the vehicle computer with the focus window as the second window. Alternatively, in one embodiment, the vehicle computer receives the interface of the vehicle computer with the focus window as the second window from the terminal device, and can adapt to the shape and size of the display interface of the vehicle computer, adjust the interface of the vehicle computer with the focus window as the second window, and then display the adjusted interface of the vehicle computer with the focus window as the second window. It should be understood that the terminal device or the vehicle computer can adjust the interface of the vehicle computer with the focus window as the second window by: adjusting the size of the interface of the vehicle computer with the focus window as the second window, or adjusting the layout of the elements in the interface of the vehicle computer with the focus window as the second window, so that the adjusted interface of the vehicle computer with the focus window as the second window adapts to the shape and size of the display interface of the vehicle computer.

[0121] S511: The window management service module does not process.

[0122] If the window management service module determines that there is no new focus window, the window management service module does not process it. Exemplarily, as shown in interface 702, a selection box is displayed on the interface of the vehicle computer surrounding the dock area, that is, the dock area (window 2) is the focus window. If the user quickly turns the knob to the left at this time, the corresponding target window switching operation is to switch the window to the left. The window management service module executes the above S506 and can determine that there are no other windows to the left of window 2. The window management service module determines that there is no new focus window. In this way, the window management service module does not need to process it, and the interface of the vehicle computer remains as shown in interface 702. Fig.10 shown.

[0123] In an embodiment of the present application, a user can realize control of the interface of the vehicle computer by a terminal device by operating mechanical components provided on the vehicle, specifically, realize switching control of the window displayed on the interface of the vehicle computer by the terminal device. The user can operate the mechanical components without turning the head or in a shorter time during driving, thereby improving the user's driving safety.

[0124] Fig.11 Schematic diagram of the system software structure applicable to the embodiment of this application. Fig.11 As shown, the terminal device may include a first application layer, a first interconnection layer and a first device layer, and the car computer may include a second application layer, a second interconnection layer and a second device layer. The first application layer may include social applications, audio and video playback applications, etc. in the terminal device. In combination with the control method of projecting the screen of the terminal device to the interface of the car computer in the embodiment of the present application, the first interconnection layer may include a module for connecting the HiCar device and service discovery, as well as a module for screen projection and reverse control. The module for connecting the HiCar device and service discovery may be a Bluetooth module, which is used to connect the terminal device and the car computer. The module for screen projection and reverse control may include the above-mentioned second window management module, window management service module and window drawing module. The first device layer may include hardware devices in the terminal device, and the hardware devices may include but are not limited to speakers, microphones, sensors, buttons, motors, cameras, and displays. The specific structure of the terminal device may be as follows Fig.12 As shown. The second application layer may include applications in the car computer, such as navigation applications, audio and video applications, etc. in the car computer. The second interconnection layer may include modules for HiCar device and service discovery connection, as well as modules for screen projection and reverse control. The modules for HiCar device and service discovery connection may be such as Bluetooth modules, and the modules for screen projection and reverse control may include the above-mentioned first window management module, display module and mechanical component management module. The second device layer may include hardware devices in the car computer, and the hardware devices may include but are not limited to speakers, microphones, sensors, buttons, and displays.

[0125] Fig.12 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. Fig.12As shown, the terminal device 10 in the embodiment of the present application may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the terminal device 10. In other embodiments of the present application, the terminal device 10 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0126] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, a display processing unit (displayprocess unit, DPU), and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. In some embodiments, the terminal device 10 may also include one or more processors 110. Among them, the processor may be the nerve center and command center of the terminal device 10. The processor may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may save instructions or data used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the terminal device 10.

[0127] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. Among them, the USB interface 130 is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device 10, and can also be used to transmit data between the terminal device 10 and a peripheral device. It can also be used to connect headphones and play audio through the headphones.

[0128] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is for schematic illustration and does not constitute a structural limitation on the terminal device 10. In other embodiments of the present application, the terminal device 10 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0129] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 10. While the charging management module 140 is charging the battery 142, it may also power the terminal device 10 through the power management module 141.

[0130] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0131] The wireless communication function of the terminal device 10 can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the terminal device 10 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0132] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the terminal device 10. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier, etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0133] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0134] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), NFC, infrared technology (IR), etc. applied to the terminal device 10. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0135] In some embodiments, the antenna 1 of the terminal device 10 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 10 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, GNSS, WLAN, NFC, FM, and / or IR technology. The above-mentioned GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou satellite navigation system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0136] The terminal device 10 can realize the display function through the GPU, the display screen 194, and the application processor. The application processor may include an NPU and a DPU. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute instructions to generate or change display information. The NPU is a neural network (NN) computing processor, which quickly processes input information by drawing on the biological neural network structure, such as the transmission mode between neurons in the human brain, and can also continuously self-learn. The NPU can realize applications such as intelligent cognition of the terminal device 10, such as image recognition, face recognition, voice recognition, text understanding, etc. The DPU is also called a display subsystem (DSS). The DPU is used to adjust the color of the display screen 194. The DPU can adjust the color of the display screen through a three-dimensional lookup table (3D LUT). The DPU can also perform processing such as scaling, noise reduction, contrast enhancement, backlight brightness management, HDR processing, and display parameter Gamma adjustment on the picture.

[0137] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 10 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0138] The terminal device 10 can realize the shooting function through an ISP, one or more cameras 193, a video codec, a GPU, one or more display screens 194, and an application processor.

[0139] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 10. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, data files such as music, photos, and videos are stored in the external memory card.

[0140] The internal memory 121 can be used to store one or more computer programs, which include instructions. The processor 110 can enable the terminal device 10 to perform various functional applications and data processing by running the above instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system; the program storage area can also store one or more applications (such as a gallery, contacts, etc.). The data storage area can store data (such as photos, contacts, etc.) created during the use of the terminal device 10. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. In some embodiments, the processor 110 can enable the terminal device 10 to perform various functional applications and data processing by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor 110.

[0141] The terminal device 10 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. For example, music playback, recording, etc. Among them, the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 are arranged in the processor 110. The speaker 170A, also known as a "speaker", is used to convert audio electrical signals into sound signals. The terminal device 10 can listen to music or listen to hands-free calls through the speaker 170A. The receiver 170B, also known as a "handset", is used to convert audio electrical signals into sound signals. When the terminal device 10 answers a call or voice message, the voice can be answered by placing the receiver 170B close to the human ear. Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C with his mouth to input the sound signal into the microphone 170C. The terminal device 10 can be provided with at least one microphone 170C. In other embodiments, the terminal device 10 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the terminal device 10 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording functions, etc. The headphone jack 170D is used to connect wired headphones. The headphone jack 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0142] The sensor 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0143] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The terminal device 10 may receive key input and generate key signal input related to user settings and function control of the terminal device 10.

[0144] In one embodiment, the vehicle computer provided in the embodiment of the present application may include: a processor (such as a CPU), a memory, a transceiver, and an output device. The memory may include a high-speed random-access memory (RAM), and may also include a non-volatile memory (NVM), such as at least one disk memory. Various instructions may be stored in the memory, and the processor is used to read and execute the instructions in the memory to implement the method steps of the present application. The transceiver is used to perform the transceiver action in the above embodiment. The output device may be a display to display the interface of the vehicle computer. Optionally, the vehicle computer involved in the present application may also include: a power supply, a communication bus, and a communication port. The above communication port is used to realize the connection and communication between the vehicle computer and other peripherals (such as terminal devices). In the embodiment of the present application, the memory is used to store computer executable program code, and the program code includes instructions; when the processor executes the instructions, the instructions cause the vehicle computer to perform the actions in the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0145] It should be noted that the above modules can be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more microprocessors (digital signal processors, DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module above is implemented in the form of a processing element scheduling program code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0146] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, a data center, etc. that contains one or more available media integrated. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0147] The term "plurality" in this article refers to two or more than two. The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the previous and next associated objects are in an "or" relationship; in a formula, the character " / " indicates that the previous and next associated objects are in a "division" relationship.

[0148] It is to be understood that the various numerical numbers involved in the embodiments of the present application are only for the convenience of description and are not intended to limit the scope of the embodiments of the present application. In the embodiments of the present application, the size of the sequence number of each process does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

Claims

1. A method for controlling an interface, characterized in that: The method is applied to a vehicle computer in a vehicle, the vehicle computer is connected to a mechanical component, and the method includes: detecting a user's operation on the mechanical component; Based on the operation, generating a mechanical event; Sending the mechanical event to the terminal device; receiving from the terminal device an interface of a vehicle computer whose focus window is a second window; the focus window is determined by the terminal device based on the window attribute information of all windows on the interface of the vehicle computer; the window attribute information includes a display identification number of the window, a focus attribute of the window and a position of the window; the position of the window is determined by the window coordinates; the display identification number of the window is used to determine whether the window is a window in the terminal device or a window in the vehicle computer; the focus attribute of the window is used to indicate whether the window is a focus window; Switching the focus window on the interface of the vehicle computer from the first window to the second window; The operation is a rotation operation on the mechanical component; and based on the operation, generating a mechanical event comprises: detecting a speed of the rotating operation; In response to the speed of the rotation operation being greater than or equal to a preset speed, generating a fast rotation event, wherein the fast rotation event includes a fast left rotation event or a fast right rotation event; When the rapid rotation event is a rapid left rotation event, the second window is: the window closest to the first window and located on the left side of the first window; when the rapid rotation event is a rapid right rotation event, the second window is: the window closest to the first window and located on the right side of the first window.

2. A method for controlling an interface, characterized in that: The method is applied in a terminal device, and the method includes: Receive mechanical events from the vehicle computer; Parsing the mechanical event, and obtaining a target window switching operation corresponding to the mechanical event; Based on the target window switching operation, the position of the first window, and the window attribute information of all windows on the interface of the vehicle computer, it is determined that the focus window on the interface of the vehicle computer is switched from the first window to the second window; the window attribute information includes a display identification number of the window, a focus attribute of the window and the position of the window; the position of the window is determined by the window coordinates; the display identification number of the window is used to determine whether the window is a window in the terminal device or a window in the vehicle computer; the focus attribute of the window is used to indicate whether the window is a focus window; Sending the vehicle computer interface whose focus window is the second window to the vehicle computer; The mechanical event is generated by the vehicle computer based on a rotation operation of a mechanical component by a user, and the speed of the rotation operation is greater than or equal to a preset speed; The mechanical event is a fast left-turn event, and the target window switching operation is switching the window to the left; or, The mechanical event is a fast right rotation event, and the target window switching operation is switching the window to the right.

3. The method according to claim 2, characterized in that Before sending the vehicle computer interface whose focus window is the second window to the vehicle computer, the method further includes: The focus attribute of the second window is modified, and the modified focus attribute of the second window is used to indicate that the second window is a focus window.

4. A control device for an interface, characterized in that: The device is arranged in a vehicle computer in a vehicle, the vehicle computer is connected to a mechanical component, and the device comprises: A mechanical component management module, configured to detect a user's operation on the mechanical component; based on the operation, generate a mechanical event, and send the mechanical event to a terminal device; A display module is used to receive an interface of a vehicle computer whose focus window is a second window from the terminal device; the focus window is determined by the terminal device based on the window attribute information of all windows on the interface of the vehicle computer; the window attribute information includes a display identification number of the window, a focus attribute of the window and a position of the window; the position of the window is determined by the window coordinates; the display identification number of the window is used to determine whether the window is a window in the terminal device or a window in the vehicle computer; the focus attribute of the window is used to indicate whether the window is a focus window; The display module is further used to switch the focus window on the interface of the vehicle computer from the first window to the second window; The operation is a rotation operation on the mechanical component; the mechanical component management module is further used to detect the speed of the rotation operation; In response to the speed of the rotation operation being greater than or equal to a preset speed, a rapid rotation event is generated, and the rapid rotation event includes a rapid left rotation event or a rapid right rotation event; when the rapid rotation event is a rapid left rotation event, the second window is: the window closest to the first window and located on the left side of the first window; when the rapid rotation event is a rapid right rotation event, the second window is: the window closest to the first window and located on the right side of the first window.

5. A control device for an interface, characterized in that: include: The second window management module is used to receive a mechanical event from the vehicle computer, analyze the mechanical event, obtain a target window switching operation corresponding to the mechanical event, and send the target window switching operation to the window management service module; The window management service module is used to determine that the focus window on the interface of the vehicle computer is switched from the first window to the second window based on the target window switching operation, the position of the first window, and the window attribute information of all windows on the interface of the vehicle computer; the window attribute information includes a display identification number of the window, a focus attribute of the window and the position of the window; the position of the window is determined by the window coordinates; the display identification number of the window is used to determine whether the window is a window in the terminal device or a window in the vehicle computer; the focus attribute of the window is used to indicate whether the window is a focus window; The mechanical event is generated by the vehicle computer based on a rotation operation of a mechanical component by a user, and the speed of the rotation operation is greater than or equal to a preset speed; The mechanical event is a fast left-turn event, and the target window switching operation is switching the window to the left; or, The mechanical event is a fast right rotation event, and the target window switching operation is switching the window to the right.

6. The device according to claim 5, characterized in that The window management service module is further used to modify the focus attribute of the second window, and the modified focus attribute of the second window is used to indicate that the second window is a focus window.

7. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store program codes, and the processor is used to execute the program codes to implement the method according to any one of claims 1 to 3.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a computer, the computer is enabled to execute the method according to any one of claims 1 to 3.

Images