Vehicle-machine interaction method and device, electronic equipment and storage medium

Abstract

The application relates to the technical field of vehicles, in particular to a vehicle machine interaction method and device, electronic equipment and a storage medium, wherein the method comprises the following steps: obtaining an interaction gesture of a user; when the interaction gesture is single-finger single clicking, performing a control activation operation or a project selection operation; when the interaction gesture is single-finger sliding, moving viewing content based on a single-finger sliding direction; when the interaction gesture is single-finger double clicking, adjusting viewing content or viewing an image; when the interaction gesture is multi-finger pinching, adjusting the viewing content or the viewing image according to a pinching direction; and when the interaction gesture is single-finger long pressing, entering a content editing state. Therefore, the problem that the vehicle machine interaction efficiency is low and the driver is easily distracted to cause a safety hazard is solved, the vehicle machine interaction system is optimized, the interaction system is clearer and easier to understand, the user can quickly get started, and the efficiency of the user in acquiring vehicle information and intelligent interaction is improved.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a vehicle-machine interaction method, device, electronic device, and storage medium. Background Technology

[0002] As the automotive industry continues to advance towards intelligence and connectivity, human-machine interaction is undergoing unprecedented expansion and deepening, becoming more widespread, interconnected, and multi-dimensional. Against this backdrop, the design of intelligent cockpits is not only a core element driving technological progress and innovation in the automotive industry, but also a decisive factor in shaping unique user experiences and firmly attracting user attention. With the increasing duration, frequency, and diversity of interaction levels, human-machine interaction has become a significant development focus in the automotive field. Therefore, focusing on developing intelligent cockpit designs with differentiated experiences and strong user appeal will have a long-term and positive impact on automakers.

[0003] While related technologies have introduced interactive systems with large screens and fewer physical buttons, in practical applications, the feedback effect of virtual buttons on large screens has not met expectations. Furthermore, the varying positions of controls on the screen present operational challenges and a learning burden for drivers. In addition, frequent operation of virtual buttons on large screens can easily distract drivers, thereby increasing safety hazards during driving. Summary of the Invention

[0004] This application provides a vehicle-machine interaction method, device, electronic device, and storage medium to solve the problems of low vehicle-machine interaction efficiency, which can easily distract drivers and cause safety hazards. It optimizes the vehicle-machine interaction system, making the interaction system clearer and easier to understand, allowing users to quickly get started, and improving the efficiency of users in obtaining vehicle information and intelligent interaction.

[0005] A first aspect of this application provides a vehicle-mounted infotainment system (V2X) interaction method. The V2X includes a touch-sensitive main display screen and at least one touch-sensitive secondary display screen. The main display screen and the secondary display screen contain main function keys. The method includes the following steps:

[0006] Get the user's interactive gestures;

[0007] When the interaction gesture is a single-finger tap, a control activation operation or an item selection operation is performed. When the interaction gesture is a single-finger swipe, the content to be viewed is moved based on the swipe direction. When the interaction gesture is a single-finger double tap, the content to be viewed or the image to be viewed is adjusted. When the interaction gesture is a multi-finger pinch, the content to be viewed or the image to be viewed is adjusted according to the pinch direction. When the interaction gesture is a single-finger long press, the content editing state is entered.

[0008] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar, and when the interactive gesture is executed on the main function key, it includes:

[0009] If the interactive gesture is used to slide the first side adjustment bar in the first direction, the operation of returning to the main menu interface of the vehicle system is performed.

[0010] If the interactive gesture is used to slide the second side adjustment bar in the second direction, the operation of returning to the previous level of the vehicle system interface is performed.

[0011] If the interactive gesture slides the first side adjustment bar in a third direction, the historical application is switched along the reverse timeline;

[0012] If the interactive gesture slides the first side adjustment bar in the fourth direction, the historical application is switched along the clockwise timeline;

[0013] If the interactive gesture slides the first side adjustment bar along the fifth direction and stays for a duration longer than the first preset duration, the task manager interface will be invoked.

[0014] Optionally, in some embodiments, before acquiring the user's interaction gestures, the method further includes:

[0015] Determine the functional permissions for each vehicle infotainment application, wherein the functional permissions include: split-screen function permissions and multi-screen interaction function permissions, and the split-screen function permissions include first window split-screen permissions and second window split-screen permissions;

[0016] Determine the display level of each in-vehicle application that has the aforementioned split-screen function permission.

[0017] Optionally, in some embodiments, when the interactive gesture is performed on a vehicle-mounted application that has the multi-screen interaction permission, it includes:

[0018] If the interactive gesture is applied to the main display screen, and the interactive gesture is a three-finger swipe in the sixth direction, the page content of the main display screen is sent to the secondary display screen.

[0019] Optionally, in some embodiments, after providing the page content of the main display screen to the secondary display screen, the method further includes:

[0020] If the interactive gesture is applied to the main display screen, and the interactive gesture is a three-finger swipe in the seventh direction, the page content of the secondary display screen will be returned to the main display screen.

[0021] A second aspect of this application provides a vehicle-mounted infotainment system, comprising: the vehicle-mounted system includes a touch-sensitive main display screen and at least one touch-sensitive secondary display screen, the main display screen and the secondary display screen containing main function keys, wherein the system includes:

[0022] The acquisition module is used to acquire the user's interactive gestures;

[0023] The execution module is used to perform control activation or item selection operations when the interaction gesture is a single-finger tap, to move the viewed content based on the single-finger swipe direction when the interaction gesture is a single-finger swipe, to adjust the viewed content or view the image when the interaction gesture is a single-finger double tap, to adjust the viewed content or view the image according to the pinch direction when the interaction gesture is a multi-finger pinch, and to enter the content editing state when the interaction gesture is a single-finger long press.

[0024] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar. When the interactive gesture is executed on the main function key, the execution module is specifically used for:

[0025] If the interactive gesture is used to slide the first side adjustment bar in the first direction, the operation of returning to the main menu interface of the vehicle system is performed.

[0026] If the interactive gesture is used to slide the second side adjustment bar in the second direction, the operation of returning to the previous level of the vehicle system interface is performed.

[0027] If the interactive gesture slides the first side adjustment bar in a third direction, the historical application is switched along the reverse timeline;

[0028] If the interactive gesture slides the first side adjustment bar in the fourth direction, the historical application is switched along the clockwise timeline;

[0029] If the interactive gesture slides the first side adjustment bar along the fifth direction and stays for a duration longer than the first preset duration, the task manager interface will be invoked.

[0030] Optionally, in some embodiments, before acquiring the user's interaction gestures, the acquisition module is specifically used for:

[0031] Determine the functional permissions for each vehicle infotainment application, wherein the functional permissions include: split-screen function permissions and multi-screen interaction function permissions, and the split-screen function permissions include first window split-screen permissions and second window split-screen permissions;

[0032] Determine the display level of each in-vehicle application that has the aforementioned split-screen function permission.

[0033] Optionally, in some embodiments, when the interactive gesture is executed on a vehicle-mounted application that has the multi-screen interaction permission, the execution module is further configured to:

[0034] If the interactive gesture is applied to the main display screen, and the interactive gesture is a three-finger swipe in the sixth direction, the page content of the main display screen is sent to the secondary display screen.

[0035] Optionally, in some embodiments, after the page content of the main display screen is given to the secondary display screen, the execution module is further configured to:

[0036] If the interactive gesture is applied to the main display screen, and the interactive gesture is a three-finger swipe in the seventh direction, the page content of the secondary display screen will be returned to the main display screen.

[0037] A third aspect of this application provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle-machine interaction method as described in the above embodiments.

[0038] A fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which is executed by a processor to implement the vehicle-to-machine interaction method as described in the above embodiments.

[0039] This allows the system to capture user interaction gestures. When the gesture is a single-finger tap, it activates a control or selects an item; when it's a single-finger swipe, it moves the viewed content based on the swipe direction; when it's a single-finger double tap, it adjusts the viewed content or image; when it's a multi-finger pinch, it adjusts the viewed content or image based on the pinch direction; and when it's a single-finger long press, it enters content editing mode. This solves the problems of low efficiency in in-vehicle infotainment systems, which can easily distract drivers and create safety hazards. It optimizes the in-vehicle interaction system, making it clearer and easier to understand, allowing users to quickly get started and improving the efficiency of obtaining in-vehicle information and intelligent interaction.

[0040] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0041] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0042] Figure 1 This is a schematic diagram illustrating the principles of in-vehicle interaction according to an embodiment of this application;

[0043] Figure 2 This is a schematic diagram illustrating the principle of in-vehicle interaction according to an embodiment of this application;

[0044] Figure 3 This is a flowchart of the vehicle-machine interaction method provided according to an embodiment of this application;

[0045] Figure 4 This is a schematic diagram illustrating the homepage return interaction according to one embodiment of this application;

[0046] Figure 5 This is a schematic diagram of a switching application interaction according to an embodiment of this application;

[0047] Figure 6 This is a schematic diagram of a task manager interaction according to an embodiment of this application;

[0048] Figure 7 This is a schematic diagram illustrating the interaction of returning to the previous level according to one embodiment of this application;

[0049] Figure 8 This is a schematic diagram of the application split-screen window hierarchy according to an embodiment of this application;

[0050] Figure 9 This is a schematic diagram of a split-screen window hierarchy with only two applications according to an embodiment of this application;

[0051] Figure 10 This is a schematic diagram of split-screen interaction according to an embodiment of this application;

[0052] Figure 11 This is a schematic diagram of multi-screen gesture interaction according to an embodiment of this application;

[0053] Figure 12 This is a schematic diagram of the test content provided according to one embodiment of this application;

[0054] Figure 13 This is a schematic diagram of test results provided according to one embodiment of this application;

[0055] Figure 14 This is a block diagram of a vehicle-machine interaction device provided according to an embodiment of this application;

[0056] Figure 15 This is a schematic diagram of the structure of an electronic device provided according to an embodiment of this application. Detailed Implementation

[0057] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0058] The following description, with reference to the accompanying drawings, outlines a vehicle-to-everything (V2X) interaction method, apparatus, electronic device, and storage medium according to embodiments of this application. Addressing the issues of low efficiency in V2X interaction, which can easily distract drivers and create safety hazards, as mentioned in the background, this application provides a V2X interaction method. In this method, the user's interaction gestures are acquired. When the interaction gesture is a single-finger tap, a control activation operation or item selection operation is performed. When the interaction gesture is a single-finger swipe, the content to be viewed is moved based on the swipe direction. When the interaction gesture is a single-finger double tap, the content to be viewed or an image to be viewed is adjusted. When the interaction gesture is a multi-finger pinch, the content to be viewed or an image to be viewed is adjusted according to the pinch direction. When the interaction gesture is a single-finger long press, the user enters a content editing state. This solves the problem of low efficiency in V2X interaction, which can easily distract drivers and create safety hazards. It optimizes the V2X interaction system, making the interaction system clearer and easier to understand, allowing users to quickly get started, and improving the efficiency of users in obtaining in-vehicle information and intelligent interaction.

[0059] Before introducing the vehicle-machine interaction method of the embodiments of this application, let's first introduce the interaction principles followed by the vehicle-machine interaction method of the embodiments of this application.

[0060] like Figure 1 As shown, the embodiments of this application follow the "three-second interaction principle," meaning that when using the in-vehicle interactive interface, the user should be able to understand the information on the interface and complete the operation within a short three seconds, satisfying the requirements of clear information delivery with concise icons; and the ability to complete settings and switch gesture operations within three seconds; simultaneously, combined with Figure 2 As shown, the system can provide timely feedback, reducing uncertainty during user operations.

[0061] Gestures can be categorized by the number of fingers used (single-finger, two-finger, three-finger, or multi-finger), by time and space (scan, draw, tap, swipe), and by eight directions and different ranges (inside / outside the screen, inside / outside components). Gesture interaction methods include:

[0062] 1. Click-based interaction methods: buttons, checkboxes, tabs, icons, search bars, etc.

[0063] 2. Sliding interaction methods: negative one screen, homepage feature cards, all progress bars (music, video, online radio, volume, brightness, air conditioner volume, temperature, etc.), list types, air conditioner direction, car model rotation, etc.

[0064] 3. Long press interaction method: Select Edit, virtual keyboard buttons.

[0065] 4. Double-click interaction methods: navigation map, image zoom.

[0066] 5. Single / Double Finger Drag: Drag with one finger to change the position of an object, and drag with two fingers to zoom in and out of images and navigation maps.

[0067] This application integrates gesture interaction into real-world user scenarios. Based on user behavior and lifestyle habits, in-vehicle gestures should adopt the most natural and efficient operation methods, minimizing learning costs and memory burdens. For gesture interaction design elements specific to intelligent driving scenarios, four interaction design principles must be followed:

[0068] (1) Principle of safe and efficient operation. Gesture interaction should reduce the possibility of user attention being distracted, minimize the need for eye-hand coordination, improve user convenience through faster interaction switching methods, and ensure that gesture guidance, operation or feedback do not cause significant interference with driving behavior or potential safety hazards.

[0069] (2) The principle of simple and easy-to-understand learning. Gestures should be simple and intuitive so that users can easily remember and perform them, avoiding overly complex or profound gestures to reduce the learning curve.

[0070] (3) The principle of universality and consistency. The same gesture should be able to control the same defined function in different application scenarios. For example, the gesture for returning in radio and music application scenarios should be universal. For functions that can adopt multiple interaction methods, a certain degree of consistency should be maintained in the form of expression or interaction method so as to facilitate users' learning and acceptance.

[0071] (4) The principle of appropriate error tolerance. The design of a gesture interaction system should itself have the characteristics of preventing errors. In the definition of gestures, gesture interaction with dangerous functions should be avoided, and users should be provided with safe and correct choices. In addition, in the definition of gesture hot zones, the response design of the underlying system should be optimized. For example, the design of the touch area should be intelligently adjusted according to the layout of the function entry to prevent invalid operation or misoperation.

[0072] Specifically, Figure 1 This is a flowchart illustrating a vehicle-machine interaction method provided in an embodiment of this application.

[0073] It should be noted that the vehicle infotainment system in this embodiment includes a touch-sensitive main display screen and at least one touch-sensitive secondary display screen. Both the main and secondary display screens contain main function keys, such as... Figure 1 As shown, the vehicle-to-machine interaction method includes the following steps:

[0074] In step S101, the user's interactive gestures are acquired.

[0075] Specifically, in this application embodiment, the user's interactive gestures can be obtained through the user's touch action on the display screen, wherein the interactive gestures include single-finger click, single-finger swipe, single-finger double click, multi-finger pinch, single-finger long press, etc.

[0076] In step S102, when the interaction gesture is a single-finger tap, a control activation operation or an item selection operation is performed; when the interaction gesture is a single-finger swipe, the content to be viewed is moved based on the swipe direction; when the interaction gesture is a single-finger double tap, the content to be viewed or an image to be viewed is adjusted; when the interaction gesture is a multi-finger pinch, the content to be viewed or an image to be viewed is adjusted according to the pinch direction; and when the interaction gesture is a single-finger long press, the content editing state is entered.

[0077] In actual implementation, the embodiments of this application can perform interactive operations based on basic gestures: ① Click: activate a control or select an item; ② Swipe: swipe up and down, or swipe left and right to continuously move the content to be viewed; ③ Press and drag: move an element left and right or up and down on the screen; ④ Double tap: zoom in or out on the content or image and center it; ⑤ Pinch with five fingers: pinch outward to zoom in, pinch inward to zoom out; ⑥ Long press: enter text or content editing mode; In addition, gestures can quickly switch between multiple screens in the cockpit to improve screen utilization. Three-finger left and right swipes can switch between the driver's screen and the passenger's screen; three-finger up and down swipes can switch between the driver's screen, passenger's screen and rear screen. Multi-screen interaction is supported in split-screen mode; information from the rear screen to the front requires permission from the front, which is reminded in the form of a pop-up window. Permissions need to be requested each time.

[0078] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar. When an interactive gesture is executed on the main function key, the following actions are taken: if the interactive gesture slides the first side adjustment bar in a first direction, the operation of returning to the main menu interface of the vehicle system is performed; if the interactive gesture slides the second side adjustment bar in a second direction, the operation of returning to the previous level of the vehicle system interface is performed; if the interactive gesture slides the first side adjustment bar in a third direction, the historical application is switched along the reverse timeline; if the interactive gesture slides the first side adjustment bar in a fourth direction, the historical application is switched along the forward timeline; if the interactive gesture slides the first side adjustment bar in a fifth direction and the duration of the gesture is longer than a first preset duration, the task manager interface is invoked.

[0079] The main function key is Home Order. The first side adjustment bar is located on the left side of the vehicle display screen, and the second side adjustment bar is located on the right side of the vehicle display screen. The first to fifth directions can be any direction, up, down, left, or right. In this embodiment, the first direction is preferably right, the second direction is left, the third direction is up, the fourth direction is down, and the fifth direction is right. The first preset duration can be preset by the user, obtained through a limited number of experiments, or obtained through a limited number of computer simulations. No specific limitation is made here.

[0080] It should be noted that the vehicle-to-everything (V2X) interaction method in this application embodiment includes three information architectures: the main function key (Home Order), split-screen operation, and multi-screen interaction. During the construction of the information hierarchy, the underlying logic should prioritize user experience and driving safety, focusing on the user's functional and operational needs while minimizing potential user distraction based on a reasonable information architecture. The in-vehicle homepage interaction in this application embodiment follows a shallow-level principle, rationally categorizing user tasks and setting up quick gesture entry points to minimize interface depth and page levels, facilitating quick information browsing and improving user efficiency and operational safety.

[0081] Within the main function key's interactive framework, the vehicle information framework is primarily divided into four parts: quick settings area, quick navigation, vehicle model + scene animation display area, and DOCK bar. Key functions include quick application switching; based on users' daily reading habits and usage scenarios, users can quickly switch between open applications by swiping up and down on the Home Order, achieving zero learning cost for the vehicle system; a one-click return function, achieved by swiping right on the Home Order, quickly returning to the desktop and disabling the Home button in the DOCK bar, improving the speed of operation while driving and further enhancing driving safety; returning to the previous level via the back button or swiping left from the right edge; the Home Order display mode defaults to displaying battery or fuel levels, normally shown in green, turning red when battery or fuel levels are below 20%, and the display mode can be switched according to the application, such as food delivery, navigation, flight or high-speed rail journey progress, automatically switching to the corresponding display mode; multi-task management switching, pressing and swiping right on the display bar activates multi-task mode and supports the use of extended shortcut components.

[0082] In actual implementation, from the perspective of user convenience and security, this embodiment of the application greatly improves operating efficiency by setting a shortcut entry for the Home Order main function key in the vehicle infotainment system. The Home Order module in the vehicle infotainment system mainly includes four parts: Return to Home Page, Switch Applications, Task Manager, and Return to Previous Level.

[0083] 1. How to return to the homepage. For example... Figure 4 As shown, you can return by swiping right with a single finger on the left side of the Home Order adjustment bar on the left side of the screen. The Home Order adjustment bar on the main interface of the vehicle system is always displayed. Its level should be higher than that of applications and lower than special pop-up layers such as quick controls and air conditioning.

[0084] 2. Switch the application interaction method. For example... Figure 5 As shown, you can switch between background apps by swiping up or down with a single finger on the Home Order adjustment bar on the left edge. During app switching, the Home Order adjustment bar moves with the page. When you swipe up or down on the edge of the screen, the apps are sorted according to their most recently used pages. The current page is the first page, swipe up to switch to the last used page (the second page), and swipe down to switch to the last page.

[0085] 3. Task Manager. For example... Figure 6 As shown, swiping right from the Home Order adjustment bar opens the Task Manager page. Full-screen applications can be switched by swiping up or down, and the Home Order follows the page movement. Applications in the Task Manager interface are sorted according to recent use, with the current page being the first page. Swiping up switches to the last used application page (the second page), while swiping down requires a previous switching action. When switching between pages, three recommended frequently used pages for that application appear on the right. By recording user habits, users can quickly select the page entry, improving user convenience.

[0086] 4. Return to the previous level. For example... Figure 7 As shown, there are two ways to go back to the previous page. The first way is to swipe left along the right edge of the screen to go back to the previous page. The second way is to retain the back button on the second-level page within the application.

[0087] Optionally, in some embodiments, before acquiring the user's interactive gestures, the method further includes: determining the functional permissions of each vehicle-mounted application, wherein the functional permissions include: split-screen function permissions and multi-screen interaction function permissions, and the split-screen function permissions include first window split-screen permissions and second window split-screen permissions; and determining the display level of each vehicle-mounted application with split-screen function permissions.

[0088] The first view split-screen permission is 1 / 3 split-screen permission, and the second view split-screen permission is 2 / 3 split-screen permission.

[0089] To provide users with richer interaction methods, this application embodiment supports split-screen interaction and multi-screen interaction. Here, the split-screen interaction method is introduced.

[0090] To provide users with a more personalized and intelligent driving experience, this embodiment of the application divides the screen into three areas, supporting split-screen, 1 / 3, 2 / 3, automatic, and multi-screen interaction functions for some applications. Users can easily change the position of the 3D desktop by dragging the horizontal bar at the top of the split screen, adjusting the viewing angle in real time to make the desktop display size and content more in line with user needs. Simultaneously, by dragging the horizontal bar to the edge, users can cancel the split-screen display of the current window, simplifying the operation interface and improving ease of use. Clicking the zoom button switches the page to full-screen display, allowing users to focus more on the content they see. This design not only considers users' personalized needs but also fully considers the intuitiveness and user-friendliness of operation. Overall, this innovative 3D desktop design is not merely a simple fusion of digital and reality but also provides users with a completely new perceptual experience. Through deep interconnection with vehicle functions, users can process information more conveniently and intelligently while driving, breaking down the barrier between the digital interface and the actual scene in traditional driving, creating a more pleasant and intelligent driving environment for drivers.

[0091] This application's embodiments support split-screen, 1 / 3, 2 / 3, automatic, and multi-screen interaction functions for some applications. When an application is opened, the window display size hierarchy is as follows: Figure 9 As shown, the homepage car model supports split-screen, 1 / 3 window, and 2 / 3 window, but does not support automatic or multi-screen interaction; music supports split-screen, 1 / 3 window, 2 / 3 window, and multi-screen interaction, but does not support automatic; navigation is at a higher level and supports all modes; vehicle settings support split-screen, 2 / 3 window, and multi-screen interaction, but do not support 1 / 3 window or automatic; the first third-party application is at the same level as vehicle settings; the second third-party application does not support split-screen operation.

[0092] When one app is closed, the remaining two apps are displayed in a split-screen window with varying sizes and levels, such as... Figure 9 As shown, when the homepage car model is retained, it is fixed to be displayed on 1 / 3 of the screen, while other applications are displayed on 2 / 3 of the screen; when music and navigation are turned on at the same time, music is displayed on 2 / 3 of the screen and navigation is displayed on 1 / 3 of the screen; when music and vehicle settings are turned on at the same time, the vehicle is set to be displayed on 2 / 3 of the screen and music is displayed on 1 / 3 of the screen; when navigation and vehicle settings are turned on at the same time, the vehicle is set to be displayed on 2 / 3 of the screen and navigation is displayed on 1 / 3 of the screen; the first and third-party applications have the highest level and always occupy 2 / 3 of the screen display.

[0093] Combination Figure 10As shown in the embodiment of this application, the vehicle infotainment display can be divided into multiple areas, making it convenient for users to handle multiple tasks simultaneously. In this embodiment, the vehicle infotainment interface supports three split-screen interfaces. After the user opens a second application, other applications with split-screen permissions can be dragged into the DOCK bar or the ALL APP page. During dragging, the target area where the second application can be displayed is highlighted on the display, and text and graphic guidance are provided. After dragging and lifting the gesture, the second application is displayed in the target area. When performing split-screen interaction, if it is necessary to display any of the first target applications that have been split in full screen, the user can swipe up on the split-screen operation bar hotspot to display the first target application in full screen; if it is necessary to cancel the split-screen of any second target application that has been split in full screen, the user can swipe down on the split-screen operation bar hotspot to cancel the split-screen.

[0094] Intelligent split-screen technology in vehicles provides drivers with a more flexible and personalized interface experience, fully leveraging the potential of in-vehicle infotainment systems. The advantages of intelligent split-screen include: ① Multitasking: Intelligent split-screen technology allows drivers to handle multiple tasks simultaneously, such as navigation, music, and calls, without frequently switching interfaces, improving information processing efficiency; ② Personalized configuration: Drivers can personalize the screen according to their preferences and needs, placing the most frequently used applications and information in more easily accessible locations, enhancing the personalization of the user experience; ③ Real-time information display: Split-screen technology allows multiple pieces of information to be displayed simultaneously, such as navigation maps, music playlists, and vehicle status, enabling drivers to understand multiple aspects of information in real time, improving the accuracy of driving decisions; ④ Reduced distraction risk: Intelligent split-screen technology helps reduce driver distraction when operating the vehicle's infotainment system. Through clear information display and a simple operating interface, it reduces the cognitive burden on drivers and improves driving safety. In this embodiment, after opening an application, the application can be slid into the dock or the ALL APP page, supporting three split-screen interfaces.

[0095] Optionally, in some embodiments, when the interactive gesture is performed on a vehicle-mounted application with multi-screen interaction permissions, it includes: if the interactive gesture touches the main display screen and the interactive gesture is a three-finger swipe in the sixth direction, the page content of the main display screen is given to the secondary display screen.

[0096] Optionally, in some embodiments, after the page content of the main display screen is given to the secondary display screen, the method further includes: if the interactive gesture touches the main display screen and the interactive gesture is a three-finger swipe in the seventh direction, the page content of the secondary display screen is returned to the main display screen.

[0097] Here, we introduce the multi-screen gesture interaction method in the vehicle-machine interaction method of this application embodiment.

[0098] The sixth and seventh directions can be any direction, up, down, left, or right. Preferably, the sixth direction is right and the seventh direction is left.

[0099] like Figure 11 As shown, if you need to display the content of the main display screen on the secondary display screen, swipe right with three fingers within the main driver's screen. The current page content of the main display screen will be given to the secondary display screen (excluding the homepage). After the main display screen is given, the previously used application page in the subsequent applications will be displayed. When the content displayed in the back row is given to the front row, the front row user needs to grant screen mirroring permission.

[0100] If the content of the secondary display screen is displayed on the primary display screen, you can swipe left with three fingers on the passenger screen to transfer the current page content of the secondary display screen to the primary display screen (excluding the homepage). After the secondary display screen is transferred, the previously used application page will be displayed in the subsequent applications. When the content displayed in the back row is transferred to the front row, the front row user needs to grant screen mirroring permission.

[0101] When the main display needs to reclaim the content displayed on the secondary display, swipe left with three fingers on the main display to reclaim the current page content of the secondary display to the main display (except for the homepage). After the main display is reclaimed, the previously used application page in the subsequent applications will be displayed. When the content displayed in the back row is given to the front row, the front row user needs to grant screen mirroring permission.

[0102] When the secondary display needs to reclaim the content displayed on the main display, swipe right with three fingers on the main driver's screen to reclaim the current page content of the main display to the secondary display (except for the homepage). After the main display is reclaimed, the previously used application page in the subsequent applications will be displayed. When the content displayed in the back row is given to the front row, the front row user needs to grant screen mirroring permission.

[0103] Multi-screen gesture interaction offers users numerous advantages, including the following three points: ① Natural and intuitive: Multi-screen interaction gestures mimic natural movements in daily life, such as dragging, pinching, and swiping, allowing users to interact with multi-screen interfaces more naturally and reducing reliance on complex control buttons; ② Improved efficiency: Multi-screen gesture interaction can achieve multiple operations through direct gesture actions, avoiding cumbersome steps and multiple clicks; ③ Improved space utilization: Multi-screen gesture operation can better utilize screen space, triggering different functions or switching between different interfaces through different gestures, improving the flexibility and scalability of multi-screen interaction; ④ Future interconnectivity: Multi-screen gesture technology provides a foundation for a more complex interconnected ecosystem in the future. Users can easily achieve interconnection and collaborative work between multiple devices through gesture operations, promoting the integration of digital life. This application's embodiments focus on achieving information flow between multiple screens while satisfying basic operations such as clicking, swiping, pressing and dragging, double-clicking, five-finger pinching, and long-pressing, and achieving multi-screen information switching through three fingers.

[0104] Human-computer interaction testing aims to comprehensively evaluate users' feelings and satisfaction when using a product; therefore, user-centered testing methods are particularly crucial. The vehicle-machine interaction method based on the embodiments of this application was tested, mainly including the following five points: ① User participation testing: By inviting real users to participate in the test, their behavior and feedback during actual use are observed and recorded. This testing method can provide the most authentic user experience data; ② User survey questionnaires: Standardized questionnaires are used to survey users' satisfaction, preferences, and feelings to obtain quantitative feedback data; ③ User interviews: In-depth user interviews are conducted to gain a deeper understanding of users' needs, expectations, and problems through communication; ④ Prototype testing: In the early stages of product development, prototype demonstrations are used to test users' understanding and acceptance of the design concepts; ⑤ User behavior analysis: Observing and analyzing user behavior during the interaction process, including clicking, swiping, and inputting, to identify potential problems and optimization points. This helps to deeply explore user needs and problems, providing a strong basis for product improvement. The advantage of this comprehensive testing method is that it can more accurately evaluate user feelings, promptly identify potential problems, and make improvements.

[0105] The test content summarizes the high-frequency task scenarios of vehicle system operation, such as... Figure 12 The system evaluates and scores the user experience based on usage, and finally outputs the corresponding data. To ensure the effectiveness of the test, environmental diversity is crucial for human-computer interaction testing. By using different devices, operating systems, and test benches with different user groups, this diversity comprehensively covers real-world usage scenarios, resulting in more comprehensive and accurate test results. Figure 13 .

[0106] The vehicle-to-everything (V2X) interaction method proposed in this application acquires the user's interaction gestures. When the gesture is a single-finger tap, a control activation or item selection operation is performed; when the gesture is a single-finger swipe, the content is moved based on the swipe direction; when the gesture is a single-finger double tap, the content or image is adjusted; when the gesture is a multi-finger pinch, the content or image is adjusted based on the pinch direction; and when the gesture is a single-finger long press, the user enters a content editing state. This solves the problems of low efficiency in V2X interaction, which can easily distract the driver and create safety hazards. It optimizes the V2X interaction system, making it clearer and easier to understand, allowing users to quickly get started and improving the efficiency of obtaining vehicle information and intelligent interaction.

[0107] Next, the vehicle-machine interaction device proposed according to the embodiments of this application is described with reference to the accompanying drawings.

[0108] Figure 14 This is a block diagram of the vehicle-machine interaction device according to an embodiment of this application.

[0109] The vehicle infotainment system in this embodiment includes a touch-sensitive main display screen and at least one touch-sensitive secondary display screen. Both the main and secondary display screens contain main function keys, such as... Figure 14 As shown, the vehicle-to-everything (V2X) interactive device 10 includes an acquisition module 100 and an execution module 200.

[0110] The acquisition module 100 is used to acquire the user's interactive gestures.

[0111] The execution module 200 is used to perform control activation or item selection operations when the interaction gesture is a single-finger click, to move the viewed content based on the single-finger swipe direction when the interaction gesture is a single-finger swipe, to adjust the viewed content or view the image when the interaction gesture is a single-finger double-click, to adjust the viewed content or view the image according to the pinch direction when the interaction gesture is a multi-finger pinch, and to enter the content editing state when the interaction gesture is a single-finger long press.

[0112] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar. When the interactive gesture is executed on the main function key, the execution module 200 is specifically used to: if the interactive gesture slides the first side adjustment bar along a first direction, perform the operation of returning to the main menu interface of the vehicle system; if the interactive gesture slides the second side adjustment bar along a second direction, perform the operation of returning to the previous level vehicle system interface; if the interactive gesture slides the first side adjustment bar along a third direction, switch the historical application along the reverse timeline; if the interactive gesture slides the first side adjustment bar along a fourth direction, switch the historical application along the forward timeline; if the interactive gesture slides the first side adjustment bar along a fifth direction and the duration of the pause is greater than a first preset duration, call the task manager interface.

[0113] Optionally, in some embodiments, before acquiring the user's interactive gestures, the acquisition module is specifically used to: determine the functional permissions of each vehicle system application, wherein the functional permissions include: split-screen function permissions and multi-screen interaction function permissions, the split-screen function permissions include first window split-screen permissions and second window split-screen permissions; and determine the display level of each vehicle system application that has split-screen function permissions.

[0114] Optionally, in some embodiments, when the interactive gesture is performed on a vehicle-mounted application with multi-screen interaction permissions, the execution module is further configured to: if the interactive gesture touches the main display screen and the interactive gesture is a three-finger swipe in the sixth direction, transfer the page content of the main display screen to the secondary display screen.

[0115] Optionally, in some embodiments, after the page content of the main display screen is given to the secondary display screen, the execution module is further configured to: if the interactive gesture touches the main display screen and the interactive gesture is a three-finger swipe in the seventh direction, return the page content of the secondary display screen to the main display screen.

[0116] It should be noted that the foregoing explanation of the vehicle-machine interaction method embodiment also applies to the vehicle-machine interaction device of this embodiment, and will not be repeated here.

[0117] The vehicle-to-everything (V2X) interaction device proposed in this application acquires the user's interaction gestures. When the gesture is a single-finger tap, it performs a control activation or item selection operation; when the gesture is a single-finger swipe, it moves the viewed content based on the swipe direction; when the gesture is a single-finger double tap, it adjusts the viewed content or image; when the gesture is a multi-finger pinch, it adjusts the viewed content or image based on the pinch direction; and when the gesture is a single-finger long press, it enters a content editing state. This solves the problems of low efficiency in V2X interaction, which can easily distract the driver and create safety hazards. It optimizes the V2X interaction system, making it clearer and easier to understand, allowing users to quickly get started and improving the efficiency of users acquiring vehicle information and engaging in intelligent interaction.

[0118] Figure 15 A schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device may include:

[0119] The memory 1501, the processor 1502, and the computer program stored on the memory 1501 and executable on the processor 1502.

[0120] When the processor 1502 executes the program, it implements the vehicle-machine interaction method provided in the above embodiments.

[0121] Furthermore, electronic devices also include:

[0122] Communication interface 1503 is used for communication between memory 1501 and processor 1502.

[0123] The memory 1501 is used to store computer programs that can run on the processor 1502.

[0124] The memory 1501 may include high-speed RAM (Random Access Memory) memory, and may also include non-volatile memory, such as at least one disk storage.

[0125] If the memory 1501, processor 1502, and communication interface 1503 are implemented independently, then the communication interface 1503, memory 1501, and processor 1502 can be interconnected via a bus to complete communication between them. The bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 15 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0126] Optionally, in a specific implementation, if the memory 1501, processor 1502, and communication interface 1503 are integrated on a single chip, then the memory 1501, processor 1502, and communication interface 1503 can communicate with each other through an internal interface.

[0127] The processor 1502 may be a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of this application.

[0128] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the above-described vehicle-machine interaction method.

[0129] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0130] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0131] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0132] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (FPGAs), field-programmable gate arrays (FPGAs), etc.

[0133] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0134] Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of this application.

Claims

1. A vehicle-machine interaction method, characterized in that, The vehicle infotainment system includes a touch-sensitive main display screen and at least one touch-sensitive secondary display screen, wherein the main display screen and the secondary display screen contain main function keys, and the method includes the following steps: Get the user's interaction gestures; When the interactive gesture is a single-finger tap, the control activation operation or item selection operation is performed; when the interactive gesture is a single-finger swipe, the content is moved and viewed based on the swipe direction; when the interactive gesture is a single-finger double tap, the content or image is adjusted; when the interactive gesture is a multi-finger pinch, the content or image is adjusted according to the pinch direction; when the interactive gesture is a single-finger long press, the content editing state is entered. The main function key includes a first side adjustment bar and a second side adjustment bar. When the interactive gesture is executed on the main function key, the following actions are taken: if the interactive gesture slides the first side adjustment bar in a first direction, the operation of returning to the main menu interface of the vehicle system is performed; if the interactive gesture slides the second side adjustment bar in a second direction, the operation of returning to the previous level of the vehicle system interface is performed; if the interactive gesture slides the first side adjustment bar in a third direction, the historical application is switched in reverse time; if the interactive gesture slides the first side adjustment bar in a fourth direction, the historical application is switched in forward time; if the interactive gesture slides the first side adjustment bar in a fifth direction and the duration of the gesture is greater than a first preset duration, the task manager interface is invoked.

2. The method according to claim 1, characterized in that, Before acquiring the user's interaction gestures, it also includes: Determine the functional permissions for each vehicle infotainment application, wherein the functional permissions include: split-screen function permissions and multi-screen interaction function permissions, and the split-screen function permissions include first window split-screen permissions and second window split-screen permissions; Determine the display level of each in-vehicle application that has the aforementioned split-screen function permission.

3. The method according to claim 2, characterized in that, When the interactive gesture is executed on a vehicle-mounted application that has the multi-screen interaction function permission, it includes: If the interactive gesture is applied to the main display screen, and the interactive gesture is a three-finger swipe in the sixth direction, the page content of the main display screen is sent to the secondary display screen.

4. The method according to claim 3, characterized in that, After providing the page content of the main display screen to the secondary display screen, the method further includes: If the interactive gesture is applied to the main display screen, and the interactive gesture is a three-finger swipe in the seventh direction, the page content of the secondary display screen will be returned to the main display screen.

5. A vehicle-to-everything (V2X) interactive device, characterized in that, The vehicle infotainment system includes a touch-sensitive main display screen and at least one touch-sensitive secondary display screen. The main display screen and the secondary display screen contain main function keys. The device includes: The acquisition module is used to acquire the user's interactive gestures; The execution module is used to perform control activation or item selection operations when the interaction gesture is a single-finger click, to move the viewed content based on the single-finger swipe direction when the interaction gesture is a single-finger swipe, to adjust the viewed content or view the image when the interaction gesture is a single-finger double-click, to adjust the viewed content or view the image according to the pinch direction when the interaction gesture is a multi-finger pinch, and to enter the content editing state when the interaction gesture is a single-finger long press. The main function key includes a first side adjustment bar and a second side adjustment bar. When the interactive gesture is executed on the main function key, the execution module is specifically used for: if the interactive gesture slides the first side adjustment bar along a first direction, performing the operation of returning to the main menu interface of the vehicle system; if the interactive gesture slides the second side adjustment bar along a second direction, performing the operation of returning to the previous level vehicle system interface; if the interactive gesture slides the first side adjustment bar along a third direction, switching the historical application along the reverse timeline; if the interactive gesture slides the first side adjustment bar along a fourth direction, switching the historical application along the clockwise timeline; if the interactive gesture slides the first side adjustment bar along a fifth direction and the duration of the pause is greater than a first preset duration, calling the task manager interface.

6. The apparatus according to claim 5, characterized in that, Before acquiring the user's interaction gestures, the acquisition module is specifically used for: Determine the functional permissions for each vehicle infotainment application, wherein the functional permissions include: split-screen function permissions and multi-screen interaction function permissions, and the split-screen function permissions include first window split-screen permissions and second window split-screen permissions; Determine the display level of each in-vehicle application that has the aforementioned split-screen function permission.

7. An electronic device, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the program to implement the vehicle-to-machine interaction method as described in any one of claims 1-4.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to implement the vehicle-to-machine interaction method as described in any one of claims 1-4.

Images