Vehicle-machine interaction method and device, electronic equipment and storage medium

Abstract

The invention relates to the technical field of vehicles, in particular to a vehicle-machine interaction method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining an interaction gesture of a user; when the interactive gesture is single-finger click, a control activation operation or an item selection operation is executed, when the interactive gesture is single-finger sliding, the viewing content is moved based on the single-finger sliding direction, when the interactive gesture is single-finger double click, the viewing content or the image is adjusted, and when the interactive mobile phone is multi-finger pinching, the viewing content is adjusted according to the pinching direction. And adjusting the viewing content or the viewing image, and entering a content editing state when the interactive gesture is single-finger long-pressing. Therefore, the problems that the vehicle-mounted information interaction efficiency is low and a driver is easily distracted to generate potential safety hazards are solved, the vehicle technology interaction system is optimized, the interaction system is clearer and easier to understand, a user can quickly master the interaction system, and the efficiency of obtaining vehicle-mounted information and intelligent interaction by the user is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a vehicle-computer interaction method, device, electronic device and storage medium. Background Art

[0002] As the automotive industry continues to move towards intelligence and networking, human-computer interaction is experiencing unprecedented expansion and deepening, becoming more universal, close and multi-dimensional. In this context, the design of the car's smart cockpit is not only a core element to promote the advancement and innovation of automotive technology, but also a decisive factor in shaping a unique user experience and firmly attracting users' attention. With the extension of interaction time, the acceleration of frequency and the diversification of levels, human-computer interaction has become a significant development focus in the automotive field. Therefore, the development of smart cockpit designs with differentiated experiences that can strongly attract users will have a long-term and positive driving effect on automakers.

[0003] Related technologies have introduced interactive systems with large screens and fewer physical buttons. However, in actual applications, the feedback effect of the virtual buttons on the large screen has not met expectations, and the different positions of the controls on the screen have brought operational challenges and learning burdens to the driver. In addition, frequent operation of the virtual buttons on the large screen can easily distract the driver, thereby increasing safety risks during driving. Summary of the invention

[0004] The present application provides a vehicle-computer interaction method, device, electronic device and storage medium to solve the problem of low vehicle-computer interaction efficiency, which easily distracts the driver and creates safety hazards, optimizes the vehicle-technology interaction system, makes the interaction system clearer and easier to understand, and enables users to quickly get started, thereby improving the efficiency of users in obtaining vehicle information and intelligent interaction.

[0005] The first aspect of the present application provides a vehicle-computer interaction method, wherein the vehicle-computer comprises a touch-controlled main display screen and at least one touch-controlled secondary display screen, wherein the main display screen and the secondary display screen comprise main function keys, wherein the method comprises the following steps:

[0006] Get the user's interactive gestures;

[0007] When the interactive gesture is a single-finger single-click, a control activation operation or an item selection operation is performed; when the interactive gesture is a single-finger slide, the viewed content is moved based on the single-finger slide direction; when the interactive gesture is a single-finger double-click, the viewed content or the viewed image is adjusted; when the interactive gesture is a multi-finger pinch, the viewed content or the viewed image is adjusted according to the pinch direction; when the interactive gesture is a single-finger long press, the content editing state is entered.

[0008] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar, and when the interactive gesture is performed on the main function key, it includes:

[0009] If the interactive gesture slides the first side adjustment bar along the first direction, an operation of returning to the main menu interface of the vehicle computer is executed;

[0010] If the interactive gesture slides the second side adjustment bar along the second direction, an operation of returning to the previous level vehicle machine interface is executed;

[0011] If the interactive gesture slides the first side adjustment bar along the third direction, the historical application is switched along the reverse timeline;

[0012] If the interactive gesture slides the first side adjustment bar along the fourth direction, the historical application is switched along the timeline;

[0013] If the interactive gesture slides the first side adjustment bar along the fifth direction and the stay time is greater than the first preset time, the task manager interface is called.

[0014] Optionally, in some embodiments, before obtaining the user's interaction gesture, the method further includes:

[0015] Determine the functional permissions of each vehicle machine application, wherein the functional permissions include: split-screen functional permissions and multi-screen interactive functional permissions, and the split-screen functional permissions include first-window split-screen permissions and second-window split-screen permissions;

[0016] Determine the display level of each vehicle-mounted application that has the split-screen function permission.

[0017] Optionally, in some embodiments, when the interactive gesture is executed in a vehicle-mounted application having the multi-screen interaction permission, it includes:

[0018] If the interactive gesture touches the main display screen, and the interactive gesture is a three-finger slide in the sixth direction, the page content of the main display screen is given to the secondary display screen.

[0019] Optionally, in some embodiments, after providing the page content of the main display screen to the secondary display screen, the method further includes:

[0020] If the interactive gesture touches the main display screen, and the interactive gesture is a three-finger slide in the seventh direction, the page content of the secondary display screen is recovered to the main display screen.

[0021] A second aspect of the present application provides a vehicle-machine interaction device, comprising: the vehicle-machine comprises a touch-controlled main display screen and at least one touch-controlled secondary display screen, the main display screen and the secondary display screen contain main function keys, wherein the device comprises:

[0022] An acquisition module is used to acquire the user's interactive gestures;

[0023] The execution module is used to execute a control activation operation or an item selection operation when the interactive gesture is a single-finger single-click, to move the viewed content based on the single-finger sliding direction when the interactive gesture is a single-finger double-click, to adjust the viewed content or the viewed image when the interactive gesture is a single-finger double-click, to adjust the viewed content or the viewed image according to the pinching direction when the interactive mobile phone is a multi-finger pinching, and to enter a content editing state when the interactive gesture is a single-finger long press.

[0024] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar, and when the interactive gesture is performed on the main function key, the execution module is specifically configured to:

[0025] If the interactive gesture slides the first side adjustment bar along the first direction, an operation of returning to the main menu interface of the vehicle computer is executed;

[0026] If the interactive gesture slides the second side adjustment bar along the second direction, an operation of returning to the previous level vehicle machine interface is executed;

[0027] If the interactive gesture slides the first side adjustment bar along the third direction, the historical application is switched along the reverse timeline;

[0028] If the interactive gesture slides the first side adjustment bar along the fourth direction, the historical application is switched along the timeline;

[0029] If the interactive gesture slides the first side adjustment bar along the fifth direction and the stay time is greater than the first preset time, the task manager interface is called.

[0030] Optionally, in some embodiments, before acquiring the user's interaction gesture, the acquisition module is specifically configured to:

[0031] Determine the functional permissions of each vehicle machine application, wherein the functional permissions include: split-screen functional permissions and multi-screen interactive functional permissions, and the split-screen functional permissions include first-window split-screen permissions and second-window split-screen permissions;

[0032] Determine the display level of each vehicle-mounted application that has the split-screen function permission.

[0033] Optionally, in some embodiments, when the interactive gesture is executed in a vehicle-mounted application having the multi-screen interaction permission, the execution module is further configured to:

[0034] If the interactive gesture touches the main display screen, and the interactive gesture is a three-finger slide in the sixth direction, the page content of the main display screen is given to the secondary display screen.

[0035] Optionally, in some embodiments, after providing the page content of the main display screen to the secondary display screen, the execution module is further configured to:

[0036] If the interactive gesture touches the main display screen, and the interactive gesture is a three-finger slide in the seventh direction, the page content of the secondary display screen is recovered to the main display screen.

[0037] The third aspect of the present application provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle-computer interaction method as described in the above embodiment.

[0038] The fourth aspect of the present application provides a computer-readable storage medium on which a computer program is stored. The program is executed by a processor to implement the vehicle-computer interaction method as described in the above embodiment.

[0039] Thus, the user's interactive gesture is obtained; when the interactive gesture is a single-finger single click, the control activation operation or item selection operation is performed; when the interactive gesture is a single-finger slide, the content to be viewed is moved based on the single-finger slide direction; when the interactive gesture is a single-finger double-click, the content to be viewed is adjusted or the image to be viewed; when the interactive mobile phone is a multi-finger pinch, the content to be viewed is adjusted according to the pinch direction; when the interactive gesture is a single-finger long press, the content editing state is entered. Thus, the problem of low efficiency of vehicle-machine interaction, which easily distracts the driver and creates safety hazards, is solved, the vehicle-technology interaction system is optimized, the interaction system is clearer and easier to understand, and users can quickly get started, improving the efficiency of users obtaining vehicle information and intelligent interaction.

[0040] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0042] Figure 1 A schematic diagram of an in-vehicle interaction principle provided according to an embodiment of the present application;

[0043] Figure 2 A schematic diagram of the principle of in-vehicle interaction provided according to an embodiment of the present application;

[0044] Figure 3 A flow chart of a vehicle-machine interaction method provided according to an embodiment of the present application;

[0045] Figure 4 A schematic diagram of an interaction for returning to the home page provided according to an embodiment of the present application;

[0046] Figure 5 A schematic diagram of application switching interaction provided according to an embodiment of the present application;

[0047] Figure 6 A schematic diagram of a task manager interaction provided according to an embodiment of the present application;

[0048] Figure 7 A schematic diagram of returning to the previous level interaction provided according to an embodiment of the present application;

[0049] Figure 8 A schematic diagram of application split-screen window hierarchy provided according to an embodiment of the present application;

[0050] Fig. 9 A schematic diagram of a split-screen window hierarchy of only two applications provided according to an embodiment of the present application;

[0051] Fig.10 A schematic diagram of split-screen interaction provided according to an embodiment of the present application;

[0052] Fig.11 A schematic diagram of multi-screen gesture interaction provided according to an embodiment of the present application;

[0053] Fig.12 A schematic diagram of test content provided according to an embodiment of the present application;

[0054] Fig.13 A schematic diagram of test results provided according to an embodiment of the present application;

[0055] Fig.14 A block diagram of a vehicle-machine interaction device provided according to an embodiment of the present application;

[0056] Fig.15 It is a schematic diagram of the structure of an electronic device provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0057] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0058] The following describes the vehicle-machine interaction method, device, electronic device and storage medium of the embodiment of the present application with reference to the accompanying drawings. In view of the problem mentioned in the above background technology that the vehicle-machine interaction efficiency is low and it is easy to distract the driver and cause safety hazards, the present application provides a vehicle-machine interaction method, in which the user's interaction gesture is obtained; when the interaction gesture is a single-finger single click, the control activation operation or item selection operation is performed, when the interaction gesture is a single-finger slide, the viewing content is moved based on the single-finger slide direction, when the interaction gesture is a single-finger double-click, the viewing content or the viewing image is adjusted, when the interactive mobile phone is a multi-finger pinch, the viewing content or the viewing image is adjusted according to the pinch direction, and when the interaction gesture is a single-finger long press, the content editing state is entered. In this way, the problem of low vehicle-machine interaction efficiency and easy distraction of the driver to cause safety hazards is solved, the vehicle-technology interaction system is optimized, the interaction system is made clearer and easier to understand, the user can quickly get started, and the efficiency of the user in obtaining vehicle information and intelligent interaction is improved.

[0059] Before introducing the vehicle-computer interaction method of the embodiment of the present application, the interaction principles followed by the vehicle-computer interaction method of the embodiment of the present application are first introduced.

[0060] like Figure 1 As shown, the embodiment of the present application follows the "three-second interaction principle", that is, when using the in-vehicle interactive interface, the user should be able to understand the information on the interface and complete the operation within just three seconds, satisfying the requirements of clear identification and concise icons for information transmission; setting and switching gesture operations can be completed within three seconds; at the same time, combined with Figure 2 As shown, the system can provide timely feedback and reduce the uncertainty during user operations.

[0061] Gestures can be divided into single-finger, double-finger, triple-finger or multi-finger gestures based on the number of fingers used. They can be divided into scanning, drawing, tapping and swiping based on time and space. Gestures can be divided into eight directions and different ranges, i.e. inside and outside the screen, inside and outside the component. Gesture interaction methods include:

[0062] 1. Click interaction methods: buttons, checkboxes, tabs, icons, search bars, etc.

[0063] 2. Sliding interaction method: negative one screen, home page feature cards, all progress bars (music, video, online radio, volume, brightness, air conditioning volume, temperature, etc.), list type, air conditioning wind direction, car model rotation, etc.

[0064] 3. Long press interaction mode: Select Edit, some keys on the virtual keyboard.

[0065] 4. Double-click interaction mode: navigation map, image zoom.

[0066] 5. Single-finger / two-finger drag: Single-finger drag changes the position of the object, two-finger drag zooms the image and navigates the map.

[0067] The embodiment of the present application integrates gesture interaction into actual user scenarios. According to the user's behavior and living habits, the car computer gesture should adopt the most natural and efficient operation mode to minimize the learning cost and memory burden. The gesture interaction design elements with characteristic intelligent driving scenarios need to follow four interaction design principles:

[0068] (1) Principle of safe and efficient operation. Gesture interaction should reduce the possibility of user distraction, minimize the need for eye-hand coordination, and improve user convenience through faster interaction switching. During gesture guidance, operation or feedback, it is imperative to avoid major interference with driving behavior or potential safety hazards.

[0069] (2) The principle of easy learning and acceptance. Gestures should be simple and intuitive so that users can easily remember and perform them. Avoid overly complex or esoteric gestures to reduce the learning curve.

[0070] (3) Principles of universality and consistency. The same gesture should be able to control the same defined function in different application scenarios. For example, the return gesture in the radio and music application scenarios should be universal. For functions that can adopt multiple interaction methods, a certain consistency should be maintained in the form of expression or interaction method to facilitate user learning and acceptance.

[0071] (4) The principle of appropriate error tolerance. The gesture interaction system design itself should have the characteristics of preventing errors. In the definition of gestures, gesture interactions with dangerous functions should be avoided to provide users with safe and correct choices. In addition, in the definition of gesture hotspots, the response design of the underlying system should be optimized. For example, the design of the touch area can be intelligently adjusted according to the layout of the function entrance to prevent invalid or erroneous operations.

[0072] Specifically, Figure 1 A flowchart of a vehicle-computer interaction method provided in an embodiment of the present application.

[0073] It should be noted that the vehicle computer of the embodiment of the present application includes a touch-sensitive main display screen and at least one touch-sensitive secondary display screen, and the main display screen and the secondary display screen contain main function keys, such as Figure 1 As shown, the vehicle-computer interaction method includes the following steps:

[0074] In step S101, the user's interaction gesture is obtained.

[0075] Specifically, the embodiments of the present application can obtain the user's interactive gestures through the user's touch actions on the display screen, where the interactive gestures include single-finger single-click, single-finger slide, single-finger double-click, multi-finger pinch, single-finger long press, etc.

[0076] In step S102, when the interaction gesture is a single-finger single-click, the control activation operation or the item selection operation is performed; when the interaction gesture is a single-finger slide, the viewing content is moved based on the single-finger slide direction; when the interaction gesture is a single-finger double-click, the viewing content is adjusted or the image is viewed; when the interaction gesture is a multi-finger pinch, the viewing content or the image is adjusted according to the pinch direction; when the interaction gesture is a single-finger long press, the content editing state is entered.

[0077] During the actual implementation process, the embodiments of the present application can perform interactive operations based on basic gestures: ① Click: activate a control or select an item; ② Slide: slide up and down, or slide left and right to continuously move the content to be viewed; ③ Press and drag: move an element left and right or up and down on the screen; ④ Double-click: zoom in or out of the content or image, and center it; ⑤ Five-finger pinch: zoom in when pinching outside, zoom out when pinching inside; ⑥ Long press: enter the text or content editing state; in addition, gestures can quickly flow between multiple screens in the cockpit to improve screen utilization, and the main driver's screen and the co-driver's screen can be transferred between by sliding left and right with three fingers; information can be transferred between the main and co-driver screens and the rear screens by sliding up and down with three fingers, and multi-screen interaction is supported in split-screen state; the rear screen information needs to allow permission from the front row to be projected to the front row, and a pop-up window will be used to remind you, and permission needs to be applied each time.

[0078] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar. When the interactive gesture is performed on the main function key, it includes: if the interactive gesture slides the first side adjustment bar along the first direction, executing the operation of returning to the main menu interface of the vehicle computer; if the interactive gesture slides the second side adjustment bar along the second direction, executing the operation of returning to the previous level vehicle computer interface; if the interactive gesture slides the first side adjustment bar along the third direction, switching the historical application along the reverse timeline; if the interactive gesture slides the first side adjustment bar along the fourth direction, switching the historical application along the forward timeline; if the interactive gesture slides the first side adjustment bar along the fifth direction, and the stay time is greater than the first preset time length, calling the task manager interface.

[0079] Among them, the main function key is Home Order, the first side adjustment bar is located on the left side of the car display screen, the second side adjustment bar is located on the right side of the car display screen, the first direction to the fifth direction can be any direction of up, down, left, and right. In the embodiment of the present application, the first direction is preferably right, the second direction is left, the third direction is up, the fourth direction is down, and the fifth direction is right. The first preset time length can be pre-set by the user, can be obtained through a limited number of experiments, or can be obtained through a limited number of computer simulations, and is not specifically limited here.

[0080] It should be noted that the vehicle-machine interaction method of the embodiment of the present application includes three information structures: the main function key, i.e., Home Order, split-screen operation, and multi-screen interaction. In the process of constructing the information hierarchy, the underlying logic should follow the principle of user experience priority and driving safety, focusing on the user's functions and operation requirements, and reducing the possibility of user distraction on the basis of a reasonable information architecture. The vehicle-mounted homepage interaction of the embodiment of the present application follows the shallow level principle, reasonably classifies the user operation tasks, and sets up quick gesture entrances, minimizing the depth of the interface and the page level as much as possible, so that users can quickly browse information, improving user operation efficiency and operation safety.

[0081] In the interactive framework of the main function key, the vehicle information framework is mainly divided into four parts: quick setting area, quick navigation, car model + scene dynamic effect display area, and DOCK bar. The main functions include quick switching applications. Based on the user's daily reading habits and usage scenarios, the already opened applications can be quickly switched by sliding up and down on the Home Order, so that the vehicle has zero learning cost; the one-key return function can quickly return to the desktop by sliding the Home Order to the right, and cancel the Home button in the DOCK bar, which improves the user's operation convenience during driving and further increases the user's driving safety; return to the previous level through the return button and swipe left on the right edge; the Home Order display mode defaults to power or fuel display, which is normally displayed in green. When the power or fuel is less than 20%, the order is displayed in red. The display mode can be switched according to the application, such as takeaway, navigation, flight or high-speed rail journey progress, and it will automatically switch to the corresponding display mode; multi-task management switch, press the display bar and slide to the right to wake up the multi-task state, and support the use of extended shortcut components.

[0082] In the actual implementation process, from the perspective of user operation convenience and safety, the embodiment of the present application greatly improves the operation efficiency by setting the main function key Home Order quick operation entry in the vehicle computer. The main function key Home Order module in the vehicle computer interaction system mainly includes four parts: return to the home page, switch applications, task manager, and return to the previous level.

[0083] 1. Return to the homepage interaction mode. Figure 4 As shown, swipe right with one finger on the Home Order adjustment bar on the left side of the screen to return. The Home Order adjustment bar on the main interface of the car is always displayed, and the level should be higher than the application and lower than special pop-up layers such as quick control and air conditioning.

[0084] 2. Switch the application interaction mode. Figure 5 As shown, you can switch background historical applications by swiping up or down with one finger on the Home Order adjustment bar on the left edge. During the application switching process, the Home Order adjustment bar moves with the page; when you slide the edge of the screen up and down, the applications are sorted in order according to the most recent use, with the current page being the first page. Swipe up to switch to the last used page, which is the second page, and swipe down to switch to the last page.

[0085] 3. Task Manager. Figure 6 As shown, the Task Manager page can be opened by sliding to the right from the Home Order adjustment bar and staying there. Full-screen applications can be switched by swiping up and down, and Home Order moves with the page. Applications on the Task Manager interface can be sorted in order according to recent use, with the current page being the first page. Swipe up to switch to the last used application page, which is the second page, and swipe down to switch. When switching up and down, three recommended frequently used pages of this application will appear on the right. By recording the user's usage habits, the user can quickly select the page entry, which improves user convenience.

[0086] 4. Return to the previous level. Figure 7 As shown, there are two ways to return to the previous level. Method 1 supports returning to the previous level by sliding to the left along the right edge of the screen, and method 2 retains the return button on the secondary page within the application.

[0087] Optionally, in some embodiments, before obtaining the user's interactive gestures, it also includes: determining the functional permissions of each vehicle-mounted application, wherein the functional permissions include: split-screen functional permissions and multi-screen interactive functional permissions, and the split-screen functional permissions include first window split-screen permissions and second window split-screen permissions; determining the display level of each vehicle-mounted application that has split-screen functional permissions.

[0088] Among them, the first view split-screen permission is 1 / 3 split-screen permission, and the second view split-screen permission is 2 / 3 split-screen permission.

[0089] In order to provide users with richer interaction methods, the embodiments of the present application support split-screen interaction and multi-screen interaction. Here, the split-screen interaction method is introduced.

[0090] In order to provide users with a more personalized and intelligent driving experience, the embodiment of the present application can divide the screen into 3 areas, support partial application split screen, 1 / 3, 2 / 3, automatic, multi-screen interactive functions, users can easily change the position of the 3D desktop by dragging the horizontal bar above the split screen, adjust the viewing angle in real time, so that the desktop display size and content are more in line with user needs, and at the same time, by dragging the horizontal bar to the edge position, the user can cancel the split screen display of the current window, simplify the operation interface, and improve the convenience of use. Clicking the zoom button can switch the page to full screen display, allowing users to focus more on what they see. This design not only takes into account the personalized needs of users, but also fully considers the intuitiveness and user-friendliness of the operation. Overall, this innovative 3D desktop design is not just a simple fusion of digital and reality, but also provides users with a new perceptual experience. Through deep interconnection with vehicle functions, users can process information more conveniently and intelligently during driving, breaking the gap between the digital interface and the actual scene in traditional driving, and creating a more pleasant and intelligent driving environment for drivers.

[0091] The embodiment of the present application supports partial application split screen, 1 / 3, 2 / 3, automatic, and multi-screen interactive functions. When opening an application, the window display size hierarchy is as follows: Fig. 9 As shown, the car model on the home page supports split screen, 1 / 3 window, 2 / 3 window, but does not support automatic and multi-screen interaction; music supports split screen, 1 / 3 window, 2 / 3 window, and multi-screen interaction, but does not support automatic; navigation at a higher level supports all; vehicle settings support split screen, 2 / 3 window, and multi-screen interaction, but do not support 1 / 3 window and automatic; the first third-party application level is the same as the vehicle setting; the second third-party application does not support split screen operation.

[0092] When one app is closed, the remaining two apps are split-screen and displayed in different sizes. Fig. 9 As shown, when the car model on the home page is retained, the display is fixed at 1 / 3 of the screen, and other applications are displayed at 2 / 3 of the screen; when music and navigation are turned on at the same time, music is displayed at 2 / 3 of the screen, and navigation is displayed at 1 / 3 of the screen; when music and vehicle settings are turned on at the same time, vehicle settings are displayed at 2 / 3 of the screen, and music is displayed at 1 / 3 of the screen; when navigation and vehicle settings are turned on at the same time, vehicle settings are displayed at 2 / 3 of the screen, and navigation is displayed at 1 / 3 of the screen; the first third-party application has the highest level and always occupies 2 / 3 of the screen.

[0093] Combination Fig.10As shown, the embodiment of the present application can divide the vehicle display screen into multiple areas, which is convenient for users to handle multiple tasks at the same time. In the embodiment of the present application, the vehicle interface supports three split-screen interfaces. After the user opens the second application, other applications with split-screen permissions can be dragged and swiped into the DOCK bar or ALL APP page. When dragging, the display screen highlights the target that can display the second application, and provides text guidance and pattern guidance. After dragging and lifting the gesture, the second application is displayed in the target area. When performing split-screen interaction, if you need to display any of the first target applications that have been split in full screen, you can swipe up in the hot area of ​​the split-screen operation bar to display the first target application in full screen; if you need to cancel the split screen of any second target application that has been split, swipe down in the hot area of ​​the split-screen operation bar to cancel the split screen.

[0094] The intelligent split screen of the car machine provides drivers with a more flexible and personalized interface experience, giving full play to the potential of the in-vehicle infotainment system. The advantages of the intelligent split screen of the car machine include: ① Multitasking: Intelligent split screen technology enables drivers to handle multiple tasks at the same time, such as navigation, music, calls, etc., without frequently switching interfaces, which improves the efficiency of information processing; ② Personalized configuration: Drivers can personalize the screen according to their preferences and needs, and place the most commonly used applications and information in a more convenient location, which improves the personalization of the user experience; ③ Real-time information display: Split screen technology allows multiple information to be displayed at the same time, such as displaying navigation maps, music playlists and vehicle status at the same time, so that drivers can understand multiple aspects of information in real time, improving the accuracy of driving decisions; ④ Reduce the risk of distracted driving: Intelligent split screen technology helps reduce the driver's distraction when operating the car system. Through clear information display and concise operation interface, the cognitive burden on the driver is reduced and driving safety is improved. In the embodiment of the present application, after opening an application, the application can be slid into the DOCK bar or the ALL APP page, and the interface supports three split screen interfaces.

[0095] Optionally, in some embodiments, when an interactive gesture is executed in a vehicle-mounted application with multi-screen interaction permission, it includes: if the interactive gesture touches the main display screen, and the interactive gesture is a three-finger slide in the sixth direction, the page content of the main display screen is given to the secondary display screen.

[0096] Optionally, in some embodiments, after the page content of the main display screen is given to the sub-display screen, it also includes: if the interaction gesture touches the main display screen, and the interaction gesture is a three-finger sliding in the seventh direction, the page content of the sub-display screen is recovered to the main display screen.

[0097] Here, a multi-screen gesture interaction method in the vehicle-machine interaction method of an embodiment of the present application is introduced.

[0098] The sixth direction and the seventh direction may be any direction of up, down, left, or right. Preferably, the sixth direction is right and the seventh direction is left.

[0099] like Fig.11 As shown, if you need to display the content of the main display screen on the secondary display screen, on the main driving screen, swipe right with three fingers, and the current page content of the main display screen will be given to the secondary display screen (except the home page). After the main display screen is given, the last used application page of the rear applications will be displayed. When the content displayed in the back row is given to the front row, the front row user needs to allow screen projection permission.

[0100] If the content on the secondary display screen is displayed on the main display screen, you can swipe left with three fingers on the co-pilot screen to give the current page content of the secondary display screen to the main display screen (except the home page). After the secondary display screen is given, the last used application page of the back application is displayed. When giving the content displayed in the back row to the front row, the front row user needs to allow screen projection permission.

[0101] When the main display screen needs to recycle the display content of the sub-display screen, on the main driving screen, swipe left with three fingers, and the current page content of the sub-display screen will be recycled to the main display screen (except the home page). After the main display screen is recycled, the last used application page of the rear application will be displayed. When the content displayed in the back row is given to the front row, the front row user needs to allow screen projection permission.

[0102] When the secondary display screen needs to recycle the display content of the main display screen, on the main driving screen, swipe right with three fingers, and the current page content of the main display screen will be recycled to the secondary display screen (except the home page). After the main display screen is recycled, the last used application page of the rear application will be displayed. When the content displayed in the back row is given to the front row, the front row user needs to allow screen projection permission.

[0103] Multi-screen gesture interaction brings many advantages to users, including the following three points: ① Natural and intuitive: Multi-screen interaction gestures imitate natural movements in daily life, such as dragging, pinching, sliding, etc., so that users can interact with the multi-screen interface more naturally and reduce the reliance on complex control buttons; ② Improve efficiency: Multi-screen gesture interaction can achieve a variety of operations through direct gesture actions, avoiding cumbersome steps and multiple clicks. ③ Space utilization: Multi-screen gesture operation can make better use of screen space, trigger different functions or switch different interfaces through different gestures, and improve the flexibility and scalability of multi-screen interaction. ④ Future interconnection: Multi-screen gesture technology provides the basis for a more complex interconnected ecosystem in the future. Users can easily realize the interconnection and collaboration between multiple devices through gesture operations, which promotes the integration of digital life. The embodiment of this application focuses on realizing the flow of information between multiple screens on the basis of satisfying basic operations such as clicking, sliding, pressing and dragging, double-clicking, five-finger pinching, and long pressing, and realizing multi-screen information switching through three fingers.

[0104] The human-computer interaction test aims to comprehensively evaluate the user's feelings and satisfaction when using the product, so the user-centered testing method is particularly critical. The vehicle-computer interaction method based on the embodiment of the present application was tested, mainly including the following 5 points: ① User participation test: By inviting real users to participate in the test, observing and recording their behavior and feedback in actual use, such a testing method can provide the most realistic user experience data; ② User questionnaire: Use standardized questionnaires to investigate user satisfaction, preferences and feelings to obtain quantitative feedback data; ③ User interviews: Conduct in-depth user interviews to gain a deeper understanding of their needs, expectations and problems through communication with users; ④ Prototype testing: In the early stages of product development, prototype demonstrations are used to test the user's understanding and acceptance of design concepts; ⑤ User behavior analysis: Observe and analyze the user's behavior during the interaction process, including clicks, slides, inputs, etc., to identify potential problems and optimization points, which helps to deeply explore user needs and problems and provide a strong basis for product improvement. The advantage of a comprehensive testing method is that it can more accurately evaluate user feelings, discover potential problems in a timely manner and make improvements.

[0105] The test content summarizes the high-frequency task scenarios of vehicle operation, such as Fig.12 , and evaluate and score the usage effect, and finally output the corresponding data. To ensure the effectiveness of the test, the diversity of the human-computer interaction test environment is crucial. By using different devices, operating systems and test benches for different user groups, such diversity can fully cover the actual usage and make the test results more comprehensive and accurate. Fig.13 .

[0106] According to the vehicle-machine interaction method proposed in the embodiment of the present application, by acquiring the user's interaction gesture, and when the interaction gesture is a single-finger single click, executing the control activation operation or item selection operation, when the interaction gesture is a single-finger slide, moving the viewing content based on the single-finger slide direction, when the interaction gesture is a single-finger double-click, adjusting the viewing content or viewing the image, when the interactive mobile phone is a multi-finger pinch, adjusting the viewing content or viewing the image according to the pinch direction, and when the interaction gesture is a single-finger long press, entering the content editing state. In this way, the problem of low efficiency of vehicle-machine interaction and easy distraction of the driver to cause safety hazards is solved, the vehicle-machine interaction system is optimized, the interaction system is made clearer and easier to understand, users can quickly get started, and the efficiency of users obtaining vehicle information and intelligent interaction is improved.

[0107] Next, the vehicle-machine interaction device proposed according to the embodiment of the present application is described with reference to the accompanying drawings.

[0108] Fig.14 It is a block diagram of the vehicle-machine interaction device of an embodiment of the present application.

[0109] The vehicle computer of the embodiment of the present application includes a touch-controlled main display screen and at least one touch-controlled secondary display screen, and the main display screen and the secondary display screen contain main function keys, such as Fig.14 As shown, the vehicle-machine interaction device 10 includes: an acquisition module 100 and an execution module 200 .

[0110] The acquisition module 100 is used to acquire the user's interactive gestures.

[0111] Execution module 200 is used to execute a control activation operation or an item selection operation when the interaction gesture is a single-finger single-click, to move the viewed content based on the single-finger sliding direction when the interaction gesture is a single-finger double-click, to adjust the viewed content or the viewed image when the interaction gesture is a single-finger double-click, to adjust the viewed content or the viewed image according to the pinching direction when the interactive mobile phone is a multi-finger pinch, and to enter the content editing state when the interaction gesture is a single-finger long press.

[0112] Optionally, in some embodiments, the main function key includes a first side adjustment bar and a second side adjustment bar. When the interactive gesture is performed on the main function key, the execution module 200 is specifically used to: if the interactive gesture slides the first side adjustment bar along the first direction, execute the operation of returning to the main menu interface of the vehicle computer; if the interactive gesture slides the second side adjustment bar along the second direction, execute the operation of returning to the previous level vehicle computer interface; if the interactive gesture slides the first side adjustment bar along the third direction, switch the historical application along the reverse timeline; if the interactive gesture slides the first side adjustment bar along the fourth direction, switch the historical application along the forward timeline; if the interactive gesture slides the first side adjustment bar along the fifth direction, and the stay time is greater than the first preset time length, call the task manager interface.

[0113] Optionally, in some embodiments, before obtaining the user's interactive gestures, an acquisition module is specifically used to: determine the functional permissions of each vehicle-mounted application, wherein the functional permissions include: split-screen functional permissions and multi-screen interactive functional permissions, and the split-screen functional permissions include first window split-screen permissions and second window split-screen permissions; determine the display level of each vehicle-mounted application that has split-screen functional permissions.

[0114] Optionally, in some embodiments, when an interactive gesture is executed in a vehicle-mounted application with multi-screen interaction permission, the execution module is also used to: if the interactive gesture touches the main display screen and the interactive gesture is a three-finger slide in the sixth direction, the page content of the main display screen is given to the secondary display screen.

[0115] Optionally, in some embodiments, after the page content of the main display screen is given to the secondary display screen, the execution module is also used to: if the interaction gesture touches the main display screen, and the interaction gesture is a three-finger sliding in the seventh direction, recycle the page content of the secondary display screen to the main display screen.

[0116] It should be noted that the aforementioned explanation of the vehicle-machine interaction method embodiment is also applicable to the vehicle-machine interaction device of this embodiment, and will not be repeated here.

[0117] According to the vehicle-machine interaction device proposed in the embodiment of the present application, by acquiring the user's interactive gesture, and when the interactive gesture is a single-finger single click, the control activation operation or item selection operation is performed; when the interactive gesture is a single-finger slide, the viewing content is moved based on the single-finger slide direction; when the interactive gesture is a single-finger double-click, the viewing content or image is adjusted; when the interactive gesture is a multi-finger pinch, the viewing content or image is adjusted according to the pinch direction; when the interactive gesture is a single-finger long press, the content editing state is entered. In this way, the problem of low efficiency of vehicle-machine interaction and easy distraction of the driver to cause safety hazards is solved, the vehicle-machine interaction system is optimized, the interaction system is made clearer and easier to understand, users can quickly get started, and the efficiency of users obtaining vehicle information and intelligent interaction is improved.

[0118] Fig.15 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device may include:

[0119] A memory 1501 , a processor 1502 , and a computer program stored in the memory 1501 and executable on the processor 1502 .

[0120] When the processor 1502 executes the program, the vehicle-machine interaction method provided in the above embodiment is implemented.

[0121] Furthermore, the electronic device further comprises:

[0122] The communication interface 1503 is used for communication between the memory 1501 and the processor 1502 .

[0123] The memory 1501 is used to store computer programs that can be executed on the processor 1502 .

[0124] The memory 1501 may include a high-speed RAM (Random Access Memory) memory, and may also include a non-volatile memory, such as at least one disk memory.

[0125] If the memory 1501, the processor 1502 and the communication interface 1503 are implemented independently, the communication interface 1503, the memory 1501 and the processor 1502 can be connected to each other through a bus and communicate with each other. The bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.15 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0126] Optionally, in a specific implementation, if the memory 1501, the processor 1502 and the communication interface 1503 are integrated on a chip, the memory 1501, the processor 1502 and the communication interface 1503 can communicate with each other through an internal interface.

[0127] The processor 1502 may be a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application.

[0128] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the above-mentioned vehicle-computer interaction method is implemented.

[0129] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0130] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0131] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0132] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array, a field programmable gate array, etc.

[0133] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0134] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in the field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A vehicle-machine interaction method, characterized in that: The vehicle computer includes a touch-controlled main display screen and at least one touch-controlled secondary display screen, wherein the main display screen and the secondary display screen contain main function keys, wherein the method includes the following steps: Get the user's interactive gestures; When the interactive gesture is a single-finger single-click, a control activation operation or an item selection operation is performed; when the interactive gesture is a single-finger slide, the viewed content is moved based on the single-finger slide direction; when the interactive gesture is a single-finger double-click, the viewed content or the viewed image is adjusted; when the interactive gesture is a multi-finger pinch, the viewed content or the viewed image is adjusted according to the pinch direction; when the interactive gesture is a single-finger long press, the content editing state is entered.

2. The method according to claim 1, characterized in that The main function key includes a first side adjustment bar and a second side adjustment bar, and when the interactive gesture is performed on the main function key, it includes: If the interactive gesture slides the first side adjustment bar along the first direction, an operation of returning to the main menu interface of the vehicle computer is executed; If the interactive gesture slides the second side adjustment bar along the second direction, an operation of returning to the previous level vehicle machine interface is executed; If the interactive gesture slides the first side adjustment bar along the third direction, the historical application is switched along the reverse timeline; If the interactive gesture slides the first side adjustment bar along the fourth direction, the historical application is switched along the timeline; If the interactive gesture slides the first side adjustment bar along the fifth direction and the stay time is greater than the first preset time, the task manager interface is called.

3. The method according to claim 1, characterized in that Before obtaining the user's interactive gesture, it also includes: Determine the functional permissions of each vehicle machine application, wherein the functional permissions include: split-screen functional permissions and multi-screen interactive functional permissions, and the split-screen functional permissions include first-window split-screen permissions and second-window split-screen permissions; Determine the display level of each vehicle-mounted application that has the split-screen function permission.

4. The method according to claim 3, characterized in that When the interactive gesture is executed in a vehicle-mounted application having the multi-screen interaction permission, it includes: If the interactive gesture touches the main display screen, and the interactive gesture is a three-finger slide in the sixth direction, the page content of the main display screen is given to the secondary display screen.

5. The method according to claim 4, characterized in that After providing the page content of the main display screen to the secondary display screen, the method further includes: If the interactive gesture touches the main display screen, and the interactive gesture is a three-finger slide in the seventh direction, the page content of the secondary display screen is recovered to the main display screen.

6. A vehicle-machine interaction device, characterized in that: The vehicle computer includes a touch-controlled main display screen and at least one touch-controlled secondary display screen, wherein the main display screen and the secondary display screen contain main function keys, wherein the device includes: An acquisition module is used to acquire the user's interactive gestures; The execution module is used to execute a control activation operation or an item selection operation when the interactive gesture is a single-finger single-click, to move the viewed content based on the single-finger sliding direction when the interactive gesture is a single-finger double-click, to adjust the viewed content or the viewed image when the interactive gesture is a single-finger double-click, to adjust the viewed content or the viewed image according to the pinching direction when the interactive mobile phone is a multi-finger pinching, and to enter a content editing state when the interactive gesture is a single-finger long press.

7. The device according to claim 6, characterized in that The main function key includes a first side adjustment bar and a second side adjustment bar. When the interactive gesture is performed on the main function key, the execution module is specifically used to: If the interactive gesture slides the first side adjustment bar along the first direction, an operation of returning to the main menu interface of the vehicle computer is executed; If the interactive gesture slides the second side adjustment bar along the second direction, an operation of returning to the previous level vehicle machine interface is executed; If the interactive gesture slides the first side adjustment bar along the third direction, the historical application is switched along the reverse timeline; If the interactive gesture slides the first side adjustment bar along the fourth direction, the historical application is switched along the timeline; If the interactive gesture slides the first side adjustment bar along the fifth direction and the stay time is greater than the first preset time, the task manager interface is called.

8. The device according to claim 6, characterized in that Before acquiring the user's interactive gesture, the acquisition module is specifically used to: Determine the functional permissions of each vehicle machine application, wherein the functional permissions include: split-screen functional permissions and multi-screen interactive functional permissions, and the split-screen functional permissions include first-window split-screen permissions and second-window split-screen permissions; Determine the display level of each vehicle-mounted application that has the split-screen function permission.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle-machine interaction method as described in any one of claims 1 to 5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the vehicle-computer interaction method as described in any one of claims 1-5.

Images