Method and device for interaction between mobile terminal and vehicle

Abstract

The present application discloses a method and device for interaction between a mobile terminal and a vehicle. The method comprises: upon establishing a communication connection between a vehicle side and a mobile terminal, receiving a mirroring instruction of the mobile terminal (S101); in response to the mirroring instruction, receiving transmitted data of the mobile terminal on the basis of a preset screen mirroring protocol, and displaying the transmitted data on a floating mirroring interface of an in-vehicle infotainment (S102); and detecting a gesture action of a user in a response area of the floating mirroring interface of the in-vehicle infotainment, and executing, on the floating mirroring interface, a control instruction corresponding to the gesture action (S103).

Description

Interaction methods and devices between mobile terminals and vehicles

[0001] This application claims priority to Chinese Patent Application No. 202510063765.8, filed on January 15, 2025, entitled “Method and Apparatus for Interaction between Mobile Terminal and Vehicle”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application belongs to the field of human-vehicle interaction technology, and specifically relates to a method and device for interaction between a mobile terminal and a vehicle. Background Technology

[0003] With the rapid development of technology, intelligence and networking have become important trends in contemporary society. Against this backdrop, "smartphone-vehicle interconnection," as a new technological concept, is gradually changing the way people travel. Smartphone-vehicle interconnection refers to a new technology that deeply integrates smartphones and smart cars, enabling information sharing and interoperability. Summary of the Invention

[0004] This application provides a method and apparatus for interaction between a mobile terminal and a vehicle. The technical solution of this application is as follows:

[0005] A first aspect of this application provides a method for interaction between a mobile terminal and a vehicle, applied to the vehicle side, comprising:

[0006] After establishing a communication connection between the vehicle and the mobile terminal, the vehicle receives the mirroring instruction from the mobile terminal.

[0007] In response to the mirroring instruction, based on a preset projection protocol, the system receives the transmitted data from the mobile terminal and displays the transmitted data on the floating mirror interface of the vehicle system.

[0008] The system detects the user's gesture in the response area of ​​the floating mirror of the vehicle's infotainment system and executes the control command corresponding to the gesture on the floating mirror interface.

[0009] In some embodiments, prior to responding to the mirroring instruction, the method further includes:

[0010] Determine whether the mobile terminal and / or the vehicle terminal meet the preset screen projection conditions;

[0011] If the preset projection conditions are met, the vehicle terminal is controlled to enter the floating mirror mode; otherwise, the mirror instruction is rejected.

[0012] In some embodiments, before controlling the vehicle to enter the floating mirror mode, the method further includes:

[0013] A user confirmation prompt is displayed on the vehicle's infotainment system.

[0014] The image instruction is rejected upon receiving a user's rejection.

[0015] In some embodiments, the preset screen projection condition is that the mobile terminal and / or the vehicle terminal are on the same local area network.

[0016] In some embodiments, the gesture action includes at least one of the following: window full-screen action, window minimize action, window edge-swiping action, window close action, and window landscape action.

[0017] In some embodiments, the method further includes:

[0018] When a user taps the floating image interface of the vehicle system with a single finger, the response area of ​​the floating image of the vehicle system is displayed;

[0019] When a user long-presses the response area of ​​the floating mirror of the vehicle system with a single finger, the interface of the floating mirror of the vehicle system will move on the vehicle system according to the user's dragging trajectory;

[0020] When the user releases the response area of ​​the vehicle's floating image, the interface of the vehicle's floating image remains at the current position.

[0021] A second aspect of the present invention provides an interaction device between a mobile terminal and a vehicle, comprising: a communication connection module, configured to receive a mirroring instruction from the mobile terminal after establishing a communication connection between the vehicle and the mobile terminal; a receiving and display module, configured to receive transmission data from the mobile terminal based on a preset projection protocol in response to the mirroring instruction, and display the transmission data on a floating mirroring interface of the vehicle system; and a detection and execution module, configured to detect a user's gesture in the response area of ​​the floating mirroring interface of the vehicle system, and execute a control command corresponding to the gesture on the floating mirroring interface.

[0022] A third aspect of this application provides a vehicle, comprising: a memory and a processor, wherein the memory stores a computer program executable on the processor, the computer program being loaded and executed by the processor to implement the interaction method between a mobile terminal and a vehicle as described in the preceding aspect.

[0023] A fourth aspect of this application provides a computer program product including computer instructions that instruct a processor to perform the mobile terminal-vehicle interaction method as described in the preceding aspect.

[0024] A fifth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the interaction method between a mobile terminal and a vehicle as described in the preceding aspect. Attached Figure Description

[0025] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0026] Figure 1 is a flowchart of an interaction method between a mobile terminal and a vehicle according to an embodiment of this application;

[0027] Figure 2 is a schematic diagram illustrating the specific execution of a mobile terminal-vehicle interaction method according to an embodiment of this application;

[0028] Figure 3 is an example diagram of its use in a cockpit scenario according to an embodiment of this application;

[0029] Figure 4 is an example diagram of floating mirror movement interaction in a cockpit scene according to an embodiment of this application;

[0030] Figure 5 is an example diagram of using landscape / portrait screen switching in a cockpit scene according to an embodiment of this application;

[0031] Figure 6 is a block diagram of an interaction device between a mobile terminal and a vehicle according to an embodiment of this application;

[0032] Figure 7 is a block diagram of a vehicle provided according to an embodiment of this application. Detailed Implementation

[0033] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0034] Currently, by extending the convenience and intelligence of mobile terminals to the automotive field, and through advanced technologies such as big data and cloud computing, real-time connectivity between vehicles and the internet has been achieved, providing users with a more convenient and comfortable driving experience. However, in these related technologies, mobile terminals (such as smartphones and tablets) and automobiles are completely separate systems. This superficial connection can only meet basic usage scenarios. As automobiles undergo a comprehensive intelligent transformation, the relationship between mobile terminals and automobiles is being restructured; mobile terminals now complement the automotive ecosystem. However, the application ecosystem on the vehicle side is too limited, and some applications (Apps) on mobile terminals are not integrated into the vehicle, making it difficult to meet users' needs in the local cockpit beyond driver assistance, resulting in a poor human-vehicle interaction experience.

[0035] The following description, with reference to the accompanying drawings, describes the interaction method between a mobile terminal and a vehicle provided in the embodiments of this application, in order to solve the problem that there is too little application ecosystem on the vehicle side and that some apps on the mobile terminal are not reflected on the vehicle side, making it difficult to meet the user's needs in the local cockpit other than driving assistance, resulting in a poor human-vehicle interaction experience.

[0036] Figure 1 is a flowchart of a mobile terminal-vehicle interaction method provided in an embodiment of this application. As shown in Figure 1, the mobile terminal-vehicle interaction method is applied to the vehicle and specifically includes the following steps:

[0037] In step S101, after establishing a communication connection between the vehicle and the mobile terminal, the vehicle receives a mirroring instruction from the mobile terminal.

[0038] Here, "vehicle end" refers to the end where the vehicle is located. In practice, this can be executed by the vehicle's overall controller.

[0039] As shown in Figure 2, in actual execution, the vehicle-mounted terminal and the mobile terminal are first connected to the same network to establish a communication connection. Then, it is determined whether the mobile terminal and / or the vehicle-mounted terminal meet the preset projection conditions. The preset projection conditions are that the mobile terminal and / or the vehicle-mounted terminal are on the same local area network. If the preset projection conditions are met, the mirroring instruction from the mobile terminal is accepted; otherwise, the mirroring instruction is rejected. Based on the preset projection conditions, the feasibility of the projection technology is ensured, transmission failures are avoided, and usage security is improved.

[0040] After rejecting the mirroring instruction, the vehicle can be controlled to send a Wi-Fi hotspot to the mobile terminal, enabling the mobile terminal to connect to the Wi-Fi hotspot; or the mobile terminal can be controlled to send a Wi-Fi hotspot to the vehicle, enabling the vehicle to connect to the Wi-Fi hotspot; or the mobile terminal and the vehicle can be controlled to connect to the same preset device's Wi-Fi hotspot, enabling the vehicle and the mobile terminal to establish a communication connection within the local area network.

[0041] For example, as shown in Figure 2, the method to connect the mobile terminal and the vehicle to the same network and under the same local area network can be as follows: the vehicle sends a Wi-Fi hotspot to the mobile terminal (e.g., mobile phone, tablet, etc.), and the mobile terminal connects to the Wi-Fi hotspot; or the mobile terminal sends a Wi-Fi hotspot to the vehicle, and the vehicle connects to the Wi-Fi hotspot; or the mobile terminal and the vehicle connect to the Wi-Fi hotspot of another device of the same type.

[0042] Furthermore, if the mobile terminal and the vehicle are not on the same local area network using the above method, then other connection methods mentioned above or a USB data cable connection can be used to ensure that the mobile terminal and the vehicle are on the same local area network, thereby guaranteeing the transmission of data and video streams.

[0043] In step S102, in response to the mirroring instruction, the system receives the transmission data from the mobile terminal based on a preset projection protocol and displays the transmission data on the floating mirror interface of the vehicle system.

[0044] In this step, the vehicle-mounted device processes the mirroring instruction received from the mobile terminal and unifies the data transmission format between the mobile terminal and the vehicle-mounted device using its own stored preset projection protocol to avoid technical problems such as screen tearing and audio desynchronization.

[0045] By receiving transmitted data from the mobile terminal and displaying the data on the vehicle's floating mirror interface, compared to traditional screen projection (i.e., full-screen exclusive mode), as shown in Figure 3, this embodiment displays the mobile terminal's form on the screen using a floating mirror method. This allows the mobile terminal's window to be presented independently, creating a flexibly manageable display layer within the vehicle's operating system. It doesn't occupy the entire screen and can run in parallel with local cockpit functions. This floating mirror display method is the core invention of this application, breaking through the display limitations of traditional screen projection. It allows the mobile terminal ecosystem to be displayed on the vehicle in a floating mirror manner, compensating for the shortcomings of the vehicle ecosystem. Furthermore, since personal data and privacy are only stored in the mobile terminal's applications, and the mobile terminal is used to display the mobile terminal's application scenarios as the user enters and leaves the vehicle, the entire process does not require the transmission of personal data and privacy to the vehicle. This helps protect personal data and privacy and provides users with a better human-vehicle interaction experience.

[0046] For example, as shown in Figure 3, which illustrates an example diagram used in a cockpit scenario, the display method of the mobile terminal style on the vehicle is a floating mirror, and the floating mirror interface is consistent with the mobile terminal interface. As can be seen from Figure 4, the mobile terminal application can be displayed on the vehicle's display screen, and at the same time, the vehicle's original applications can also be displayed on the vehicle's display screen. The two do not interfere with each other and can coexist, thus solving the problem of insufficient application ecosystem on the vehicle side.

[0047] In actual execution, as shown in Figure 2, before the vehicle enters the floating mirror mode, based on the preset screen projection protocol, while the mobile terminal and the vehicle are on the same local area network, in order to ensure the transmission of video and audio streams, the vehicle's Bluetooth also needs to be connected to the mobile terminal. Therefore, the vehicle needs to turn on Bluetooth and send a Bluetooth connection request to the mobile terminal. After the mobile terminal agrees to the vehicle's Bluetooth connection request, the user will see the vehicle's infotainment system (i.e., the central control screen) to be projected (connected device) on the mobile terminal, and the vehicle will pop up a confirmation box to ask whether to agree to the screen projection, in order to prevent the user from frequently initiating screen projection requests and to allow the user to confirm on the vehicle's infotainment system. After the user agrees, the mobile terminal starts screen projection, and the vehicle receives the video or audio data transmitted by the mobile terminal and displays the transmitted data on the floating mirror interface of the vehicle's infotainment system. Otherwise, it will not respond to the mirroring instruction.

[0048] In step S103, the user's gesture action in the response area of ​​the floating mirror of the vehicle system is detected, and the control command corresponding to the gesture action is executed on the floating mirror interface.

[0049] In actual execution, as shown in Figures 2 and 3, based on WindowManager technology, after the user agrees to the screen mirroring request on the vehicle's infotainment system (i.e., the central control screen), the mobile terminal is displayed on the vehicle's infotainment system via a floating mirror method. That is, the vehicle's infotainment system will display a floating mirror interface, which is consistent with the current interface of the mobile terminal. The user can perform corresponding gesture actions in the response area of ​​the floating mirror on the vehicle's infotainment system to call corresponding control commands to adjust the floating mirror interface on the vehicle's terminal.

[0050] The gesture actions include at least one of the following: full-screen window action, minimize window action, pop-up window action, close window action, and landscape window action. In other words, gesture actions can control the floating mirrored interface to achieve at least one of the following: full-screen window action, minimize window action, pop-up window action, close window action, and landscape window action.

[0051] In some embodiments, the method further includes:

[0052] When a user taps the floating mirror image of the vehicle's infotainment system with a single finger, the response area of ​​the floating mirror image is displayed.

[0053] When a user long-presses the response area of ​​the floating mirror on the vehicle's infotainment system with a single finger, the floating mirror interface will move on the vehicle's screen according to the user's dragging trajectory.

[0054] When the user releases the response area of ​​the vehicle's floating mirror, the floating mirror interface remains in its current position.

[0055] The above methods enable users to move and interact with the floating mirror interface.

[0056] In actual execution, as shown in Figures 4 and 5, the top area of ​​the floating mirror interface has a response area. When the user taps the floating mirror interface on the vehicle system (i.e., the central control screen) with a single finger, the response area hotspot is displayed. When the user long-presses the response area hotspot with a single finger, the floating mirror interface will move on the vehicle system following the trajectory dragged by the user. After the user releases their finger in the response area of ​​the floating mirror interface, the floating mirror interface stays at the current position of the vehicle system.

[0057] It should be noted that this area is the interactive area of ​​the window itself, not the interface mirrored on the mobile terminal. In other words, the responsive hotspot is not the interface mirrored on the mobile terminal, but a separate interactive area.

[0058] Furthermore, as shown in Figure 5, the floating mirror interface adapts to the portrait and landscape orientation of the mobile terminal application app itself. When users open long videos, map apps, movies, music apps, meeting apps, etc. on the mobile terminal for screen projection, it can support both portrait and landscape orientations. When the user clicks the "Portrait / Landscape" button with one finger, the floating mirror will be displayed in landscape mode. When the user clicks the "Portrait / Landscape" button again with one finger, the floating mirror will be displayed in portrait mode. This satisfies the user's needs in the local cockpit other than driver assistance. Moreover, personal data and privacy are only stored in the mobile app. The screen is projected when getting into the car and taken away with the mobile terminal when getting out of the car, so there is no need to worry about personal privacy, giving users a better human-vehicle interaction experience.

[0059] In summary, the floating mirror interaction method based on vehicle-to-grid interconnection proposed in this embodiment of the invention has the following beneficial effects:

[0060] (1) To address the lack of automotive cockpit ecosystem, communication between mobile terminals and vehicle terminals is achieved via USB data cable or WIFI, and data is transmitted via screen projection protocol, so that the mobile terminal ecosystem can be floated and mirrored on the vehicle system (central control screen), thus making up for the lack of vehicle system ecosystem.

[0061] (2) A floating mirror on the vehicle is realized through vehicle-to-vehicle interconnection. The floating mirror supports functions such as dragging, zooming, shrinking, maximizing, minimizing, switching between portrait and landscape modes, and reverse control at any position. For the scenario of mobile terminal and vehicle-to-vehicle interconnection, it achieves seamless integration with the local cockpit and the vehicle-to-vehicle cockpit, with a low learning threshold for users.

[0062] (3) Through vehicle-to-vehicle communication, the entire mobile application ecosystem and account system can be projected onto the vehicle system, enabling vehicle-side login-free access. Videos, movies, music, maps, and meetings can all be displayed on the vehicle system. Personal data and privacy are only in the mobile terminal APP. The screen can be projected when you get in the car and taken away with the mobile terminal when you get out of the car, so there is no need to worry about personal privacy. It is not limited by the viewing of the mobile terminal screen and provides an immersive viewing experience on the large screen of the vehicle system.

[0063] Next, the interaction device between a mobile terminal and a vehicle according to an embodiment of the present invention is described with reference to the accompanying drawings. Figure 6 is a block diagram of the interaction device between a mobile terminal and a vehicle provided according to an embodiment of the present application.

[0064] As shown in Figure 6, the floating mirror interaction device 60 based on vehicle-to-grid interconnection includes: a communication connection module 601, a receiving and display module 602, and a detection and execution module 603.

[0065] The communication connection module 601 is used to receive mirroring instructions from the mobile terminal after establishing a communication connection between the vehicle and the mobile terminal. The receiving and display module 602 is used to receive the transmitted data from the mobile terminal based on a preset projection protocol in response to the mirroring instructions, and display the transmitted data on the floating mirroring interface of the vehicle system. The detection and execution module 603 is used to detect the user's gesture actions in the response area of ​​the floating mirroring interface of the vehicle system, and execute the control commands corresponding to the gesture actions on the floating mirroring interface.

[0066] In some embodiments, the device further includes:

[0067] The judgment module is used to determine whether the mobile terminal and / or vehicle terminal meet the preset projection conditions before responding to the mirroring instruction; if the preset projection conditions are met, the vehicle terminal is controlled to enter the floating mirroring mode; otherwise, the mirroring instruction is rejected.

[0068] In some embodiments, the determining module further includes:

[0069] Before the vehicle-mounted system enters the floating mirror mode, a user confirmation prompt is displayed on the vehicle's infotainment system; upon receiving a user rejection, the mirror instruction is rejected.

[0070] In some embodiments, the preset screen mirroring condition is that the mobile terminal and / or the vehicle terminal are on the same local area network.

[0071] In some embodiments, the gesture action includes at least one of the following: window full-screen action, window minimize action, window edge-grabbing action, window close action, and window landscape action.

[0072] In some embodiments, the device further includes:

[0073] The floating mirror mobile interaction module is used to display the response area of ​​the vehicle's floating mirror when the user taps the floating mirror interface with a single finger; when the user long-presses the response area of ​​the floating mirror, the floating mirror interface will move on the vehicle according to the user's dragging trajectory; when the user releases the response area of ​​the floating mirror, the floating mirror interface will remain at the current position.

[0074] It should be noted that the foregoing explanation of the interaction method embodiment between the mobile terminal and the vehicle also applies to the interaction device between the mobile terminal and the vehicle in this embodiment, and will not be repeated here.

[0075] The interaction device between a mobile terminal and a vehicle according to embodiments of the present invention has the following beneficial effects:

[0076] (1) To address the lack of automotive cockpit ecosystem, communication between mobile terminals and vehicle terminals is achieved via USB data cable or WIFI, and data is transmitted via screen projection protocol, so that the mobile terminal ecosystem can be floated and mirrored on the vehicle system (central control screen), thus making up for the lack of vehicle system ecosystem.

[0077] (2) A floating mirror on the vehicle is realized through vehicle-to-vehicle interconnection. The floating mirror supports functions such as dragging, zooming, shrinking, maximizing, minimizing, switching between portrait and landscape modes, and reverse control at any position. For the scenario of mobile terminal and vehicle-to-vehicle interconnection, it achieves seamless integration with the local cockpit and the vehicle-to-vehicle cockpit, with a low learning threshold for users.

[0078] (3) Through vehicle-to-vehicle communication, the entire mobile application ecosystem and account system can be projected onto the vehicle system, enabling vehicle-side login-free access. Videos, movies, music, maps, and meetings can all be displayed on the vehicle system. Personal data and privacy are only in the mobile terminal APP. The screen can be projected when you get in the car and taken away with the mobile terminal when you get out of the car, so there is no need to worry about personal privacy. It is not limited by the viewing of the mobile terminal screen and provides an immersive viewing experience on the large screen of the vehicle system.

[0079] Figure 7 is a schematic diagram of the structure of a vehicle provided in an embodiment of this application. The electronic device may include a memory 701 and a processor 702, wherein the memory 701 stores a computer program that can run on the processor 702. The computer program is loaded and run by the processor to implement the interaction method between the mobile terminal and the vehicle provided in the above embodiments.

[0080] Furthermore, the vehicle controller also includes:

[0081] Communication interface 703 is used for communication between memory 701 and processor 702.

[0082] The memory 701 is used to store computer programs that can run on the processor 702.

[0083] The memory 701 may include high-speed RAM memory, and may also include non-transitory memory, such as at least one disk storage device.

[0084] If the memory 701, processor 702, and communication interface 703 are implemented independently, they can be interconnected via a bus to communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, only one thick line is used in Figure 7, but this does not indicate that there is only one bus or one type of bus.

[0085] Optionally, in a specific implementation, if the memory 701, processor 702, and communication interface 703 are integrated on a single chip, then the memory 701, processor 702, and communication interface 703 can communicate with each other through an internal interface.

[0086] The processor 702 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0087] This application also provides a computer program product, which, when executed by a processor, implements the above-described interaction method between a mobile terminal and a vehicle.

[0088] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the above-described method for interaction between a mobile terminal and a vehicle.

[0089] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0090] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0091] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0092] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-including system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0093] More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) with one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which the program can be printed, since the program can be obtained electronically by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0094] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0095] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0096] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0097] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A method for interaction between a mobile terminal and a vehicle, applied to the vehicle side, the method comprising: After establishing a communication connection between the vehicle and the mobile terminal, the vehicle receives the mirroring instruction from the mobile terminal. In response to the mirroring instruction, based on a preset projection protocol, the system receives the transmitted data from the mobile terminal and displays the transmitted data on the floating mirror interface of the vehicle system. The system detects the user's gesture in the response area of ​​the floating mirror of the vehicle's infotainment system and executes the control command corresponding to the gesture on the floating mirror interface.

2. The interaction method between a mobile terminal and a vehicle according to claim 1, wherein, Prior to responding to the mirroring instruction, the method further includes: Determine whether the mobile terminal and / or the vehicle terminal meet the preset screen projection conditions; If the preset projection conditions are met, the vehicle terminal is controlled to enter the floating mirror mode; otherwise, the mirror instruction is rejected.

3. The interaction method between a mobile terminal and a vehicle according to claim 2, wherein, Before controlling the vehicle to enter the floating mirror mode, the method further includes: A user confirmation prompt is displayed on the vehicle's infotainment system. The image instruction is rejected upon receiving a user's rejection.

4. The interaction method between a mobile terminal and a vehicle according to claim 2, wherein, The preset screen projection condition is that the mobile terminal and / or the vehicle terminal are on the same local area network.

5. The interaction method between a mobile terminal and a vehicle according to claim 1, wherein, The gesture actions include at least one of the following: full-screen window action, minimize window action, snap window action, close window action, and landscape window action.

6. The interaction method between a mobile terminal and a vehicle according to claim 1, wherein, The method further includes: When a user taps the floating image interface of the vehicle system with a single finger, the response area of ​​the floating image of the vehicle system is displayed; When a user long-presses the response area of ​​the floating mirror of the vehicle system with a single finger, the interface of the floating mirror of the vehicle system will move on the vehicle system according to the user's dragging trajectory; When the user releases the response area of ​​the vehicle's floating image, the interface of the vehicle's floating image remains at the current position.

7. An interaction device between a mobile terminal and a vehicle, comprising: A communication connection module is used to establish a communication connection between the vehicle and the mobile terminal and to receive the mirroring instruction from the mobile terminal. The receiving and display module is used to respond to the mirroring instruction, receive the transmitted data from the mobile terminal based on a preset projection protocol, and display the transmitted data on the floating mirroring interface of the vehicle system. The detection and execution module is used to detect the user's gesture in the response area of ​​the floating mirror of the vehicle system, and execute the control command corresponding to the gesture on the floating mirror interface.

8. A vehicle comprising: A memory and a processor, wherein the memory stores a computer program executable on the processor, the computer program being loaded and executed by the processor to implement the interaction method between a mobile terminal and a vehicle as described in any one of claims 1-6.

9. A computer program product comprising computer instructions that instruct a processor to perform the interaction method between a mobile terminal and a vehicle as described in any one of claims 1-6.

10. A computer-readable storage medium storing a computer program that, when executed by a processor, implements the interaction method between a mobile terminal and a vehicle as described in any one of claims 1-6.

Images