Method and device for realizing reverse control of mobile terminal by in-vehicle infotainment device

Abstract

The invention relates to the technical field of data processing, and discloses a method and device for achieving reverse control over a mobile terminal by a vehicle infotainment device, and the method comprises the steps: constructing a screen projection link between the vehicle infotainment device and the mobile terminal, obtaining the first screen size information of the mobile terminal through the screen projection link, and obtaining the first screen size information of the mobile terminal according to the first screen size information; calculating second screen size information of screen projection of the mobile terminal on the vehicle-mounted terminal, obtaining a preset standard HID descriptor, transforming the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, mapping the mobile terminal to the vehicle-mounted terminal according to the target HID descriptor, obtaining touch screen operation information triggered by a user on the vehicle-mounted terminal, and displaying the touch screen operation information on the vehicle-mounted terminal. And controlling the mobile terminal based on the touch screen operation information. Therefore, by implementing the method, the accuracy and the efficiency of controlling the mobile terminal through the vehicle-mounted terminal can be improved, the compatibility and the universality are improved, the convenience of controlling the mobile terminal through the vehicle-mounted terminal is improved, the operation complexity is reduced, and the driving safety is improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a method and device for realizing reverse control of a vehicle computer over a mobile terminal. Background Art

[0002] With the rapid development of modern technology, smartphones have become an indispensable part of people's daily lives. People have the need to use mobile phones in various scenarios. For example, in driving scenarios, drivers often need to operate their mobile phones while driving, such as answering calls, navigating, adjusting music, etc. However, operating a mobile phone through traditional mobile phone operations while driving has many inconveniences and poses a traffic safety hazard.

[0003] In order to solve the above problems, a variety of in-vehicle systems have appeared on the market, aiming to control mobile phones to a certain extent through in-vehicle devices. However, most of these systems rely on wired connections or specific applications, and the operation is relatively complicated. Although some systems have achieved some control functions for mobile phones, they often cannot simulate all touch inputs of mobile phones, resulting in users still having to frequently operate the mobile phone itself, which is inconvenient for users to use. Therefore, it is particularly important to propose a technical solution that can improve the convenience of controlling mobile terminals through car computers and reduce the complexity of operations. Summary of the invention

[0004] The present invention provides a method and device for realizing reverse control of a mobile terminal by a vehicle computer, which can help improve the convenience of controlling the mobile terminal by the vehicle computer and reduce the complexity of operation.

[0005] In order to solve the above technical problems, the first aspect of the present invention discloses a method for realizing reverse control of a mobile terminal by a vehicle computer, the method comprising:

[0006] Establishing a screen projection link between the vehicle computer and the mobile terminal, and obtaining first screen size information of the mobile terminal through the screen projection link;

[0007] Calculating second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information;

[0008] Acquire a preset standard HID descriptor, modify the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, and map the mobile terminal to the vehicle computer according to the target HID descriptor;

[0009] The touch screen operation information triggered by the user on the vehicle computer is obtained, and the mobile terminal is controlled based on the touch screen operation information.

[0010] As an optional implementation manner, in the first aspect of the present invention, the second screen size information includes a second screen width and a second screen height;

[0011] The step of modifying the standard HID descriptor based on the second screen size information to obtain a target HID descriptor includes:

[0012] According to the second screen size information, the horizontal axis movement length corresponding to the standard HID descriptor is transformed into the second screen width, and the vertical axis movement length corresponding to the standard HID descriptor is transformed into the second screen height;

[0013] The coordinate input type of the standard HID descriptor is transformed from a relative input type to an absolute input type to obtain a target HID descriptor.

[0014] As an optional implementation manner, in the first aspect of the present invention, the first screen size information includes a first screen width and a first screen height;

[0015] The calculating, according to the first screen size information, second screen size information for projecting the screen by the mobile terminal on the vehicle computer includes:

[0016] According to the first screen width, a second screen width of the mobile terminal for screen projection on the vehicle computer is calculated, and according to the first screen height, a second screen height of the mobile terminal for screen projection on the vehicle computer is calculated, wherein the second screen width includes eight lower bits of second screen width data and eight higher bits of second screen width data, and the second screen height includes eight lower bits of second screen height data and eight higher bits of second screen height data;

[0017] The second screen size information of the mobile terminal for screen projection on the vehicle computer is determined according to the second screen width and the second screen height.

[0018] As an optional implementation, in the first aspect of the present invention, the acquiring of touch screen operation information triggered by the user on the vehicle computer includes:

[0019] Acquire a screen operation signal triggered by a user on the vehicle computer and the vehicle computer coordinates corresponding to the screen operation signal;

[0020] Determine the display area size information corresponding to the vehicle computer, and calculate the conversion of the vehicle computer coordinates to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, wherein the display area size information includes the display area width and the display area height;

[0021] According to the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, the touch screen operation information triggered by the user on the vehicle computer is determined.

[0022] As an optional implementation, in the first aspect of the present invention, the step of calculating the conversion of the vehicle computer coordinates to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal includes:

[0023] Calculate the vehicle computer coordinates converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information, the vehicle computer coordinates corresponding to the screen operation signal, and a preset coordinate conversion calculation formula, wherein the coordinate conversion calculation formula includes a horizontal coordinate conversion calculation formula and a vertical coordinate conversion calculation formula, and the mobile terminal coordinates include a mobile terminal horizontal coordinate and a mobile terminal vertical coordinate;

[0024] And, the abscissa conversion calculation formula includes:

[0025] MobileTouchX=MT_Width*car head unit X coordinate÷display area width

[0026] The vertical coordinate conversion calculation formula includes:

[0027] MobileTouchY=MT_Height*Y coordinate of vehicle machine÷height of display area

[0028] Among them, MobileTouchX represents the horizontal coordinate of the mobile terminal, MobileTouchY represents the vertical coordinate of the mobile terminal, MT_Width represents the first screen width, and MT_Height represents the first screen height.

[0029] As an optional implementation manner, in the first aspect of the present invention, controlling the mobile terminal based on the touch screen operation information includes:

[0030] Determine an operation signal type corresponding to the screen operation signal, and determine flag data corresponding to the screen operation signal according to the operation signal type, wherein the operation signal type includes a screen click signal type or a screen slide signal type;

[0031] Generate a HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag data, and send the HID instruction to the mobile terminal through the screen projection link;

[0032] After receiving the HID instruction, the mobile terminal parses the HID instruction and controls the mobile terminal based on the parsed HID instruction.

[0033] As an optional implementation, in the first aspect of the present invention, generating a HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag data includes:

[0034] Calculating coordinate data corresponding to the coordinates of the mobile terminal, the coordinate data including horizontal coordinate data and vertical coordinate data;

[0035] Generate a HID instruction for the mobile terminal according to the coordinate data corresponding to the coordinates of the mobile terminal and the flag data;

[0036] And, mapping the mobile terminal to the vehicle computer according to the target HID descriptor includes:

[0037] The target HID descriptor is registered in the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal, and the mobile terminal is mapped to the vehicle computer based on the communication protocol stack, wherein the communication protocol stack includes a Bluetooth protocol stack.

[0038] A second aspect of the present invention discloses a device for realizing reverse control of a mobile terminal by a vehicle computer, the device comprising:

[0039] A construction module, used to construct a screen projection link between the vehicle computer and the mobile terminal, and obtain the first screen size information of the mobile terminal through the screen projection link;

[0040] A calculation module, used to calculate second screen size information of the mobile terminal for screen projection on the vehicle machine according to the first screen size information;

[0041] an acquisition module, configured to acquire a preset standard HID descriptor, transform the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, and map the mobile terminal to the vehicle computer according to the target HID descriptor;

[0042] The acquisition module is also used to acquire touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information.

[0043] As an optional implementation manner, in the second aspect of the present invention, the second screen size information includes a second screen width and a second screen height;

[0044] The acquisition module modifies the standard HID descriptor based on the second screen size information to obtain the target HID descriptor in the following manner:

[0045] According to the second screen size information, the horizontal axis movement length corresponding to the standard HID descriptor is transformed into the second screen width, and the vertical axis movement length corresponding to the standard HID descriptor is transformed into the second screen height;

[0046] The coordinate input type of the standard HID descriptor is transformed from a relative input type to an absolute input type to obtain a target HID descriptor.

[0047] As an optional implementation manner, in the second aspect of the present invention, the first screen size information includes a first screen width and a first screen height;

[0048] The method in which the calculation module calculates the second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information specifically includes:

[0049] According to the first screen width, a second screen width of the mobile terminal for screen projection on the vehicle computer is calculated, and according to the first screen height, a second screen height of the mobile terminal for screen projection on the vehicle computer is calculated, wherein the second screen width includes eight lower bits of second screen width data and eight higher bits of second screen width data, and the second screen height includes eight lower bits of second screen height data and eight higher bits of second screen height data;

[0050] The second screen size information of the mobile terminal for screen projection on the vehicle computer is determined according to the second screen width and the second screen height.

[0051] As an optional implementation, in the second aspect of the present invention, the manner in which the acquisition module acquires the touch screen operation information triggered by the user on the vehicle computer specifically includes:

[0052] Acquire a screen operation signal triggered by a user on the vehicle computer and the vehicle computer coordinates corresponding to the screen operation signal;

[0053] Determine the display area size information corresponding to the vehicle computer, and calculate the conversion of the vehicle computer coordinates to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, wherein the display area size information includes the display area width and the display area height;

[0054] According to the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, the touch screen operation information triggered by the user on the vehicle computer is determined.

[0055] As an optional implementation, in the second aspect of the present invention, the acquisition module calculates the conversion of the vehicle computer coordinates to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, specifically including:

[0056] Calculate the vehicle computer coordinates converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information, the vehicle computer coordinates corresponding to the screen operation signal, and a preset coordinate conversion calculation formula, wherein the coordinate conversion calculation formula includes a horizontal coordinate conversion calculation formula and a vertical coordinate conversion calculation formula, and the mobile terminal coordinates include a mobile terminal horizontal coordinate and a mobile terminal vertical coordinate;

[0057] And, the abscissa conversion calculation formula includes:

[0058] MobileTouchX=MT_Width*car head unit X coordinate÷display area width

[0059] The vertical coordinate conversion calculation formula includes:

[0060] MobileTouchY=MT_height*Y coordinate of vehicle machine÷height of display area

[0061] Among them, MobileTouchX represents the horizontal coordinate of the mobile terminal, MobileTouchY represents the vertical coordinate of the mobile terminal, MT_Width represents the first screen width, and MT_height represents the first screen height.

[0062] As an optional implementation, in the second aspect of the present invention, the manner in which the acquisition module controls the mobile terminal based on the touch screen operation information specifically includes:

[0063] Determine an operation signal type corresponding to the screen operation signal, and determine flag data corresponding to the screen operation signal according to the operation signal type, wherein the operation signal type includes a screen click signal type or a screen slide signal type;

[0064] Generate a HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag data, and send the HID instruction to the mobile terminal through the screen projection link;

[0065] After receiving the HID instruction, the mobile terminal parses the HID instruction and controls the mobile terminal based on the parsed HID instruction.

[0066] As an optional implementation, in the second aspect of the present invention, the acquisition module generates a HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag data, specifically including:

[0067] Calculating coordinate data corresponding to the coordinates of the mobile terminal, the coordinate data including horizontal coordinate data and vertical coordinate data;

[0068] Generate a HID instruction for the mobile terminal according to the coordinate data corresponding to the coordinates of the mobile terminal and the flag data;

[0069] And, the acquisition module maps the mobile terminal to the vehicle computer according to the target HID descriptor specifically includes:

[0070] The target HID descriptor is registered in the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal, and the mobile terminal is mapped to the vehicle computer based on the communication protocol stack, wherein the communication protocol stack includes a Bluetooth protocol stack.

[0071] The third aspect of the present invention discloses another device for realizing reverse control of a mobile terminal by a vehicle computer, the device comprising:

[0072] A memory storing executable program code;

[0073] a processor coupled to the memory;

[0074] The processor calls the executable program code stored in the memory to execute the method for realizing reverse control of the mobile terminal by the vehicle computer disclosed in the first aspect of the present invention.

[0075] The fourth aspect of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute the method for realizing reverse control of a mobile terminal by a vehicle computer disclosed in the first aspect of the present invention.

[0076] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0077] In an embodiment of the present invention, a screen projection link is constructed between the vehicle computer and the mobile terminal, and the first screen size information of the mobile terminal is obtained through the screen projection link. According to the first screen size information, the second screen size information of the mobile terminal for screen projection on the vehicle computer is calculated, and a preset standard HID descriptor is obtained. The standard HID descriptor is modified based on the second screen size information to obtain a target HID descriptor, and the mobile terminal is mapped to the vehicle computer according to the target HID descriptor, and the touch screen operation information triggered by the user on the vehicle computer is obtained, and the mobile terminal is controlled based on the touch screen operation information. It can be seen that the implementation of the present invention can improve the accuracy and efficiency of controlling the mobile terminal through the vehicle computer through the modification of the HID descriptor. Through the Bluetooth-based screen projection link, there is no need to install third-party software, which improves compatibility and versatility, and can improve the convenience of controlling the mobile terminal through the vehicle computer and reduce the complexity of operation. At the same time, it can enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0079] Figure 1 It is a flow chart of a method for realizing reverse control of a mobile terminal by a vehicle computer disclosed in an embodiment of the present invention;

[0080] Figure 2 It is a flow chart of another method for realizing reverse control of a mobile terminal by a vehicle computer disclosed in an embodiment of the present invention;

[0081] Figure 3 It is a structural schematic diagram of a device for realizing reverse control of a mobile terminal by a vehicle computer disclosed in an embodiment of the present invention;

[0082] Figure 4 It is a structural schematic diagram of another device for realizing reverse control of a mobile terminal by a vehicle computer disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0083] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0084] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or end including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or ends.

[0085] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0086] The present invention discloses a method and device for realizing reverse control of a mobile terminal by a vehicle computer, which can improve the accuracy and efficiency of controlling a mobile terminal by a vehicle computer by modifying a HID descriptor, and through a projection link based on Bluetooth, there is no need to install third-party software, thereby improving compatibility and versatility, and can improve the convenience of controlling a mobile terminal by a vehicle computer, reduce the complexity of operation, and enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety. The following are detailed descriptions respectively.

[0087] Embodiment 1

[0088] See also Figure 1 , Figure 1 The following is a flow chart of a method for realizing reverse control of a mobile terminal by a vehicle computer according to an embodiment of the present invention. Figure 1 The method for realizing reverse control of a mobile terminal by a vehicle computer can be applied to a device for realizing reverse control of a mobile terminal by a vehicle computer. The device for realizing reverse control of a mobile terminal by a vehicle computer can include an intelligent server or intelligent platform for realizing screen projection connection control between the vehicle computer and the mobile terminal. The intelligent server includes a local server or a cloud server, which is not limited in the embodiments of the present invention. Figure 1 As shown, the method for realizing reverse control of the mobile terminal by the vehicle computer may include the following operations:

[0089] 101. Build a screen projection link between the vehicle computer and the mobile terminal, and obtain first screen size information of the mobile terminal through the screen projection link.

[0090] In an embodiment of the present invention, optionally, the mobile terminal may include one or more of a smart mobile phone, a tablet computer, a smart wearable device, etc. The smart mobile phone may include an Android phone and / or an iPhone phone. The screen projection link between the vehicle computer and the mobile terminal may be a screen projection link based on Bluetooth communication, or a screen projection link based on WIFI communication, 4G communication or 5G communication. The first screen size information of the mobile terminal may include the first screen width and the first screen height of the mobile terminal, which is not limited by the present invention.

[0091] 102. Calculate second screen size information of the mobile terminal for screen projection on the vehicle computer based on the first screen size information.

[0092] In an embodiment of the present invention, optionally, the second screen size information may represent screen size information of projecting the screen size of the mobile terminal in proportion to the screen size of the vehicle computer. The second screen size information may include a second screen width and a second screen height. Optionally, the second screen size information may be larger than the first screen size information, smaller than the first screen size information, or equal to the first screen size information, and the present invention does not limit this.

[0093] 103. Obtain a preset standard HID descriptor, modify the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, and map the mobile terminal to the vehicle computer according to the target HID descriptor.

[0094] In an embodiment of the present invention, optionally, the preset standard HID descriptor can adopt a HID descriptor commonly used in the industry. For example, the common mouse HID device descriptor has a moving range of (-127, -127) on the X-axis and the Y-axis. The standard HID descriptor is modified based on the second screen size information to obtain a target HID descriptor, that is, the moving range of the standard HID descriptor on the X-axis and the Y-axis is modified to a range corresponding to the second screen size information based on the second screen size information, and the present invention is not limited thereto.

[0095] 104. Acquire touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information.

[0096] In an embodiment of the present invention, optionally, the touch screen operation information triggered by the user on the vehicle computer may include click operation information and / or sliding operation information. Based on the click operation information and / or sliding operation information triggered by the user on the vehicle computer, the mobile terminal can be reversely controlled to achieve reverse control of the mobile terminal by operating the mapped mobile terminal content on the vehicle computer. The present invention is not limited to this.

[0097] It can be seen that the implementation Figure 1The described method for realizing reverse control of a mobile terminal by a vehicle computer can build a screen projection link between the vehicle computer and the mobile terminal, and obtain first screen size information of the mobile terminal through the screen projection link, calculate second screen size information of the mobile terminal for screen projection on the vehicle computer based on the first screen size information, obtain a preset standard HID descriptor, modify the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, and map the mobile terminal to the vehicle computer based on the target HID descriptor, obtain touch screen operation information triggered by a user on the vehicle computer, and control the mobile terminal based on the touch screen operation information. The accuracy and efficiency of controlling the mobile terminal through the vehicle computer can be improved by modifying the HID descriptor. Through the Bluetooth-based screen projection link, there is no need to install third-party software, thereby improving compatibility and versatility, and can improve the convenience of controlling the mobile terminal through the vehicle computer and reduce the complexity of operation. At the same time, it can enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety.

[0098] In an optional embodiment, the first screen size information includes a first screen width and a first screen height;

[0099] Calculating the second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information may include the following operations:

[0100] According to the first screen width, calculate the second screen width of the mobile terminal for screen projection on the vehicle computer, and according to the first screen height, calculate the second screen height of the mobile terminal for screen projection on the vehicle computer, the second screen width includes the lower eight bits of the second screen width data and the higher eight bits of the second screen width data, and the second screen height includes the lower eight bits of the second screen height data and the higher eight bits of the second screen height data;

[0101] The second screen size information of the mobile terminal for screen projection on the vehicle machine is determined according to the second screen width and the second screen height.

[0102] In this optional embodiment, optionally, the first screen size information may include a first screen width and a first screen height, and the second screen size information may represent the screen size information of projecting the screen size of the mobile terminal in proportion to the vehicle computer, that is, the second screen width may be greater than, less than or equal to the first screen width, and the second screen height may be greater than, less than or equal to the first screen height. The specific values ​​of the second screen width and the second screen height may be determined according to the size of the vehicle computer screen, and may also be manually adjusted by the user, and this embodiment does not limit this.

[0103] In this optional embodiment, optionally, the second screen width may include the lower eight bits of the second screen width data and the higher eight bits of the second screen width data, and the second screen height may include the lower eight bits of the second screen height data and the higher eight bits of the second screen height data, that is:

[0104] maxXLsb=MT_Width

[0105] maxXMsb=MT_Width>>8

[0106] maxYLsb=MT_Height

[0107] maxYMsb=MT_Height>>8

[0108] It can be seen that implementing this optional embodiment can calculate the second screen width of the mobile terminal for projecting the screen on the vehicle computer according to the first screen width, and calculate the second screen height of the mobile terminal for projecting the screen on the vehicle computer according to the first screen height, the second screen width includes the lower eight bits of the second screen width data and the upper eight bits of the second screen width data, the second screen height includes the lower eight bits of the second screen height data and the upper eight bits of the second screen height data, and the second screen size information of the mobile terminal for projecting the screen on the vehicle computer is determined according to the second screen width and the second screen height, and the projection screen size on the vehicle computer can be determined according to the mobile terminal screen, and the upper and lower eight bits of the screen width and height data can be determined, thereby improving the accuracy of determining the projection screen size, and at the same time, can improve the efficiency and accuracy of subsequent modification of the HID descriptor.

[0109] In another optional embodiment, obtaining the touch screen operation information triggered by the user on the vehicle computer may include the following operations:

[0110] Obtain the screen operation signal triggered by the user on the vehicle computer and the vehicle computer coordinates corresponding to the screen operation signal;

[0111] Determine the display area size information corresponding to the vehicle computer, and calculate the vehicle computer coordinates converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, the display area size information including the display area width and the display area height;

[0112] According to the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, the touch screen operation information triggered by the user on the vehicle computer is determined.

[0113] In this optional embodiment, optionally, the screen operation signal triggered by the user on the vehicle computer may include a screen click operation signal or a screen sliding operation signal, the vehicle computer coordinates corresponding to the screen operation signal may indicate the coordinates when the user triggers the screen operation signal on the vehicle computer screen, the display area size information corresponding to the vehicle computer may include the display area width and the display area height, the mobile terminal coordinates may indicate the coordinates when the user triggers the screen operation signal on the vehicle computer screen converted to the coordinates of the corresponding position on the mobile terminal screen, and the vehicle computer coordinates may be converted to the mobile terminal coordinates corresponding to the mobile terminal according to a preset coordinate conversion calculation formula, and the touch screen operation information triggered by the user on the vehicle computer may include the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, which are not limited in this embodiment.

[0114] It can be seen that implementing this optional embodiment can obtain the screen operation signal triggered by the user on the vehicle computer and the vehicle computer coordinates corresponding to the screen operation signal, determine the display area size information corresponding to the vehicle computer, and calculate the vehicle computer coordinates to convert to the mobile terminal coordinates corresponding to the mobile terminal based on the display area size information and the vehicle computer coordinates corresponding to the screen operation signal. The display area size information includes the display area width and the display area height. According to the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, the touch screen operation information triggered by the user on the vehicle computer is determined. The operation signal triggered by the user on the vehicle computer and the corresponding coordinates can be obtained, and then the coordinates mapped to the mobile terminal screen are calculated, thereby improving the accuracy and efficiency of controlling the mobile terminal through the vehicle computer.

[0115] In yet another optional embodiment, according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, calculating the conversion of the vehicle computer coordinates to the mobile terminal coordinates corresponding to the mobile terminal may include the following operations:

[0116] Calculate the vehicle computer coordinates to be converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information, the vehicle computer coordinates corresponding to the screen operation signal, and a preset coordinate conversion calculation formula, the coordinate conversion calculation formula includes a horizontal coordinate conversion calculation formula and a vertical coordinate conversion calculation formula, and the mobile terminal coordinates include a mobile terminal horizontal coordinate and a mobile terminal vertical coordinate;

[0117] And, the abscissa conversion calculation formula includes:

[0118] MobileTouchX=MT_Width*car head unit X coordinate÷display area width

[0119] The vertical coordinate conversion calculation formula includes:

[0120] MobileTouchY=MT_height*Y coordinate of vehicle machine÷height of display area

[0121] Among them, MobileTouchX represents the horizontal coordinate of the mobile terminal, MobileTouchY represents the vertical coordinate of the mobile terminal, MT_Width represents the width of the first screen, and MT_height represents the height of the first screen.

[0122] In this optional embodiment, optionally, the display area size information and the vehicle computer coordinates corresponding to the screen operation signal can be calculated according to a preset coordinate conversion calculation formula to obtain the vehicle computer coordinates converted to the mobile terminal coordinates corresponding to the mobile terminal. The coordinate conversion calculation formula may include a horizontal coordinate conversion calculation formula and a vertical coordinate conversion calculation formula. The mobile terminal coordinates may include a mobile terminal horizontal coordinate and a mobile terminal vertical coordinate. In the horizontal coordinate conversion calculation formula, MobileTouchX represents the horizontal coordinate of the mobile terminal, MT_Width represents the first screen width, that is, the screen width of the mobile terminal, the vehicle computer X coordinate represents the horizontal coordinate of the vehicle computer coordinate corresponding to the screen operation signal, and in the vertical coordinate conversion calculation formula, MobileTouchY represents the vertical coordinate of the mobile terminal, MT_Height represents the first screen height, that is, the screen height of the mobile terminal, and the vehicle computer Y coordinate represents the vertical coordinate of the vehicle computer coordinate corresponding to the screen operation signal. This embodiment does not limit this.

[0123] It can be seen that the implementation of this optional embodiment can convert the vehicle computer coordinates into the mobile terminal coordinates corresponding to the mobile terminal through a preset calculation formula, which can improve the accuracy and efficiency of controlling the mobile terminal through the vehicle computer.

[0124] In yet another optional embodiment, controlling the mobile terminal based on the touch screen operation information may include the following operations:

[0125] Determine the operation signal type corresponding to the screen operation signal, and determine the flag bit data corresponding to the screen operation signal according to the operation signal type, where the operation signal type includes a screen click signal type or a screen slide signal type;

[0126] Generate a HID command for the mobile terminal according to the coordinates and flag data of the mobile terminal, and send the HID command to the mobile terminal through the screen projection link;

[0127] After receiving the HID instruction, the mobile terminal parses the HID instruction and controls the mobile terminal based on the parsed HID instruction.

[0128] In this optional embodiment, optionally, the operation signal type corresponding to the screen operation signal may include a screen click signal type or a screen sliding signal type, and the flag data corresponding to the screen operation signal may be used to indicate a mouse press or lift action corresponding to the screen operation signal, for example, the flag data = 0x01 or 0x00, wherein the flag data = 0x01 may indicate a mouse press action corresponding to the screen operation signal, and the flag data = 0x00 may indicate a mouse lift action corresponding to the screen operation signal, and this embodiment does not limit this.

[0129] In this optional embodiment, optionally, the HID instruction for the mobile terminal may include flag data, high eight-bit data and low eight-bit data corresponding to the horizontal and vertical coordinates of the mobile terminal coordinates. When the mobile terminal receives the HID instruction, the HID instruction is parsed, and the mobile terminal is controlled based on the parsed HID instruction, so that the mobile terminal executes the operation triggered by the user on the vehicle screen. This embodiment does not limit this.

[0130] It can be seen that the implementation of this optional embodiment can determine the operation signal type corresponding to the screen operation signal, and determine the flag data corresponding to the screen operation signal according to the operation signal type, the operation signal type includes a screen click signal type or a screen sliding signal type, and generate a HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag data, and send the HID instruction to the mobile terminal through the screen projection link. When the mobile terminal receives the HID instruction, the HID instruction is parsed and the mobile terminal is controlled based on the parsed HID instruction. According to the click or sliding operation triggered by the user and the corresponding coordinates, a control instruction can be sent to the mobile terminal to control the mobile terminal, thereby improving the accuracy and efficiency of controlling the mobile terminal through the vehicle computer, enabling the driver to control the mobile terminal more conveniently during driving, and improving driving safety.

[0131] In yet another optional embodiment, generating a HID instruction for a mobile terminal according to the mobile terminal coordinates and the flag data may include the following operations:

[0132] Calculate coordinate data corresponding to the coordinates of the mobile terminal, the coordinate data including horizontal coordinate data and vertical coordinate data;

[0133] Generate a HID instruction for the mobile terminal according to the coordinate data and flag data corresponding to the coordinates of the mobile terminal;

[0134] And, mapping the mobile terminal to the vehicle computer according to the target HID descriptor may include the following operations:

[0135] The target HID descriptor is registered in the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal, and the mobile terminal is mapped to the vehicle computer based on the communication protocol stack, and the communication protocol stack includes a Bluetooth protocol stack.

[0136] In this optional embodiment, optionally, the coordinate data corresponding to the coordinates of the mobile terminal may include horizontal coordinate data and vertical coordinate data, the horizontal coordinate data may include high-order eight-bit data of the horizontal coordinate and low-order eight-bit data of the horizontal coordinate, and the vertical coordinate data may include high-order eight-bit data of the vertical coordinate and low-order eight-bit data of the vertical coordinate. According to the coordinate data and flag data corresponding to the coordinates of the mobile terminal, a HID instruction for the mobile terminal is generated. The format of the HID instruction for the mobile terminal is: [flag data, low-order eight-bit data of the horizontal coordinate, high-order eight-bit data of the horizontal coordinate, low-order eight-bit data of the vertical coordinate, high-order eight-bit data of the vertical coordinate], which is not limited in this embodiment.

[0137] In this optional embodiment, the target HID descriptor may be optionally registered in the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal. Taking an iPhone as an example, the registration method includes:

[0138] BluetoothHidDeviceAppSdpSettings sdp=new

[0139] BluetoothHidDeviceAppSdpSettings(NAME,DESCRIPTION,PROVIDER,BluetoothHidDevice.SUBCLASS1_COMBO,HidConsts.IOS_TOUCH_SCREEN);

[0140] BluetoothAdapter bluetoothAdapter=BluetoothAdapter.getDefaultAdapter();

[0141] bluetoothAdapter.getProfileProxy(context,mProfileServiceListener,BluetoothProfile.HID_DEVICE);

[0142] Among them, the communication protocol stack may include a Bluetooth protocol stack, and may also include a WIFI communication protocol stack, a 4G communication protocol stack or a 5G communication protocol stack, which is not limited in this embodiment.

[0143] It can be seen that the implementation of this optional embodiment can calculate the coordinate data corresponding to the coordinates of the mobile terminal, the coordinate data including horizontal coordinate data and vertical coordinate data, and generate a HID instruction for the mobile terminal according to the coordinate data and flag data corresponding to the coordinates of the mobile terminal, which can improve the accuracy of the generated HID instruction, thereby improving the accuracy and efficiency of controlling the mobile terminal through the vehicle computer, registering the target HID descriptor to the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal, and mapping the mobile terminal to the vehicle computer based on the communication protocol stack. The communication protocol stack includes a Bluetooth protocol stack. Through the Bluetooth-based screen projection link, there is no need to install third-party software, thereby improving compatibility and versatility, and can improve the convenience of controlling the mobile terminal through the vehicle computer and reduce the complexity of operation. At the same time, it can enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety.

[0144] Embodiment 2

[0145] See also Figure 2 , Figure 2 The following is a flow chart of a method for realizing reverse control of a mobile terminal by a vehicle computer according to an embodiment of the present invention. Figure 2 The method for realizing reverse control of a mobile terminal by a vehicle computer can be applied to a device for realizing reverse control of a mobile terminal by a vehicle computer. The device for realizing reverse control of a mobile terminal by a vehicle computer can include an intelligent server or intelligent platform for realizing screen projection connection control between the vehicle computer and the mobile terminal. The intelligent server includes a local server or a cloud server, which is not limited in the embodiments of the present invention. Figure 2 As shown, the method for realizing reverse control of the mobile terminal by the vehicle computer may include the following operations:

[0146] 201. Construct a screen projection link between the vehicle computer and the mobile terminal, and obtain first screen size information of the mobile terminal through the screen projection link.

[0147] 202. Calculate second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information.

[0148] 203. Obtain a preset standard HID descriptor, and according to the second screen size information, transform the horizontal axis movement length corresponding to the standard HID descriptor into the second screen width, and transform the vertical axis movement length corresponding to the standard HID descriptor into the second screen height.

[0149] In an embodiment of the present invention, optionally, the second screen size information may include a second screen width and a second screen height, and the data corresponding to the second screen width may be divided into eight lower bits of second screen width data and eight higher bits of second screen width data, and the data corresponding to the second screen height may be divided into eight lower bits of second screen height data and eight higher bits of second screen height data, and the present invention is not limited thereto.

[0150] In the embodiment of the present invention, optionally, taking the common mouse HID device descriptor in which the moving ranges of the X-axis and the Y-axis are both (-127, -127) as an example, the horizontal axis moving length corresponding to the standard HID descriptor is transformed into the second screen width, and the vertical axis moving length corresponding to the standard HID descriptor is transformed into the second screen height. It may include: the moving ranges of the mouse HID device descriptor in the X-axis and the Y-axis are both (-127, -127) to (0, Car_Width) and (0, Car_Height), that is, the horizontal axis moving range corresponding to the standard HID descriptor is transformed from (-127, -127) to (0, Car_Width), Car_Width represents the second screen width, and the vertical axis moving range corresponding to the standard HID descriptor is transformed from (-127, -127) to (0, Car_Height), Car_Height represents the second screen height, and the present invention is not limited thereto.

[0151] 204. The coordinate input type of the standard HID descriptor is transformed from a relative input type to an absolute input type to obtain a target HID descriptor.

[0152] In the embodiment of the present invention, optionally, the coordinate input type of the standard HID descriptor is transformed from a relative input type to an absolute input type, that is, the X and Y inputs of the mouse are transformed from 0x81, 0x06, / / Input (Data, Variable, Relative) relative input to 0x81, 0x02, / / Input (Data, Variable, Absolute) absolute input. Before the transformation, the mouse HID can only make relative displacement based on the coordinate point of the current mouse cursor to the surrounding (-127, 127) range. After the transformation, it can realize absolute displacement of any point in the range of (Car_Width, Car_Height), instead of relative movement based on the coordinate point of the mouse cursor in the range of (-127, 127). The standard HID descriptor before the transformation is:

[0153] 0x15,0x81, / / Logical Minimum(-127)

[0154] 0x25,0x7f, / / Logical Maximum(127)

[0155] 0x81,0x06, / / Input, Data, Variable, Relative (0x06)

[0156] The modified target HID descriptor:

[0157] 0x15,0x00, / / Logical Minimum(0)

[0158] 0x26,maxXLsb,maxXMsb, / / Logical Minimum(iPhoneWidth)

[0159] 0x15,0x00, / / Logical Minimum(0)

[0160] 0x26,maxYLsb,maxYMsb, / / Logical Minimum(iPhoneHeight)

[0161] 0x81,0x02, / / Input, Data, Variable, Absolute (0x02)

[0162] Among them, maxXLsb represents the lower eight bits of the second screen width, maxXMsb represents the upper eight bits of the second screen width, maxYLsb represents the lower eight bits of the second screen height, and maxYMsb represents the upper eight bits of the second screen height. Taking the movement of the mouse cursor from the coordinate point (0,0) to the coordinate point (500,500) as an example, before the modification, four HID events need to be sent, namely (127,127), (127,127), (127,127), and (119,119). After the modification, only one HID event (500,500) needs to be sent. That is, by modifying the configuration of HID, not only the frequency of HID sending is reduced, but also the control accuracy of the mobile terminal screen is improved.

[0163] 205. Map the mobile terminal to the vehicle computer according to the target HID descriptor.

[0164] 206. Acquire touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information.

[0165] In the embodiment of the present invention, for other descriptions of step 201, step 202, step 205 and step 206, please refer to the detailed description of step 101 to step 104 in the first embodiment, and the embodiment of the present invention will not be repeated here.

[0166] It can be seen that the implementation Figure 2The described method for realizing reverse control of a mobile terminal by a vehicle computer can build a screen projection link between the vehicle computer and the mobile terminal, and obtain the first screen size information of the mobile terminal through the screen projection link, calculate the second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information, obtain a preset standard HID descriptor, and transform the horizontal axis movement length corresponding to the standard HID descriptor into the second screen width according to the second screen size information, transform the vertical axis movement length corresponding to the standard HID descriptor into the second screen height, transform the coordinate input type of the standard HID descriptor from a relative input type to an absolute input type, obtain the target HID descriptor, and be able to perform HID projection based on the screen size of the mobile terminal. The descriptor is modified to improve the accuracy and smoothness of the user-triggered click and slide operations, improve the accuracy of controlling the mobile terminal through the vehicle computer, and map the mobile terminal to the vehicle computer according to the target HID descriptor to obtain the touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information. The accuracy and efficiency of controlling the mobile terminal through the vehicle computer can be improved by modifying the HID descriptor. Through the Bluetooth-based screen projection link, there is no need to install third-party software, which improves compatibility and versatility, and can improve the convenience of controlling the mobile terminal through the vehicle computer and reduce the complexity of operation. At the same time, it can enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety.

[0167] Embodiment 3

[0168] See also Figure 3 , Figure 3 1 is a schematic diagram of a structure of a device for realizing reverse control of a mobile terminal by a vehicle computer according to an embodiment of the present invention. Figure 3 The described device for realizing reverse control of the vehicle machine over the mobile terminal may include an intelligent server or intelligent platform for realizing screen projection connection control between the vehicle machine and the mobile terminal, and the intelligent server includes a local server or a cloud server, which is not limited in the embodiment of the present invention. Figure 3 As shown, the device for realizing reverse control of the mobile terminal by the vehicle computer may include:

[0169] A construction module 301 is used to construct a screen projection link between the vehicle machine and the mobile terminal, and obtain first screen size information of the mobile terminal through the screen projection link;

[0170] A calculation module 302, configured to calculate second screen size information for projection of the mobile terminal on the vehicle based on the first screen size information;

[0171] The acquisition module 303 is used to acquire a preset standard HID descriptor, transform the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, and map the mobile terminal to the vehicle computer according to the target HID descriptor;

[0172] The acquisition module 303 is also used to acquire the touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information.

[0173] It can be seen that implementation Figure 3 The described device for realizing reverse control of the mobile terminal by the vehicle computer can establish a screen projection link between the vehicle computer and the mobile terminal, and obtain the first screen size information of the mobile terminal through the screen projection link, calculate the second screen size information of the mobile terminal for screen projection on the vehicle computer based on the first screen size information, obtain the preset standard HID descriptor, modify the standard HID descriptor based on the second screen size information to obtain the target HID descriptor, and map the mobile terminal to the vehicle computer based on the target HID descriptor, obtain the touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information, and can improve the accuracy and efficiency of controlling the mobile terminal through the vehicle computer by modifying the HID descriptor. Through the Bluetooth-based screen projection link, there is no need to install third-party software, thereby improving compatibility and versatility, and can improve the convenience of controlling the mobile terminal through the vehicle computer and reduce the complexity of operation. At the same time, it can enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety.

[0174] In an optional embodiment, if Figure 3 As shown, the second screen size information includes a second screen width and a second screen height;

[0175] The acquisition module 303 transforms the standard HID descriptor based on the second screen size information to obtain the target HID descriptor in the following specific manners:

[0176] According to the second screen size information, the horizontal axis movement length corresponding to the standard HID descriptor is transformed into the second screen width, and the vertical axis movement length corresponding to the standard HID descriptor is transformed into the second screen height;

[0177] The coordinate input type of the standard HID descriptor is transformed from a relative input type to an absolute input type to obtain a target HID descriptor.

[0178] It can be seen that implementation Figure 3The described device for realizing reverse control of the mobile terminal by the vehicle computer can establish a screen projection link between the vehicle computer and the mobile terminal, and obtain the first screen size information of the mobile terminal through the screen projection link, calculate the second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information, obtain the preset standard HID descriptor, and according to the second screen size information, transform the horizontal axis movement length corresponding to the standard HID descriptor into the second screen width, transform the vertical axis movement length corresponding to the standard HID descriptor into the second screen height, transform the coordinate input type of the standard HID descriptor from the relative input type to the absolute input type, obtain the target HID descriptor, and be able to control the HID based on the screen size of the mobile terminal The descriptor is modified to improve the accuracy and smoothness of the user-triggered click and slide operations, improve the accuracy of controlling the mobile terminal through the vehicle computer, and map the mobile terminal to the vehicle computer according to the target HID descriptor to obtain the touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information. The accuracy and efficiency of controlling the mobile terminal through the vehicle computer can be improved by modifying the HID descriptor. Through the Bluetooth-based screen projection link, there is no need to install third-party software, which improves compatibility and versatility, and can improve the convenience of controlling the mobile terminal through the vehicle computer and reduce the complexity of operation. At the same time, it can enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety.

[0179] In another optional embodiment, Figure 3 As shown, the first screen size information includes a first screen width and a first screen height;

[0180] The specific manner in which the calculation module 302 calculates the second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information includes:

[0181] According to the first screen width, calculate the second screen width of the mobile terminal for screen projection on the vehicle computer, and according to the first screen height, calculate the second screen height of the mobile terminal for screen projection on the vehicle computer, the second screen width includes the lower eight bits of the second screen width data and the higher eight bits of the second screen width data, and the second screen height includes the lower eight bits of the second screen height data and the higher eight bits of the second screen height data;

[0182] The second screen size information of the mobile terminal for screen projection on the vehicle machine is determined according to the second screen width and the second screen height.

[0183] It can be seen that implementation Figure 3The described device for realizing reverse control of the mobile terminal by the vehicle computer can calculate the second screen width of the mobile terminal for screen projection on the vehicle computer according to the first screen width, and calculate the second screen height of the mobile terminal for screen projection on the vehicle computer according to the first screen height, the second screen width includes the lower eight bits of data of the second screen width and the upper eight bits of data of the second screen width, the second screen height includes the lower eight bits of data of the second screen height and the upper eight bits of data of the second screen height, and the second screen size information of the mobile terminal for screen projection on the vehicle computer is determined according to the second screen width and the second screen height, and the projection screen size on the vehicle computer can be determined according to the mobile terminal screen, and the upper and lower eight bits of the screen width and height data can be determined, thereby improving the accuracy of determining the projection screen size, and at the same time improving the efficiency and accuracy of subsequent modification of the HID descriptor.

[0184] In yet another optional embodiment, Figure 3 As shown, the specific method in which the acquisition module 303 acquires the touch screen operation information triggered by the user on the vehicle computer includes:

[0185] Obtain the screen operation signal triggered by the user on the vehicle computer and the vehicle computer coordinates corresponding to the screen operation signal;

[0186] Determine the display area size information corresponding to the vehicle computer, and calculate the vehicle computer coordinates converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, the display area size information including the display area width and the display area height;

[0187] According to the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, the touch screen operation information triggered by the user on the vehicle computer is determined.

[0188] It can be seen that implementation Figure 3 The described device for realizing reverse control of a mobile terminal by a vehicle computer can obtain the screen operation signal triggered by a user on the vehicle computer and the vehicle computer coordinates corresponding to the screen operation signal, determine the display area size information corresponding to the vehicle computer, and calculate the vehicle computer coordinates to be converted to the mobile terminal coordinates corresponding to the mobile terminal based on the display area size information and the vehicle computer coordinates corresponding to the screen operation signal. The display area size information includes the display area width and the display area height. According to the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, the touch screen operation information triggered by the user on the vehicle computer is determined. The operation signal triggered by the user on the vehicle computer and the corresponding coordinates can be obtained, and then the coordinates mapped to the mobile terminal screen are calculated, thereby improving the accuracy and efficiency of controlling the mobile terminal through the vehicle computer.

[0189] In yet another optional embodiment, Figure 3As shown, the specific method of the acquisition module 303 calculating the vehicle computer coordinates converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal includes:

[0190] Calculate the vehicle computer coordinates to be converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information, the vehicle computer coordinates corresponding to the screen operation signal, and a preset coordinate conversion calculation formula, the coordinate conversion calculation formula includes a horizontal coordinate conversion calculation formula and a vertical coordinate conversion calculation formula, and the mobile terminal coordinates include a mobile terminal horizontal coordinate and a mobile terminal vertical coordinate;

[0191] And, the abscissa conversion calculation formula includes:

[0192] MobileTouchX=MT_Width*car head unit X coordinate÷display area width

[0193] The vertical coordinate conversion calculation formula includes:

[0194] MobileTouchY=MT_height*Y coordinate of vehicle machine÷height of display area

[0195] Among them, MobileTouchX represents the horizontal coordinate of the mobile terminal, MobileTouchY represents the vertical coordinate of the mobile terminal, MT_Width represents the width of the first screen, and MT_height represents the height of the first screen.

[0196] It can be seen that implementation Figure 3 The described device for realizing reverse control of a mobile terminal by a vehicle computer can convert the vehicle computer coordinates into the mobile terminal coordinates corresponding to the mobile terminal by a preset calculation formula, thereby improving the accuracy and efficiency of controlling the mobile terminal by the vehicle computer.

[0197] In yet another optional embodiment, Figure 3 As shown, the specific manner in which the acquisition module 303 controls the mobile terminal based on the touch screen operation information includes:

[0198] Determine the operation signal type corresponding to the screen operation signal, and determine the flag bit data corresponding to the screen operation signal according to the operation signal type, where the operation signal type includes a screen click signal type or a screen slide signal type;

[0199] Generate a HID command for the mobile terminal according to the coordinates and flag data of the mobile terminal, and send the HID command to the mobile terminal through the screen projection link;

[0200] After receiving the HID instruction, the mobile terminal parses the HID instruction and controls the mobile terminal based on the parsed HID instruction.

[0201] It can be seen that the implementation Figure 3 The described device for realizing reverse control of a mobile terminal by a vehicle computer can determine the type of operation signal corresponding to a screen operation signal, and determine the flag data corresponding to the screen operation signal according to the type of operation signal. The operation signal type includes a screen click signal type or a screen sliding signal type. According to the coordinates of the mobile terminal and the flag data, a HID instruction for the mobile terminal is generated, and the HID instruction is sent to the mobile terminal through the screen projection link. When the mobile terminal receives the HID instruction, the HID instruction is parsed, and the mobile terminal is controlled based on the parsed HID instruction. According to the click or sliding operation triggered by the user and the corresponding coordinates, a control instruction can be sent to the mobile terminal to control the mobile terminal, thereby improving the accuracy and efficiency of controlling the mobile terminal through the vehicle computer, enabling the driver to control the mobile terminal more conveniently during driving, and improving driving safety.

[0202] In yet another optional embodiment, Figure 3 As shown, the specific manner in which the acquisition module 303 generates the HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag data includes:

[0203] Calculate coordinate data corresponding to the coordinates of the mobile terminal, the coordinate data including horizontal coordinate data and vertical coordinate data;

[0204] Generate a HID instruction for the mobile terminal according to the coordinate data and flag data corresponding to the coordinates of the mobile terminal;

[0205] And, the specific manner in which the acquisition module 303 maps the mobile terminal to the vehicle computer according to the target HID descriptor includes:

[0206] The target HID descriptor is registered in the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal, and the mobile terminal is mapped to the vehicle computer based on the communication protocol stack, and the communication protocol stack includes a Bluetooth protocol stack.

[0207] It can be seen that the implementation Figure 3The described device for realizing reverse control of the mobile terminal by the vehicle computer can calculate the coordinate data corresponding to the coordinates of the mobile terminal, the coordinate data including horizontal coordinate data and vertical coordinate data, and generate a HID instruction for the mobile terminal according to the coordinate data and flag data corresponding to the coordinates of the mobile terminal, which can improve the accuracy of the generated HID instruction, thereby improving the accuracy and efficiency of controlling the mobile terminal through the vehicle computer, registering the target HID descriptor in the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal, and mapping the mobile terminal to the vehicle computer based on the communication protocol stack, the communication protocol stack including the Bluetooth protocol stack, through the Bluetooth-based screen projection link, there is no need to install third-party software, thereby improving compatibility and versatility, and can improve the convenience of controlling the mobile terminal through the vehicle computer and reduce the complexity of operation, and at the same time enable the driver to control the mobile terminal more conveniently during driving, thereby improving driving safety.

[0208] Embodiment 4

[0209] See also Figure 4 , Figure 4 1 is a schematic diagram of the structure of another device for realizing reverse control of a mobile terminal by a vehicle computer according to an embodiment of the present invention. Figure 4 As shown, the device for realizing reverse control of the mobile terminal by the vehicle computer may include:

[0210] A memory 401 storing executable program codes;

[0211] a processor 402 coupled to the memory 401;

[0212] The processor 402 calls the executable program code stored in the memory 401 to execute the steps of the method for realizing reverse control of the mobile terminal by the vehicle computer as described in the first embodiment of the present invention or the second embodiment of the present invention.

[0213] Embodiment 5

[0214] An embodiment of the present invention discloses a computer storage medium storing computer instructions. When the computer instructions are called, they are used to execute the steps of the method for realizing reverse control of a mobile terminal by a vehicle computer as described in Embodiment 1 or Embodiment 2 of the present invention.

[0215] Embodiment 6

[0216] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps of the method for realizing reverse control of a mobile terminal by a vehicle computer as described in Embodiment 1 or Embodiment 2.

[0217] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0218] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or partly contributed to the prior art in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0219] Finally, it should be noted that the method and device for realizing reverse control of a mobile terminal by a vehicle computer disclosed in the embodiment of the present invention disclose only the preferred embodiments of the present invention, which are only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A method for realizing reverse control of a mobile terminal by a vehicle computer, characterized in that: The method comprises: Establishing a screen projection link between the vehicle computer and the mobile terminal, and obtaining first screen size information of the mobile terminal through the screen projection link; Calculating second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information; Acquire a preset standard HID descriptor, modify the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, and map the mobile terminal to the vehicle computer according to the target HID descriptor; The touch screen operation information triggered by the user on the vehicle computer is obtained, and the mobile terminal is controlled based on the touch screen operation information.

2. The method for realizing reverse control of a mobile terminal by a vehicle computer according to claim 1, characterized in that: The second screen size information includes a second screen width and a second screen height; The step of modifying the standard HID descriptor based on the second screen size information to obtain a target HID descriptor includes: According to the second screen size information, the horizontal axis movement length corresponding to the standard HID descriptor is transformed into the second screen width, and the vertical axis movement length corresponding to the standard HID descriptor is transformed into the second screen height; The coordinate input type of the standard HID descriptor is transformed from a relative input type to an absolute input type to obtain a target HID descriptor.

3. The method for realizing reverse control of a mobile terminal by a vehicle computer according to claim 1 or 2, characterized in that: The first screen size information includes a first screen width and a first screen height; The calculating, according to the first screen size information, second screen size information for projecting the screen by the mobile terminal on the vehicle computer includes: According to the first screen width, a second screen width of the mobile terminal for screen projection on the vehicle computer is calculated, and according to the first screen height, a second screen height of the mobile terminal for screen projection on the vehicle computer is calculated, wherein the second screen width includes eight lower bits of second screen width data and eight higher bits of second screen width data, and the second screen height includes eight lower bits of second screen height data and eight higher bits of second screen height data; The second screen size information of the mobile terminal for screen projection on the vehicle computer is determined according to the second screen width and the second screen height.

4. The method for realizing reverse control of a mobile terminal by a vehicle computer according to claim 1 or 2, characterized in that: The acquiring of touch screen operation information triggered by the user on the vehicle computer includes: Acquire a screen operation signal triggered by a user on the vehicle computer and the vehicle computer coordinates corresponding to the screen operation signal; Determine the display area size information corresponding to the vehicle computer, and calculate the conversion of the vehicle computer coordinates to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, wherein the display area size information includes the display area width and the display area height; According to the screen operation signal, the vehicle computer coordinates and the mobile terminal coordinates, the touch screen operation information triggered by the user on the vehicle computer is determined.

5. The method for realizing reverse control of a mobile terminal by a vehicle computer according to claim 4, characterized in that: The calculating, based on the display area size information and the vehicle computer coordinates corresponding to the screen operation signal, converting the vehicle computer coordinates to mobile terminal coordinates corresponding to the mobile terminal comprises: Calculate the vehicle computer coordinates converted to the mobile terminal coordinates corresponding to the mobile terminal according to the display area size information, the vehicle computer coordinates corresponding to the screen operation signal, and a preset coordinate conversion calculation formula, wherein the coordinate conversion calculation formula includes a horizontal coordinate conversion calculation formula and a vertical coordinate conversion calculation formula, and the mobile terminal coordinates include a mobile terminal horizontal coordinate and a mobile terminal vertical coordinate; And, the abscissa conversion calculation formula includes: MobileTouchX=MT_Width*car head unit X coordinate÷display area width The vertical coordinate conversion calculation formula includes: MobileTouchY=MT_Height*Y coordinate of vehicle machine÷height of display area Among them, MobileTouchX represents the horizontal coordinate of the mobile terminal, MobileTouchY represents the vertical coordinate of the mobile terminal, MT_Width represents the first screen width, and MT_Height represents the first screen height.

6. The method for realizing reverse control of a mobile terminal by a vehicle computer according to claim 4, characterized in that: The controlling the mobile terminal based on the touch screen operation information includes: Determine an operation signal type corresponding to the screen operation signal, and determine flag data corresponding to the screen operation signal according to the operation signal type, wherein the operation signal type includes a screen click signal type or a screen slide signal type; Generate a HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag data, and send the HID instruction to the mobile terminal through the screen projection link; After receiving the HID instruction, the mobile terminal parses the HID instruction and controls the mobile terminal based on the parsed HID instruction.

7. The method for realizing reverse control of a mobile terminal by a vehicle computer according to claim 6, characterized in that: The generating a HID instruction for the mobile terminal according to the mobile terminal coordinates and the flag bit data comprises: Calculating coordinate data corresponding to the coordinates of the mobile terminal, the coordinate data including horizontal coordinate data and vertical coordinate data; Generate a HID instruction for the mobile terminal according to the coordinate data corresponding to the coordinates of the mobile terminal and the flag data; And, mapping the mobile terminal to the vehicle computer according to the target HID descriptor includes: The target HID descriptor is registered in the communication protocol stack corresponding to the screen projection link between the vehicle computer and the mobile terminal, and the mobile terminal is mapped to the vehicle computer based on the communication protocol stack, wherein the communication protocol stack includes a Bluetooth protocol stack.

8. A device for realizing reverse control of a mobile terminal by a vehicle computer, characterized in that: The device comprises: A construction module, used to construct a screen projection link between the vehicle computer and the mobile terminal, and obtain the first screen size information of the mobile terminal through the screen projection link; A calculation module, used to calculate second screen size information of the mobile terminal for screen projection on the vehicle computer according to the first screen size information; an acquisition module, configured to acquire a preset standard HID descriptor, transform the standard HID descriptor based on the second screen size information to obtain a target HID descriptor, and map the mobile terminal to the vehicle computer according to the target HID descriptor; The acquisition module is also used to acquire touch screen operation information triggered by the user on the vehicle computer, and control the mobile terminal based on the touch screen operation information.

9. A device for realizing reverse control of a mobile terminal by a vehicle computer, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the method for realizing reverse control of the mobile terminal by the vehicle computer as described in any one of claims 1-7.

10. A computer storage medium, characterized in that: The computer storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the method for realizing reverse control of a mobile terminal by a vehicle computer as described in any one of claims 1-7.

Images