Vehicle-mounted screen control method, device and system

Abstract

The present invention provides a method, device, and system for controlling an in-vehicle screen, including: obtaining the horizontal yaw angle and vertical pitch angle of a mobile terminal through a built-in sensor of the mobile terminal; simultaneously obtaining the horizontal yaw angle and vertical pitch angle of the vehicle through a built-in sensor of the vehicle; calculating the horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same time; calculating the vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same time; positioning the cursor of the vehicle's in-vehicle screen based on the horizontal offset component and the vertical offset component; and operating the corresponding control at the cursor position of the in-vehicle screen after receiving an operation instruction transmitted by the mobile terminal. Through this application, passengers can use their own mobile terminals to control the in-vehicle screen, which greatly improves convenience and can achieve accurate cursor positioning when the vehicle is moving or shaking.

Description

Technical Field

[0001] The present invention relates to the field of display screen control, and in particular to a vehicle-mounted screen control method, device and system. Background Art

[0002] When passengers are in a vehicle, some vehicles will be equipped with a large entertainment screen for the rear passengers. The entertainment screen is usually hung on the roof, and the rear users cannot operate the screen while sitting. Current entertainment screens are generally operated by gestures or voice, which is not very convenient. Gestures have a lag and a probability of recognition errors, and it will be tiring to raise your hand to operate for a long time. Voice control may expose private conversations in the current car (the vehicle will continuously collect audio data of the current environment), and it is not very accurate, and there is a certain probability of recognition errors. The existing technology has the following main shortcomings:

[0003] 1. Gesture control: Gesture control recognition requires time to analyze user behavior, which has a certain lag and a probability of error. Users will also be tired if they keep their hands raised.

[0004] 2. Voice control: If voice recognition is performed in the cloud, the conversation content will be sent to the cloud for recognition, which cannot ensure complete privacy and security. The voice recognition module will continuously record the audio, and the recording system is a black box to the user. It is impossible to predict whether the manufacturer will send the audio to the cloud for training. Moreover, there is a certain probability of voice recognition errors.

[0005] 3. Ordinary air mouse: It is based on the phone’s own gyroscope or magnetoresistive sensor, so it cannot accurately locate the vehicle when it is moving or shaking. Summary of the Invention

[0006] To address the above issues, the present invention provides a method, device, and system for controlling an in-vehicle screen, which effectively solve the above problems and can accurately position the in-vehicle screen cursor when the vehicle is moving or shaking.

[0007] The technical solution of the vehicle-mounted screen control method provided by the present invention is as follows:

[0008] In some embodiments, the method comprises the steps of:

[0009] Acquire the horizontal yaw angle and vertical pitch angle of the mobile terminal through a built-in sensor of the mobile terminal;

[0010] Acquiring the horizontal yaw angle and vertical pitch angle of the vehicle through a built-in sensor of the vehicle;

[0011] Calculating a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment;

[0012] Calculating a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment;

[0013] Positioning a cursor on a vehicle-mounted screen of the vehicle according to the horizontal offset component and the vertical offset component;

[0014] After receiving the operation instruction transmitted by the mobile terminal, a corresponding operation is performed on the control corresponding to the cursor position of the vehicle-mounted screen.

[0015] In some embodiments, calculating the horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same time specifically includes:

[0016] Based on the horizontal yaw angle X1 of the mobile terminal and the horizontal yaw angle X2 of the vehicle at the same moment, the horizontal offset component deltaX of the mobile terminal relative to the vehicle is calculated by the following formula:

[0017] deltaX = X1 - X2;

[0018] The positive and negative values ​​of deltaX represent the horizontal deflection direction and horizontal deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0019] In some embodiments, calculating the vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same time specifically includes:

[0020] Obtaining the angle alpha between the line connecting the center of the vehicle screen to the mobile terminal and the horizontal plane;

[0021] Based on the vertical pitch angle Y1 of the mobile terminal and the vertical pitch angle Y2 of the vehicle at the same moment, and the included angle alpha, the vertical offset component deltaY of the mobile terminal relative to the vehicle is calculated according to the following formula:

[0022] deltaY=Y1-Y2-alpha;

[0023] The positive and negative values ​​of deltaY represent the vertical deflection direction and vertical deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0024] In some embodiments, positioning a cursor on the vehicle screen according to the horizontal offset component and the vertical offset component specifically includes:

[0025] According to the horizontal offset component deltaX and the preset calculation ratio rateX of the horizontal offset component corresponding to the coordinate point position on the X-axis of the vehicle screen, the horizontal offset pixel offsetX of the cursor is obtained by the following formula:

[0026] offsetX = deltaX * rateX;

[0027] According to the vertical offset component deltaY and the calculated ratio rateY of the preset vertical offset component corresponding to the coordinate point position on the Y axis of the vehicle screen, the vertical offset pixel offsetY of the cursor is obtained by the following formula:

[0028] offsetY = deltaY * rateY;

[0029] According to the vehicle screen pixel width screenWidth, the vehicle screen pixel height screenHeight, and the horizontal offset pixel offsetX and the vertical offset pixel offsetY of the cursor, the coordinate position (X, Y) of the cursor on the vehicle screen is obtained by the following formula:

[0030] X=screenWidth / 2+offsetX,

[0031] Y=screenHeight / 2+offsetY.

[0032] In some embodiments, the method of controlling the vehicle screen through the mobile terminal further includes:

[0033] According to the distance between the rear seat of the vehicle and the screen and the size of the vehicle screen, the calculation ratio rateX of the horizontal offset component corresponding to the coordinate point position on the X-axis of the vehicle screen and the calculation ratio rateY of the vertical offset component corresponding to the coordinate point position on the Y-axis of the vehicle screen are pre-set.

[0034] In some embodiments, a vehicle-mounted screen control device is further provided, comprising:

[0035] A mobile terminal angle acquisition module, configured to acquire the horizontal yaw angle and vertical pitch angle of the mobile terminal through a built-in sensor of the mobile terminal;

[0036] A vehicle angle acquisition module is used to acquire the horizontal yaw angle and vertical pitch angle of the vehicle through the vehicle's built-in sensors;

[0037] a horizontal offset component calculation module, configured to calculate a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment;

[0038] a vertical offset component calculation module, configured to calculate a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment;

[0039] A cursor positioning module, configured to realize cursor positioning on the vehicle-mounted screen according to the horizontal offset component and the vertical offset component;

[0040] The operation module is used to perform corresponding operations on the control corresponding to the cursor position of the vehicle-mounted screen after receiving the operation instruction transmitted by the mobile terminal.

[0041] In some implementations, the horizontal offset component calculation module is specifically configured to:

[0042] Based on the horizontal yaw angle X1 of the mobile terminal and the horizontal yaw angle X2 of the vehicle at the same moment, the horizontal offset component deltaX of the mobile terminal relative to the vehicle is calculated by the following formula:

[0043] deltaX = X1 - X2;

[0044] The positive and negative values ​​of deltaX represent the horizontal deflection direction and horizontal deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0045] In some embodiments, the vertical offset component calculation module specifically includes:

[0046] Angle acquisition submodule, used to obtain the angle alpha between the line connecting the center of the vehicle screen to the mobile terminal and the horizontal plane,

[0047] The vertical offset component calculation submodule is configured to calculate the vertical offset component deltaY of the mobile terminal relative to the vehicle according to the vertical pitch angle Y1 of the mobile terminal and the vertical pitch angle Y2 of the vehicle at the same time, and the angle alpha according to the following formula:

[0048] deltaY=Y1-Y2-alpha;

[0049] The positive and negative values ​​of deltaY represent the vertical deflection direction and vertical deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0050] In some implementations, the cursor positioning module includes:

[0051] The offset pixel calculation submodule is used to obtain the horizontal offset pixel offsetX of the cursor according to the horizontal offset component deltaX and the preset calculation ratio rateX of the horizontal offset component corresponding to the coordinate point position on the X-axis of the vehicle screen through the following formula:

[0052] offsetX = deltaX * rateX;

[0053] It is also used to obtain the vertical offset pixel offsetY of the cursor according to the vertical offset component deltaY and the preset calculation ratio rateY of the vertical offset component corresponding to the coordinate point position on the Y axis of the vehicle screen through the following formula:

[0054] offsetY = deltaY * rateY;

[0055] The cursor positioning submodule is used to obtain the coordinate position (X, Y) of the cursor on the vehicle screen according to the vehicle screen pixel width screenWidth, the vehicle screen pixel height screenHeight, and the horizontal offset pixel offsetX and the vertical offset pixel offsetY of the cursor by the following formula:

[0056] X=screenWidth / 2+offsetX,

[0057] Y=screenHeight / 2+offsetY.

[0058] In some embodiments, the present invention further provides an in-vehicle screen control system, comprising: a mobile terminal, an in-vehicle system, and an in-vehicle screen; wherein the in-vehicle screen control device described in any one of the above embodiments is integrated into the in-vehicle system; and before the in-vehicle screen control device controls the in-vehicle screen through the mobile terminal, the mobile terminal establishes a communication connection with the in-vehicle system; and the in-vehicle system is electrically connected to the in-vehicle screen.

[0059] The vehicle-mounted screen control device obtains the horizontal yaw angle and vertical pitch angle of the mobile terminal respectively through the built-in magnetoresistive sensor and gravity sensor of the mobile terminal;

[0060] At the same time, the horizontal yaw angle and vertical pitch angle of the vehicle are obtained respectively through the vehicle's built-in magnetoresistive sensor and gravity sensor;

[0061] The vehicle-mounted screen control device calculates a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment;

[0062] The vehicle-mounted screen control device calculates a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment;

[0063] The vehicle screen control device realizes cursor positioning on the vehicle-mounted screen according to the horizontal offset component and the vertical offset component;

[0064] After receiving the operation instruction transmitted by the mobile terminal, the vehicle screen control device performs corresponding operations on the control corresponding to the cursor position of the vehicle screen through the vehicle system.

[0065] The in-vehicle screen control method and device proposed by the present invention have at least the following beneficial effects:

[0066] 1. The in-vehicle screen control method provided by the present invention can communicate data with the vehicle system wirelessly, effectively solving the problem that rear passengers cannot reach the in-vehicle screen and feel tired when operating the in-vehicle screen through gestures.

[0067] 2. The in-vehicle screen control method provided by the present invention can control the in-vehicle screen through a mobile terminal without the need for voice recognition, effectively avoiding voice recognition errors, and also helping to protect passengers' ordinary conversation content and privacy.

[0068] 3. The present invention provides a method for controlling an in-vehicle screen, which collects data through the built-in sensors of the vehicle system and the built-in sensors of the mobile terminal. Regardless of the direction of the vehicle, the horizontal offset component deltaX and the vertical offset component deltaY of the mobile terminal relative to the vehicle can be obtained based on the relative magnetic field direction of the vehicle. When the vehicle shakes continuously during movement, the passengers will shake with the vehicle, so the mobile terminal (mobile phone) and the vehicle will remain relatively stable, and the huge error caused by the continuous and violent shaking of the vehicle during movement is avoided. This is something that cannot be achieved by ordinary gyroscope-based air mice, greatly improving the user experience of the in-vehicle screen.

[0069] 4. The in-vehicle screen control system provided by the present invention integrates the in-vehicle screen control device into the vehicle's onboard computer system. The vehicle's onboard computer communicates with a mobile terminal (such as a mobile phone) via Bluetooth. When a mobile phone attempts to connect to the car's Bluetooth, the Bluetooth connection password is displayed on the large screen on the top of the vehicle. Only those sitting in the car can see the password and enter it on their mobile phone, thus ensuring security. When the car is parked and the engine is turned off, the car shuts down and Bluetooth connection is impossible. Therefore, when the car is parked and the engine is turned off, there is no security issue with outsiders being able to peek at the password. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] The following will explain the preferred implementation scheme in a clear and easy-to-understand manner with reference to the accompanying drawings, and further illustrate the above-mentioned characteristics, technical features, advantages and implementation methods of a vehicle-mounted screen control method, device and system.

[0071] Figure 1 This is a flow chart of an embodiment of a vehicle-mounted screen control method of the present invention;

[0072] Figure 2 is a schematic diagram of an angle alpha according to another embodiment of a method for controlling a vehicle-mounted screen of the present invention;

[0073] Figure 3 This is a module block diagram of an embodiment of a vehicle-mounted screen control device of the present invention;

[0074] Figure 4 It is a module block diagram of another embodiment of a vehicle-mounted screen control device of the present invention. DETAILED DESCRIPTION

[0075] In the following description, specific details such as specific system structures and technologies are provided for illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obstructing the description of the present application with unnecessary details.

[0076] It will be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections.

[0077] It should be further understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0078] In addition, in the description of the present application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0079] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the specific embodiments of the present invention will be described below with reference to the accompanying drawings. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings and other embodiments can be obtained based on these drawings without inventive work.

[0080] In one embodiment, reference Figure 1 The present invention provides a method for controlling a vehicle screen, comprising the steps of:

[0081] S100, obtaining a horizontal yaw angle and a vertical pitch angle of the mobile terminal through a built-in sensor of the mobile terminal;

[0082] Specifically, the horizontal yaw angle and vertical pitch angle can be obtained using the corresponding sensors built into the mobile terminal. For example, the magnetoresistive sensor built into the mobile phone can obtain the horizontal yaw angle X1 of the mobile phone, and the gravity sensor built into the mobile phone can obtain the vertical pitch angle Y1 of the mobile phone.

[0083] S200, obtains the vehicle's horizontal yaw angle and vertical pitch angle through the vehicle's built-in sensors;

[0084] Specifically, the vehicle's built-in magnetoresistive sensor can be used to obtain the vehicle's horizontal yaw angle X2, and the vehicle's built-in gravity sensor can be used to obtain the vehicle's vertical pitch angle Y2.

[0085] S300, calculating a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment;

[0086] S400, calculating a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment;

[0087] Specifically, based on the horizontal yaw angle and vertical pitch angle obtained in the first two steps, the horizontal offset component and vertical offset component of the passenger's mobile phone relative to the vehicle at the same moment are calculated to ensure that the passenger can accurately control the entertainment screen.

[0088] S500, positioning a cursor on a vehicle screen according to the horizontal offset component and the vertical offset component;

[0089] S600: After receiving the operation instruction transmitted by the mobile terminal, perform corresponding operations on the control corresponding to the cursor position on the vehicle screen.

[0090] When passengers are in a vehicle, some vehicles are equipped with an onboard screen for passenger entertainment, also known as an entertainment screen. To operate the entertainment screen, passengers must first use the built-in sensors of the vehicle and the passenger's mobile terminal (usually a mobile phone) to obtain their respective horizontal yaw and vertical pitch angles. These are used to subsequently calculate the horizontal and vertical offsets to accurately locate the target the passenger wants to click. Specifically, in this embodiment, based on the geomagnetic field, the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle (this value is "yaw" on the sensor) range from 0° to 360°. When the passenger's mobile phone (mobile terminal) is facing due south, the value is 0. Similarly, when facing due north, the value is 180°. The vertical pitch angle of the mobile phone based on gravity represents the angle at which the phone's head is tilted up, similar to an airplane diving. This value on the sensor is "pitch" and ranges from -90° to 90°. When the phone is horizontal, the value is 0. Under this preset standard, the cursor on the entertainment screen is positioned based on the calculated horizontal and vertical offset components. The cursor then moves and responds to passenger commands in sync. This allows for precise positioning in bumpy vehicles, effectively improving the passenger experience with the entertainment screen.

[0091] In another embodiment of the present invention, based on the above embodiment, step S300 calculates the horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle, specifically including:

[0092] Based on the horizontal yaw angle X1 of the mobile terminal and the horizontal yaw angle X2 of the vehicle at the same time, the horizontal offset component deltaX of the mobile terminal relative to the vehicle is calculated:

[0093] deltaX = X1 - X2;

[0094] The positive and negative values ​​of deltaX represent the horizontal deflection direction and horizontal deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0095] Specifically, assuming that the vehicle is traveling due north, the vehicle's horizontal yaw angle X2 is 180°, and the passenger's mobile phone is facing 45° northwest, that is, the horizontal yaw angle X1 is 135°. At this time, the horizontal offset component of the mobile phone relative to the vehicle is deltaX=X1-X2=-45°, indicating that the mobile phone is deviated to the left relative to the vehicle's direction of travel, with a deflection amplitude of 45°.

[0096] The step S400 calculates the vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle, specifically including:

[0097] Get the angle alpha between the line connecting the center of the vehicle screen to the mobile terminal and the horizontal plane;

[0098] Based on the vertical pitch angle Y1 of the mobile terminal and the vertical pitch angle Y2 of the vehicle at the same time, as well as the included angle alpha, the vertical offset component deltaY of the mobile terminal relative to the vehicle is calculated:

[0099] deltaY=Y1-Y2-alpha;

[0100] The positive and negative values ​​of deltaY represent the vertical deflection direction and vertical deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0101] Specifically, assuming that the car screen is suspended on the top of the vehicle, the angle alpha between the horizontal plane and the line connecting the center of the car screen to the mobile terminal is 30° (this value can be adjusted according to the spatial position of the large screen and the rear seats). Figure 2 As shown, assuming that the vehicle is level, the vertical pitch angle Y2 is 0, and the passenger's mobile phone is also level, then deltaY = Y1 - Y2 - alpha = -30°.

[0102] In one embodiment, based on the above embodiment, step S500 implements cursor positioning on the vehicle screen according to the horizontal offset component and the vertical offset component, specifically including:

[0103] According to the horizontal offset component deltaX and the calculated ratio rateX of the preset horizontal offset component corresponding to the coordinate point position on the X-axis of the vehicle screen, the horizontal offset pixel offsetX of the cursor is obtained:

[0104] offsetX = deltaX * rateX;

[0105] Get the vertical offset pixel offsetY of the cursor based on the preset vertical offset component deltaY and the calculated ratio rateY of the preset vertical offset component corresponding to the coordinate point position on the Y axis of the vehicle screen:

[0106] offsetY = deltaY * rateY;

[0107] Get the coordinate position (X, Y) of the cursor on the car screen based on the car screen pixel width screenWidth, the car screen pixel height screenHeight, the cursor horizontal offset pixel offsetX, and the vertical offset pixel offsetY:

[0108] X=screenWidth / 2+offsetX,

[0109] Y=screenHeight / 2+offsetY.

[0110] Specifically, based on the horizontal offset component deltaX and vertical offset component deltaY obtained in the previous step, combined with the calculated ratio rateX and rateY, the horizontal offset pixel offsetX and vertical offset pixel offsetY of the cursor are calculated. For example, when rateX is 3 and deltaX is 15, offsetX is 45 pixels, that is, X is offset to the right by 45 pixels. Thus, the coordinate position (X, Y) of the cursor on the car screen is obtained, where

[0111] X=screenWidth / 2+offsetX,

[0112] Y=screenHeight / 2+offsetY,

[0113] Here we select the center of the screen as the coordinate origin. Of course, you can also select other locations as the coordinate origin. There is no limitation here.

[0114] In the above embodiment, the calculated ratio (rateX) of the horizontal offset component deltaX to the position of point X on the vehicle screen, and the calculated ratio (rateY) of the vertical offset component deltaY to the position of point Y on the vehicle screen, can be pre-set based on actual conditions such as the distance between the vehicle's rear seats and the screen and the size of the vehicle screen. In other words, the calculated ratios of point X and point Y on the screen are determined by factors such as the distance between the vehicle's rear seats and the screen and the size of the vehicle screen.

[0115] For example, if the screen resolution is 1920x1080, and you rotate the mobile terminal 90 degrees horizontally, you can move the cursor from one border to the other. A width of 1920 corresponds to 90 degrees, so rateX = 1920 / 90 = 21.333. If you rotate the mobile terminal 60 degrees vertically, you can move the cursor from one border to the other. A width of 1080 corresponds to 60 degrees, so rateX = 1080 / 60 = 18.

[0116] In one embodiment, based on the same technical concept, the present invention also provides a vehicle-mounted screen control device, referring to Figure 3 ,include:

[0117] The mobile terminal angle acquisition module 10 is used to acquire the horizontal yaw angle and vertical pitch angle of the mobile terminal through the built-in sensor of the mobile terminal;

[0118] The vehicle angle acquisition module 20 is used to obtain the horizontal yaw angle and vertical pitch angle of the vehicle through the vehicle's built-in sensors;

[0119] A horizontal offset component calculation module 30 is configured to calculate a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment;

[0120] A vertical offset component calculation module 40 is configured to calculate a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment;

[0121] The cursor positioning module 50 is used to realize the positioning of the cursor on the vehicle screen according to the horizontal offset component and the vertical offset component;

[0122] The operating module 60 is configured to perform corresponding operations on the control corresponding to the cursor position on the vehicle-mounted screen after receiving an operating instruction transmitted by the mobile terminal.

[0123] Specifically, the mobile terminal angle acquisition module primarily uses sensors to obtain the mobile terminal's horizontal yaw and vertical pitch angles. Similarly, the vehicle angle acquisition module obtains the vehicle's horizontal yaw and vertical pitch angles. The horizontal and vertical offset components are then calculated using the horizontal and vertical offset components, respectively. The cursor positioning module then uses these components to position the cursor, allowing passengers to operate the vehicle's screen using the operation module.

[0124] In another embodiment of the present invention, based on the above embodiment, the horizontal offset component calculation module is specifically configured to:

[0125] Based on the horizontal yaw angle X1 of the mobile terminal and the horizontal yaw angle X2 of the vehicle at the same moment, calculate the horizontal offset component deltaX of the mobile terminal relative to the vehicle:

[0126] deltaX = X1 - X2;

[0127] The positive and negative values ​​of deltaX represent the horizontal deflection direction and horizontal deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0128] Specifically, the default is based on the geomagnetic field. The horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle (this value is "yaw" on the sensor) ranges from 0° to 360°. When the passenger's mobile phone (mobile terminal) is facing due south, the value is 0. Similarly, the due north direction is 180°. The vertical pitch angle of the mobile phone based on gravity indicates the angle of the mobile phone head similar to a dive of an airplane. This value on the sensor is "pitch" and ranges from -90° to 90°. When the mobile phone is in a horizontal state, the value is 0.

[0129] The vertical offset component calculation module specifically includes:

[0130] The angle acquisition submodule is used to obtain the angle alpha between the center of the vehicle screen and the line connecting the mobile terminal and the horizontal plane.

[0131] The vertical offset component calculation submodule is used to calculate the vertical offset component deltaY of the mobile terminal relative to the vehicle based on the vertical pitch angle Y1 of the mobile terminal and the vertical pitch angle Y2 of the vehicle at the same time, as well as the angle alpha:

[0132] deltaY=Y1-Y2-alpha;

[0133] The positive and negative values ​​of deltaY represent the vertical deflection direction and vertical deflection amplitude of the mobile terminal relative to the vehicle, respectively.

[0134] Specifically, spatial parameters can be obtained separately through the vehicle's control system and the mobile phone (mobile terminal). For example, the data from the magnetoresistive sensor and the gravity sensor can be used to obtain the mobile phone's deltaX and deltaY based on the relative magnetic field direction of the car, regardless of the vehicle's orientation. When the vehicle shakes continuously during movement, the passengers will shake with the vehicle, so the mobile phone and the car will remain relatively stable, thus avoiding the huge errors caused by the constant and violent shaking of the car during movement, and can effectively circumvent the shortcomings of the gyroscope-based air mouse control method.

[0135] In another embodiment of the present invention, based on the above embodiment, Figure 4 , the cursor positioning module includes:

[0136] The offset pixel calculation submodule 51 is used to obtain the horizontal offset pixel offsetX of the cursor according to the horizontal offset component deltaX and the preset calculation ratio rateX of the horizontal offset component corresponding to the coordinate point position on the X axis of the vehicle screen:

[0137] offsetX = deltaX * rateX;

[0138] It is also used to obtain the vertical offset pixel offsetY of the cursor based on the vertical offset component deltaY and the calculated ratio rateY of the preset vertical offset component corresponding to the coordinate point position on the Y axis of the vehicle screen:

[0139] offsetY = deltaY * rateY;

[0140] The cursor positioning submodule 52 is used to obtain the coordinate position (X, Y) of the cursor on the vehicle screen according to the vehicle screen pixel width screenWidth, the vehicle screen pixel height screenHeight, and the horizontal offset pixel offsetX and the vertical offset pixel offsetY of the cursor:

[0141] X=screenWidth / 2+offsetX,

[0142] Y=screenHeight / 2+offsetY.

[0143] Specifically, the pixel width of the vehicle screen is screenWidth, and the pixel height is screenHeight. The calculation ratios rateX and rateY can be determined based on factors such as the distance from the seat to the vehicle screen and the screen size. Different large screens have different sizes, and the distance from the location where the screen is installed to the passenger is also different. The car manufacturer can adjust the preset rateX, rateY, and alpha parameters according to actual conditions. In this embodiment, the center of the screen is used as the cursor origin, and the horizontal offset component and the vertical offset component both move with the center as the starting point.

[0144] By rotating their phone up, down, left, and right, the passenger can transmit the phone's X1 and Y1 parameters to the vehicle's head unit via Bluetooth. The head unit then calculates and displays the aiming point's position in real time on the vehicle's screen based on the phone's X1 and Y1 parameters and the vehicle's X2 and Y2 parameters. This allows the user to control the click position on the vehicle screen. The control interface on the passenger's phone can include several function buttons, such as return, home screen, and confirm. Furthermore, the passenger can customize options such as sensitivity, thereby modifying the vehicle's preset rateX and rateY values.

[0145] In one embodiment, the present invention further provides a vehicle-mounted screen control system, comprising: a mobile terminal, a vehicle-mounted system, and a vehicle-mounted screen; wherein the vehicle-mounted screen control device provided by any one of the above-mentioned embodiments is integrated into the vehicle-mounted system; and before the vehicle-mounted screen control device controls the vehicle-mounted screen through the mobile terminal, the mobile terminal establishes a communication connection with the vehicle-mounted system; and the vehicle-mounted system is electrically connected to the vehicle-mounted screen;

[0146] The in-vehicle screen control device obtains the horizontal yaw angle and vertical pitch angle of the mobile terminal through the built-in magnetoresistive sensor and gravity sensor of the mobile terminal;

[0147] At the same time, the vehicle's built-in magnetoresistive sensor and gravity sensor are used to obtain the vehicle's horizontal yaw angle and vertical pitch angle respectively;

[0148] The vehicle-mounted screen control device calculates a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment;

[0149] The vehicle-mounted screen control device calculates a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment;

[0150] The vehicle screen control device realizes the positioning of the cursor on the vehicle-mounted screen according to the horizontal offset component and the vertical offset component;

[0151] After receiving the operation instruction transmitted by the mobile terminal, the vehicle screen control device performs corresponding operations on the control corresponding to the cursor position of the vehicle screen through the vehicle system.

[0152] Specifically, the vehicle's head unit system can be wirelessly connected to a mobile phone via Blue Night. When a mobile phone attempts to connect to the car's Bluetooth, the Bluetooth connection password will be displayed on the large screen on the top of the vehicle. Only those sitting in the car can see the password and enter it correctly on the phone, which ensures safety. When the car is parked and the engine is turned off, the head unit will be turned off and Bluetooth connection will be impossible. Therefore, when the car is parked and the engine is turned off, no one outside the car can see the password.

[0153] It should be emphasized that the above-mentioned in-vehicle screen control system can be deployed in any part of the vehicle computer system or the in-vehicle screen, without limitation. When the in-vehicle control system is deployed in the vehicle computer system, users only need to connect to it wirelessly through a mobile terminal, which greatly facilitates passenger use.

[0154] They can be implemented using program code executable by a computing device, and thus, can be stored in a storage device and executed by the computing device, or can be fabricated into separate integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0155] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0156] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0157] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0158] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0159] It should be noted that the above embodiments can be freely combined as needed. The above description is only a preferred embodiment of the present invention. It should be pointed out that those skilled in the art can make several improvements and modifications without departing from the principles of the present invention, and such improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A vehicle screen control method, characterized in that: Including steps: Acquire the horizontal yaw angle and vertical pitch angle of the mobile terminal through a built-in sensor of the mobile terminal; Acquiring the horizontal yaw angle and vertical pitch angle of the vehicle through a built-in sensor of the vehicle; Calculating a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment, specifically comprising: calculating a horizontal offset component deltaX of the mobile terminal relative to the vehicle based on the horizontal yaw angle X1 of the mobile terminal and the horizontal yaw angle X2 of the vehicle at the same moment using the following formula: deltaX=X1-X2; The positive and negative values ​​of deltaX represent the horizontal deflection direction and horizontal deflection amplitude of the mobile terminal relative to the vehicle, respectively. Calculating a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment, specifically comprising: obtaining an angle alpha between a line from the center of the vehicle screen to the mobile terminal and a horizontal plane; and calculating a vertical offset component deltaY of the mobile terminal relative to the vehicle based on the vertical pitch angle Y1 of the mobile terminal and the vertical pitch angle Y2 of the vehicle at the same moment, and the angle alpha, according to the following formula: deltaY = Y1-Y2-alpha; The positive and negative values ​​of deltaY represent the vertical deflection direction and vertical deflection amplitude of the mobile terminal relative to the vehicle, respectively. Positioning a cursor on the vehicle-mounted screen of the vehicle according to the horizontal offset component and the vertical offset component specifically includes: According to the horizontal offset component deltaX and the preset calculation ratio rateX of the horizontal offset component corresponding to the coordinate point position on the X-axis of the vehicle screen, the horizontal offset pixel offsetX of the cursor is obtained by the following formula: offsetX=deltaX*rateX; According to the vertical offset component deltaY and the calculated ratio rateY of the preset vertical offset component corresponding to the coordinate point position on the Y axis of the vehicle screen, the vertical offset pixel offsetY of the cursor is obtained by the following formula: offsetY=deltaY*rateY; According to the vehicle screen pixel width screenWidth, the vehicle screen pixel height screenHeight, and the horizontal offset pixel offsetX and vertical offset pixel offsetY of the cursor, the coordinate position (X, Y) of the cursor on the vehicle screen is obtained by the following formula: X = screenWidth / 2+offsetX, Y = screenHeight / 2+offsetY; After receiving the operation instruction transmitted by the mobile terminal, a corresponding operation is performed on the control corresponding to the cursor position of the vehicle-mounted screen.

2. A vehicle-mounted screen control method according to claim 1, characterized in that: Also includes: According to the distance between the rear seat of the vehicle and the screen and the size of the vehicle screen, the calculation ratio rateX of the horizontal offset component corresponding to the coordinate point position on the X-axis of the vehicle screen and the calculation ratio rateY of the vertical offset component corresponding to the coordinate point position on the Y-axis of the vehicle screen are pre-set.

3. A vehicle-mounted screen control device, characterized in that: include: A mobile terminal angle acquisition module, configured to acquire the horizontal yaw angle and vertical pitch angle of the mobile terminal through a built-in sensor of the mobile terminal; A vehicle angle acquisition module is used to acquire the horizontal yaw angle and vertical pitch angle of the vehicle through the vehicle's built-in sensors; The horizontal offset component calculation module is configured to calculate the horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same time. Specifically, the module calculates the horizontal offset component deltaX of the mobile terminal relative to the vehicle based on the horizontal yaw angle X1 of the mobile terminal and the horizontal yaw angle X2 of the vehicle at the same time using the following formula: deltaX=X1-X2; The positive and negative values ​​of deltaX represent the horizontal deflection direction and horizontal deflection amplitude of the mobile terminal relative to the vehicle, respectively. A vertical offset component calculation module is used to calculate the vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same time. The vertical offset component calculation module specifically includes: An angle acquisition submodule, used to obtain the angle alpha between the line connecting the center of the vehicle screen to the mobile terminal and the horizontal plane; The vertical offset component calculation submodule is configured to calculate the vertical offset component deltaY of the mobile terminal relative to the vehicle according to the vertical pitch angle Y1 of the mobile terminal and the vertical pitch angle Y2 of the vehicle at the same time, and the angle alpha according to the following formula: deltaY = Y1-Y2-alpha; The positive and negative values ​​of deltaY represent the vertical deflection direction and vertical deflection amplitude of the mobile terminal relative to the vehicle, respectively. A cursor positioning module is used to realize cursor positioning on the vehicle screen according to the horizontal offset component and the vertical offset component, and the cursor positioning module includes: The offset pixel calculation submodule is used to obtain the horizontal offset pixel offsetX of the cursor according to the horizontal offset component deltaX and the preset calculation ratio rateX of the horizontal offset component corresponding to the coordinate point position on the X-axis of the vehicle screen through the following formula: offsetX=deltaX*rateX; It is also used to obtain the vertical offset pixel offsetY of the cursor according to the vertical offset component deltaY and the preset calculation ratio rateY of the vertical offset component corresponding to the coordinate point position on the Y axis of the vehicle screen through the following formula: offsetY=deltaY*rateY; The cursor positioning submodule is used to obtain the coordinate position (X, Y) of the cursor on the vehicle screen according to the vehicle screen pixel width screenWidth, the vehicle screen pixel height screenHeight, and the horizontal offset pixel offsetX and the vertical offset pixel offsetY of the cursor using the following formula: X = screenWidth / 2+offsetX, Y=screenHeight / 2+offsetY; The operation module is used to perform corresponding operations on the control corresponding to the cursor position of the vehicle-mounted screen after receiving the operation instruction transmitted by the mobile terminal.

4. A vehicle-mounted screen control system, characterized in that: include: A mobile terminal, a vehicle-mounted system, and a vehicle-mounted screen; wherein the vehicle-mounted screen control device according to claim 3 is integrated into the vehicle-mounted system; and before the vehicle-mounted screen control device controls the vehicle-mounted screen through the mobile terminal, the mobile terminal establishes a communication connection with the vehicle-mounted system; and the vehicle-mounted system is electrically connected to the vehicle-mounted screen; The vehicle-mounted screen control device obtains the horizontal yaw angle and vertical pitch angle of the mobile terminal respectively through the built-in magnetoresistive sensor and gravity sensor of the mobile terminal; At the same time, the horizontal yaw angle and vertical pitch angle of the vehicle are obtained respectively through the vehicle's built-in magnetoresistive sensor and gravity sensor; The vehicle-mounted screen control device calculates a horizontal offset component of the mobile terminal relative to the vehicle based on the horizontal yaw angle of the mobile terminal and the horizontal yaw angle of the vehicle at the same moment; The vehicle-mounted screen control device calculates a vertical offset component of the mobile terminal relative to the vehicle based on the vertical pitch angle of the mobile terminal and the vertical pitch angle of the vehicle at the same moment; The vehicle-mounted screen control device realizes cursor positioning on the vehicle-mounted screen according to the horizontal offset component and the vertical offset component; After receiving the operation instruction transmitted by the mobile terminal, the vehicle-mounted screen control device performs corresponding operations on the control corresponding to the cursor position of the vehicle-mounted screen through the vehicle system.

Images