Method for automatically matching movement sensitivity of HID mouse of iphone

Abstract

The invention belongs to the technical field of mobile phone screen sharing, and particularly relates to a method for automatically matching the movement sensitivity of an HID mouse of an iphone. In the method, a negative feedback automatic correction method is adopted, the resolution ratios of mobile phone screens of different iPhone mobile phones, the tracking sensitivity of auxiliary touch control and the tracking sensitivity of a mouse are matched by changing the moving sensitivity of a mouse pointer of a lower computer, and accurate coordinate positioning of the mouse pointer at different positions of the mobile phone screens is achieved.

Description

Technical Field

[0001] The invention belongs to the technical field of mobile phone same-screen technology, and particularly relates to a method for automatically matching the movement sensitivity of a HID mouse of an iPhone mobile phone. Background Art

[0002] With the expansion of the application of mobile phone screen sharing technology, more and more occasions require reverse control of the mobile phone screen through the touch screen of the screen sharing device, or control of the mobile phone screen with one button. Such operation is relatively easy for Android phones and Hongmeng phones, because both Android and Hongmeng phones support the access of Bluetooth HID touch screens, and the touch screen operation of Bluetooth HID touch screens uses absolute coordinates. Therefore, if the Bluetooth remote control device in the lower computer integrates a Bluetooth HID touch screen, the lower computer only needs to convert the coordinate value of the touch point of the Bluetooth HID touch screen with the position coordinate of the mobile phone screen, and then send it to the smartphone in the form of an input report of the HID input touch point operation, so that a certain position of the smartphone screen can be touched with one button, or the screen of the mobile phone can be reversely controlled through the touch screen.

[0003] This method has many applications in the field of remote control of smartphone photography. For example, high-end mobile phone Bluetooth remote controls can realize one-touch control of the icon position of the front and rear camera switch on the mobile phone's camera APP interface to achieve remote camera switching; sliding the image position of the mobile phone's camera APP interface horizontally with one finger can switch the camera mode, and sliding the image area of ​​the mobile phone's camera APP interface with two fingers can zoom in or out the camera.

[0004] If the lower computer is a screen sharing device for a smartphone, this type of Bluetooth product, after integrating a Bluetooth HID touch screen, can reversely control the phone screen through the touch screen on the screen sharing device.

[0005] However, the above methods and applications are limited to smartphones with Android or Hongmeng systems, and cannot be applied to Apple's iPhones. This is because the iPhone has disabled the access to the Bluetooth HID touch screen, and the iPhone currently only supports the access to the Bluetooth HID mouse. Although the HID mouse can also perform operations such as clicking and sliding on the iPhone screen, the pointer movement operation parameters of the HID mouse use relative coordinates. Therefore, when the lower computer operates the mouse pointer to move, it can only know how far it has moved relative to its previous position, but cannot directly know the absolute position of the HID mouse pointer on the phone screen.

[0006] In order to solve the above problems, a method for controlling the native camera app of a mobile phone to zoom in and out is disclosed in a prior patent. The method includes the following steps: Step 1: After the iPhone establishes a connection with the Bluetooth hardware, two sensitivity settings are performed on the iPhone; the iPhone enters the native camera app interface, and then the native camera app of the iPhone is set to a photo taking mode that supports zooming in and out; Step 2: The Bluetooth hardware controls the mouse pointer to locate the zoom interface button area of ​​the native camera app interface; Step 3: Keep the left button of the mouse pointer pressed, the zoom extension interface pops up, and the Bluetooth hardware is used to control the mouse pointer to move left or right to perform the zoom operation. Although the method described above can well solve the problem of using an HID mouse to perform a one-click or sliding operation on a certain position of the mobile phone screen, it also has defects.

[0007] When users use this device, the setting operation process is very complicated: after adding the Bluetooth device with integrated Bluetooth HID mouse to the iPhone, they need to enter the auxiliary touch interface of the iPhone's system settings menu and turn on the auxiliary touch function; then, adjust the tracking sensitivity of the auxiliary touch to the maximum (or minimum); then exit this operation interface, and then enter the mouse settings interface, and then adjust the tracking sensitivity of the mouse to the maximum (or minimum), then enter the configuration APP, and then select the corresponding iPhone model, write the coordinate information group (Xn, Yn) of the corresponding mobile phone screen to the lower computer Bluetooth device, and complete the setting. Such a setting process will discourage users. Summary of the invention

[0008] In order to solve the above problems, the purpose of the present invention is to provide a method for automatically matching the movement sensitivity of the HID mouse of an iPhone mobile phone. The method omits the tracking sensitivity setting operation of the auxiliary touch that affects the movement sensitivity of the mouse pointer, and omits the tracking sensitivity setting operation of the mouse that affects the movement sensitivity of the mouse pointer, thereby simplifying the operation steps and improving the user experience.

[0009] In order to achieve the above object, the technical solution of the present invention is as follows.

[0010] A method for automatically matching the movement sensitivity of a HID mouse of an iPhone mobile phone, characterized in that the method comprises:

[0011] Step 1: The iPhone interacts with the lower computer; the iPhone enters the matching operation interface;

[0012] Step 2: Select the reference coordinates (X, Y) and send them to the lower computer; after receiving the reference coordinates (X, Y), the lower computer presets the horizontal movement sensitivity Sx of the mouse and the vertical movement sensitivity Sy of the pointer;

[0013] Step 3: The lower computer sends a HID input report to the mobile phone to move the mouse pointer to a corner of the iPhone screen to determine the reference origin (0,0);

[0014] Then move the distance of X*Sx in the horizontal direction and the distance of X*Sy in the vertical direction, and the mouse pointer finally stays at the coordinates (X`, Y`) on the iPhone screen;

[0015] Finally, the lower computer sends a HID input report of pressing the left mouse button. After the upper computer receives the HID input report of pressing the left mouse button, it triggers the left mouse button press event and then reads the coordinates (X`, Y`);

[0016] Step 4: The iPhone calculates and compares the coordinates (X`, Y`) with the previous reference coordinates (X, Y) to calculate the offset;

[0017] Step 5: Determine whether the coordinates (X`, Y`) coincide with the reference coordinates (X, Y) based on the offset; if they coincide, proceed to step 7; if they do not coincide, proceed to step 6;

[0018] Step 6: Calculate the corrected motion sensitivity values ​​Sxn and Syn according to the offset, then reassign Sxn to Sx, reassign Syn to Sy, and repeat steps 3 to 5;

[0019] Step 7: Complete the matching work.

[0020] In this method, a negative feedback automatic correction method is adopted to match the screen resolution of different iPhone phones and the tracking sensitivity of the auxiliary touch and the mouse tracking sensitivity by changing the movement sensitivity of the mouse pointer of the lower computer, so as to achieve precise coordinate positioning of the mouse pointer at different positions on the mobile phone screen.

[0021] Furthermore, in step 1, enter the settings menu of the iPhone and turn on the assistive touch function; then open the configuration app and scan the Bluetooth device to add the Bluetooth device of the lower computer to complete the interaction with the lower computer; then click the automatic matching screen icon in the configuration app to enter the matching operation interface and start the automatic matching operation of the mouse movement sensitivity.

[0022] Furthermore, the matching operation interface must include at least one view control that can cover the entire mobile phone screen and is used to detect the coordinate position of the mouse pointer.

[0023] Furthermore, in step 2, when the reference coordinate (X, Y) is selected, a reference coordinate (X, Y) for setting the movement sensitivity Sx and Sy of the mouse pointer in the x and y directions is selected for the view control that is pre-displayed on the full screen.

[0024] Furthermore, the offset includes ΔX and ΔY, ΔX=X`-X, ΔY=Y`-Y.

[0025] Furthermore, in step 6, the lower computer calculates Sx and Sy according to the values ​​of ΔX and ΔY using the following formula:

[0026] Sxn = (X*Sx) / (ΔX+X);

[0027] Syn=(Y*Sy) / (ΔY+Y);

[0028] The corrected movement sensitivity values ​​Sxn and Syn are calculated, and then Sxn is reassigned to Sx, and Syn is reassigned to Sy.

[0029] Furthermore, multiple reference points are set on the iPhone screen, and the movement sensitivity of the mouse pointer when the mouse moves to the multiple reference points is tested respectively, and a two-dimensional array is generated. The mouse movement sensitivity at any point on the screen is calculated through a two-dimensional array table lookup.

[0030] Furthermore, the two-dimensional array is:

[0031] {

[0032] {S11x, S11y}, {S12x, S12y},…, {S1nx, S1ny},

[0033] , {S21x, S21y}, {S22x, S12y},…, {S2nx, S2ny}

[0034] ,…

[0035] , {Sm1x, Sm1y}, {Sm2x, S12y},…, {Smnx, Smny}

[0036] }.

[0037] Furthermore, when calculating the mouse movement sensitivity of any point on the screen, first look up the two-dimensional array table to obtain at least two other reference points (X(m-1(n-1, Y(m-1(n-1), (Xmn, Ymn) adjacent to the point to calculate the mouse movement sensitivity of the arbitrary point: Sx=S(m-1)(n-1)x+(Smnx-S(m-1(n-1x)*(XX(m-1(n-1) / (Xmn-X(m-1(n-1), Sy=S(m-1)(n-1)y+(Smny-S(m-1(n-1y)*(YY(m-1(n-1) / (Ymn-Y(m-1(n-1)

[0038] The beneficial effect of the present invention is that, in the method, a negative feedback automatic correction method is adopted to match the resolution of the mobile phone screen of different iPhone mobile phones and the tracking sensitivity of the auxiliary touch and the mouse tracking sensitivity by changing the movement sensitivity of the mouse pointer of the lower computer, so as to realize the precise coordinate positioning of the mouse pointer at different positions of the mobile phone screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 The present invention is a flow chart of a method for automatically matching the movement sensitivity of a HID mouse of an iPhone mobile phone.

[0040] Figure 2 It is a schematic diagram of the calculation comparison of coordinates (X`, Y`) and reference coordinates (X, Y).

[0041] Figure 3 It is a schematic diagram of a series of reference points between the center of the iPhone screen and the reference origin corner.

[0042] Figure 4 It is the configuration APP initialization flow chart. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0044] In the present invention, the resolutions of different mobile phone screens, the tracking sensitivity of the auxiliary touch and the mouse tracking sensitivity are no longer processed on the setting interface of the iPhone mobile phone. Instead, a negative feedback automatic correction method is adopted to match the resolutions of different mobile phone screens and the tracking sensitivity of the auxiliary touch and the mouse tracking sensitivity by changing the movement sensitivity of the mouse pointer of the lower computer, so as to realize accurate coordinate positioning of the mouse pointer at different positions of the mobile phone screen.

[0045] The hardware environment conditions of the present invention include at least a lower computer hardware with integrated Bluetooth function (hereinafter referred to as the lower computer) and an upper computer software for configuration that can be run on an iPhone (hereinafter referred to as the configuration APP). The Bluetooth function in the lower computer needs to integrate at least a Bluetooth HID mouse.

[0046] The lower computer also includes an indefinite number of operation buttons, which can simulate a series of Bluetooth HID mouse pointer movement operations and key click operations, so as to achieve one-key control of the mouse pointer to a certain position on the iPhone screen, and then perform mouse clicks, slides or other mouse actions;

[0047] The lower computer hardware also includes a screen controller for an iPhone with a touch screen. The CPU of the lower computer can convert the touch coordinate information of the touch screen into the coordinate information of the corresponding iPhone screen, and change the touch action (such as clicking / sliding, etc.) into the action of the Bluetooth HID mouse (such as left button pressing / pointer sliding), so as to realize the function of controlling the screen of the iPhone by touching the touch screen on the screen controller.

[0048] See also Figure 1-3 This embodiment provides a method for automatically matching the movement sensitivity of the HID mouse of an iPhone mobile phone, characterized in that the method includes:

[0049] Step 1: The iPhone interacts with the lower computer; the iPhone enters the matching operation interface;

[0050] Step 2: Select the reference coordinates (X, Y) and send them to the lower computer; after receiving the reference coordinates (X, Y), the lower computer presets the horizontal movement sensitivity Sx of the mouse and the vertical movement sensitivity Sy of the pointer;

[0051] Step 3: The lower computer sends a HID input report to the mobile phone to move the mouse pointer to a corner of the iPhone screen to determine the reference origin (0,0);

[0052] Then move the distance of X*Sx in the horizontal direction and the distance of X*Sy in the vertical direction, and the mouse pointer finally stays at the coordinates (X`, Y`) on the iPhone screen;

[0053] Finally, the lower computer sends a HID input report of pressing the left mouse button. After the upper computer receives the HID input report of pressing the left mouse button, it triggers the left mouse button press event and then reads the coordinates (X`, Y`);

[0054] Step 4: The iPhone calculates and compares the coordinates (X`, Y`) with the previous reference coordinates (X, Y) to calculate the offset;

[0055] Step 5: Determine whether the coordinates (X`, Y`) coincide with the reference coordinates (X, Y) based on the offset; if they coincide, proceed to step 7; if they do not coincide, proceed to step 6;

[0056] Step 6: Calculate the corrected motion sensitivity values ​​Sxn and Syn according to the offset, then reassign Sxn to Sx, reassign Syn to Sy, and repeat steps 3 to 5;

[0057] Step 7: Complete the matching work.

[0058] Furthermore, step 1 is to meet the software conditions required by the method, specifically:

[0059] Step 1.1, enter the settings menu of your iPhone and turn on the Assistive Touch function.

[0060] Step 1.2, open the configuration app, scan Bluetooth devices, and add the Bluetooth device of the lower computer to the system.

[0061] Step 1.3, click the automatic screen matching icon in the configuration app to enter the matching operation interface and start the automatic matching operation of mouse movement sensitivity. The matching operation interface must include at least one view control that can cover the entire mobile phone screen. The view control type is not limited, but this view control must have the ability to trigger the button pressing event of the HID mouse, and the ability to read the mouse pointer coordinates (X`, Y`) when the mouse button is pressed after the event is triggered.

[0062] Furthermore, in step 2, specifically:

[0063] Step 2.1, select a reference coordinate (X, Y) for setting the movement sensitivity Sx and Sy of the mouse pointer in the x and y directions in advance in the view control displayed on the full screen.

[0064] Step 2.2, configure the APP to send the reference coordinates (X, Y) to the slave computer.

[0065] Step 2.3, after the lower computer receives the reference coordinates (X, Y), it presets the horizontal mouse movement sensitivity Sx and the vertical pointer movement sensitivity Sy, where the preset initial values ​​of Sx and Sy come from empirical values ​​that are as close to the debugging results as possible.

[0066] Furthermore, in step 3, specifically:

[0067] Step 3.1, the lower computer sends a HID input report to the mobile phone to move the mouse pointer. First, move the pointer to a corner of the screen to determine the reference origin (0,0);

[0068] Step 3.2, move the distance of X*Sx in the horizontal direction and the distance of X*Sy in the vertical direction. Because the tracking sensitivity of the auxiliary touch and the tracking sensitivity of the mouse of different mobile phones are different, the coordinates where the mouse pointer finally stops on the mobile phone screen are also an unknown fixed value (X`, Y`).

[0069] Step 3.3, the lower computer sends a HID input report of pressing the left mouse button. After receiving the HID input report of pressing the left mouse button, the upper computer triggers the left mouse button press event and then reads (X`, Y`).

[0070] Further, in step 4, specifically: configure the APP to calculate and compare the coordinates (X`, Y`) with the previous reference coordinates (X, Y), and calculate the offset ΔX=X`-X, ΔY=Y`-Y.

[0071] In step 6, if the calculated ΔX, ΔY has too large an error, it means that the positions of (X`, Y`) and (X, Y) differ greatly, and the values ​​of the mouse pointer's movement sensitivity Sx, Sy do not match the current mobile phone. Then ΔX, ΔY are sent to the lower computer, and the lower computer calculates Sx and Sy according to the values ​​of ΔX and ΔY using the following formulas: Sxn = (X*Sx) / (ΔX+X), Syn = (Y*Sy) / (ΔY+Y), calculates the corrected movement sensitivity values ​​Sxn and Syn, and then reassigns Sxn to Sx, and reassigns Syn to Sy, and then repeats steps 3 to 5 for a new round of measurements.

[0072] In step 7, if the calculated ΔX and ΔY are within the error range, it means that (X`, Y`) and (X, Y) have overlapped, and the values ​​of Sx and Sy of the mouse pointer's movement sensitivity when moving the mouse pointer from the reference origin (0, 0) to the reference point (X, Y) have been matched with the mobile phone. The matching work is completed, and the values ​​of Sx and Sy are the values ​​of the mouse pointer's movement sensitivity in the horizontal and vertical directions of the reference coordinates (X, Y).

[0073] The above steps complete the movement sensitivity Sx, Sy of the mouse pointer when it moves from the reference origin (0, 0) to a certain reference point (X, Y). In fact, because the position of the reference point is different, the movement distance and movement speed of the mouse pointer may be different, and its movement sensitivity may also be different. In order to deal with this problem:

[0074] In this embodiment, multiple reference points are set on the iPhone screen, the movement sensitivity of the mouse pointer when the mouse moves to the multiple reference points is tested respectively, and a two-dimensional array is generated. The mouse movement sensitivity at any point on the screen is calculated by looking up the two-dimensional array table.

[0075] By testing the movement sensitivity of the mouse pointer when the mouse moves to different positions in different areas, a two-dimensional array is generated. The movement sensitivity of the mouse pointer at each position point is calculated by table lookup + calculation. In this way, when the mouse is positioned, it can be done in one step, shortening the positioning time.

[0076] The specific description is as follows: From the center of the iPhone screen to the reference origin corner, a series of reference points are set according to the accuracy requirements, and the movement sensitivity Sx, Sy of the mouse pointer at different reference points are measured according to the previous measurement method, and a two-dimensional array is generated. Then, the mouse movement sensitivity Sx, Sy at any point on the screen is calculated through a two-dimensional array table lookup.

[0077] {

[0078] {S11x, S11y}, {S12x, S12y},…, {S1nx, S1ny},

[0079] , {S21x, S21y}, {S22x, S12y},…, {S2nx, S2ny}

[0080] …

[0081] , {Sm1x, Sm1y}, {Sm2x, S12y},…, {Smnx, Smny}

[0082] }

[0083] When the accuracy does not need to be too high, only one reference point in the center of the screen is collected, or a simple linear calculation is used between the reference points. For example: To obtain the mouse sensitivity of any coordinate (X, Y), first check the two-dimensional array table to obtain the two reference points adjacent to the coordinate (X, Y). For example, within the interval of adjacent reference points (X11, Y11), (X22, Y22), the sensitivity in the x direction is Sx=S11x+(S22x-S11x)*(X-X11) / (X22-X11), and the sensitivity in the y direction is Sy=S11y+(S22y-S11y)*(Y-Y11) / (Y22-Y11).

[0084] See also Figure 4 , in this embodiment, a flowchart of APP initialization.

[0085] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for automatically matching the movement sensitivity of the HID mouse of an iPhone mobile phone, characterized in that: The method includes: Step 1: The iPhone interacts with the lower computer; the iPhone enters the matching operation interface; Step 2: Select the reference coordinates (X, Y) and send them to the lower computer; after receiving the reference coordinates (X, Y), the lower computer presets the horizontal movement sensitivity Sx of the mouse and the vertical movement sensitivity Sy of the pointer; Step 3: The lower computer sends a HID input report to the mobile phone to move the mouse pointer to a corner of the iPhone screen to determine the reference origin (0,0); Then move the distance of X*Sx in the horizontal direction and the distance of X*Sy in the vertical direction, and the mouse pointer finally stays at the coordinates (X`, Y`) on the iPhone screen; Finally, the lower computer sends a HID input report of pressing the left mouse button. After the upper computer receives the HID input report of pressing the left mouse button, it triggers the left mouse button press event and then reads the coordinates (X`, Y`); Step 4: The iPhone calculates and compares the coordinates (X`, Y`) with the previous reference coordinates (X, Y) to calculate the offset; Step 5: Determine whether the coordinates (X`, Y`) coincide with the reference coordinates (X, Y) based on the offset; if they coincide, proceed to step 7; if they do not coincide, proceed to step 6; Step 6: Calculate the corrected motion sensitivity values ​​Sxn and Syn according to the offset, then reassign Sxn to Sx, reassign Syn to Sy, and repeat steps 3 to 5; Step 7: Complete the matching work.

2. The method of automatically matching the movement sensitivity of the HID mouse of an iPhone according to claim 1, characterized in that: In step 1, enter the settings menu of the iPhone and turn on the assistive touch function; then open the configuration app and scan the Bluetooth devices to add the Bluetooth device of the lower computer to complete the interaction with the lower computer; then click the automatic matching screen icon in the configuration app to enter the matching operation interface and start the automatic matching operation of mouse movement sensitivity.

3. The method for automatically matching the movement sensitivity of the HID mouse of an iPhone according to claim 1, characterized in that: The matching operation interface must include at least one view control that can cover the entire mobile phone screen and is used to detect the coordinate position of the mouse pointer.

4. The method of automatically matching the movement sensitivity of the HID mouse of an iPhone according to claim 3, characterized in that: In step 2, when the reference coordinate (X, Y) is selected, a reference coordinate (X, Y) for setting the movement sensitivity Sx and Sy of the mouse pointer in the x and y directions is selected for the view control that is pre-displayed on the full screen.

5. The method for automatically matching the movement sensitivity of the HID mouse of an iPhone according to claim 1, characterized in that: The offset includes ΔX and ΔY, ΔX=X`-X, ΔY=Y`-Y.

6. The method of automatically matching the movement sensitivity of the HID mouse of an iPhone according to claim 5, characterized in that: In step 6, the lower computer calculates Sx and Sy according to the values ​​of ΔX and ΔY using the following formula: Sxn = (X*Sx) / (ΔX+X); Syn=(Y*Sy) / (ΔY+Y); The corrected movement sensitivity values ​​Sxn and Syn are calculated, and then Sxn is reassigned to Sx, and Syn is reassigned to Sy.

7. A method for automatically matching the movement sensitivity of a HID mouse of an iPhone according to any one of claims 1 to 6, characterized in that: Multiple reference points are set on the iPhone screen, and the movement sensitivity of the mouse pointer when the mouse moves to multiple reference points is tested respectively. A two-dimensional array is generated, and the mouse movement sensitivity at any point on the screen is calculated through a two-dimensional array table lookup.

8. The method for automatically matching the movement sensitivity of the HID mouse of an iPhone according to claim 7, characterized in that: The two-dimensional array is: { {S11x, S11y}, {S12x, S12y},…, {S1nx, S1ny}, , {S21x, S21y}, {S22x, S12y},…, {S2nx, S2ny} … , {Sm1x, Sm1y}, {Sm2x, S12y},…, {Smnx, Smny} }。 9. The method for automatically matching the movement sensitivity of the HID mouse of an iPhone according to claim 8, characterized in that: When calculating the mouse movement sensitivity of any point on the screen, first look up the two-dimensional array table to obtain at least two other reference points (X(m-1(n-1, Y(m-1(n-1), (Xmn, Ymn)) adjacent to the point to calculate the mouse movement sensitivity of the arbitrary point: Sx=S(m-1)(n-1)x+(Smnx-S(m-1(n-1x)*(XX(m-1(n-1) / (Xmn-X(m-1(n-1)), Sy=S(m-1)(n-1)y+(Smny-S(m-1(n-1y)*(YY(m-1(n-1) / (Ymn-Y(m-1(n-1)).

Images