Method for manually adjusting photographing parameters based on screen sharing device

Abstract

The invention discloses a method for manually adjusting photographing parameters based on a same-screen device. The method comprises the following steps: S1, creating an icon C on a screen of the same-screen device; s2, creating a button K at a position close to the side on the screen of the same-screen device; S3, defining a pair of icon A and icon B for marking a scale bar S area of the lens parameters on the screen of the same-screen device; and S4, defining an area T convenient for a finger to slide the screen at the side position of the screen of the same-screen device. Accurate click operation on a certain position in the middle of a screen of the same-screen device is converted into click operation on the side position of the screen of the same-screen device; a sliding operation on a certain area in the middle of the screen of the same-screen device is converted into a sliding operation on the side position of the screen of the same-screen device; therefore, accurate click operation or sliding operation on any point on the screen of the same-screen device can be realized in a blind operation manner, so that the function of manually adjusting the photographing parameters can be quickly realized.

Description

Technical Field

[0001] This invention belongs to the field of mobile phone photography, and specifically relates to a method for manually adjusting photography parameters based on a screen mirroring device. Background Technology

[0002] Currently, many mobile phone apps support photo and video recording functions, especially some apps designed for cinematic-level photography, and most of them support manual adjustment of lens parameters. The methods and processes for adjusting lens parameters in most camera apps are basically the same: tap the parameter icons on the phone screen (such as AF focus, ISO sensitivity, WB white balance, EV exposure compensation, etc.), and a parameter scale bar will pop up. There are usually automatic and manual options. If you select automatic, the phone will automatically adjust the lens parameters to the optimal position based on the sensor. However, for video effects, we often need to choose manual mode for shooting. For example, if we want to capture a subject that starts blurry and then gradually becomes clear, we need to manually adjust the lens's focus point. Similarly, if we want to gradually change the brightness of the video due to changes in scene brightness, we need to manually adjust the lens's exposure compensation. Furthermore, in complex environments where AI autofocus fails, we still need to manually adjust the focus point for precise focusing. Of course, there are many other such scenarios.

[0003] In manual mode, we usually adjust the parameters by tapping the screen to bring up the parameter scale bar, and then touching and sliding the screen on the scale bar to adjust the parameters.

[0004] Since the parameter icons and scale bars on a mobile phone screen are usually located in the center, it's difficult to adjust lens parameters simultaneously when the phone is mounted on a camera stabilizer or gimbal and held with both hands for video recording. The most common practice is to adjust all lens parameters before starting recording, and during recording, aside from zoom (most stabilizers or gimbals come with Bluetooth remotes that support zoom adjustment), other lens parameters are rarely adjusted. If you need to adjust lens parameters while recording, you have to use one hand, which causes significant camera shake.

[0005] To reduce camera shake during shooting, many products on the market indirectly control the touchscreen of a mobile phone via Bluetooth remote control to adjust parameters. For example, the most common Bluetooth remote controls allow for indirect clicking or screen operation. However, such remote controls typically only allow clicking a fixed area of ​​the screen, such as focusing in the center, or swiping a fixed area with two fingers to zoom in or out, like zooming in or out on a lens. It's difficult to achieve more complex parameter adjustments. Based on this approach, a more advanced screen mirroring device has emerged. This device allows for reverse touchscreen control of the mobile phone screen and also allows viewing a mirrored image of the phone screen on its own screen. This device allows for remote clicking and swiping of any area of ​​the phone screen, effectively solving the problem of directly adjusting parameters by touching the screen. Compared to directly clicking the phone screen, using a screen mirroring device significantly reduces body movement, thus reducing screen shake.

[0006] While using a touchscreen mirroring device effectively solves the problem of manually adjusting camera parameters on a mobile phone, it's still not easy to precisely touch or slide a specific location on the device while holding a stabilizer or gimbal with both hands, all while keeping your hands steady. This is because during filming, your eyes are usually focused on the phone screen, while simultaneously observing the subject and moving the camera using peripheral vision. Therefore, precisely touching or sliding a specific location on the screen while doing so is quite inconvenient. Summary of the Invention

[0007] To address the aforementioned problems, the present invention aims to provide a method for manually adjusting photographic parameters based on a screen mirroring device. This method transforms a precise click operation on a specific location in the center of the screen mirroring device into a click operation on a relatively fixed, large button located near the edge of the screen. It also transforms a sliding operation on a specific area in the center of the screen mirroring device into a sliding operation on a relatively fixed, large area located near the edge of the screen. This allows for precise clicks or slides on any point on the screen mirroring device without requiring careful visual observation, enabling rapid manual adjustment of photographic parameters.

[0008] To achieve the above objectives, the technical solution of the present invention is as follows:

[0009] This invention provides a method for manually adjusting photography parameters based on a screen mirroring device, comprising the following steps:

[0010] S1: On a screen mirroring device system with reverse touch screen functionality, an icon C is created on the screen of the screen mirroring device through embedded programming. The icon C can be dragged and dropped to any position on the screen, with coordinates (Xc, Yc). The icon C is then dragged and dropped to the position of the icon that can bring up the lens parameter scale bar S.

[0011] S2: Create a button K on the edge of the screen of the screen mirroring device, with coordinates (Xk, Yk). When button K is touched, the screen mirroring device system will trigger a touch event that controls the screen of the device by clicking, and send a command to the device to control the screen of the device at the coordinates of the icon C, so that the device APP can bring up the scale bar S marked with lens parameters.

[0012] S3: Define a pair of icons A and B on the screen of the screen mirroring device to mark the area of ​​the scale bar S for lens parameters. The coordinates of icon A are (Xa, Ya) and the coordinates of icon B are (Xb, Yb). Drag and drop icon A and icon B to the two ends of the scale bar S to mark the area of ​​action of the scale bar for lens parameters. When the finger slides between the two points of icon A and icon B, the lens parameters can be adjusted.

[0013] S4: Define an area T on the edge of the screen of the screen mirroring device to facilitate finger swiping. When the finger swipes in area T, the system triggers a touch event that controls the device screen in reverse. The screen mirroring device sends a command to the device that controls the device screen by changing the coordinate values ​​between two points, icon A and icon B. This causes the device APP to perform a swipe operation on the scale bar S to adjust the parameters.

[0014] It should be noted that the screen mirroring system needs to have the functions of screen mirroring and reverse touch control of the device screen.

[0015] There are many methods and technologies for achieving device screen mirroring, including Aircast, Miracast, TypeCDP, and device app technologies that use precise values ​​similar to remote desktop technology, etc. All of these can achieve device screen mirroring. For example, TypeCDP to HDMI can be implemented using CS5261AN or AD9310. These are all existing technologies and are the basic conditions for realizing this invention.

[0016] Similarly, there are many methods and technologies for implementing reverse touch control of device screens, such as UIBC reverse touch control technology based on WIFI, HID touch screen based on Bluetooth / USB, or HID mouse based on Bluetooth / USB that supports absolute coordinates. All of these can achieve reverse control of device screens. These are all existing technologies and are the basic conditions for implementing this invention.

[0017] Further, the process of setting the positions of icon C, as well as icons A and B, is as follows: Enter the settings interface via the physical settings button on the side of the screen mirroring device. In the settings interface, touch and drag icon C to the position where clicking it will bring up the lens parameter scale bar S, and record its coordinate values ​​(Xc, Yc). Click the position of icon C to bring up the lens parameter scale bar S. Set icons A and B to the positions at both ends of scale bar S, and record their coordinate segments (Xa, Ya) and (Xb, Yb). Then define a global coordinate variable S(Xs, Ys) to record the coordinate values ​​of scale bar S, initializing it as Xs=(Xa+Xb) / 2; Ys=(Ya+Yb) / 2, so that it is positioned in the middle of scale bar S. After setting, exit the settings page.

[0018] Furthermore, the positions of icons C, A, and B can be reset after initialization, as follows:

[0019] Step S31: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S32; otherwise, end.

[0020] Step S32: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon C (Xc, Yc). If yes, proceed to step S33; otherwise, proceed to step S34.

[0021] Step S33: Determine whether the coordinates (Xtp, Ytp) are equal to the icon C (Xc, Yc). If they are, end the process. If not, assign values ​​to the icon C: Xc=Xtp, Yc=Ytp, and move the icon C to the new coordinate position.

[0022] Step S34: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon A (Xa, Ya). If yes, proceed to step S35; otherwise, proceed to step S36.

[0023] Step S35: Determine whether the coordinates (Xtp, Ytp) are equal to the icon A (Xa, Ya). If they are, end the process. If not, assign values ​​to icon A: Xa=Xtp, Ya=Ytp, and move icon A to the new coordinate position.

[0024] Step S36: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon B (Xb, Yb). If yes, proceed to step S37; otherwise, end.

[0025] Step S37: Determine whether the coordinates (Xtp, Ytp) are equal to the icon B (Xb, Yb). If they are, end the process. If not, assign values ​​to icon B: Xb=Xtp, Yb=Ytp, and move icon B to the new coordinate position.

[0026] Furthermore, the touch area T is set as follows: depending on the usage of the device screen, it needs to be divided into landscape mode and portrait mode. In landscape mode, the touch area T is generally positioned at the bottom of the screen, and swiping in the X direction is effective. In portrait mode, it is generally positioned at the left or right of the screen, and swiping in the Y direction is effective. For simplicity, this application uses landscape mode for explanation. In portrait mode, it is only necessary to change the position of the icon and the effective variables of the swipe operation coordinates X or Y according to the direction, which will not be described in detail here.

[0027] Further, in step S2, after the settings are completed, the system returns to the operation interface. At this time, touch the button K on the screen mirroring device, and the system starts the operation of the screen mirroring device to reverse touch the device screen, sending a command to the device with the coordinates (Xc, Yc) of the icon C on the touch device screen, and bringing up the lens parameter scale bar S.

[0028] Furthermore, in step S4, taking landscape mode as an example, when the screen is touched and slid in area T under the operation interface, the screen mirroring system will periodically calculate the sliding distance ΔX in the X direction, and then convert ΔX into a change in global coordinate S (Xs, Ys) on the line segment formed by icon A and icon B, and initiate the instruction operation of the reverse touch device screen with coordinate value (Xs, Ys) to realize the screen sliding operation on the scale bar S to adjust the lens parameters.

[0029] Furthermore, in step S4, when a lens parameter is selected for the first time, the current parameter is initialized. At the same time, the value of |Xb-Xa| and |Yb-Ya| is used to determine whether the parameter's scale bar is valid in the Y direction or the X direction. Taking landscape mode as an example, the scale bar S is in the Y direction, that is: |Yb-Ya| > |Xb-Xa|, that is, the Y direction is valid. The global coordinates of the current pointer of the scale bar are defined as (Xs, Ys) in the middle position of the scale bar: Xs=Xa, Ys=(Ya+Yb) / 2.

[0030] Furthermore, in step S4, the methods for implementing the transformation of (Xs, Ys) through ΔX include:

[0031] (1) Calculation using a 1:1 linear transformation;

[0032] (2) Nonlinear conversion calculation based on the feel of the sliding speed is used;

[0033] (3) Use a joystick or dial analogy to convert the calculation in an incremental manner;

[0034] If the final adjustment value after ΔX accumulation exceeds the range of icon A and icon B, you can release the touch first, then reset (Xs, Ys) and execute the next round of touch.

[0035] Furthermore, in step S2, the position of button K on the screen can also be reset. In the setting mode, by touching button K and sliding your finger, you can drag button K to the most convenient touch position on the screen mirroring device to accommodate the touch habits of different users. The setting process is as follows:

[0036] Step S21: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S42; otherwise, end.

[0037] Step S22: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of button K (Xk, Yk). If yes, proceed to step S23; otherwise, end.

[0038] Step S23: Determine whether the coordinates (Xtp, Ytp) are equal to the button K (Xk, Yk). If they are equal, the process ends; otherwise, proceed to step S24.

[0039] Step S24: Assign values ​​to button K: Xk=Xtp, Yk=Ytp, and move button K to a new coordinate position that is convenient for operation.

[0040] Furthermore, in step S4, taking landscape mode as an example, the operation process of clicking button K to bring up the parameter scale bar S of a certain parameter on the device screen, and adjusting the parameter scale bar S on the device screen by touching the sliding area T, is as follows:

[0041] Step S41: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S42; otherwise, end.

[0042] Step S42: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of button K (Xk, Yk). If yes, send the reverse control device screen signal at coordinates (Xc, Yc). If not, proceed to step S43.

[0043] Step S43: Determine if the coordinates (Xtp, Ytp) are within the coordinate range of region T. If not, send a reverse control device screen signal for the (Xtp, Ytp) coordinates to end the operation. If yes, proceed to step S44:

[0044] Step S44: Define a variable Xhis in the X-axis direction, and determine whether the coordinates (Xtp, Ytp) are within the coordinate range of the first entry into region T. If yes, proceed to step S45; otherwise, proceed to step S46.

[0045] Step S45: Save the X-axis of the coordinates (Xtp, Ytp) to the variable Xhis, Xhis = Xtp;

[0046] Step S46: Calculate the user's sliding distance ΔX = Xtp - Xhis in the X-axis direction, save the new His, Xhis = Xtp;

[0047] Step S47: Assign a value to the global coordinate S(Xs, Ys) of the scale bar S in the Y direction, Ys=Ys+ΔX, send a reverse touch device command with touch screen coordinates (Xs, Ys) to the device, and then end the operation.

[0048] The beneficial effects of this invention are as follows: Compared with the prior art, the precise click operation on a certain position in the middle of the screen of the screen mirroring device is transformed into a click operation on a relatively fixed and large button on the edge of the screen of the screen mirroring device; the sliding operation on a certain area in the middle of the screen of the screen mirroring device is transformed into a sliding operation on a relatively fixed and large area on the edge of the screen of the screen mirroring device; thus, precise click or sliding operation on any point on the screen of the screen mirroring device can be achieved blindly without the need for careful visual observation, so as to quickly realize the function of manually adjusting the photography parameters. Attached Figure Description

[0049] Figure 1 This is a flowchart illustrating the method for manually adjusting photographic parameters.

[0050] Figure 2 This is a reference diagram showing an application scenario for this method of manually adjusting photographic parameters.

[0051] Figure 3 This is a reference diagram showing the application scenarios for setting the positions of icon C, icon A, and icon B.

[0052] Figure 4 This is a flowchart showing the position settings for icon C, as well as icons A and B.

[0053] Figure 5 This is a flowchart showing how to set the position of button K.

[0054] Figure 6 This is a reference diagram illustrating an application scenario where the parameter scale bar S on a mobile phone screen is adjusted by touching the sliding area T.

[0055] Figure 7 This is a flowchart of adjusting the parameter scale bar S on the mobile phone screen by touching the sliding area T.

[0056] Figure 8 This is the architecture diagram of the screen mirroring system.

[0057] Figure 9 This is a reference diagram for an application scenario where multiple parameters are adjusted in this implementation. Detailed Implementation

[0058] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0059] To achieve the above objectives, the technical solution of the present invention is as follows:

[0060] See Figure 1-2 This embodiment provides a method for manually adjusting photography parameters based on a screen mirroring device. It is applicable to scenarios where manual adjustment of the phone's lens parameters is required during video recording, and is particularly suitable for situations where the phone's lens parameters need to be manually adjusted when both hands are gripping a shooting stabilizer or gimbal for video recording. The method includes the following steps:

[0061] S1: On a screen mirroring device with reverse touch screen functionality, an icon C is created on the screen of the screen mirroring device through embedded programming. The icon C can be dragged and dropped to any position on the screen. Its coordinates are (Xc, Yc). The icon C is then dragged and dropped to the position of the icon that can bring up the lens parameter scale bar S.

[0062] S2: Create a button K on the edge of the screen of the screen mirroring device, with coordinates (Xk, Yk). When the button K is touched, the screen mirroring device system will trigger a touch event that controls the phone screen in reverse by clicking, and send a command to the phone screen that controls the phone screen at the coordinates of the icon C, so as to control the phone APP to bring up the scale bar S marked with lens parameters.

[0063] S3: Define a pair of icons A and B on the screen of the screen mirroring device to mark the area of ​​the scale bar S for lens parameters. The coordinates of icon A are (Xa, Ya) and the coordinates of icon B are (Xb, Yb). Drag and drop icon A and icon B to the two ends of the scale bar S to mark the area of ​​action of the scale bar for lens parameters. When the finger slides between the two points of icon A and icon B, the lens parameters can be adjusted.

[0064] S4: Define an area T on the edge of the screen of the screen mirroring device to facilitate finger swiping. When the finger swips in area T, the system triggers a touch event that controls the phone screen in reverse. The screen mirroring device sends a command to the phone to control the phone screen in reverse, which changes the coordinate value between two points, icon A and icon B. This causes the phone APP to perform a swipe operation on the scale bar S to adjust the parameters.

[0065] It should be noted that the screen mirroring device system needs to have the functions of screen mirroring with mobile phones and reverse touch control of mobile phone screens.

[0066] There are many methods and technologies for achieving screen mirroring on mobile phones, including Aircast, Miracast, TypeCDP, and mobile app technologies that use precise values ​​similar to remote desktop technology. All of these can achieve the screen mirroring function. For example, TypeCDP to HDMI conversion can be achieved using CS5261AN or AD9310. These are all existing technologies and are the basic conditions for realizing this invention.

[0067] Similarly, there are many methods and technologies for achieving reverse touch control of mobile phone screens, such as UIBC reverse touch control technology based on WIFI, HID touch screen based on Bluetooth / USB, or HID mouse based on Bluetooth / USB that supports absolute coordinates. All of these can achieve reverse control of the mobile phone screen. These are all existing technologies and are the basic conditions for realizing this invention.

[0068] Furthermore, participate Figure 3 The process of setting the positions of icon C, as well as icons A and B, is as follows: Enter the settings interface via the physical settings button on the side of the screen mirroring device. In the settings interface, touch and drag icon C to the position where clicking it will bring up the lens parameter scale bar S, and record its coordinate values ​​(Xc, Yc). Click the position of icon C to bring up the lens parameter scale bar S. Set icons A and B to the positions at both ends of scale bar S, and record their coordinate segments (Xa, Ya) and (Xb, Yb). Then define a global coordinate variable S(Xs, Ys) to record the coordinate values ​​of scale bar S, initializing it to Xs=(Xa+Xb) / 2; Ys=(Ya+Yb) / 2, so that it is in the middle position of scale S. After setting, exit the settings page.

[0069] Furthermore, participate Figure 4 The positions of icons C, A, and B can be reset after initialization. The specific implementation method is as follows:

[0070] Step S31: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S32; otherwise, end.

[0071] Step S32: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon C (Xc, Yc). If yes, proceed to step S33; otherwise, proceed to step S34.

[0072] Step S33: Determine whether the coordinates (Xtp, Ytp) are equal to the icon C (Xc, Yc). If they are, end the process. If not, assign values ​​to the icon C: Xc=Xtp, Yc=Ytp, and move the icon C to the new coordinate position.

[0073] Step S34: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon A (Xa, Ya). If yes, proceed to step S35; otherwise, proceed to step S36.

[0074] Step S35: Determine whether the coordinates (Xtp, Ytp) are equal to the icon A (Xa, Ya). If they are, end the process. If not, assign values ​​to icon A: Xa=Xtp, Ya=Ytp, and move icon A to the new coordinate position.

[0075] Step S36: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon B (Xb, Yb). If yes, proceed to step S37; otherwise, end.

[0076] Step S37: Determine whether the coordinates (Xtp, Ytp) are equal to the icon B (Xb, Yb). If they are, end the process. If not, assign values ​​to icon B: Xb=Xtp, Yb=Ytp, and move icon B to the new coordinate position.

[0077] Furthermore, the touch area T is set as follows: depending on how the phone screen is used, it needs to be divided into landscape mode and portrait mode. In landscape mode, the touch area T is generally positioned at the bottom of the screen, and swiping in the X direction is effective. In portrait mode, it is generally positioned at the left or right of the screen, and swiping in the Y direction is effective. For simplicity, this application uses landscape mode for explanation. In portrait mode, it is only necessary to change the position of the icon and the effective variables of the swipe operation coordinates X or Y according to the direction, which will not be explained in detail here.

[0078] Further, in step S2, after the settings are completed, the system returns to the operation interface. At this time, touch the button K on the screen mirroring device, and the system starts the operation of the screen mirroring device to touch the mobile phone screen in reverse. It sends a command to the mobile phone with the coordinates (Xc, Yc) of the icon C to touch the mobile phone screen and brings up the lens parameter scale bar S.

[0079] Furthermore, in step S4, taking landscape mode as an example, when the screen is touched and slid in area T under the operation interface, the screen mirroring system will periodically calculate the sliding distance ΔX in the X direction, and then convert ΔX into the change of global coordinate S (Xs, Ys) on the line segment formed by icon A and icon B, and start the instruction operation of reverse touch on the mobile phone screen with coordinate value (Xs, Ys) to realize the sliding operation on the scale bar S to adjust the lens parameters.

[0080] Furthermore, in step S4, when a lens parameter is selected for the first time, the current parameter is initialized. At the same time, the value of |Xb-Xa| and |Yb-Ya| is used to determine whether the parameter's scale bar is valid in the Y direction or the X direction. Taking landscape mode as an example, the scale bar S is in the Y direction, that is: |Yb-Ya| > |Xb-Xa|, that is, the Y direction is valid. The global coordinates of the current pointer of the scale bar are defined as (Xs, Ys) in the middle position of the scale bar: Xs=Xa, Ys=(Ya+Yb) / 2.

[0081] Furthermore, in step S4, the methods for implementing the transformation of (Xs, Ys) through ΔX include:

[0082] (1) Calculation using a 1:1 linear transformation;

[0083] (2) Nonlinear conversion calculation based on the feel of the sliding speed is used;

[0084] (3) Use a joystick or dial analogy to convert the calculation in an incremental manner;

[0085] If the final adjustment value after ΔX accumulation exceeds the range of icon A and icon B, you can release the touch first, then reset (Xs, Ys) and execute the next round of touch.

[0086] Furthermore, participate Figure 5 In step S2, the position of button K on the screen can also be reset. In the setting mode, by touching button K and sliding your finger, you can drag button K to the most convenient touch position on the screen mirroring device to accommodate the touch habits of different users. The setting process is as follows:

[0087] Step S21: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S42; otherwise, end.

[0088] Step S22: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of button K (Xk, Yk). If yes, proceed to step S23; otherwise, end.

[0089] Step S23: Determine whether the coordinates (Xtp, Ytp) are equal to the button K (Xk, Yk). If they are equal, the process ends; otherwise, proceed to step S24.

[0090] Step S24: Assign values ​​to button K: Xk=Xtp, Yk=Ytp, and move button K to a new coordinate position that is convenient for operation.

[0091] Further, see Figure 6-7 In step S4, taking landscape mode as an example, the operation process of clicking button K to bring up the parameter scale bar S of a certain parameter on the phone screen, and adjusting the parameter scale bar S on the phone screen by touching the sliding area T, is as follows:

[0092] Step S41: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S42; otherwise, end.

[0093] Step S42: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of button K (Xk, Yk). If yes, send the reverse control signal of the mobile phone screen at coordinates (Xc, Yc). If not, proceed to step S43.

[0094] Step S43: Determine if the coordinates (Xtp, Ytp) are within the coordinate range of region T. If not, send a reverse control signal to the mobile phone screen for the (Xtp, Ytp) coordinates and end the process. If yes, proceed to step S44:

[0095] Step S44: Define a variable Xhis in the X-axis direction, and determine whether the coordinates (Xtp, Ytp) are within the coordinate range of the first entry into region T. If yes, proceed to step S45; otherwise, proceed to step S46.

[0096] Step S45: Save the X-axis of the coordinates (Xtp, Ytp) to the variable Xhis, Xhis = Xtp;

[0097] Step S46: Calculate the user's sliding distance ΔX = Xtp - Xhis in the X-axis direction, save the new His, Xhis = Xtp;

[0098] Step S47: Assign a value to the global coordinate S(Xs, Ys) of the scale bar S in the Y direction, Ys=Ys+ΔX, send a reverse touch phone command with touch screen coordinates (Xs, Ys) to the phone, and then end the process.

[0099] See Figure 8 For a screen mirroring system that implements the above functions, its system architecture includes:

[0100] Screen mirroring device main control IC;

[0101] Wi-Fi module;

[0102] Bluetooth module;

[0103] A display screen with touch control functionality;

[0104] CS5261 chip;

[0105] The main control IC is model S800, which supports FreeRTOS and Linux systems. The RTOS system we are currently using has video signal processing capabilities and supports signal input functions such as serial port, GPIO, USB, WIFI, and HDMI_RX. It also supports LCD screen signal output such as RGB and MIPI. The software protocols support Aircast, Miracast projection technology protocols, as well as HID and UIBC technology protocols.

[0106] The WIFI module provides WIFI screen mirroring functionality and is connected via a USB interface.

[0107] The Bluetooth module, which provides functions such as Bluetooth HID touchscreen protocol, is connected via a serial port;

[0108] The display screen is used to provide the UI interface display and to display the mobile phone screen on the same screen. It is output through the MIPI port and is used to generate touch signals. It is connected through both the I2C port and IO.

[0109] The CS5261 chip is used to convert the mobile phone's TYPECDP signal into an HDMI signal, which is then connected via the HDMI_RX port.

[0110] The remaining power supply circuit, battery charging circuit, and TYPEC / CC line detection circuit are existing technologies and will not be described in detail in this application.

[0111] Based on the aforementioned hardware system, we can implement the mobile phone screen mirroring function by writing software. In the settings mode, the user can interact via the touch screen, and in the screen mirroring mode, the user can control the mobile phone screen via the touch screen. This application combines the user interaction via the touch screen and the user control via the touch screen according to a certain logic.

[0112] For the purposes of this application, adjusting lens parameters is only one function of the device. In actual implementation, other functions can be added to the display interface. Furthermore, considering that the sliding method of the lens parameter scale bar may differ between different camera apps, the sliding algorithm will also be adjusted according to different sliding methods. See [link to relevant documentation]. Figure 9 :

[0113] 1. Add parameter selection icons for parameters 1 to N to switch between different lens parameter adjustments. For example, parameter 1 can be used for focus parameters, parameter 2 can be used for exposure compensation parameters, parameter 3 can be used for ISO parameters, etc.

[0114] 2. For ease of use, a camera button S can be added to start or stop the photography function. This can be achieved by simulating the HID volume buttons or clicking the camera icon on the screen. This is existing technology and will not be described in detail here.

[0115] 3. If you want to achieve zoom functionality while adjusting lens parameters, you can convert the swiping operation outside the sliding area T into a simulated two-finger touch command to zoom in or out on the APP's camera interface. This is another patented technology of our company and will not be detailed here. In this way, you can adjust the zoom by sliding the middle area of ​​the screen mirror, and adjust the focus point, exposure, and other parameters by sliding the edge sliding area T.

[0116] 4. Because some camera apps adjust lens parameters by sliding scales, while others adjust them by sliding pointers, a sliding method option will be added to ensure compatibility with more camera apps. This involves minor adjustments to the sliding conversion algorithm described in the claims. If the pointer method is used, when the coordinates of pointer S exceed the range of icon A / icon B, the coordinates of pointer S will no longer be affected by changes in the sliding area T, remaining at the coordinates of icon A / icon B. If the scale method is used, when the coordinates of pointer S exceed the range of icon A / icon B, the coordinates of pointer S will jump from icon A to icon B (or vice versa), initiating a new round of scale sliding.

[0117] Compared to existing technologies, the beneficial effects of this application are:

[0118] This invention is particularly suitable for situations where a mobile phone is mounted on a shooting stabilizer or gimbal, and the camera is held with both hands while shooting video. When both hands are busy, there's no longer a need to use the entire hand to tap and swipe the phone screen or the screen mirroring device to adjust parameters such as zoom, focus, and exposure. Instead, only the thumb is needed to touch and swipe the edge of the screen mirroring device to manually adjust zoom, focus, and exposure compensation parameters, making manual adjustment of lens parameters easy and simple, and reducing camera shake.

[0119] Before this invention, in most cases, when using a camera stabilizer or gimbal for shooting, all lens parameters needed to be adjusted before shooting. During the shooting process, it was difficult to adjust the lens parameters while shooting (although theoretically it was possible to hold the camera stabilizer with one hand and touch the phone screen with the other to adjust the parameters, this was rarely done in practice because it would negate the stabilizing effect of the camera stabilizer). In this application, the touch button K and the sliding area T can be defined next to the thumb, making it easy to adjust the lens parameters while shooting video. This allows for adjusting the lens parameters during shooting and achieves many video effects that cannot be achieved with fixed lens parameters.

[0120] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for manually adjusting photographic parameters based on a screen mirroring device, characterized in that, Including the following steps: S1: On a screen mirroring device with reverse touch screen functionality, an icon C is created on the screen of the screen mirroring device through embedded programming. The icon C can be dragged and dropped to any position on the screen. Its coordinates are (Xc, Yc). The icon C is then dragged and dropped to the position of the icon that can bring up the lens parameter scale bar S. S2: Create a button K on the edge of the screen of the screen mirroring device, with coordinates (Xk, Yk). When button K is touched, the screen mirroring device system will trigger a touch event that controls the screen of the device by clicking, and send a command to the device to control the screen of the device at the coordinates of the icon C, so that the device APP can bring up the scale bar S marked with lens parameters. S3: Define a pair of icons A and B on the screen of the screen mirroring device to mark the area of ​​the scale bar S for lens parameters. The coordinates of icon A are (Xa, Ya) and the coordinates of icon B are (Xb, Yb). Drag and drop icon A and icon B to the two ends of the scale bar S to mark the area of ​​action of the scale bar for lens parameters. When the finger slides between the two points of icon A and icon B, the lens parameters can be adjusted. S4: Define an area T on the edge of the screen of the screen mirroring device to facilitate finger swiping. When the finger swipes in area T, the system triggers a touch event that controls the device screen in reverse. The screen mirroring device sends a command to the device that controls the device screen by changing the coordinate values ​​between two points, icon A and icon B. This causes the device APP to perform a swipe operation on the scale bar S to adjust the parameters.

2. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 1, characterized in that, The process of setting the positions of icon C, as well as icons A and B, is as follows: Enter the settings interface via the physical settings button on the side of the screen mirroring device. In the settings interface, touch and drag icon C to the position where clicking it will bring up the lens parameter scale bar S, and record its coordinate values ​​(Xc, Yc). Click the position of icon C to bring up the lens parameter scale bar S. Set icons A and B to the positions at the two ends of scale bar S respectively, and record their coordinate segments (Xa, Ya) and (Xb, Yb). Then define a global coordinate variable S(Xs, Ys) to record the coordinate values ​​of scale bar S, initializing it to Xs=(Xa+Xb) / 2; Ys=(Ya+Yb) / 2, so that it is positioned in the middle of scale bar S. After completing the settings, exit the settings page.

3. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 2, characterized in that, The positions of icons C, A, and B can be reset after initialization. The specific implementation method is as follows: Step S31: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S32; otherwise, end. Step S32: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon C (Xc, Yc). If yes, proceed to step S33; otherwise, proceed to step S34. Step S33: Determine whether the coordinates (Xtp, Ytp) are equal to the icon C (Xc, Yc). If they are, end the process. If not, assign values ​​to the icon C: Xc=Xtp, Yc=Ytp, and move the icon C to the new coordinate position. Step S34: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon A (Xa, Ya). If yes, proceed to step S35; otherwise, proceed to step S36. Step S35: Determine whether the coordinates (Xtp, Ytp) are equal to the icon A (Xa, Ya). If they are, end the process. If not, assign values ​​to icon A: Xa=Xtp, Ya=Ytp, and move icon A to the new coordinate position. Step S36: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of icon B (Xb, Yb). If yes, proceed to step S37; otherwise, end. Step S37: Determine whether the coordinates (Xtp, Ytp) are equal to the icon B (Xb, Yb). If they are, end the process. If not, assign values ​​to icon B: Xb=Xtp, Yb=Ytp, and move icon B to the new coordinate position.

4. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 1, characterized in that, The touch area T is set as follows: depending on how the device screen is used, including landscape mode, the touch area T will be positioned at the bottom of the screen mirroring device. When touching and sliding, sliding in the X direction is effective.

5. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 1, characterized in that, The touch area T is set according to the usage of the device screen, including portrait mode. In portrait mode, it will be positioned on the left or right side of the screen mirroring device. When touching and sliding, sliding in the Y direction is effective.

6. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 4, characterized in that, In step S4, taking landscape mode as an example, when the screen is touched and slid in area T under the operation interface, the screen mirroring system will periodically calculate the sliding distance ΔX in the X direction, and then convert ΔX into the change of global coordinate S (Xs, Ys) on the line segment formed by icon A and icon B, and start the instruction operation of the reverse touch device screen with coordinate value (Xs, Ys) to realize the sliding operation on the scale bar S to adjust the lens parameters.

7. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 6, characterized in that, In step S4, when a lens parameter is selected for the first time, the current parameter is initialized. At the same time, the value of |Xb-Xa| and |Yb-Ya| is used to determine whether the parameter's scale bar is valid in the Y direction or the X direction. Taking landscape mode as an example, the scale bar S is in the Y direction, that is: |Yb-Ya| > |Xb-Xa|, that is, the Y direction is valid. The global coordinates of the current pointer of the scale bar are defined as (Xs, Ys) in the middle position of the scale bar: Xs=Xa, Ys=(Ya+Yb) / 2.

8. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 7, characterized in that, In step S4, the method for implementing the change of (Xs, Ys) through ΔX transformation is as follows: Calculations were performed using a 1:1 linear transformation. Alternatively, a non-linear conversion calculation can be performed based on the feel of the gliding speed; Alternatively, a joystick or dial-like mechanism can be used to convert the calculation in an incremental manner; If the final adjustment value after ΔX accumulation exceeds the range of icon A and icon B, you can release the touch first, then reset (Xs, Ys) and execute the next round of touch.

9. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 1, characterized in that, In step S2, the position of button K on the screen can also be reset. In the setting mode, by touching button K and sliding your finger, you can drag button K to the most convenient touch position on the screen mirroring device to accommodate the touch habits of different users. The setting process is as follows: Step S21: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S42; otherwise, end. Step S22: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of button K (Xk, Yk). If yes, proceed to step S23; otherwise, end. Step S23: Determine whether the coordinates (Xtp, Ytp) are equal to the button K (Xk, Yk). If they are equal, the process ends; otherwise, proceed to step S24. Step S24: Assign values ​​to button K: Xk=Xtp, Yk=Ytp, and move button K to a new coordinate position that is convenient for operation.

10. The method for manually adjusting photography parameters based on a screen mirroring device as described in claim 4, characterized in that, In step S4, taking landscape mode as an example, the operation process of clicking button K to bring up the parameter scale bar S of a certain parameter on the device screen, and adjusting the parameter scale bar S on the device screen by touching the sliding area T, is as follows: Step S41: Press the settings button, and the system enters the settings interface. The user touches and slides the screen of the screen mirroring device to determine whether it is a touch screen event coordinate (Xtp, Ytp). If it is, proceed to step S42; otherwise, end. Step S42: Determine whether the touch screen event coordinates (Xtp, Ytp) are within the range of button K (Xk, Yk). If yes, send the reverse control device screen signal at coordinates (Xc, Yc). If not, proceed to step S43. Step S43: Determine if the coordinates (Xtp, Ytp) are within the coordinate range of region T. If not, send a reverse control device screen signal for the (Xtp, Ytp) coordinates to end the operation. If yes, proceed to step S44: Step S44: Define a variable Xhis in the X-axis direction, and determine whether the coordinates (Xtp, Ytp) are within the coordinate range of the first entry into region T. If yes, proceed to step S45; otherwise, proceed to step S46. Step S45: Save the X-axis of the coordinates (Xtp, Ytp) to the variable Xhis, Xhis = Xtp; Step S46: Calculate the user's sliding distance ΔX = Xtp - Xhis in the X-axis direction, save the new His, Xhis = Xtp; Step S47: Assign a value to the global coordinate S(Xs, Ys) of the scale bar S in the Y direction, Ys=Ys+ΔX, send a reverse touch device command with touch screen coordinates (Xs, Ys) to the device, and then end the operation.

Images