Processing method and electronic equipment
By projecting the screen to the terminal device and using the gravity sensor and plane conversion strategy to process the input parameters, the problem of inconsistent operation direction when the electronic device is placed on the support surface is solved, the operation direction is unified, and the user experience is improved.
Patent Information
- Application Number
- CN202111312076.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-08
- Publication Date
- 2025-09-23
- Estimated Expiration
- 2041-11-08
AI Technical Summary
In the prior art, when an electronic device is placed on a support surface, the posture change of the touch display screen cannot be detected, resulting in the user's operation direction on the mobile terminal being inconsistent with the movement direction of the focus display position on the terminal device, affecting the user's convenient use.
The display content is projected to the terminal device through the connection channel, the sensing parameters of the gravity sensor are obtained, the input parameters of the touch sensing module are processed based on the plane conversion strategy, the response parameters are obtained, and the display position of the focus in the output area is controlled according to the response parameters to feedback the movement operation and ensure the consistency of the operation direction.
When used on a supporting surface, the electronic device can detect the changes in the posture of the touch display screen, ensuring that the user's moving operation direction is consistent with the moving direction of the focus display position on the terminal device, thereby improving user convenience.
Smart Images

Figure CN114063797B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a processing method and electronic equipment. Background Art
[0002] Nowadays, mobile devices such as mobile phones, which are commonly carried by people, have become increasingly versatile and feature-rich. By pairing a mobile terminal with a display device such as a monitor or projector, the mobile terminal's touch screen can be used as a touchpad to control the cursor on the display. However, after successful pairing, rotating the mobile terminal may cause the direction of the finger sliding on the touch screen to be inconsistent with the direction of the cursor on the corresponding display.
[0003] In response to the above problems, the existing technology can use the automatic screen rotation function in the mobile terminal to adjust the coordinate system of the touch screen to ensure the consistency of the control direction. However, the applicability of this function is poor. For example, when the electronic device is placed on a support surface for use, the electronic device cannot detect the position change of the touch screen on the support surface, and the existing screen rotation function generally rotates by 90 degrees. Therefore, for operations on the touch screen in this case, it is necessary for the electronic device to be able to detect the position change of the touch screen on the support surface to ensure that the user's moving operation direction relative to the touch screen is consistent with the moving direction of the display position of the focus on the output area on the terminal device, thereby facilitating convenient use by the user. Summary of the Invention
[0004] In view of this, the embodiments of the present application provide a processing method and an electronic device, the main purpose of which is to solve the problem of inconsistent control operation directions due to rotation when the electronic device is placed on a support surface for use.
[0005] To achieve the above objectives, this application mainly provides the following technical solutions:
[0006] In one aspect, an embodiment of the present application provides a processing method, the method comprising:
[0007] Projecting display content to a terminal device having a display output module through a connection channel, wherein the display content belongs to the electronic device;
[0008] Get the sensing parameters of the gravity sensor;
[0009] If the sensing parameters satisfy the support surface placement condition, processing input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module based on a plane conversion strategy to obtain response parameters, wherein the input parameters are used to represent the movement operation of the operating body relative to the reference reference;
[0010] The display position of the focus in the output area is changed according to the response parameter control to feedback the movement operation, and the change direction of the display position of the focus in the output area is consistent with the direction of the movement operation of the operating body relative to the reference base.
[0011] Optionally, the method further includes:
[0012] If the sensing parameters meet the spatial grip condition, the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module are processed based on the spatial conversion strategy.
[0013] Optionally, the sensing parameters include a sensing value of an X-axis, a sensing value of a Y-axis, and a sensing value of a Z-axis;
[0014] When the sensing value of the X-axis included in the sensing parameter is zero and the sensing value of the Y-axis included in the sensing parameter is zero, it is determined that the sensing parameter meets the support surface placement condition.
[0015] Optionally, the processing, based on the plane conversion strategy, of the input parameter for the focus displayed on the output area of the display output module obtained by the touch sensing module to obtain the response parameter includes:
[0016] Call the compass or gyroscope;
[0017] determining a rotation angle based on sensing parameters of the compass or the gyroscope;
[0018] Based on the rotation angle and the coordinate points of the input parameters, other coordinate points except the coordinates of the starting point are converted to obtain response parameters, where the response parameters include the coordinates of the starting point and the converted coordinates.
[0019] Optionally, the processing of the input parameter of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain the response parameter further includes:
[0020] If the rotation angle is zero, the coordinate point of the input parameter is used as the response parameter;
[0021] If the rotation angle is greater than zero, coordinate points other than the starting point coordinates are converted based on the rotation angle and the coordinate points of the input parameters to obtain response parameters, where the response parameters include the starting point coordinates and the converted coordinates.
[0022] Optionally, the processing of the input parameter of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain the response parameter further includes:
[0023] Get the interactive mode of the display screen;
[0024] If the display screen is in a vertical screen interaction mode and the rotation angle is zero degrees, the coordinate point of the input parameter is used as the response parameter;
[0025] If the display screen is in a portrait interaction mode and the rotation angle is non-zero, the coordinate points other than the starting point coordinates are converted based on the rotation angle and the coordinate points of the input parameters to obtain response parameters, and the response parameters include the starting point coordinates and the converted coordinates.
[0026] Optionally, the processing of the input parameter of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain the response parameter further includes:
[0027] If the display screen is in the first landscape interaction mode and the rotation angle is the first angle corresponding to the first landscape interaction mode, the coordinate points of the input parameters are converted according to the first conversion mode to obtain response parameters; if the display screen is in the first landscape interaction mode and the rotation angle is not equal to the first angle, based on the rotation angle relative to the first angle and the coordinate points of the input parameters, the coordinate points other than the coordinates of the starting point are converted to obtain first parameters to be converted, and the first parameters to be converted are converted according to the first conversion mode to obtain response parameters;
[0028] If the display screen is in the second landscape interaction mode and the rotation angle is the second angle corresponding to the second landscape interaction mode, the coordinate point of the input parameter is converted according to the second conversion method to obtain the response parameter; if the display screen is in the second landscape interaction mode and the rotation angle is not equal to the second angle, based on the rotation angle relative to the second angle and the coordinate point of the input parameter, the other coordinate points except the starting point coordinates are converted to obtain the second parameter to be converted, and the second parameter to be converted is converted according to the second conversion method to obtain the response parameter.
[0029] Optionally, the method further includes:
[0030] In the process of acquiring the input parameters, based on real-time detection of the rotation of the electronic device within the support surface, the angle at which the rotation stops is used as the rotation angle.
[0031] In another aspect, an embodiment of the present application further provides an electronic device, comprising:
[0032] An output unit, configured to project display content to a terminal device having a display output module via a connection channel, wherein the display content belongs to the electronic device;
[0033] An acquisition unit, used to acquire sensing parameters of the gravity sensor;
[0034] a processing unit configured to, if the sensing parameters obtained by the acquisition unit meet the support surface placement condition, process input parameters obtained by the touch sensing module for the focus displayed on the output area of the display output module based on a plane conversion strategy to obtain response parameters, wherein the input parameters are used to represent a movement operation of the operating body relative to a reference datum;
[0035] A control unit is used to control the display position of the focus in the output area to feedback the movement operation based on the response parameters obtained by the processing unit, and the direction of change of the display position of the focus in the output area is consistent with the direction of the movement operation of the operating body relative to the reference base.
[0036] Optionally, the processing unit is further used to process the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the space conversion strategy if the sensing parameters obtained by the acquisition unit meet the space holding condition.
[0037] Optionally, the sensing parameters acquired by the acquisition unit include an X-axis sensing value, a Y-axis sensing value, and a Z-axis sensing value, and the electronic device further includes:
[0038] A determining unit is configured to determine that the sensing parameters meet a support surface placement condition when the sensing value of the X axis included in the sensing parameters is zero and the sensing value of the Y axis included in the sensing parameters is zero.
[0039] Optionally, the processing unit includes:
[0040] Calling module, used to call the compass or gyroscope;
[0041] a determination module, configured to determine a rotation angle based on the sensing parameters of the compass or gyroscope obtained by the calling module;
[0042] The conversion module is used to convert the coordinate points other than the starting point coordinates based on the rotation angle obtained by the determination module and the coordinate points of the input parameters to obtain response parameters, wherein the response parameters include the starting point coordinates and the conversion coordinates.
[0043] Optionally, the processing unit further includes:
[0044] The determining module is further configured to, if the rotation angle is zero, use the coordinate point of the input parameter as the response parameter;
[0045] The conversion module is further configured to, if the rotation angle is greater than zero, convert other coordinate points except the starting point coordinates based on the rotation angle determined by the determination module and the coordinate points of the input parameters to obtain response parameters, wherein the response parameters include the starting point coordinates and the converted coordinates.
[0046] Optionally, the conversion module further includes:
[0047] The acquisition submodule is used to obtain the interaction mode of the display screen;
[0048] a determination submodule, wherein if the interaction mode of the display screen acquired by the acquisition submodule is in a vertical screen interaction mode and the rotation angle is zero, the coordinate point of the input parameter is used as the response parameter;
[0049] The conversion submodule is also used to obtain response parameters by converting other coordinate points except the starting point coordinates based on the rotation angle and the coordinate points of the input parameters if the interaction mode of the display screen obtained by the acquisition submodule is in a vertical screen interaction mode and the rotation angle is non-zero. The response parameters include the starting point coordinates and the conversion coordinates.
[0050] Optionally, the conversion module further includes:
[0051] The conversion submodule is further configured to, if the interaction mode of the display screen acquired by the acquisition submodule is in the first horizontal screen interaction mode and the rotation angle is the first angle corresponding to the first horizontal screen interaction mode, convert the coordinate point of the input parameter according to the first conversion mode to obtain the response parameter;
[0052] The conversion submodule is further configured to, if the interaction mode of the display screen acquired by the acquisition submodule is in the first horizontal screen interaction mode and the rotation angle is not equal to the first angle, convert other coordinate points except the coordinates of the starting point based on the rotation angle relative to the first angle and the coordinate points of the input parameters to obtain first parameters to be converted, and convert the first parameters to be converted according to the first conversion mode to obtain response parameters;
[0053] The conversion submodule is further configured to convert the coordinate point of the input parameter according to the second conversion mode to obtain a response parameter if the interaction mode of the display screen acquired by the acquisition submodule is in the second horizontal screen interaction mode and the rotation angle is a second angle corresponding to the second horizontal screen interaction mode;
[0054] The conversion submodule is also used to, if the interaction mode of the display screen acquired by the acquisition submodule is in the second horizontal screen interaction mode and the rotation angle is not equal to the second angle, convert other coordinate points except the starting point coordinates based on the rotation angle relative to the second angle and the coordinate points of the input parameters to obtain second parameters to be converted, and convert the second parameters to be converted according to the second conversion mode to obtain response parameters.
[0055] Optionally, the electronic device further includes:
[0056] The detection unit, in the process of acquiring the input parameters, detects the rotation of the electronic device within the support surface in real time and uses the angle when the rotation stops as the rotation angle.
[0057] By means of the above technical solution, the technical solution provided by the embodiment of the present application has at least the following advantages:
[0058] The embodiment of the present application provides a processing method and electronic device, which projects display content to a terminal device with a display output module through a connection channel, and obtains the sensing parameters of the gravity sensor. If the sensing parameters meet the support surface placement conditions, the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module are processed based on the plane conversion strategy to obtain response parameters, and then the display position of the focus in the output area is controlled according to the response parameters to feedback the movement operation. In this way, when the electronic device is placed on the support surface for use, the electronic device can detect the posture change of the touch display screen on the support surface, thereby ensuring that the user's movement operation direction relative to the touch display screen is consistent with the movement direction of the display position of the focus on the output area on the terminal device, thereby facilitating convenient use by the user.
[0059] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0060] Figure 1 A schematic diagram showing the sliding direction comparison provided in an embodiment of the present application;
[0061] Figure 2 A flowchart of a processing method provided in an embodiment of the present application;
[0062] Figure 3 A flow chart of another processing method provided in an embodiment of the present application;
[0063] Figure 4 A flow chart of another processing method provided in an embodiment of the present application;
[0064] Figure 5 A block diagram of an electronic device according to an embodiment of the present application;
[0065] Figure 6 A block diagram of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0066] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0067] Nowadays, mobile phones and other devices, as mobile terminals that people carry daily, have more and more functions and are becoming more and more abundant. By pairing the mobile terminal with display devices such as monitors and projectors, the touch screen of the mobile terminal can be used as a touchpad to control the cursor in the display. After the pairing is successful, the cursor movement on the display can be controlled in real time through the touch operation of the user on the screen of the mobile terminal. In order to facilitate the user to perform touch operations, the mobile terminal is often placed on a support surface such as a desktop for use. The applicability of the automatic rotation function of the mobile terminal screen is poor, and the existing screen rotation function generally rotates 90 degrees. Therefore, for operations on the touch screen in this case, the electronic device needs to be able to detect the posture change of the touch screen on the support surface to ensure that the user's moving operation direction relative to the touch screen is consistent with the moving direction of the display position of the focus on the output area on the terminal device, thereby facilitating user convenient use. To this end, an embodiment of the present application provides a processing method, and its specific execution steps are as follows: Figure 2 As shown, including:
[0068] 101. Project the display content to a terminal device having a display output module through a connection channel.
[0069] Among them, the display content belongs to the electronic device. The execution subject in each step in the embodiment of the present application is an electronic device, and the electronic device includes but is not limited to: electronic devices with touch screens such as tablet computers and smart phones, and terminal devices include but are not limited to all-in-one computers, smart TVs, projectors, etc. with display output modules or capable of screen projection functions. After the electronic device is connected to the terminal device, the display content on the touch screen of the electronic device can be projected onto the display screen of the terminal device for display, and the connection method between the electronic device and the terminal device can be an Internet connection or a local area network connection. The specific connection can be a wired connection or a wireless connection. In this regard, this embodiment does not limit the connection method between the electronic device and the terminal device.
[0070] 102. Obtain the sensing parameters of the gravity sensor.
[0071] In an embodiment of the present application, the gravity sensor is a conventional built-in sensing component in an electronic device. Specifically, the gravity sensor can use the spatial coordinate system in the space where the electronic device is located as a reference, and determine the three-dimensional vector indicating the direction and magnitude of gravity provided by the gravity sensor based on the current posture of the electronic device. The change in the three-dimensional vector is the sensing parameter obtained by the gravity sensor. The change in the sensing parameter can be used to determine the relative screen direction of the touch display screen of the electronic device in the space where it is located.
[0072] 103. If the sensing parameters meet the support surface placement condition, process the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain response parameters.
[0073] Among them, the input parameters are used to characterize the movement operation of the operating body relative to the reference base. In the embodiment of the present application, the operating body refers to the executive body that performs the touch operation through the touch sensing module, which can be the user's hand or the stylus held by the user. This application does not limit this. The input parameters are the set of input coordinate points obtained by the electronic device through the touch sensing module when the user slides on the touch display screen of the electronic device through his hand or stylus, and the response parameters are the set of response coordinate points after the input coordinate point set obtained by the touch sensing module is processed by the plane transformation strategy.
[0074] It should be noted that the reference datum is defined relative to the user who controls the operating body. Figure 1 As shown in columns A and B:
[0075] (1) Pass Figure 1As can be seen from column A, when the electronic device is placed on a horizontal desktop and is used with the screen in portrait orientation facing the user, the portrait state of the electronic device can be defaulted to the reference state corresponding to the connection with the terminal device. If the user slides horizontally on the touch screen of the electronic device through the operating body, the sliding trajectory at this time is horizontal relative to the user or the touch screen of the electronic device, and the moving direction of the focus displayed on the output area is also horizontal.
[0076] (2) Pass Figure 1 As can be seen from column B, when the electronic device is rotated to one side by an angle θ relative to the aforementioned vertical screen state, if the user still slides horizontally on the touch screen of the electronic device according to the sliding direction (1), the sliding direction at this time is horizontal relative to the user, but relative to the touch screen of the electronic device, the sliding direction at this time is inclined, and the moving direction of the focus displayed on the output area is also inclined.
[0077] It can be seen from this that in the prior art, when the placement state of the electronic device on the supporting surface is at an angle relative to the vertical screen state of the electronic device, the operation direction of the user through the operating body on the touch display screen of the electronic device is inconsistent with the moving direction of the focus displayed on the output area of the terminal device.
[0078] (3) Pass Figure 1 From the C column, we can see that the status of the C column is the same as that of the B column. Figure 1 In the case of the situation in column B of the present application, the embodiment of the present application can obtain the input parameters through the touch sensing module in the electronic device, and process the input parameters through the plane conversion strategy to obtain the response parameters. The input parameters at this time are Figure 1 The dashed part of the electronic device side in column C of Figure 1 The solid line part on the electronic device side in column C intersects with the dotted line part, and the angle between the dotted line part and the solid line part is equal to the angle θ. Therefore, the response parameter at this time is Figure 1 The solid line portion on the electronic device side in column A ensures that the operation direction of the user through the operating body on the touch display screen of the electronic device is inconsistent with the moving direction of the focus displayed on the output area of the terminal device.
[0079] 104. Control the display position of the focus in the output area according to the response parameter to feedback the movement operation, wherein the change direction of the display position of the focus in the output area is consistent with the direction of the movement operation of the operating body relative to the reference base.
[0080] In the embodiments of the present application, the shape of the focus includes but is not limited to: arrow shape, circle, square, cross shape, etc. The user can customize it according to the specific operating environment and usage requirements. In addition, the focus can hide its movement trajectory when its display position changes, or it can retain its movement trajectory when its display position changes. This is not limited in the present application.
[0081] For example, when a user needs to slide on the touch screen of an electronic device to control the focus in the output area to perform operations such as marking lines or inputting text, the focus can be set to a cross shape and the movement track can be retained.
[0082] A processing method provided by an embodiment of the present application, a processing method and an electronic device provided by an embodiment of the present application, which projects display content to a terminal device having a display output module through a connection channel, and obtains the sensing parameters of the gravity sensor. If the sensing parameters meet the support surface placement conditions, the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module are processed based on the plane conversion strategy to obtain response parameters, and then the display position of the focus in the output area is controlled according to the response parameters to feedback the movement operation. In this way, when the electronic device is placed on a support surface for use, the electronic device can detect the posture change of the touch display screen on the support surface, thereby ensuring that the user's movement operation direction relative to the touch display screen is consistent with the movement direction of the display position of the focus on the output area on the terminal device, thereby facilitating convenient use by the user.
[0083] Furthermore, as a Figure 2 The embodiment of the present application further provides another processing method, such as Figure 3 As shown, the specific steps are as follows:
[0084] 201. Project the display content to a terminal device having a display output module through a connection channel.
[0085] Among them, the displayed content belongs to the electronic device.
[0086] This step is combined with the description of step 101 in the above method, and the same content is not repeated here.
[0087] 202. Obtain sensing parameters of the gravity sensor.
[0088] This step is combined with the description of step 102 in the above method, and the same contents are not repeated here.
[0089] 203. When the sensing value of the X-axis included in the sensing parameters is zero and the sensing value of the Y-axis included in the sensing parameters is zero, it is determined that the sensing parameters meet the support surface placement condition.
[0090] In an embodiment of the present application, the sensing parameter is a three-dimensional vector indicating the direction and magnitude of gravity of the current posture of the electronic device relative to the spatial coordinate system, obtained by the gravity sensor in the electronic device, wherein the three-dimensional vector is specifically the sensing value of the X-axis, the sensing value of the Y-axis, and the sensing value of the Z-axis. When the sensing value of the X-axis and the sensing value of the Y-axis are both zero, the electronic device is parallel to the plane formed by the X-axis and the Y-axis in the spatial coordinate system, that is, parallel to the ground plane, thereby determining whether the current state of the electronic device meets the support surface placement conditions. If so, execute step 204.
[0091] It should be noted that in this step, the sensing parameters are also used to characterize the motion stability and spatial position of the electronic device. Motion stability is determined by whether the X-axis and Y-axis sensing values of the sensing parameters change within a preset time range. When the X-axis and Y-axis sensing values of the sensing parameters do not change within the preset time range, the electronic device can be determined to be stable. The spatial position can be determined by whether the angle between the plane where the touch screen of the electronic device is located and the ground plane is within a preset angle range for the electronic device. This angle is the angle between the plane formed by the X-axis and Y-axis sensing values of the sensing parameters and the plane formed by the X-axis and Y-axis in the spatial coordinates. Because the automatic rotation function of the electronic device requires the touch screen of the electronic device to tilt to either side at a certain angle to work, when the aforementioned angle is within the angle range preset in the electronic device to control the operation of the automatic rotation function and does not change within the preset time range, it can also be determined that the spatial position of the electronic device meets the support surface placement conditions. Otherwise, it is determined that the electronic device meets the spatial holding conditions, and subsequent operations are performed based on the spatial conversion strategy.
[0092] According to the method of this step, by obtaining the sensing values of the X-axis, the Y-axis, and the Z-axis in the sensing parameters, it is possible to quickly determine whether the electronic device meets the support surface placement conditions, and then determine the plane conversion strategy when the electronic device is on the support surface, thereby providing a basis for subsequent detection of the rotation angle of the electronic device when it is placed on the support surface.
[0093] 204. Call the compass or gyroscope.
[0094] It's important to note that compasses and gyroscopes are commonly found in electronic devices. A gyroscope, also known as an angular velocity sensor, differs from an accelerometer in that it measures the angular velocity of an electronic device when it is tilted or deflected. In practical applications, it's impossible to measure or reconstruct the full three-dimensional motion of an electronic device's deflection or tilt using only an accelerometer. Without the ability to measure rotational motion, an accelerometer can only detect linear motion along an axis. However, a gyroscope is highly capable of measuring both rotational and deflection motion, enabling accurate analysis and interpretation of the user's actual movements.
[0095] In the embodiment of the present application, in this step, after determining that the electronic device meets the support surface placement conditions, the electronic device can automatically call the compass or gyroscope. The specific calling situation can be called separately or simultaneously, which is not limited in this application. The gyroscope can measure the rotational angular velocity of the electronic device in a horizontal position.
[0096] 205. Determine the rotation angle based on sensing parameters of the compass or gyroscope.
[0097] It should be noted that the rotation angle is obtained when the electronic device is placed on the support surface. The sensing parameters obtained based on the compass or gyroscope can be processed by a processor pre-installed in the electronic device to obtain the angle between the current state of the electronic device and the vertical screen state of the touch display screen of the electronic device. The angle at this time is the rotation angle.
[0098] According to the method of steps 204-205, only when the touch display screen of the electronic device meets the support surface placement conditions can the electronic device call the compass or gyroscope to work, so as to quickly obtain the rotation angle of the current state of the electronic device relative to the vertical screen state of the electronic device, thereby avoiding the compass or gyroscope from frequently obtaining sensing parameters under the support surface placement conditions and interfering with the detection of the rotation angle, thereby improving the accuracy of the electronic device in obtaining the rotation angle.
[0099] 206. If the rotation angle is zero, the coordinate point of the input parameter is used as the response parameter.
[0100] In this step, if the rotation angle is zero degrees, it can be determined that the electronic device is in a portrait state at this time, that is, the electronic device has not rotated. In this case, there is no need to process the input parameters through a plane conversion strategy. The coordinate point of the input parameter is directly used as the response parameter, and the display position of the focus in the output area is controlled according to the response parameter to feedback the moving operation. At this time, the direction of change of the display position of the focus in the output area is consistent with the direction of the moving operation of the operating body relative to the reference base.
[0101] 207. If the rotation angle is non-zero, convert the coordinate points other than the starting point coordinates based on the rotation angle and the input parameters to obtain response parameters, where the response parameters include the starting point coordinates and the converted coordinates.
[0102] In this step, if the rotation angle is non-zero, it can be determined that the electronic device is rotated at an angle relative to the portrait state. At this time, the starting point coordinates in the input parameters can be used as the origin, and a reference coordinate system can be established based on the reference reference in step 104, wherein the X-axis of the reference coordinate system is tangent to the ground plane at the current position of the device and approximately points to the east, the Y-axis is tangent to the ground plane at the current position of the device and points to the geomagnetic north pole, and the Z-axis points to the sky and is perpendicular to the ground plane. The reference coordinate system is then rotated around its origin according to the rotation angle determined in step 205 to obtain a new coordinate system. The coordinate points of the input parameters are then mapped to the new coordinate system through the coordinate system conversion principle to obtain the coordinate points of the response parameters. At this time, the trajectory direction of the coordinate points of the response parameters relative to the touch screen of the electronic device is Figure 1 In column A enter the coordinates of the parameters for the trajectory direction.
[0103] According to the method of steps 206-207, the response parameters are obtained by converting the coordinate points of the input parameters into coordinate points other than the starting point coordinates, and the coordinate point trajectory of the input parameters can be converted into the coordinate trajectory of the response parameters. Under the condition that the starting position for the user to slide on the display screen through the operating body corresponds to the focus position in the output area of the end device, the change direction of the display position of the focus in the output area is consistent with the direction of the moving operation of the operating body relative to the reference base.
[0104] 208. In the process of obtaining input parameters, based on real-time detection of the rotation of the electronic device within the support surface, the angle when the rotation stops is used as the rotation angle.
[0105] In actual applications, when a user slides an electronic device's touch screen through an operating body, if the force applied to the electronic device by the operating body is large, the electronic device will continue to rotate on the plane where it is located as the sliding operation progresses. If the calculation is still based on the rotation angle relative to the vertical screen state of the electronic device before the electronic device and the operating body make contact, it will inevitably have a negative impact on the accuracy of the conversion of input parameters into response parameters. Therefore, it is necessary to re-determine the angle at which the electronic device stops rotating as the rotation angle, and apply this rotation angle to step 207 to convert the input parameters, so as to obtain accurate response parameters and further improve the accuracy of the conversion calculation.
[0106] A processing method provided by an embodiment of the present application projects display content to a terminal device having a display output module through a connection channel, and obtains sensing parameters of a gravity sensor. When the sensing value of the X-axis included in the sensing parameters is zero and the sensing value of the Y-axis included in the sensing parameters is zero, it is determined that the sensing parameters meet the support surface placement conditions. Subsequently, a compass or a gyroscope is called and the rotation angle is determined based on the sensing parameters obtained from the two. If the rotation angle is zero degrees, the coordinate point of the input parameter is used as a response parameter. If the rotation angle is non-zero degrees, the response parameter is obtained by converting other coordinate points except the starting point coordinate based on the rotation angle and the coordinate point of the input parameter. In addition, in the process of obtaining the input parameters, the angle when the rotation stops is used as the rotation angle based on real-time detection of the rotation of the electronic device within the support surface. In this way, the electronic device can quickly determine whether it is being used under the condition of being placed on a supporting surface, and can quickly obtain the rotation angle of the electronic device's current state relative to its portrait state. At the same time, the rotation angle can also be re-determined based on whether the electronic device rotates when the user operates the touch screen of the electronic device through the operating body, thereby improving the accuracy of converting input parameters into response parameters, thereby ensuring that the user's moving operation direction relative to the electronic device is consistent with the moving direction of the display position on the end device, which is conducive to convenient use by the user.
[0107] Furthermore, as a refinement and expansion of the embodiment shown in the above steps 204-207, its purpose is to eliminate the need for the electronic device to use the coordinate conversion strategy in step 207 when it is in the horizontal or vertical state, and only need to use the coordinate rotation strategy when switching between horizontal and vertical screens in the prior art. The embodiment of the present application also provides another processing method, such as Figure 4 As shown, the specific steps are as follows:
[0108] 301. Obtain an interactive mode of the display screen.
[0109] It should be noted that the interactive mode of the display screen is the coordinate correspondence between the vertical screen state and the horizontal screen state of the electronic device and the terminal device after connection, which is obtained and determined in the process of the electronic device changing from a spatial holding state to a support surface placement state. According to the user's usage habits, vertical holding and horizontal holding are conventional holding habits. Therefore, when the user places the electronic device on the support surface for use, the electronic device can automatically determine the horizontal and vertical screen usage states corresponding to the touch display screen at this time. Among them, the vertical screen state is the application state in which the electronic device is placed vertically and is parallel to the Y-axis direction of the reference coordinate system in step 207, and the horizontal screen state can be divided into two types. The first is obtained by rotating the electronic device 90 degrees counterclockwise relative to the vertical screen state, and the second is obtained by rotating the electronic device 90 degrees clockwise relative to the vertical screen state, that is, the horizontally placed electronic device is parallel to the X-axis direction of the reference coordinate system in step 207.
[0110] 302. If the display screen is in a portrait interaction mode and the rotation angle is zero, the coordinate point of the input parameter is used as a response parameter.
[0111] Specifically, when the rotation angle is zero degrees, the portrait state of the electronic device is the current application state, that is, when the electronic device is placed vertically, it is parallel to the Y-axis direction of the reference coordinate system in step 207. Therefore, there is no need to perform coordinate conversion on the coordinate points of the input parameters, and the coordinate points of the input parameters can be directly used as the coordinate points of the response parameters.
[0112] 303. If the display screen is in a portrait interaction mode and the rotation angle is non-zero, convert the coordinate points other than the starting point coordinates based on the rotation angle and the input parameters to obtain response parameters, where the response parameters include the starting point coordinates and the converted coordinates.
[0113] Specifically, when the rotation angle is non-zero, it is known that the current application state of the electronic device is at an angle relative to the portrait state. Therefore, the input parameter coordinate point needs to be converted into the response parameter coordinate point according to the coordinate conversion strategy in step 207.
[0114] For example, when the user holds the electronic device vertically and places it on a supporting surface for use, the interaction mode of the touch screen of the electronic device when the user holds it vertically is a vertical screen interaction mode. When placed on the supporting surface for use, the touch screen of the electronic device will still use the vertical screen interaction mode. If the touch screen of the electronic device is parallel to the Y-axis direction of the reference coordinate system in step 207 at this time, the input parameters at this time will be converted into response parameters using the coordinate conversion strategy corresponding to the vertical screen interaction mode. Otherwise, the input parameters will be converted into response parameters according to the coordinate conversion strategy in step 207.
[0115] According to the method of steps 302-303, by detecting whether the touch display screen of the electronic device is in a vertical screen interaction mode and whether the rotation angle is zero degrees, it is possible to quickly determine whether the application state of the electronic device is a vertical screen state, and then directly use the coordinate conversion strategy corresponding to the vertical screen interaction mode after the electronic device is connected to the terminal device in the prior art to process the input parameters to obtain the response parameters, thereby reducing the computational burden of the coordinate conversion and avoiding interference between different coordinate conversion strategies.
[0116] 304. If the display screen is in the horizontal first interaction mode and the rotation angle is the first angle corresponding to the horizontal first interaction mode, the coordinate point of the input parameter is converted according to the first conversion method to obtain a response parameter.
[0117] Specifically, the first horizontal screen interaction mode is the coordinate conversion strategy corresponding to the horizontal screen state obtained by rotating the electronic device 90 degrees counterclockwise relative to the vertical screen state described in step 301. As can be seen from the above, the rotation angle is the angle formed by the current state of the electronic device relative to the vertical screen state. Therefore, when the interaction mode corresponding to the touch display screen of the electronic device is the first horizontal screen interaction mode, the corresponding first angle is -90 degrees. When the first angle is -90 degrees, the coordinate point of the input parameter only needs to be converted using the coordinate conversion strategy corresponding to the first horizontal screen interaction mode to obtain the corresponding response parameter coordinate point.
[0118] 305. If the display screen is in the first landscape interaction mode and the rotation angle is not equal to the first angle, based on the rotation angle relative to the first angle and the coordinate point of the input parameter, other coordinate points except the starting point coordinates are converted to obtain the first parameter to be converted, and the first parameter to be converted is converted according to the first conversion mode to obtain the response parameter.
[0119] Specifically, the first parameter to be converted is obtained based on the coordinate conversion strategy corresponding to the touch display screen in the first horizontal screen interaction mode. When the interaction mode corresponding to the touch display screen of the electronic device is the first horizontal screen interaction mode, if the rotation angle is not equal to -90 degrees, the coordinate point of the input parameter needs to be converted according to the coordinate conversion strategy in step 207 to obtain the corresponding response parameter coordinate point.
[0120] For example, when a user holds the electronic device horizontally and places it on a supporting surface for use, the interaction mode of the touch display screen of the electronic device when the user holds it horizontally is the first horizontal screen interaction mode. When placed on the supporting surface for use, the touch display screen of the electronic device will still use the first horizontal screen interaction mode. If the angle formed by the state of the electronic device relative to the vertical screen state is -100 degrees at this time, that is, the electronic device is rotated -100 degrees relative to its vertical screen state, because the interaction mode corresponding to the touch display screen of the electronic device is the first horizontal screen interaction mode, it is necessary to subtract the rotation angle relative to the vertical screen state, that is, -100 degrees, from the absolute value of the first angle, and determine whether it is a positive value or a negative value according to the rotation direction. It can be seen that the current state of the electronic device is -10 degrees counterclockwise rotated relative to the first horizontal screen state described in step 301, and then according to the rotation angle, the coordinate point of the input parameter at this time needs to be converted according to the coordinate conversion strategy in step 207 to obtain the corresponding response parameter coordinate point.
[0121] 306. If the display screen is in the second horizontal interaction mode and the rotation angle is a second angle corresponding to the second horizontal interaction mode, the coordinate point of the input parameter is converted according to the second conversion method to obtain a response parameter.
[0122] Specifically, the second horizontal screen interaction mode is the coordinate conversion strategy corresponding to the horizontal screen state obtained by rotating the electronic device 90 degrees clockwise relative to the vertical screen state described in step 301. As mentioned above, the rotation angle is the angle formed by the current state of the electronic device relative to the vertical screen state. Therefore, when the interaction mode corresponding to the touch display screen of the electronic device is the second horizontal screen interaction mode, the corresponding second angle is 90 degrees. When the second angle is 90 degrees, the coordinate point of the input parameter only needs to be converted using the coordinate conversion strategy corresponding to the second horizontal screen interaction mode to obtain the corresponding response parameter coordinate point.
[0123] 307. If the display screen is in the second landscape interaction mode and the rotation angle is not equal to the second angle, based on the rotation angle relative to the second angle and the coordinate point of the input parameter, other coordinate points except the starting point coordinates are converted to obtain second parameters to be converted, and the second parameters to be converted are converted according to the second conversion mode to obtain response parameters.
[0124] Specifically, the second parameter to be converted is obtained based on the coordinate conversion strategy corresponding to the second horizontal interaction mode of the touch display screen. When the interaction mode corresponding to the touch display screen of the electronic device is the second horizontal interaction mode, if the rotation angle is not equal to 90 degrees, the coordinate point of the input parameter needs to be converted according to the coordinate conversion strategy in step 207 to obtain the corresponding response parameter coordinate point.
[0125] For example, when the user holds the electronic device horizontally and places it on a desktop for use, the interaction mode of the touch screen of the electronic device when the user holds it horizontally is the second horizontal screen interaction mode. When placed on the desktop for use, the touch screen of the electronic device will still use the second horizontal screen interaction mode. If the angle formed by the state of the electronic device relative to the vertical screen state is 100 degrees at this time, that is, the electronic device is rotated 100 degrees relative to its vertical screen state, because the interaction mode corresponding to the touch screen of the electronic device is the second horizontal screen interaction mode, it is necessary to subtract the rotation angle relative to the vertical screen state, that is, 100 degrees, from the absolute value of the first angle, and determine whether it is a positive value or a negative value according to the rotation direction. It can be seen that the current state of the electronic device is 10 degrees clockwise rotated relative to the second horizontal screen state described in step 301, and then according to the rotation angle, the coordinate point of the input parameter at this time needs to be converted according to the coordinate conversion strategy in step 207 to obtain the corresponding response parameter coordinate point.
[0126] According to the method of steps 304-307, by detecting whether the touch display screen of the electronic device is in the horizontal screen interaction mode and the rotation angle, it is possible to quickly determine whether the application state of the electronic device is the horizontal screen state, and then directly use the coordinate conversion strategy corresponding to the horizontal screen interaction mode after the electronic device is connected to the terminal device in the existing technology to process the input parameters to obtain the response parameters, thereby reducing the computational burden of the coordinate conversion and avoiding interference between different coordinate conversion strategies.
[0127] Furthermore, as a response to the above Figure 2-4 In order to realize the method shown in FIG. 1 , the embodiment of the present application further provides an electronic device for Figure 2-4 This electronic device embodiment corresponds to the aforementioned method embodiment. For ease of reading, this electronic device embodiment will not describe the details of the aforementioned method embodiment one by one, but it should be clear that the electronic device in this embodiment can implement all the contents of the aforementioned method embodiment. Figure 5 As shown, the electronic device includes:
[0128] An output unit 401 is configured to project display content to a terminal device having a display output module via a connection channel, wherein the display content belongs to the electronic device;
[0129] An acquisition unit 402 is used to acquire sensing parameters of the gravity sensor;
[0130] a processing unit 403 configured to, if the sensing parameters obtained by the acquisition unit 402 meet the support surface placement condition, process input parameters obtained by the touch sensing module for the focus displayed on the output area of the display output module based on the plane conversion strategy to obtain response parameters, wherein the input parameters are used to represent the movement operation of the operating body relative to the reference datum;
[0131] The control unit 404 is used to control the display position of the focus in the output area to feedback the movement operation based on the response parameters obtained by the processing unit 403, and the change direction of the display position of the focus in the output area is consistent with the direction of the movement operation of the operating body relative to the reference base.
[0132] Further, such as Figure 6 As shown, the processing unit 403 is further used to process the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the space conversion strategy if the sensing parameters obtained by the acquisition unit 402 meet the spatial holding conditions.
[0133] Further, such as Figure 6 As shown, the sensing parameters acquired by the acquisition unit 402 include the sensing value of the X axis, the sensing value of the Y axis, and the sensing value of the Z axis. The electronic device also includes:
[0134] The determining unit 405 is configured to determine that the sensing parameters meet the support surface placement condition when the sensing value of the X axis included in the sensing parameters acquired by the acquiring unit 402 is zero and the sensing value of the Y axis included in the sensing parameters is zero.
[0135] Further, such as Figure 6 As shown, the processing unit 403 includes:
[0136] The calling module 4031 is used to call the compass or gyroscope;
[0137] A determination module 4032 is configured to determine a rotation angle based on the sensing parameters of the compass or gyroscope obtained by calling module 4031;
[0138] The conversion module 4033 is used to convert the coordinate points other than the starting point coordinates based on the rotation angle obtained by the determination module 4032 and the coordinate points of the input parameters to obtain response parameters, where the response parameters include the starting point coordinates and the converted coordinates.
[0139] Further, such as Figure 6 As shown, the processing unit 403 further includes:
[0140] The determination module 4032 is further configured to, if the rotation angle is zero, use the coordinate point of the input parameter as a response parameter;
[0141] The conversion module 4033 is also used to, if the rotation angle is greater than zero, convert other coordinate points except the starting point coordinates based on the rotation angle determined by the determination module 4032 and the coordinate points of the input parameters to obtain response parameters, and the response parameters include the starting point coordinates and the converted coordinates.
[0142] Further, such as Figure 6 As shown, the conversion module 4033 also includes:
[0143] The acquisition submodule 40331 is used to obtain the interaction mode of the display screen;
[0144] The determining submodule 40332 is configured to input the coordinate point of the parameter as a response parameter if the interaction mode of the display screen obtained by the obtaining submodule 40331 is in the portrait interaction mode and the rotation angle is zero degrees;
[0145] The conversion submodule 40333 is also used to obtain response parameters by converting other coordinate points except the starting point coordinates based on the rotation angle and the coordinate points of the input parameters if the interaction mode of the display screen obtained by the acquisition submodule 40331 is in vertical screen interaction mode and the rotation angle is non-zero. The response parameters include the starting point coordinates and the conversion coordinates.
[0146] Further, such as Figure 6 As shown, the conversion module also includes:
[0147] The conversion submodule 40333 is further configured to, if the interaction mode of the display screen acquired by the acquisition submodule 40331 is in the first horizontal interaction mode and the rotation angle is the first angle corresponding to the first horizontal interaction mode, convert the coordinate point of the input parameter according to the first conversion mode to obtain a response parameter;
[0148] The conversion submodule 40333 is further configured to, if the interaction mode of the display screen acquired by the acquisition submodule 40331 is in the first landscape interaction mode and the rotation angle is not equal to the first angle, convert the coordinate points other than the starting point coordinates based on the rotation angle relative to the first angle and the coordinate points of the input parameters to obtain a first parameter to be converted, and convert the first parameter to be converted according to the first conversion mode to obtain a response parameter;
[0149] The conversion submodule 40333 is further configured to, if the interaction mode of the display screen acquired by the acquisition submodule 40331 is in the second landscape interaction mode and the rotation angle is a second angle corresponding to the second landscape interaction mode, convert the coordinate point of the input parameter according to the second conversion mode to obtain a response parameter;
[0150] The conversion submodule 40333 is also used to, if the interaction mode of the display screen acquired by the acquisition submodule 40331 is in the second horizontal screen interaction mode and the rotation angle is not equal to the second angle, convert the other coordinate points except the starting point coordinates based on the rotation angle relative to the second angle and the coordinate point of the input parameter to obtain the second parameter to be converted, and convert the second parameter to be converted according to the second conversion mode to obtain the response parameter.
[0151] Further Figure 6 As shown, the electronic device also includes:
[0152] The detection unit, in the process of acquiring the input parameters, detects the rotation of the electronic device within the support surface in real time and uses the angle when the rotation stops as the rotation angle.
[0153] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0154] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0155] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.
[0156] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0157] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.
[0158] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0159] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.
[0160] Through the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus necessary general-purpose hardware, or of course by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, hard disk or optical disk, and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
[0161] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A treatment method, comprising: Projecting display content to a terminal device having a display output module through a connection channel, wherein the display content belongs to the electronic device; Get the sensing parameters of the gravity sensor; If the sensing parameters satisfy the support surface placement conditions, processing the input parameters obtained by the touch sensing module for the focus displayed on the output area of the display output module based on a plane conversion strategy to obtain response parameters, wherein the input parameters are used to represent the movement operation of the operating body relative to the reference reference, the support surface placement conditions are used to represent the conditions used for placement on the support surface, and the plane conversion strategy is used to represent a strategy for performing plane coordinate conversion on coordinate points of the input parameters other than the starting point coordinates based on the rotation angle determined by the sensing parameters; The display position of the focus in the output area is changed according to the response parameter control to feedback the movement operation, and the change direction of the display position of the focus in the output area is consistent with the direction of the movement operation of the operating body relative to the reference base.
2. The method according to claim 1, characterized in that The method further comprises: If the sensing parameters meet the spatial grip condition, the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module are processed based on the spatial conversion strategy.
3. The method according to claim 1, characterized in that The sensing parameters include the sensing value of the X axis, the sensing value of the Y axis and the sensing value of the Z axis; When the sensing value of the X-axis included in the sensing parameter is zero and the sensing value of the Y-axis included in the sensing parameter is zero, it is determined that the sensing parameter meets the support surface placement condition.
4. The method according to claim 3, characterized in that The processing of the input parameters of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain the response parameters includes: Call the compass or gyroscope; determining a rotation angle based on sensing parameters of the compass or the gyroscope; Based on the rotation angle and the coordinate points of the input parameters, other coordinate points except the coordinates of the starting point are converted to obtain response parameters, where the response parameters include the coordinates of the starting point and the converted coordinates.
5. The method according to claim 4, characterized in that The processing of the input parameter of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain the response parameter further includes: If the rotation angle is zero, the coordinate point of the input parameter is used as the response parameter; If the rotation angle is non-zero, the coordinate points other than the starting point coordinates are converted based on the rotation angle and the coordinate points of the input parameters to obtain response parameters, where the response parameters include the starting point coordinates and the converted coordinates.
6. The method according to claim 4, characterized in that The processing of the input parameter of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain the response parameter further includes: Get the interactive mode of the display screen; If the display screen is in a vertical screen interaction mode and the rotation angle is zero degrees, the coordinate point of the input parameter is used as the response parameter; If the display screen is in a portrait interaction mode and the rotation angle is non-zero, the coordinate points other than the starting point coordinates are converted based on the rotation angle and the coordinate points of the input parameters to obtain response parameters, and the response parameters include the starting point coordinates and the converted coordinates.
7. The method according to claim 6, characterized in that The processing of the input parameter of the focus displayed on the output area of the display output module obtained by the touch sensing module based on the plane conversion strategy to obtain the response parameter further includes: If the display screen is in the first landscape interaction mode and the rotation angle is the first angle corresponding to the first landscape interaction mode, the coordinate points of the input parameters are converted according to the first conversion mode to obtain response parameters; if the display screen is in the first landscape interaction mode and the rotation angle is not equal to the first angle, based on the rotation angle relative to the first angle and the coordinate points of the input parameters, the coordinate points other than the coordinates of the starting point are converted to obtain first parameters to be converted, and the first parameters to be converted are converted according to the first conversion mode to obtain response parameters; If the display screen is in the second landscape interaction mode and the rotation angle is the second angle corresponding to the second landscape interaction mode, the coordinate point of the input parameter is converted according to the second conversion method to obtain the response parameter; if the display screen is in the second landscape interaction mode and the rotation angle is not equal to the second angle, based on the rotation angle relative to the second angle and the coordinate point of the input parameter, the other coordinate points except the starting point coordinates are converted to obtain the second parameter to be converted, and the second parameter to be converted is converted according to the second conversion method to obtain the response parameter.
8. The method according to claim 4, characterized in that The method further comprises: In the process of acquiring the input parameters, based on real-time detection of the rotation of the electronic device within the support surface, the angle at which the rotation stops is used as the rotation angle.
9. An electronic device, comprising: An output unit, configured to project display content to a terminal device having a display output module via a connection channel, wherein the display content belongs to the electronic device; An acquisition unit, used to acquire sensing parameters of the gravity sensor; a processing unit configured to, if the sensing parameters obtained by the acquisition unit satisfy the support surface placement conditions, process input parameters obtained by the touch sensing module for the focus displayed on the output area of the display output module based on a plane conversion strategy to obtain response parameters, wherein the input parameters are used to represent a movement operation of the operating body relative to a reference datum, the support surface placement conditions are used to represent conditions used for placement on the support surface, and the plane conversion strategy is used to represent a strategy for performing plane coordinate conversion on coordinate points of the input parameters other than the coordinates of the starting point based on a rotation angle determined by the sensing parameters; A control unit is used to control the display position of the focus in the output area to feedback the movement operation based on the response parameters obtained by the processing unit, and the direction of change of the display position of the focus in the output area is consistent with the direction of the movement operation of the operating body relative to the reference base.
10. The electronic device according to claim 9, characterized in that The sensing parameters acquired by the acquisition unit include an X-axis sensing value, a Y-axis sensing value, and a Z-axis sensing value. The electronic device further includes: a determining unit, configured to determine that the sensing parameters satisfy a support surface placement condition when an X-axis sensing value included in the sensing parameters is zero and a Y-axis sensing value included in the sensing parameters is zero; The processing unit includes: Calling module, used to call the compass or gyroscope; a determination module, configured to determine a rotation angle based on the sensing parameters of the compass or gyroscope obtained by the calling module; a conversion module, configured to convert the coordinate points other than the starting point coordinates based on the rotation angle obtained by the determination module and the coordinate points of the input parameters to obtain response parameters, wherein the response parameters include the starting point coordinates and the converted coordinates; or The processing unit further includes: The determining module is further configured to, if the rotation angle is zero, use the coordinate point of the input parameter as the response parameter; The conversion module is further configured to, if the rotation angle is greater than zero, convert other coordinate points except the starting point coordinates based on the rotation angle determined by the determination module and the coordinate points of the input parameters to obtain response parameters, wherein the response parameters include the starting point coordinates and the converted coordinates.
Citation Information
Patent Citations
Projection screen display method and related device
CN109960449A
Head-mounted display apparatus and automatic calibration method of touch device thereof
WO2019100299A1