An information processing method and an information processing apparatus
By generating display data and using sensor-sensing information to control the movement of position indicators on the display screen, the problem of low touchpad operation flexibility is solved, enabling more flexible operation of displayed content.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-01
- Publication Date
- 2026-04-14
AI Technical Summary
The existing technology offers low flexibility in operating the displayed content via touchpad.
By generating display data and using the sensor information of the electronic device to control the movement of the position indicator on the display screen, flexible operation of the displayed content can be achieved.
It improves the flexibility of operating the displayed content and solves the problem of low touchpad operation flexibility.
Smart Images

Figure CN115357129B_ABST
Abstract
Description
Technical Field
[0001] This application relates to information processing technology in the field of information processing, and more particularly to an information processing method and an information processing apparatus. Background Technology
[0002] With the development of communication technology, electronic devices are being used more and more widely. When operating the content displayed on the screen of an electronic device, one usually clicks or swipes on the touchpad provided by the electronic device to operate the displayed content. However, this method of operating the displayed content through the touchpad is not very flexible. Summary of the Invention
[0003] To address the aforementioned technical problems, this application provides an information processing method and an information processing device, which solve the problem of low flexibility in operating the displayed content via a touchpad in related technologies, and improve the flexibility of operating the displayed content.
[0004] An information processing method, the method comprising:
[0005] Generate display data, which is used by a display device connected to an electronic device to output a display screen;
[0006] If the electronic device is in the target state, it obtains the identification display data of the location indicator and the first sensing information of the first target sensor; wherein, the first sensing information is used to characterize the movement of the electronic device in the target state; the identification display data is used by the display device to output the location indicator;
[0007] Based on the first sensing information, the position indicator is controlled to move on the display screen.
[0008] In the above scheme, the electronic device being in the target state includes:
[0009] The opening angle between the first body and the second body of the electronic device is within the target range.
[0010] The method in the above scheme further includes:
[0011] The second sensing information of the second target sensor of the electronic device satisfies the target sensing condition; wherein the second sensing information is used to characterize the attitude of the electronic device.
[0012] In the above scheme, generating display data includes:
[0013] If the electronic device is connected to the display device, target display data corresponding to the display device is generated.
[0014] In the above scheme, controlling the position indicator to move on the display screen based on the first sensing information includes:
[0015] The first movement information of the electronic device is determined based on the first sensing information;
[0016] Based on the first movement information, determine the second movement information of the location indicator;
[0017] Based on the second movement information, the position indicator is controlled to move on the display screen.
[0018] In the above scheme, determining the first movement information of the electronic device based on the first sensing information includes:
[0019] Based on the first sensing parameter for the first direction and the second sensing parameter for the second direction at the first moment, and the third sensing parameter for the first direction and the fourth sensing parameter for the second direction at the second moment, the movement change parameters of the electronic device are determined; wherein, the first sensing information includes the first sensing parameter, the second sensing parameter, the third sensing parameter, and the third sensing parameter; the first moment is earlier than the second moment;
[0020] The first movement time of the electronic device is determined based on the first time and the second time, and the first movement direction of the electronic device is determined based on the third sensing parameter and the fourth sensing parameter. The first movement information includes the first movement time, the first movement direction, and the movement change parameter.
[0021] In the above scheme, determining the first moving direction of the electronic device based on the third sensing parameter and the fourth sensing parameter includes:
[0022] Based on the third and fourth sensing parameters, the target value and the range of the movement direction of the electronic device are determined.
[0023] The first moving direction is determined based on the target value and the range of moving directions.
[0024] In the above scheme, determining the movement change parameters of the electronic device based on the first sensing parameter for the first direction and the second sensing parameter for the second direction at the first moment, and the third sensing parameter for the first direction and the fourth sensing parameter for the second direction at the second moment, includes:
[0025] Determine the first sensing change parameter between the first sensing parameter and the third sensing parameter;
[0026] A second sensing change parameter is determined between the second sensing parameter and the fourth sensing parameter; wherein the movement change parameter includes the first sensing change parameter and the second sensing change parameter.
[0027] In the above scheme, determining the second movement information of the location indicator based on the first movement information includes:
[0028] Based on the first sensing change parameter and the second sensing change parameter, the target moving speed of the location indicator is determined;
[0029] Determine the second movement direction of the position indicator based on the first movement direction;
[0030] The second movement time of the location indicator is determined based on the first movement time, and the target movement distance of the location indicator is determined based on the target movement speed and the second movement time; wherein, the second movement information includes the second movement direction and the target movement distance.
[0031] In the above scheme, determining the target moving speed of the position indicator based on the first sensing change parameter and the second sensing change parameter includes:
[0032] Based on the resolution of the display device, determine the correspondence between the sensing change parameters and the moving speed of the position indicator;
[0033] Based on the first sensing change parameter and the correspondence, the first sub-moving speed of the location indicator is determined, and based on the second sensing change parameter and the correspondence, the second sub-moving speed of the location indicator is determined.
[0034] The target movement speed is obtained based on the first sub-movement speed and the second sub-movement speed.
[0035] The method in the above scheme further includes:
[0036] Upon receiving a user's pressing operation on the first body and the second body, a first opening angle between the first body and the second body is determined, and a second opening angle between the first body and the second body is determined before the user performs the pressing operation;
[0037] Based on the first opening angle and the second opening angle, the data corresponding to the target sub-display screen in the display data is adjusted to obtain the display data to be updated; wherein, the display screen includes the target sub-display screen;
[0038] Update the display data based on the display data to be updated.
[0039] An information processing apparatus, the apparatus comprising:
[0040] A generation unit is used to generate display data, which is used by a display device connected to an electronic device to output a display screen.
[0041] The acquisition unit is configured to, if the electronic device is in a target state, acquire identification display data of a location indicator and first sensing information of a first target sensor; wherein, the first sensing information is used to characterize the movement of the electronic device in the target state; and the identification display data is used by the display device to output the location indicator.
[0042] The processing unit is configured to control the position indicator to move on the display screen based on the first sensing information.
[0043] An electronic device, the electronic device comprising: a processor and a memory;
[0044] The processor is used to generate display data, which is used by a display device connected to an electronic device to output a display screen.
[0045] The processor is further configured to, if the electronic device is in a target configuration, obtain from a memory identification display data of a location indicator and first sensing information of a first target sensor; wherein, the first sensing information is used to characterize the movement of the electronic device in the target configuration; and the identification display data is used by the display device to output the location indicator.
[0046] The processor is also configured to control the position indicator to move on the display screen based on the first sensing information. Attached Figure Description
[0047] Figure 1 A flowchart illustrating an information processing method provided in an embodiment of this application;
[0048] Figure 2 This is a schematic diagram of the electronic device in the target configuration provided in the embodiments of this application;
[0049] Figure 3 A flowchart illustrating another information processing method provided in an embodiment of this application;
[0050] Figure 4 A schematic diagram illustrating the acquisition of first sensing information by a first target sensor in an electronic device provided in an embodiment of this application;
[0051] Figure 5A flowchart illustrating another information processing method provided in an embodiment of this application;
[0052] Figure 6 A schematic flowchart illustrating the detection of the form of an electronic device in an information processing method provided in an embodiment of this application;
[0053] Figure 7 A schematic diagram illustrating an application scenario of an electronic device provided in an embodiment of this application;
[0054] Figure 8 A top view of the electronic device provided in the embodiments of this application in the target configuration;
[0055] Figure 9 This is a schematic diagram of the structure of the information processing device provided in the embodiments of this application;
[0056] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0057] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.
[0058] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.
[0059] This application provides an information processing method, which is applied to electronic devices, such as... Figure 1 As shown, the method includes the following steps:
[0060] Step 101: Generate display data. The display data is used by the display device connected to the electronic device to output the display screen.
[0061] In this embodiment, the display data may be generated based on the resolution of the display device; the display device may be a display screen inside an electronic device; of course, it may also be a display screen external to the electronic device; the electronic device may send the display data to the display device, and the display device may drive the display pixels of the display screen to present the display content corresponding to the display data based on the received display data.
[0062] Step 102: If the electronic device is in target mode, obtain the identification display data of the location indicator and the first sensing information of the first target sensor.
[0063] The first sensing information is used to characterize the movement of the electronic device in the target form; the identification display data is used to display the device output position indication label.
[0064] In this embodiment, an adjustment command for adjusting the form of an electronic device can be received, and the form of the electronic device can be automatically adjusted based on the adjustment command. The adjustment command can be sent by the user to the electronic device through another device; of course, the form of the electronic device can also be manually adjusted by the user. The electronic device can detect its own form in real time, and when it detects that its form is in a target form, it generates location indicator display data and collects first sensing information when the electronic device moves through a first target sensor. The electronic device can send the location indicator display data to a display device, and the display device drives the display pixels on its screen to display the location indicator based on the received location indicator display data. The first target sensor can be an accelerometer. The location indicator can be an icon for indicating a position; in one feasible implementation, the icon can be an arrow.
[0065] It should be noted that the identification display data and the first sensing information can be obtained simultaneously; or the identification display data can be obtained first and then the first sensing information can be obtained; or the first sensing information can be obtained first and then the identification display data can be obtained. In this embodiment of the application, the execution order between obtaining the first sensing information and obtaining the identification display data is not limited.
[0066] The target state of the electronic device can be defined as the opening and closing angle between the first and second bodies of the electronic device falling within a target range. This opening and closing angle can be understood as the angle between the first and second bodies, and the target range is a pre-defined angle range. The first and second bodies are connected by a folding shaft.
[0067] In one feasible implementation, the first body can be a screen on an electronic device, and the second body can be a button control panel on an electronic device; the opening and closing angle can be obtained by an angle sensor set on the folding axis between the first body and the second body.
[0068] The electronic device being in the target state can also mean that the opening angle between the first body and the second body of the electronic device falls within the target range, and the second sensing information of the second target sensor of the electronic device satisfies the target sensing condition; wherein, the second sensing information is used to characterize the attitude of the electronic device; the second target sensor can be a gravity sensor. The target sensing condition is that the second sensing information satisfies the target sensing condition.
[0069] In one feasible implementation, the electronic device is a mobile phone. The phone's internal gravity sensor can measure the gravity parameters of the phone screen. The second sensing information includes the gravity parameters. When measuring the gravity parameters of the phone screen, a three-dimensional coordinate system is established with the phone screen as a reference. The direction perpendicular to the phone screen is the z-axis, and the x-axis and y-axis are located on the phone screen. The gravity sensor can obtain the gravity parameters of the phone screen in the x-axis, y-axis, and z-axis directions, respectively. The target sensing information could be a gravity value of 0 on the x-axis, 0 on the y-axis, and -9.81 on the z-axis. The phone screen can be composed of a first sub-screen on a first body and a second sub-screen on a second body.
[0070] like Figure 2 As shown, when the second sensing information is the same as the target sensing information, and the opening angle between the first body and the second body is within the target range, the electronic device is in the target form. The electronic device has a touchscreen on the operating surface that comes into contact with the user.
[0071] It should be noted that step 101 and step 102 can be executed simultaneously; or step 102 can be executed first and then step 101 can be executed; of course, step 101 can be executed first and then step 102 can be executed; the execution order between step 101 and step 102 is not limited in this application embodiment.
[0072] Step 103: Based on the first sensing information, control the position indicator to move on the display screen.
[0073] In this embodiment of the application, the movement information of the position indicator when it moves on the display device can be determined according to the first sensing information and the resolution of the display device, and the position indicator can be controlled to move on the display screen based on the movement information, thereby realizing the control of the movement of the position indicator on the display screen through a mobile electronic device to operate on the target display content on the display screen.
[0074] The information processing method provided in this application generates display data, which is used by a display device connected to an electronic device to output a display screen. If the electronic device is in a target state, it obtains the identification display data of a position indicator and the first sensing information of a first target sensor. The first sensing information is used to characterize the movement of the electronic device in the target state. The identification display data is used by the display device to output a position indicator. Based on the first sensing information, the position indicator is controlled to move on the display screen. In this way, the electronic device can be moved flexibly when it is in the target state, and the movement of the position indicator on the display screen can be controlled based on the first sensing information generated when the electronic device moves, so as to realize the operation of the target display content on the display screen, improve the flexibility of operating the target display content, and solve the problem of low flexibility of operating the display content through the touchpad in related technologies.
[0075] Based on the foregoing embodiments, embodiments of this application provide an information processing method, referring to... Figure 3 As shown, the method includes the following steps:
[0076] Step 201: If the electronic device is connected to an external display device, the electronic device generates the target display data corresponding to the display device.
[0077] In this embodiment of the application, the electronic device can be connected to an external display device through a target interface; wherein, the target interface may include Type-C and High Definition Multimedia Interface (HDMI); when the electronic device is connected to an external display device, the target display data corresponding to the display device can be generated based on the resolution of the display device.
[0078] In one feasible implementation, the display device can be an external display device connected to an electronic device via an HDMI interface. The number of display devices can be at least one.
[0079] Step 202: If the electronic device is in target mode, the electronic device obtains the identification display data of the location indicator and the first sensing information of the first target sensor.
[0080] The first sensing information is used to characterize the movement of the electronic device in the target form; the identification display data is used to display the device output position indication label.
[0081] Optionally, the electronic device being in the target configuration includes: the opening angle between the first body and the second body of the electronic device falling within the target range.
[0082] Optionally, the electronic device being in the target state includes: the opening angle between the first body and the second body of the electronic device being within the target range, and the second sensing information of the second target sensor of the electronic device satisfying the target sensing condition.
[0083] The second sensing information is used to characterize the attitude of the electronic device.
[0084] Step 203: The electronic device determines the first movement information of the electronic device based on the first sensing information.
[0085] In this embodiment of the application, the first sensing information corresponding to the electronic device at different times can be analyzed to determine the first movement information of the electronic device within a target time period; wherein, the first movement information includes the target time, the movement direction of the electronic device within the target time period, and the movement change parameters of the electronic device within the target time period.
[0086] It should be noted that step 203 can be achieved through steps A1-A2:
[0087] Step A1: The electronic device determines the movement change parameters of the electronic device based on the first sensing parameter of the electronic device in the first direction and the second sensing parameter of the electronic device in the second direction at the first moment, and the third sensing parameter of the electronic device in the first direction and the fourth sensing parameter of the electronic device in the second moment.
[0088] The first sensing information includes a first sensing parameter, a second sensing parameter, a third sensing parameter, and a fourth sensing parameter; the first moment is earlier than the second moment.
[0089] In this embodiment of the application, a first movement change parameter in a first direction can be determined based on a first sensing parameter and a third sensing parameter within a target time interval between a first time interval and a second time interval, and a second movement change parameter in a second direction can be determined based on a second sensing parameter and a fourth sensing parameter within the target time interval. The movement change parameters of the electronic device include both the first and second movement change parameters.
[0090] It should be noted that the first target sensor is located inside the electronic device. When the electronic device moves, it can acquire in real time the first sensing parameters of the electronic device in the first direction, the second sensing parameters of the electronic device in the second direction, and the third sensing parameters of the electronic device in the third direction. In the target configuration, the electronic device actually moves on a horizontal plane, at which point the third sensing parameter is 0. Therefore, when determining the movement parameters of the electronic device, only the first and second sensing parameters need to be considered. The first target sensor is an accelerometer.
[0091] like Figure 4 As shown, the first target sensor is installed inside the electronic device and can detect in real time the first sensing parameter in the first direction (X-direction), the second sensing parameter in the second direction (Y-direction), and the third sensing parameter in the third direction (Z-direction) when the electronic device moves in the target form; the third sensing parameter is 0. The X, Y, and Z directions can be determined by a three-dimensional coordinate system established with the phone screen as a reference. The Z-axis is perpendicular to the phone screen. The coordinate system corresponding to the first target sensor and the coordinate system corresponding to the second target sensor can be the same or different.
[0092] In one feasible implementation, a first acceleration value in the X direction and a second acceleration value in the Y direction at a first moment can be detected by an accelerometer, and a third acceleration value in the X direction and a fourth acceleration value in the Y direction at a second moment can be detected. Based on the first and third acceleration values, a first movement change parameter of the electronic device in the X direction is determined; and based on the second and fourth acceleration values, a second movement change parameter of the electronic device in the Y direction is determined.
[0093] Step A2: The electronic device determines its first movement time based on the first and second time points, and determines its first movement direction based on the third and fourth sensing parameters.
[0094] The first movement information includes the first movement time, the first movement direction, and movement change parameters.
[0095] In this embodiment, the first movement time is the time between a first moment and a second moment; the first movement time can be calculated based on the first moment and the second moment. When the electronic device moves from the first moment to the second moment, the first movement direction can be determined based on the third sensing parameter of the electronic device in the first direction and the fourth sensing parameter of the second direction at the second moment.
[0096] Step 204: The electronic device determines the second movement information of the location indicator based on the first movement information.
[0097] In this embodiment of the application, the electronic device can determine the second movement information of the location indicator based on the first movement information and the resolution of the display device; specifically, it can convert the first movement information based on the resolution of the display device to obtain the second movement information.
[0098] Step 205: Based on the second movement information, the electronic device controls the position indicator to move on the display screen.
[0099] In this embodiment of the application, the electronic device can control the speed, direction and time of movement of the position indicator on the display screen based on the second movement information, so as to operate on the target display content on the display screen.
[0100] It should be noted that the descriptions of the same steps and contents as in other embodiments in this embodiment can be found in the descriptions in other embodiments, and will not be repeated here.
[0101] The information processing method provided in this application embodiment can flexibly move the electronic device when it is in the target state, and control the movement of the position indicator on the display screen based on the first sensing information generated when the electronic device moves, so as to realize the operation of the target display content on the display screen, improve the flexibility of operating the target display content, and solve the problem of low flexibility of operating the display content through the touchpad in related technologies.
[0102] Based on the foregoing embodiments, embodiments of this application provide an information processing method, referring to... Figure 5 As shown, the method includes the following steps:
[0103] Step 301: If the electronic device is connected to an external display device, the electronic device generates the target display data corresponding to the display device.
[0104] Step 302: If the electronic device is in target mode, the electronic device obtains the identification display data of the location indicator and the first sensing information of the first target sensor.
[0105] The first sensing information is used to characterize the movement of the electronic device in the target form; the identification display data is used to display the device output position indication identification.
[0106] Optionally, the electronic device being in the target configuration includes: the opening angle between the first body and the second body of the electronic device falling within the target range.
[0107] Optionally, the electronic device being in the target state includes: the opening angle between the first body and the second body of the electronic device being within the target range, and the second sensing information of the second target sensor of the electronic device satisfying the target sensing condition.
[0108] The second sensing information is used to characterize the attitude of the electronic device.
[0109] Step 303: The electronic device determines the first sensing change parameter between the first sensing parameter and the third sensing parameter.
[0110] In this embodiment of the application, the difference between the first sensing parameter and the third sensing parameter can be calculated to obtain the first sensing change parameter.
[0111] In one feasible implementation, the first sensing parameter is the first acceleration value of the electronic device in the first direction at a first moment, and the third sensing parameter is the third acceleration value of the electronic device in the first direction at a second moment. The difference between the first acceleration value and the third acceleration value can be calculated to obtain the first acceleration change value. The first sensing change parameter includes the first acceleration change value.
[0112] Step 304: The electronic device determines the second sensing change parameter between the second sensing parameter and the fourth sensing parameter.
[0113] The movement change parameters include the first sensing change parameter and the second sensing change parameter.
[0114] In the embodiments of this application, the difference between the second sensing parameter and the fourth sensing parameter can be calculated to obtain the second sensing change parameter.
[0115] In one feasible implementation, the second sensing parameter is the second acceleration value of the electronic device in the second direction at the first moment, and the fourth sensing parameter is the fourth acceleration value of the electronic device in the second direction at the second moment. The difference between the second acceleration value and the fourth acceleration value can be calculated to obtain the second acceleration change value. The second sensing change parameter includes the second acceleration change value.
[0116] Step 305: The electronic device determines its first movement time based on the first and second time points.
[0117] Step 306: The electronic device determines the target value and the range of movement direction of the electronic device based on the third and fourth sensor parameters.
[0118] In this embodiment, the target value can be the ratio of the third sensing parameter to the fourth sensing parameter; the range of movement direction can be determined based on the sign of the third sensing parameter and the sign of the fourth sensing parameter. The third sensing parameter is the sensing parameter of the electronic device in the X direction at the second moment, and the fourth sensing parameter is the sensing parameter of the electronic device in the Y direction at the second moment.
[0119] In one feasible implementation, the third sensing parameter can be represented by a1, and the fourth sensing parameter can be represented by a2, then the target value is a1:a2. If a1 is greater than 0 and a2 is greater than 0, then in the two-dimensional plane coordinate system corresponding to the first target sensor (i.e., the coordinate system after ignoring the Z direction in three dimensions), the range of movement direction is the direction corresponding to the first quadrant. If a1 is less than 0 and a2 is greater than 0, then in the two-dimensional plane coordinate system corresponding to the first target sensor, the range of movement direction is the direction corresponding to the second quadrant. If a1 is less than 0 and a2 is less than 0, then in the two-dimensional plane coordinate system corresponding to the first target sensor, the range of movement direction is the direction corresponding to the third quadrant. If a1 is greater than 0 and a2 is less than 0, then in the plane coordinate system corresponding to the first target sensor, the range of movement direction is the direction corresponding to the fourth quadrant.
[0120] Step 307: The electronic device determines the first direction of movement based on the target value and the range of movement directions.
[0121] In this embodiment, a target angle can be determined based on the movement direction angle and the target value, and a first movement direction can be determined from the range of movement directions based on the target angle. Each quadrant corresponds to a movement direction angle of 90°. The target angle is an offset angle determined from the movement direction angles based on the target value.
[0122] Step 308: The electronic device determines the target moving speed of the position indicator based on the first sensing change parameter and the second sensing change parameter.
[0123] In this embodiment of the application, the resolution of the display device can be obtained, and based on the resolution and the first sensing change parameter, a first sub-moving speed of the position indicator in the first direction can be determined, and based on the resolution and the second sensing change parameter, a second sub-moving speed of the position indicator in the second direction can be determined, and based on the first sub-moving speed and the second sub-moving speed, a target moving speed can be determined.
[0124] It should be noted that step 308 can be achieved through steps B1-B3:
[0125] Step B1: The electronic device determines the correspondence between the sensing change parameters and the moving speed of the position indicator based on the resolution of the display device.
[0126] In this embodiment of the application, the correspondence relationship includes a first sub-correspondence relationship and a second sub-correspondence relationship; wherein, the first sub-correspondence relationship is the correspondence between the sensing change parameter in the first direction and the resolution of the display device; and the second sub-correspondence relationship is the correspondence between the sensing change parameter in the second direction and the resolution of the display device.
[0127] In one feasible implementation, the first sub-correspondence can be represented by formula (1):
[0128] vx = ax / (a1 * width) Formula (1)
[0129] Where vx represents the moving speed of the position indicator in the first direction; ax represents the first acceleration change value in the first direction; width represents the number of pixels in the horizontal direction on the display device; the resolution of the display device is represented by (width, height); and a1 is a pre-set standard coefficient in the first direction.
[0130] In one feasible implementation, the second sub-correspondence can be represented by formula (2):
[0131] vy=ay / (b1*height); Formula (2)
[0132] Where vy represents the moving speed of the position indicator in the second direction; ay represents the change in acceleration in the second direction; height represents the number of pixels in the vertical direction on the display device; and the resolution of the display device is represented by (width, height). b1 is a pre-set standard coefficient in the second direction.
[0133] Step B2: The electronic device determines the first sub-moving speed of the position indicator based on the first sensing change parameters and the corresponding relationship, and determines the second sub-moving speed of the position indicator based on the second sensing change parameters and the corresponding relationship.
[0134] In this embodiment of the application, the first sub-moving speed can be determined based on the first sub-correspondence in the first sensing change parameter and the correspondence relationship; the second sub-moving speed can be determined based on the second sensing change parameter and the correspondence relationship relationship.
[0135] In one feasible implementation, the first acceleration change value can be substituted into the above formula (1) to obtain the first sub-moving speed, and the second acceleration change value can be substituted into the above formula (2) to obtain the second sub-moving speed.
[0136] Step B3: The electronic device obtains the target moving speed based on the first sub-moving speed and the second sub-moving speed.
[0137] In this embodiment of the application, the first sub-moving speed and the second sub-moving speed are combined to obtain the target moving speed.
[0138] Step 309: The electronic device determines the second movement direction of the position indicator based on the first movement direction.
[0139] In this embodiment of the application, the first moving direction can be used as the second moving direction of the position indicator; of course, the first moving direction can also be fine-tuned and the fine-tuned first moving direction can be used as the second moving direction.
[0140] Step 310: The electronic device determines the second movement time of the location indicator based on the first movement time, and determines the target movement distance of the location indicator based on the target movement speed and the second movement time.
[0141] The second movement information includes the second movement direction and the target movement distance.
[0142] In this embodiment of the application, the first movement time can be used as the second movement time of the location indicator; the electronic device can calculate the target movement speed and the second movement time to obtain the target movement distance.
[0143] In one feasible implementation, the target's moving speed and the second moving time can be multiplied to obtain the target's moving distance.
[0144] Step 311: Based on the second movement information, the electronic device controls the position indicator to move on the display screen.
[0145] Based on the foregoing embodiments, in other embodiments of this application, the information processing method further includes the following steps:
[0146] Step 312: Upon receiving a press operation from the user on the first body and the second body, the electronic device determines a first opening angle between the first body and the second body, and determines a second opening angle between the first body and the second body before the user performs the press operation.
[0147] In this embodiment of the application, a pressure sensor may be provided inside the electronic device. When the electronic device is in the target state, it can detect whether a user has pressed the first body and the second body based on the pressure value measured by the pressure sensor. If it is determined that a pressing operation has been received, the first opening angle between the first body and the second body can be obtained by the angle sensor, and the second opening angle between the first body and the second body at the most recent time before the user performed the pressing operation can be obtained.
[0148] Step 313: The electronic device adjusts the data corresponding to the target sub-display screen in the display data based on the first opening angle and the second opening angle to obtain the display data to be updated.
[0149] The display screen includes the target sub-display screen.
[0150] In this embodiment, the angle difference between the first opening angle and the second opening angle can be calculated, and the data corresponding to the target sub-display screen in the display data can be adjusted according to the angle difference to obtain the data to be updated; wherein, the target sub-display screen can be the window corresponding to the target application in the current display screen of the display device. The electronic device can also adjust the data corresponding to the target sub-display screen in the display data based on the first opening angle and the second opening angle when it receives a user's trigger operation on the target button on the electronic device to obtain the display data to be updated.
[0151] Step 314: The electronic device updates the display data based on the display data to be updated.
[0152] In this embodiment, the display data corresponding to the current display screen of the display device can be replaced based on the display data to be updated; the electronic device can send the updated display data to the display device to update the display screen and further adjust the proportion of the display content corresponding to the target sub-display screen.
[0153] In this way, the electronic device in target form can realize the function of a mouse, and operate on the target content displayed on the display screen of the display device through the electronic device, which improves the flexibility of the user in operating the target content. It does not have to rely on clicking or sliding operations on the touchpad to operate the target content, thus retaining the user's mouse habit and improving the flexibility of the user when operating the display content.
[0154] The following section provides a detailed explanation of the information processing method provided in the embodiments of this application, in conjunction with application scenarios.
[0155] In this embodiment of the application, the electronic device may be a mobile phone, such as... Figure 6 As shown, the phone's internal gravity sensor acquires the gravity parameters of the phone screen. When the gravity parameter on the x-axis is 0, the gravity parameter on the y-axis is 0, and the gravity parameter on the z-axis is -9.81, the phone's posture is determined to be the target posture. At this time, the angle of the hinge at the folding axis of the phone can be detected. When the hinge angle is determined to be between 45° and 90°, the phone is determined to be in mouse mode. Then, when an external display is connected to the phone, display data for the display is generated and sent to the display. The display can then output the display screen based on the display data; for example... Figure 7As shown, users can control the movement of a position indicator on the display screen by moving their mobile phones. During the movement, the phone uses an accelerometer to detect the acceleration values in the X and Y directions. Based on these acceleration values, the user controls the movement of the position indicator on the external display screen. The opening angle includes the hinge angle; the target shape includes a mouse shape.
[0156] The following detailed explanation of the information processing method provided in the embodiments of this application, in conjunction with the structure of the electronic device, provides a comprehensive description of the method.
[0157] like Figure 8 As shown, when the phone is in the target mode and receives a user's press operation on the back of the touch screen, the angle change of the hinge at the folding axis of the phone is monitored, and the data corresponding to the target sub-screen in the current display screen is adjusted to obtain the display data to be updated. The display data corresponding to the current display screen is updated by the display data to be updated, so as to realize the scaling of the content displayed in the target sub-screen.
[0158] When a mobile phone is in mouse mode, the surface that the user interacts with has a touchscreen. Different areas of the touchscreen can correspond to different response events; for example, Figure 8 As shown, by using different response events corresponding to different areas on the touchscreen, the functions of the left mouse button, right mouse button, and mouse wheel can be implemented on the mobile phone. Among them, the extended button 1 can be used to switch the working mode of the mobile phone; the extended button 2 can realize the function of scaling the content displayed on the target sub-screen. For example, when the mobile phone receives a user's trigger operation on the extended button 2, it can detect whether a press operation has been received. When a press operation is detected, it determines the angle change of the hinge at the folding axis of the mobile phone, and then uses the angle variable to realize the scaling of the content displayed on the target sub-screen.
[0159] It should be noted that the descriptions of the same steps and contents as in other embodiments in this embodiment can be found in the descriptions in other embodiments, and will not be repeated here.
[0160] The information processing method provided in this application embodiment can flexibly move the electronic device when it is in the target state, and control the movement of the position indicator on the display screen based on the first sensing information generated when the electronic device moves, so as to realize the operation of the target display content on the display screen, improve the flexibility of operating the target display content, and solve the problem of low flexibility of operating the display content through the touchpad in related technologies.
[0161] Based on the foregoing embodiments, embodiments of this application provide an information processing apparatus that can be applied to... Figure 1 , Figure 3 and Figure 5 In the information processing method provided in the corresponding embodiment, refer to Figure 9 As shown, the information processing device 4 includes:
[0162] The generation unit 41 is used to generate display data, which is used by the display device connected to the electronic device to output the display screen.
[0163] The acquisition unit 42 is used to acquire the identification display data of the position indicator and the first sensing information of the first target sensor if the electronic device is in the target mode; wherein, the first sensing information is used to characterize the movement of the electronic device in the target mode; and the identification display data is used to display the position indicator output by the device.
[0164] The processing unit 43 is used to control the position indicator to move on the display screen based on the first sensing information.
[0165] In other embodiments of this application, the electronic device being in the target configuration includes:
[0166] The opening and closing angle between the first body and the second body of the electronic device is within the target range.
[0167] In other embodiments of this application, the second sensing information of the second target sensor of the electronic device satisfies the target sensing condition; wherein, the second sensing information is used to characterize the attitude of the electronic device.
[0168] In other embodiments of this application, the generation unit 41 is specifically used to perform the following steps:
[0169] If an electronic device is connected to an external display device, it generates the target display data corresponding to the display device.
[0170] In other embodiments of this application, the processing unit 43 is specifically used to perform the following steps:
[0171] The first movement information of the electronic device is determined based on the first sensing information;
[0172] The second movement information of the location indicator is determined based on the first movement information;
[0173] Based on the second movement information, the position indicator is controlled to move on the display screen.
[0174] In other embodiments of this application, the processing unit 43 is specifically used to perform the following steps:
[0175] Based on the first sensing parameter for the first direction and the second sensing parameter for the second direction at the first moment, and the third sensing parameter for the first direction and the fourth sensing parameter for the second direction at the second moment, the movement change parameters of the electronic device are determined; wherein, the first sensing information includes the first sensing parameter, the second sensing parameter, the third sensing parameter, and the third sensing parameter; the first moment is earlier than the second moment;
[0176] The first movement time of the electronic device is determined based on the first moment and the second moment, and the first movement direction of the electronic device is determined based on the third sensing parameter and the fourth sensing parameter. The first movement information includes the first movement time, the first movement direction and the movement change parameter.
[0177] In other embodiments of this application, the processing unit 43 is specifically used to perform the following steps:
[0178] Based on the third and fourth sensor parameters, the target value and the range of movement direction of the electronic device are determined.
[0179] Based on the target value and the range of movement directions, the first movement direction is determined.
[0180] In other embodiments of this application, the processing unit 43 is specifically used to perform the following steps:
[0181] Determine the first sensing change parameter between the first sensing parameter and the third sensing parameter;
[0182] A second sensing change parameter is determined between the second sensing parameter and the fourth sensing parameter; wherein, the movement change parameter includes the first sensing change parameter and the second sensing change parameter.
[0183] In other embodiments of this application, the processing unit 43 is specifically used to perform the following steps:
[0184] Based on the first and second sensor change parameters, the target moving speed of the position indicator is determined;
[0185] Determine the second movement direction of the position indicator based on the first movement direction;
[0186] The second movement time of the location indicator is determined based on the first movement time, and the target movement distance of the location indicator is determined based on the target movement speed and the second movement time; wherein, the second movement information includes the second movement direction and the target movement distance.
[0187] In other embodiments of this application, the processing unit 43 is specifically used to perform the following steps:
[0188] Based on the resolution of the display device, determine the correspondence between the sensing change parameters and the moving speed of the position indicator;
[0189] Based on the first sensing change parameters and their correspondence, the first sub-moving speed of the position indicator is determined, and based on the second sensing change parameters and their correspondence, the second sub-moving speed of the position indicator is determined.
[0190] The target movement speed is obtained based on the first sub-movement speed and the second sub-movement speed.
[0191] In other embodiments of this application, the processing unit 43 is specifically used to perform the following steps:
[0192] Upon receiving a user's pressing operation on the first and second bodies, a first opening angle between the first and second bodies is determined, and a second opening angle between the first and second bodies is determined before the user performs the pressing operation.
[0193] Based on the first opening angle and the second opening angle, the data corresponding to the target sub-display screen in the display data is adjusted to obtain the display data to be updated; wherein, the display screen includes the target sub-display screen;
[0194] Update the display data based on the data to be updated.
[0195] It should be noted that the interaction process between the units in the embodiments of this application can be referred to Figure 1 , Figure 3 and Figure 5 The implementation process of the information processing method provided in the corresponding embodiments will not be described in detail here.
[0196] The information processing device provided in this application embodiment can flexibly move the electronic device when the electronic device is in the target state, and control the movement of the position indicator on the display screen based on the first sensing information generated when the electronic device moves, so as to realize the operation of the target display content on the display screen, improve the flexibility of operating the target display content, and solve the problem of low flexibility of operating the display content through the touchpad in related technologies.
[0197] Based on the foregoing embodiments, embodiments of this application provide an electronic device that can be applied to... Figure 1 , Figure 3 and Figure 5 In the information processing method provided in the corresponding embodiment, refer to Figure 10 As shown, the electronic device 5 includes:
[0198] Processor 51 is used to generate display data, which is used by the display device connected to the electronic device to output the display screen;
[0199] The processor 51 is further configured to, if the electronic device is in a target mode, obtain from the memory 42 identification display data of a position indicator and first sensing information of a first target sensor; wherein the first sensing information is used to characterize the movement of the electronic device in the target mode; and the identification display data is used to display the device outputting a position indicator.
[0200] The processor 51 is also used to control the position indicator to move on the display screen based on the first sensing information.
[0201] In other embodiments of this application, the electronic device being in the target configuration includes:
[0202] The opening and closing angle between the first body and the second body of the electronic device is within the target range.
[0203] In other embodiments of this application, the second sensing information of the second target sensor of the electronic device satisfies the target sensing condition; wherein, the second sensing information is used to characterize the attitude of the electronic device.
[0204] In other embodiments of this application, processor 51 is specifically configured to perform the following steps:
[0205] If an electronic device is connected to an external display device, it generates the target display data corresponding to the display device.
[0206] In other embodiments of this application, processor 52 is specifically configured to perform the following steps:
[0207] The first movement information of the electronic device is determined based on the first sensing information;
[0208] The second movement information of the location indicator is determined based on the first movement information;
[0209] Based on the second movement information, the position indicator is controlled to move on the display screen.
[0210] In other embodiments of this application, processor 52 is specifically configured to perform the following steps:
[0211] Based on the first sensing parameter for the first direction and the second sensing parameter for the second direction at the first moment, and the third sensing parameter for the first direction and the fourth sensing parameter for the second direction at the second moment, the movement change parameters of the electronic device are determined; wherein, the first sensing information includes the first sensing parameter, the second sensing parameter, the third sensing parameter, and the third sensing parameter; the first moment is earlier than the second moment;
[0212] The first movement time of the electronic device is determined based on the first moment and the second moment, and the first movement direction of the electronic device is determined based on the third sensing parameter and the fourth sensing parameter. The first movement information includes the first movement time, the first movement direction and the movement change parameter.
[0213] In other embodiments of this application, processor 52 is specifically configured to perform the following steps:
[0214] Based on the third and fourth sensor parameters, the target value and the range of movement direction of the electronic device are determined.
[0215] Based on the target value and the range of movement directions, the first movement direction is determined.
[0216] In other embodiments of this application, processor 52 is specifically configured to perform the following steps:
[0217] Determine the first sensing change parameter between the first sensing parameter and the third sensing parameter;
[0218] A second sensing change parameter is determined between the second sensing parameter and the fourth sensing parameter; wherein, the movement change parameter includes the first sensing change parameter and the second sensing change parameter.
[0219] In other embodiments of this application, processor 52 is specifically configured to perform the following steps:
[0220] Based on the first and second sensor change parameters, the target moving speed of the position indicator is determined;
[0221] Determine the second movement direction of the position indicator based on the first movement direction;
[0222] The second movement time of the location indicator is determined based on the first movement time, and the target movement distance of the location indicator is determined based on the target movement speed and the second movement time; wherein, the second movement information includes the second movement direction and the target movement distance.
[0223] In other embodiments of this application, processor 52 is specifically configured to perform the following steps:
[0224] Based on the resolution of the display device, determine the correspondence between the sensing change parameters and the moving speed of the position indicator;
[0225] Based on the first sensing change parameters and their correspondence, the first sub-moving speed of the position indicator is determined, and based on the second sensing change parameters and their correspondence, the second sub-moving speed of the position indicator is determined.
[0226] The target movement speed is obtained based on the first sub-movement speed and the second sub-movement speed.
[0227] In other embodiments of this application, processor 52 is specifically configured to perform the following steps:
[0228] Upon receiving a user's pressing operation on the first and second bodies, a first opening angle between the first and second bodies is determined, and a second opening angle between the first and second bodies is determined before the user performs the pressing operation.
[0229] Based on the first opening angle and the second opening angle, the data corresponding to the target sub-display screen in the display data is adjusted to obtain the display data to be updated; wherein, the display screen includes the target sub-display screen;
[0230] Update the display data based on the data to be updated.
[0231] It should be noted that the specific implementation process of the steps executed by the processor in this embodiment can be referred to Figure 1 , Figure 3 and Figure 5 The implementation process of the information processing method provided in the corresponding embodiments will not be described in detail here.
[0232] The electronic device provided in the embodiments of this application can flexibly move the electronic device when it is in the target state, and control the movement of the position indicator on the display screen based on the first sensing information generated when the electronic device moves, so as to realize the operation of the target display content on the display screen, improve the flexibility of operating the target display content, and solve the problem of low flexibility of operating the display content through the touchpad in the related technology.
[0233] Based on the foregoing embodiments, embodiments of this application provide a computer-readable storage medium storing one or more programs, which can be executed by one or more processors to implement... Figure 1 , Figure 3 and Figure 5 The steps in the information processing method provided in the corresponding embodiment.
[0234] It should be noted that the aforementioned computer-readable storage media can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM), etc.; or it can be various electronic devices that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.
[0235] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0236] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0237] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application can essentially be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0238] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0239] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0240] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0241] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.
Claims
1. An information processing method, the method comprising: Generate display data, which is used by a display device connected to an electronic device to output a display screen; If the electronic device is in the target mode, it obtains the identification display data of the location indicator and the first sensing information of the first target sensor; The target form includes a state where the opening angle between the first body and the second body of the electronic device is within a target range; wherein, the first sensing information is used to characterize the horizontal movement of the electronic device based on a plane when it is in the target form; the identification display data is used by the display device to output the position indication identifier; Based on the first sensing information, the position indicator is controlled to move on the display screen; The method further includes: Upon receiving a user's pressing operation on the first body and the second body, a first opening angle between the first body and the second body is determined, and a second opening angle between the first body and the second body is determined before the user performs the pressing operation; Based on the first opening angle and the second opening angle, the display screen output by the display device corresponding to the display data is scaled.
2. The method according to claim 1, further comprising: The second sensing information of the second target sensor of the electronic device satisfies the target sensing condition; wherein the second sensing information is used to characterize the attitude of the electronic device.
3. The method according to claim 1, wherein generating display data includes: If the electronic device is connected to the display device, target display data corresponding to the display device is generated.
4. The method according to claim 1, wherein controlling the position indicator to move on the display screen based on the first sensing information comprises: The first movement information of the electronic device is determined based on the first sensing information; Based on the first movement information, determine the second movement information of the location indicator; Based on the second movement information, the position indicator is controlled to move on the display screen.
5. The method according to claim 4, wherein determining the first movement information of the electronic device based on the first sensing information comprises: Based on the first sensing parameter for the first direction and the second sensing parameter for the second direction at the first moment, and the third sensing parameter for the first direction and the fourth sensing parameter for the second direction at the second moment, the movement change parameters of the electronic device are determined; wherein, the first sensing information includes the first sensing parameter, the second sensing parameter, the third sensing parameter, and the third sensing parameter; the first moment is earlier than the second moment; The first movement time of the electronic device is determined based on the first time and the second time, and the first movement direction of the electronic device is determined based on the third sensing parameter and the fourth sensing parameter. The first movement information includes the first movement time, the first movement direction, and the movement change parameter.
6. The method according to claim 5, wherein determining the first moving direction of the electronic device based on the third sensing parameter and the fourth sensing parameter comprises: Based on the third and fourth sensing parameters, the target value and the range of the movement direction of the electronic device are determined. The first moving direction is determined based on the target value and the range of moving directions.
7. The method according to claim 5, wherein determining the movement change parameters of the electronic device based on a first sensing parameter for a first direction and a second sensing parameter for a second direction at a first moment, and a third sensing parameter for the first direction and a fourth sensing parameter for the second direction at a second moment, comprises: Determine the first sensing change parameter between the first sensing parameter and the third sensing parameter; A second sensing change parameter is determined between the second sensing parameter and the fourth sensing parameter; wherein the movement change parameter includes the first sensing change parameter and the second sensing change parameter; The second movement information for determining the location indicator based on the first movement information includes: Based on the first sensing change parameter and the second sensing change parameter, the target moving speed of the location indicator is determined; Determine the second movement direction of the position indicator based on the first movement direction; A second movement time of the location indicator is determined based on the first movement time, and a target movement distance of the location indicator is determined based on the target movement speed and the second movement time; wherein, the second movement information includes the second movement direction and the target movement distance; Determining the target movement speed of the location indicator based on the first sensing change parameter and the second sensing change parameter includes: Based on the resolution of the display device, determine the correspondence between the sensing change parameters and the moving speed of the position indicator; Based on the first sensing change parameter and the correspondence, the first sub-moving speed of the location indicator is determined, and based on the second sensing change parameter and the correspondence, the second sub-moving speed of the location indicator is determined. The target movement speed is obtained based on the first sub-movement speed and the second sub-movement speed.
8. An information processing apparatus, the apparatus comprising: A generation unit is used to generate display data, which is used by a display device connected to an electronic device to output a display screen. The acquisition unit is configured to acquire, if the electronic device is in a target state, the identification display data of the location indicator and the first sensing information of the first target sensor; The target form includes a state where the opening angle between the first body and the second body of the electronic device is within a target range; wherein, the first sensing information is used to characterize the horizontal movement of the electronic device based on a plane when it is in the target form; the identification display data is used by the display device to output the position indication identifier; The processing unit is configured to control the position indicator to move on the display screen based on the first sensing information; upon receiving a user's pressing operation on the first body and the second body, determine a first opening angle between the first body and the second body, and determine a second opening angle between the first body and the second body before the user performs the pressing operation; and scale the display screen output by the display device corresponding to the display data based on the first opening angle and the second opening angle.
Citation Information
Patent Citations
Information display method and device
CN111857485A
Display processing method and device and computer storage medium
CN111880873A
Information processing method and electronic equipment
CN112527174A