A pointing method, apparatus, electronic device, and storage medium
By determining the equivalent plane of the magnetic sensor in the foldable state of the electronic device and mapping motion and orientation data onto this plane, the problem of inaccurate positioning of the magnetic sensor in the foldable state is solved, and accurate orientation of the device is achieved.
Patent Information
- Application Number
- CN202110334452.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-29
- Publication Date
- 2025-10-31
- Estimated Expiration
- 2041-03-29
AI Technical Summary
In the open state of foldable electronic devices, the magnetic sensor has difficulty pointing accurately in the direction of the device, resulting in inaccurate positioning.
By determining the equivalent plane of the magnetic sensor and mapping the motion and orientation data to this equivalent plane, compensation of the equivalent motion and orientation data is achieved, ensuring that the magnetic sensor can point accurately in the folded state.
This allows the foldable screen to accurately determine its direction of movement when it is not folded, compensates for the tilt of the accelerometer, and ensures the accurate positioning of the magnetic sensor.
Smart Images

Figure CN115145428B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to, but is not limited to, the field of communication technology, and in particular to a pointing method, apparatus, electronic device, and storage medium. Background Technology
[0002] With the development of technology, the form of electronic device displays has also undergone tremendous changes, with foldable screen displays being an emerging form of electronic device. For example, when the foldable screen of an electronic device is folded up, the outer screen can be used for display; when the foldable screen is unfolded, either the inner or outer screen can be used for display. Furthermore, based on the degree of folding, the usage modes of foldable screens can be at least divided into: folded state, half-folded state (or half-unfolded state), and unfolded state; among these, the half-folded state and the unfolded state can also be considered as the non-folded state.
[0003] Foldable screen electronic devices present numerous challenges in their sensor usage (such as accelerometers or magnetometers) depending on their operating configuration; therefore, the sensor data output needs to be adjusted according to these different usage scenarios. For example, when a foldable screen electronic device is used in its open state, its magnetometer may not accurately point in the direction of the device. Summary of the Invention
[0004] This disclosure provides a pointing method, apparatus, electronic device, and storage medium.
[0005] According to a first aspect of this disclosure, a pointing method is provided, applied to an electronic device, the electronic device comprising: a foldable screen and a magnetic sensor; the method comprising:
[0006] In response to the foldable screen being in an open state, the equivalent plane of the magnetic sensor is determined;
[0007] The detected motion data is mapped onto the equivalent plane to obtain equivalent motion data, and the direction data detected by the magnetic sensor is mapped onto the equivalent plane to obtain equivalent direction data.
[0008] The equivalent motion data and the equivalent direction data are used to indicate the operating direction of the electronic device.
[0009] In some embodiments, the method further includes:
[0010] Obtain the opening angle of the foldable screen in its non-folded state;
[0011] Based on the opening and closing angle, determine the equivalent angle of the equivalent plane;
[0012] The step of mapping the detected motion data to the equivalent plane to obtain equivalent motion data, and mapping the direction data detected by the magnetic sensor to the equivalent plane to obtain equivalent direction data, includes:
[0013] Based on the equivalent angle, the detected motion data is mapped onto the equivalent plane to obtain the equivalent motion data;
[0014] Based on the equivalent angle, the direction data detected by the magnetic sensor is mapped onto the equivalent plane to obtain the equivalent direction data.
[0015] In some embodiments, the foldable screen includes at least: a first sub-display and a second sub-display; the first sub-display includes a first accelerometer and the second sub-display includes a second accelerometer.
[0016] The process of obtaining the opening angle of the foldable screen in its unfolded state includes at least one of the following:
[0017] Based on the first acceleration sensor, the first angle between the first sub-display screen and the horizontal plane is obtained;
[0018] Based on the second acceleration sensor, the second angle between the second sub-display and the horizontal plane is obtained;
[0019] The opening and closing angle of the foldable screen is obtained based on the first angle and the second angle.
[0020] In some embodiments, determining the equivalent angle of the equivalent plane based on the opening angle includes one of the following:
[0021] In response to the electronic device being in a stationary state, the equivalent angle is determined based on the opening / closing angle;
[0022] In response to the electronic device being in a moving state, the equivalent angle is determined based on whether the magnetic sensor is included in the sub-display targeted by the opening and closing angle and the visual range.
[0023] In some embodiments, the magnetic sensor corresponds to the first sub-display screen;
[0024] The step of determining the equivalent angle based on the opening / closing angle in response to the electronic device being in a stationary state includes:
[0025] In response to the electronic device being in a stationary state, the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening / closing angle.
[0026] In some embodiments, the determination of the equivalent angle based on whether the magnetic sensor is included in the sub-display targeted by the opening / closing angle and the visual range in response to the electronic device being in a moving state includes one of the following:
[0027] In response to the electronic device being in a moving state, if the first sub-display screen targeted by the visual range includes the magnetic sensor, the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening and closing angle;
[0028] In response to the electronic device being in a moving state, if the first sub-display screen to which the visual range is directed does not include the magnetic sensor and the second sub-display screen does include the magnetic sensor, the equivalent angle is determined based on the opening and closing angle.
[0029] In some embodiments, the first sub-display to which the visual range is directed includes the magnetic sensor, and the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening / closing angle, including one of the following:
[0030] If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is parallel to the equivalent plane, then the equivalent angle is determined to be 0.
[0031] If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is not parallel to the equivalent plane, the equivalent angle is determined to be the difference between the first angle and 90 degrees.
[0032] In some embodiments, mapping the detected motion data to the equivalent plane to obtain equivalent motion data includes one of the following:
[0033] The motion data detected by the first accelerometer is mapped to the equivalent plane, and the motion data detected by the second accelerometer is mapped to the equivalent plane, until the equivalent motion data is obtained;
[0034] If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is parallel to the equivalent plane, the motion data detected by the first accelerometer is mapped to the equivalent plane to obtain the equivalent motion data.
[0035] In some embodiments, determining the equivalent plane of the magnetic sensor includes:
[0036] The plane perpendicular to the horizontal plane is determined as the equivalent plane of the magnetic sensor;
[0037] The plane parallel to the horizontal plane is determined as the equivalent plane of the magnetic sensor.
[0038] According to a second aspect of this disclosure, a pointing device is provided for use in an electronic device, the electronic device comprising: a foldable screen and a magnetic sensor; the device comprising:
[0039] A determination module is used to determine the equivalent plane of the magnetic sensor in response to the folding screen being in an open state;
[0040] The processing module is used to map the detected motion data onto the equivalent plane to obtain equivalent motion data, and to map the direction data detected by the magnetic sensor onto the equivalent plane to obtain equivalent direction data;
[0041] The equivalent motion data and the equivalent direction data are used to indicate the operating direction of the electronic device.
[0042] In some embodiments, the apparatus further includes:
[0043] The acquisition module is used to acquire the opening angle of the foldable screen when it is in the non-folded state;
[0044] The determining module is used to determine the equivalent angle of the equivalent plane based on the opening and closing angle.
[0045] The processing module is configured to map the detected motion data onto the equivalent plane based on the equivalent angle to obtain the equivalent motion data; and to map the direction data detected by the magnetic sensor onto the equivalent plane based on the equivalent angle to obtain the equivalent direction data.
[0046] In some embodiments, the foldable screen includes at least: a first sub-display and a second sub-display; the first sub-display includes a first accelerometer and the second sub-display includes a second accelerometer.
[0047] The acquisition module is used for at least one of the following:
[0048] Based on the first acceleration sensor, the first angle between the first sub-display screen and the horizontal plane is obtained;
[0049] Based on the second acceleration sensor, the second angle between the second sub-display and the horizontal plane is obtained;
[0050] The opening and closing angle of the foldable screen is obtained based on the first angle and the second angle.
[0051] In some embodiments, the determining module is configured to determine the equivalent angle based on the opening / closing angle in response to the electronic device being in a stationary state; or...
[0052] The determining module is configured to, in response to the electronic device being in a moving state, determine the equivalent angle based on whether the magnetic sensor is included in the sub-display screen targeted by the opening / closing angle and the visual range.
[0053] In some embodiments, the magnetic sensor corresponds to the first sub-display screen;
[0054] The determining module is configured to determine the equivalent angle based on the difference between the first angle and 90 degrees in the opening / closing angle, in response to the electronic device being in a stationary state.
[0055] In some embodiments, the determining module is configured to, in response to the electronic device being in a moving state, determine the equivalent angle based on the difference between the first angle and 90 degrees in the opening / closing angle, if the first sub-display to which the visual range is directed includes the magnetic sensor; or...
[0056] The determining module is configured to, in response to the electronic device being in a moving state, determine the equivalent angle based on the opening and closing angle if the first sub-display screen to which the visual range is directed does not include the magnetic sensor and the second sub-display screen does include the magnetic sensor.
[0057] In some embodiments, the determining module is configured to determine the equivalent angle as 0 if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is parallel to the equivalent plane;
[0058] or,
[0059] The determining module is configured to determine the equivalent angle as the difference between the first angle and 90 degrees if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is not parallel to the equivalent plane.
[0060] In some embodiments, the processing module is configured to map motion data detected by the first accelerometer to the equivalent plane and to map motion data detected by the second accelerometer to the equivalent plane, thereby obtaining the equivalent motion data; or...
[0061] The processing module is configured to, if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is parallel to the equivalent plane, map the motion data detected by the first accelerometer to the equivalent plane to obtain the equivalent motion data.
[0062] In some embodiments, the determining module is configured to determine that a plane perpendicular to the horizontal plane is the equivalent plane of the magnetic sensor; or,
[0063] The determining module is used to determine that the plane parallel to the horizontal plane is the equivalent plane of the magnetic sensor.
[0064] According to a third aspect of the present disclosure, an electronic device is provided, comprising:
[0065] processor;
[0066] Memory used to store processor-executable instructions;
[0067] The processor is configured to implement the pointing method described in any embodiment of this disclosure when running the executable instructions.
[0068] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, characterized in that the readable storage medium stores an executable program, wherein the executable program, when executed by a processor, implements the pointing method described in any embodiment of the present disclosure.
[0069] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:
[0070] In this embodiment of the present disclosure, in response to the foldable screen being in an open state, an equivalent plane for the magnetic sensor is determined; the detected motion data is mapped onto the equivalent plane to obtain equivalent motion data, and the direction data detected by the magnetic sensor is mapped onto the equivalent plane to obtain equivalent direction data; wherein, the equivalent motion data and the equivalent direction data are used to indicate the operating direction of the electronic device. Thus, the method described in this embodiment of the present disclosure allows the electronic device in an open state to have both the detected motion data and the direction data detected by the magnetic sensor mapped onto the equivalent plane for the magnetic sensor, so that the equivalent motion data can compensate for the tilt of the accelerometer; thereby enabling the magnetic sensor to accurately determine the operating direction of the electronic device even when the foldable screen is unfolded to a certain angle.
[0071] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0072] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0073] Figure 1This is a flowchart illustrating a pointing method according to an exemplary embodiment.
[0074] Figure 2 This is a schematic diagram illustrating a foldable screen according to an exemplary embodiment.
[0075] Figure 3 This is a schematic diagram illustrating a foldable screen according to an exemplary embodiment.
[0076] Figure 4 This is a flowchart illustrating a pointing method according to an exemplary embodiment.
[0077] Figure 5 This is a flowchart illustrating a pointing method according to an exemplary embodiment.
[0078] Figure 6 This is a schematic diagram illustrating a foldable screen according to an exemplary embodiment.
[0079] Figure 7 This is a schematic diagram illustrating a foldable screen according to an exemplary embodiment.
[0080] Figure 8 This is a schematic diagram illustrating a foldable screen according to an exemplary embodiment.
[0081] Figure 9 This is a schematic diagram illustrating a foldable screen according to an exemplary embodiment.
[0082] Figure 10 This is a flowchart illustrating a pointing method according to an exemplary embodiment.
[0083] Figure 11 This is a block diagram illustrating a pointing device according to an exemplary embodiment.
[0084] Figure 12 This is a block diagram illustrating an electronic device according to an exemplary embodiment. Detailed Implementation
[0085] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatuses and devices consistent with some aspects of the invention as detailed in the appended claims.
[0086] To facilitate understanding by those skilled in the art, this disclosure provides multiple embodiments to clearly illustrate the technical solutions of the embodiments of this disclosure. Of course, those skilled in the art will understand that the multiple embodiments provided in this disclosure can be executed individually, or in combination with the methods of other embodiments in this disclosure, or individually or in combination with some methods in other related technologies; this disclosure does not limit these aspects.
[0087] like Figure 1 As shown, this disclosure provides a flowchart of a pointing method. Figure 1 As shown, the pointing method is applied to an electronic device, which includes a foldable screen and a magnetic sensor; the method includes the following steps:
[0088] Step S11: In response to the folding screen being in an unfolded state, determine the equivalent plane of the magnetic sensor;
[0089] Step S12: Map the detected motion data to the equivalent plane to obtain equivalent motion data, and map the direction data detected by the magnetic sensor to the equivalent plane to obtain equivalent direction data;
[0090] The equivalent motion data and the equivalent direction data are used to indicate the operating direction of the electronic device.
[0091] The pointing method described in this disclosure is applied to an electronic device, which includes a foldable screen. The electronic device described herein can be a mobile terminal or a fixed terminal; for example, the electronic device may be, but is not limited to, a mobile phone, computer, tablet computer, or television, etc.
[0092] The foldable screen here includes at least two sub-displays.
[0093] In one embodiment, the foldable screen includes a first sub-display and a second sub-display.
[0094] In one embodiment, the first sub-display includes a magnetic sensor, or the second sub-display includes a magnetic sensor. For example, as... Figure 2 As shown, a magnetic sensor 110 is built into the first sub-display 11. In one embodiment, the magnetic sensor can be considered as a compass.
[0095] Of course, in other embodiments, the magnetic sensor can be replaced by a magnetic component; it is only necessary that the magnetic component can detect directional data used to indicate the direction of the electronic device, and there is no limitation thereto.
[0096] In one embodiment, the magnetic sensor is a triaxial magnetic sensor; wherein the three axes of the triaxial magnetic sensor may include: an X-axis, a Y-axis, and a Z-axis. Here, the X-axis and Y-axis represent two components perpendicular to the horizontal plane, and the X-axis and Y-axis are perpendicular to each other. The Z-axis is used to indicate the component perpendicular to the horizontal plane. Of course, in other embodiments, the magnetic sensor may be any other type of magnetic sensor or magnetic component, and there is no limitation herein.
[0097] In one embodiment, the foldable screen includes: an accelerometer;
[0098] Step S12 includes:
[0099] The motion data detected by the accelerometer is mapped onto the equivalent plane to obtain equivalent motion data, and the direction data detected by the magnetometer is mapped onto the equivalent plane to obtain equivalent direction data.
[0100] The equivalent motion data and the equivalent direction data are used to indicate the operating direction of the electronic device by the magnetic sensor, which is equivalent to the equivalent plane.
[0101] Thus, in this embodiment of the disclosure, the accelerometer and magnetometer of the electronic device can be equivalent to the same plane, thereby enabling the accelerometer to compensate for the tilt angle of the magnetometer, so that the electronic device can be accurately positioned even when the folding screen of the electronic device is in an open state.
[0102] In one embodiment, the acceleration sensor includes a first acceleration sensor and a second acceleration sensor; wherein the first sub-display includes the first sensor and the second sensor. For example, as... Figure 2 As shown, the first sub-display 11 has a built-in first sensor 111; the second sub-display 12 has a built-in second sensor 121.
[0103] Of course, in other embodiments, the acceleration sensor here can be replaced by a motion detection component; as long as the motion detection component can detect motion data used to indicate the speed and acceleration of the electronic device, there is no limitation here.
[0104] In one embodiment, the accelerometer is a triaxial accelerometer; wherein the three axes of the triaxial accelerometer may include: an X-axis, a Y-axis, and a Z-axis. Here, the X-axis and Y-axis represent two components perpendicular to the horizontal plane, and the Z-axis indicates the component perpendicular to the horizontal plane. Of course, in other embodiments, the accelerometer can be any other type of accelerometer or motion detection component, and there are no limitations herein.
[0105] In one embodiment, the first and second sensors may be symmetrically arranged based on the folding center line of the foldable screen. Of course, in other embodiments, the first and second sensors may not be symmetrically arranged based on the folding center line of the foldable screen.
[0106] The foldable screen here can include a folded state and a non-folded state; wherein, the non-folded state includes a semi-unfolded state and an unfolded state. For example, in one embodiment, when the foldable screen is in the folded state, the angle between the first sub-display and the second sub-display is 0 degrees; when the foldable screen is in the semi-unfolded state, the angle between the first sub-display and the second sub-display is greater than 0 degrees and less than 180 degrees; when the foldable screen is in the unfolded state, the angle between the first sub-display and the second sub-display is 180 degrees. The semi-unfolded state here can also be considered as a semi-folded state.
[0107] In one embodiment, the foldable screen being in an open state can include: an unfolded state, a half-folded state with the screen folded outwards, or a half-folded state with the screen folded inwards. For example, as... Figure 3 As shown, if the folding screen is in a half-folded state with the screen folded outwards, the content can be displayed on the outer screen 21 of the folding screen; if the folding screen is in a half-folded state with the screen folded inwards, the content can be displayed on the inner screen 22 of the folding screen.
[0108] In one embodiment, the foldable screen being in an unfolded state may include: the foldable screen being in a landscape orientation unfolded state, or the foldable screen being in a portrait orientation unfolded state.
[0109] The motion data detected by the accelerometer here may include: motion data detected by the first sensor on the first sub-display and / or motion data detected by the second sensor on the second sub-display. The motion data here includes: data on the foldable screen's operating speed and / or acceleration.
[0110] The direction data detected by the magnetic sensor here may include: direction data detected by the magnetic sensor on the first sub-display, or direction data detected by the magnetic sensor on the second sub-display.
[0111] In one embodiment, the equivalent plane includes, but is not limited to, at least one of the following:
[0112] A plane perpendicular to the horizontal plane;
[0113] A plane parallel to the horizontal plane.
[0114] In some embodiments, determining the equivalent plane of the magnetic sensor includes:
[0115] The plane perpendicular to the horizontal plane is determined as the equivalent plane of the magnetic sensor;
[0116] The plane parallel to the horizontal plane is determined as the equivalent plane of the magnetic sensor.
[0117] In one embodiment, if the foldable screen is in an open state, the plane parallel to the horizontal plane is set as the equivalent plane by default. In another embodiment, if the foldable screen is in an open state, the plane perpendicular to the horizontal plane is set as the equivalent plane by default.
[0118] Please see again Figure 2 If the sensor is processed to be equivalent to an equivalent plane, then the equivalent magnetic sensor can be located at any position on the equivalent plane; for example, it can be located at position 10 on the equivalent plane.
[0119] Thus, in this embodiment, the magnetic sensor can be equivalent to a horizontal plane or a plane perpendicular to the horizontal plane; thus, the equivalent magnetic sensor on the horizontal plane or a plane perpendicular to the horizontal plane can be considered to be tilted or tilted by 90 degrees, thereby enabling the equivalent magnetic sensor to achieve more accurate directional pointing.
[0120] Of course, in other embodiments, the equivalent plane can be any plane. Thus, in this embodiment, as long as the data detected by the accelerometer and the data detected by the magnetometer are on the same plane, the accelerometer can also compensate for the tilt angle of the magnetometer, thereby achieving accurate orientation of the electronic device.
[0121] In one embodiment, the direction of movement of the electronic device includes: the direction of movement of the electronic device when it is stationary or the direction of movement of the electronic device when it is moving. For example, when the electronic device is stationary on a table, it may be facing due north. Or, when the electronic device moves forward, it may be facing southeast at 30 degrees; or, the electronic device may move backward, to the left or right, or to the right.
[0122] This embodiment of the invention allows for the determination of an equivalent plane for the magnetic sensor when the foldable screen of an electronic device is in an open state. Detected motion data is mapped onto this equivalent plane to obtain equivalent motion data, and the direction data detected by the magnetic sensor is mapped onto the equivalent plane to obtain equivalent direction data. The equivalent motion data and equivalent direction data are used to indicate the operating direction of the electronic device. Thus, the method described in this embodiment enables the electronic device, when the foldable screen is in an open state, to map both the detected motion data and the direction data detected by the magnetic sensor onto the equivalent plane that the magnetic sensor needs to be equivalent to. This allows the equivalent motion data to compensate for the tilt of the accelerometer. Consequently, even when the foldable screen is unfolded to a certain angle, the magnetic sensor can accurately determine the operating direction of the electronic device.
[0123] like Figure 4 As shown, in some embodiments, the method further includes:
[0124] Step S10: Obtain the opening angle of the foldable screen in its non-folded state;
[0125] Step S13: Based on the opening and closing angle, determine the equivalent angle of the equivalent plane;
[0126] Step S12 includes:
[0127] Step S121: Based on the equivalent angle, map the detected motion data onto the equivalent plane to obtain the equivalent motion data;
[0128] Step S122: Based on the equivalent angle, map the direction data detected by the magnetic sensor onto the equivalent plane to obtain the equivalent direction data.
[0129] The foldable screen here includes: a first sub-display and a second sub-display; the first sub-display includes a first accelerometer and the second sub-display includes a second accelerometer.
[0130] The opening angle of the foldable screen in its non-folded state is the angle between the first sub-display and the second sub-display.
[0131] In one embodiment, step S121 includes: mapping the motion data detected by the acceleration sensor to the equivalent plane based on the equivalent angle to obtain the equivalent motion data.
[0132] One way to implement step S121 is to convert the motion data detected by the accelerometer in the first coordinate system into a second coordinate system that differs from the first coordinate system by an equivalent angle, and obtain the equivalent motion data in the second coordinate system.
[0133] For example, if the detected motion data has components on the X, Y, and Z axes, respectively, V X1 V y1 Vz1; If the foldable screen is in the portrait, unfolded state. If the equivalent angle is C, then the components V of the equivalent motion data on the X, Y, and Z axes are... X2 =cosC×V X1 V y2 =sinC×V y1 Vz2 = Vz1; then based on V X2 V y2 Equivalent motion data of the equivalent plane obtained by Vz2.
[0134] One way to implement step S122 is to convert the direction data detected by the magnetic sensor in the first coordinate system into the second coordinate system, which differs from the first coordinate system by an equivalent angle, and obtain the equivalent direction data in the second coordinate system.
[0135] For example, if the directional data detected by the accelerometer has components in the X, Y, and Z axes, respectively L X1 L y1 Lz1; If the foldable screen is in the portrait, unfolded state. If the equivalent angle is C, then the components L of the equivalent motion data on the X, Y, and Z axes are... X2 =cosC×L X1 L y2 =sinC×L y1 Lz2 = Lz1; then based on L X2 L y2 The equivalent motion data of the equivalent plane obtained by Lz2.
[0136] Of course, in other embodiments, there may be any other equivalent methods that can be implemented, as long as they satisfy the same principle of achieving equivalence based on motion data and orientation data, and no restrictions are imposed here.
[0137] In one embodiment, step S13 may include: determining the equivalent angle based on the opening / closing angle and the equivalent plane. The equivalent angle is the angle between the sub-display screen equipped with the magnetic sensor and the equivalent plane.
[0138] In some embodiments, step S13 includes at least one of the following:
[0139] Based on the first acceleration sensor, the first angle between the first sub-display screen and the horizontal plane is obtained;
[0140] Based on the second acceleration sensor, the second angle between the second sub-display and the horizontal plane is obtained;
[0141] The opening and closing angle of the foldable screen is obtained based on the first angle and the second angle.
[0142] In one embodiment, obtaining the opening / closing angle of the foldable screen based on the first angle and the second angle includes: obtaining the opening / closing angle of the foldable screen based on the sum of the first angle and the second angle.
[0143] In another embodiment, obtaining the opening angle of the folding screen based on the first angle and the second angle includes: obtaining the opening angle of the folding screen based on the difference between the first angle and the second angle.
[0144] In one embodiment, determining the equivalent angle based on the opening / closing angle includes, but is limited to, at least one of the following:
[0145] Based on the opening and closing angle, determine the equivalent angle;
[0146] If the magnetic sensor corresponds to the first sub-display screen, the equivalent angle is determined based on the first angle in the opening and closing angle;
[0147] If the magnetic sensor corresponds to the second sub-display, the equivalent angle is determined based on the second angle in the opening and closing angle.
[0148] In this embodiment, the opening angle of the folding screen can be obtained based on its non-folded state; and based on the opening angle, the equivalent angle of the magnetic sensor to the equivalent plane can be determined. Thus, this embodiment can achieve accurate equivalence of motion and direction data based on this equivalent angle, thereby enabling accurate determination of the electronic device's orientation using the equivalent direction and motion data.
[0149] like Figure 5 As shown, in some embodiments, step S13 includes one of the following:
[0150] Step S131: In response to the electronic device being in a stationary state, determine the equivalent angle based on the opening / closing angle;
[0151] Step S132: In response to the electronic device being in a moving state, determine the equivalent angle based on whether the magnetic sensor is included in the sub-display screen targeted by the opening and closing angle and the visual range.
[0152] In one embodiment, the magnetic sensor corresponds to the first sub-display screen;
[0153] Step S131 includes:
[0154] In response to the electronic device being in a stationary state, the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening / closing angle.
[0155] For example, such as Figure 6 As shown. If the electronic device is in a stationary state, the first angle between the first sub-display 11 and the horizontal plane is A, and the first angle between the second sub-display and the horizontal plane is B; the equivalent plane 20 is a plane parallel to the horizontal plane. In this case, the equivalent angle C can be determined based on the first angle A in the opening / closing angle; here, C = 90° - A. Figure 6 In this case, the opening and closing angle is the sum of the first angle and the second angle.
[0156] In the above embodiment, if the magnetic sensor corresponds to the second sub-display screen, then the equivalent angle C = 90° - B.
[0157] In this embodiment, if the electronic device is stationary, the sub-display being viewed by the user cannot be determined. Therefore, the equivalent angle can be directly determined based on the display screen containing the magnetic sensor and its equivalent plane. For example, if the first sub-display screen has a magnetic sensor, the equivalent angle can be determined based on the difference between the first angle and 90° in the opening / closing angle. This allows for accurate determination of the equivalent angle, thus ensuring accurate orientation of the electronic device when the folding screen is unfolded to a certain angle while the device is stationary.
[0158] In some embodiments, step S132 includes one of the following:
[0159] In response to the electronic device being in a moving state, if the first sub-display screen targeted by the visual range includes the magnetic sensor, the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening and closing angle;
[0160] In response to the electronic device being in a moving state, if the first sub-display screen to which the visual range is directed does not include the magnetic sensor and the second sub-display screen does include the magnetic sensor, the equivalent angle is determined based on the opening and closing angle.
[0161] The visual range here refers to the sub-display screen, that is, the sub-display screen that the user is viewing. For example, the first sub-display screen to which the visual range refers is the first sub-display screen that the user is viewing.
[0162] In one embodiment, the electronic device may include an image detection device. In one embodiment, the electronic device detects image information based on the image detection device and determines, based on the image information, whether the sub-display to which the visual range is directed is a first sub-display or a second sub-display. Thus, in this embodiment of the disclosure, the sub-display viewed by the user can be determined from the image captured by the electronic device, i.e., the sub-display to which the visual range is directed can be determined.
[0163] In one embodiment, the first sub-display to which the visual range is directed includes the magnetic sensor, and the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening / closing angle, including one of the following:
[0164] If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is parallel to the equivalent plane, then the equivalent angle is determined to be 0.
[0165] If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is not parallel to the equivalent plane, the equivalent angle is determined to be the difference between the first angle and 90 degrees.
[0166] For example, such as Figure 7 As shown, if the electronic device is in a moving state; the user is viewing the first sub-display screen 11, and the first sub-display screen 11 is equipped with a magnetic sensor 110; if the first sub-display screen is parallel to the equivalent plane 20, and the equivalent plane 20 is perpendicular to the horizontal plane; then the first sub-display screen 11 is also perpendicular to the horizontal plane (i.e., the first angle is 90 degrees). Then the equivalent angle is determined to be 0 (i.e., the difference between the first angle and 90 degrees).
[0167] Thus, in this embodiment of the disclosure, if the sub-display screen targeted by the visual range (i.e., the sub-display screen viewed by the user) is the first sub-display screen and the first sub-display screen includes a magnetic sensor; if the first sub-display screen is parallel to the equivalent plane; then it can be determined that the direction in which the user looks at the first sub-display screen is horizontal, which is the direction of movement of the electronic device. In this way, the equivalent angle of the magnetic sensor can be determined to be 0, meaning that the motion data collected by the first accelerometer and the direction data collected by the magnetic sensor are themselves on the equivalent plane, and therefore no equivalence is required, and accurate pointing of the direction of movement of the electronic device (i.e., when moving in a moving state) can still be achieved.
[0168] For example, such as Figure 8As shown, if the electronic device is in a moving state; the user is viewing the first sub-display screen 11, and the first sub-display screen 11 is equipped with a magnetic sensor 110; if the first sub-display screen is not parallel to the equivalent plane 20, the angle between the first sub-display screen and the horizontal plane is a first angle A; the equivalent plane is perpendicular to the horizontal plane. Then the equivalent angle C = 90° - A.
[0169] Thus, in this embodiment, if the visual range targets a first sub-display screen and the first sub-display screen includes a magnetic sensor; and if the first sub-display screen is parallel to the equivalent plane portion; then it can be determined that the direction in which the user looks at the first sub-display screen is not horizontal, i.e., not the direction of movement of the electronic device. Therefore, it is necessary to determine that the equivalent angle of the magnetic sensor is the difference between a first angle and 90 degrees, so that the direction in which the user looks at the first sub-display screen is equivalent to a horizontal direction; thus, precise pointing of the electronic device's movement direction can be achieved.
[0170] For example, such as Figure 9 As shown, if the electronic device is in motion; the user is viewing the first sub-display 11; the first sub-display 11 is parallel to the equivalent plane 20, and the equivalent plane is perpendicular to the horizontal plane. If the first sub-display 11 does not have a magnetic sensor 110 but the second sub-display 12 does, then the magnetic sensor needs to be equivalent to an equivalent plane. Then the equivalent angle C is the opening / closing angle. Figure 9 In this case, the opening and closing angle is the difference between the first angle and the second angle.
[0171] Therefore, in this embodiment, if the first sub-display screen to which the visual range is directed does not have a magnetic sensor, and the first sub-display screen is parallel to the equivalent plane, then the magnetic sensor in the second sub-display screen can be equivalently represented to the equivalent plane. In this way, the equivalent angle can be determined as the opening / closing angle; thus, the motion data detected by the second accelerometer and the motion data detected by the processing sensor can be equivalently represented to the same plane, thereby achieving precise pointing of the electronic device's motion direction.
[0172] like Figure 7 , 8 In example 9, the example illustrates an application scenario where the visual range is directed towards the outer screen; of course, in other embodiments, it could also be an application scenario where the visual range is directed towards the inner screen.
[0173] like Figure 7 , 8 In example 9, the visual range is for a landscape screen application scenario; of course, in other embodiments, the visual range can also be for a portrait screen application scenario.
[0174] In the embodiments of this disclosure, the equivalent angle when the electronic device is in a stationary or moving state can be determined; it can also be determined whether, when in a moving state, the equivalent angle is determined based on whether the sub-display to which the visual range is directed is equipped with a magnetic sensor or whether it is parallel to an equivalent plane. Thus, the embodiments of this disclosure provide a variety of solutions for determining the equivalent angle in various application scenarios, thereby enabling precise pointing of the electronic device in these application scenarios.
[0175] like Figure 10 As shown, in some embodiments, in step S12, the detected motion data is mapped to the equivalent plane to obtain equivalent motion data, including one of the following:
[0176] Step S123: Map the motion data detected by the first accelerometer to the equivalent plane and map the motion data detected by the second accelerometer to the equivalent plane, until the equivalent motion data is obtained;
[0177] Step S124: If the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is parallel to the equivalent plane, the motion data detected by the first accelerometer is mapped to the equivalent plane to obtain the equivalent motion data.
[0178] In any of the above embodiments, equivalent motion data can be determined through step S123. In this way, the motion data detected by both accelerometers can be equivalently mapped to an equivalent plane, thereby obtaining more accurate equivalent motion data and further improving the pointing accuracy of the electronic device.
[0179] In this embodiment of the disclosure, the first sub-display screen, which is the target of the visual range, includes the magnetic sensor, and the first sub-display screen is parallel to the equivalent plane; therefore, the equivalent angle is 0, and the direction in which the user views the electronic device is the same as the direction of movement of the electronic device. Thus, the motion data detected by the first acceleration sensor can represent the movement of the electronic device, thereby achieving precise pointing of the electronic device's movement direction even by simply equating the motion data detected by the first acceleration sensor to the equivalent plane.
[0180] Figure 11 An exemplary embodiment illustrates a pointing device applied to an electronic device, the electronic device including: a foldable screen and a magnetic sensor; the device includes:
[0181] The determining module 41 is used to determine the equivalent plane of the magnetic sensor in response to the folding screen being in an unfolded state;
[0182] Processing module 42 is used to map the detected motion data to the equivalent plane to obtain equivalent motion data, and to map the direction data detected by the magnetic sensor to the equivalent plane to obtain equivalent direction data;
[0183] The equivalent motion data and the equivalent direction data are used to indicate the operating direction of the electronic device.
[0184] In some embodiments, the apparatus further includes:
[0185] The acquisition module 43 is used to acquire the opening angle of the folding screen when it is in the non-folded state;
[0186] The determining module 41 is used to determine the equivalent angle of the equivalent plane based on the opening angle;
[0187] The processing module 42 is used to map the detected motion data to the equivalent plane based on the equivalent angle to obtain the equivalent motion data; and to map the direction data detected by the magnetic sensor to the equivalent plane based on the equivalent angle to obtain the equivalent direction data.
[0188] In some embodiments, the foldable screen includes at least: a first sub-display and a second sub-display; the first sub-display includes a first accelerometer and the second sub-display includes a second accelerometer.
[0189] The acquisition module 43 is used for at least one of the following:
[0190] Based on the first acceleration sensor, the first angle between the first sub-display screen and the horizontal plane is obtained;
[0191] Based on the second acceleration sensor, the second angle between the second sub-display and the horizontal plane is obtained;
[0192] The opening and closing angle of the foldable screen is obtained based on the first angle and the second angle.
[0193] In some embodiments, the determining module 41 is configured to determine the equivalent angle based on the opening / closing angle in response to the electronic device being in a stationary state; or...
[0194] The determining module 41 is used to determine the equivalent angle based on whether the magnetic sensor is included in the sub-display screen targeted by the opening and closing angle and the visual range in response to the electronic device being in a moving state.
[0195] In some embodiments, the magnetic sensor corresponds to the first sub-display screen;
[0196] The determining module 41 is used to determine the equivalent angle based on the difference between the first angle and 90 degrees in the opening and closing angle when the electronic device is in a stationary state.
[0197] In some embodiments, the determining module 41 is configured to, in response to the electronic device being in a moving state, determine the equivalent angle based on the difference between the first angle and 90 degrees in the opening / closing angle, if the first sub-display to which the visual range is directed includes the magnetic sensor; or...
[0198] The determining module 41 is configured to, in response to the electronic device being in a moving state, determine the equivalent angle based on the opening and closing angle if the first sub-display screen to which the visual range is directed does not include the magnetic sensor and the second sub-display screen does include the magnetic sensor.
[0199] In some embodiments, the determining module 41 is configured to determine the equivalent angle as 0 if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is parallel to the equivalent plane;
[0200] or,
[0201] The determining module 41 is used to determine the equivalent angle as the difference between the first angle and 90 degrees if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is not parallel to the equivalent plane.
[0202] In some embodiments, the processing module 42 is configured to map the motion data detected by the first accelerometer to the equivalent plane and to map the motion data detected by the second accelerometer to the equivalent plane, thereby obtaining the equivalent motion data; or...
[0203] The processing module 42 is configured to, if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is parallel to the equivalent plane, map the motion data detected by the first acceleration sensor to the equivalent plane to obtain the equivalent motion data.
[0204] In some embodiments, the determining module 41 is configured to determine that a plane perpendicular to the horizontal plane is the equivalent plane of the magnetic sensor; or,
[0205] The determining module 41 is used to determine that the plane parallel to the horizontal plane is the equivalent plane of the magnetic sensor.
[0206] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0207] Embodiments of this disclosure also provide an electronic device, characterized in that it includes:
[0208] processor;
[0209] Memory used to store processor-executable instructions;
[0210] The processor is configured to implement the pointing method described in any embodiment of this disclosure when running the executable instructions.
[0211] The memory may include various types of storage media, which are non-temporary computer storage media that can continue to store information after the communication device loses power.
[0212] The processor can be connected to the memory via a bus or similar means to read executable programs stored in the memory, for example, to implement... Figure 1 , 4 At least one of the methods shown in 5 and 10.
[0213] Embodiments of this disclosure also provide a computer-readable storage medium storing an executable program, wherein the executable program, when executed by a processor, implements the pointing method described in any embodiment of this disclosure. For example, implementing as... Figure 1 , 4 At least one of the methods shown in 5 and 10.
[0214] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0215] Figure 12 This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting electronic device, messaging transceiver, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0216] Reference Figure 12 The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.
[0217] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
[0218] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0219] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.
[0220] Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0221] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
[0222] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0223] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.
[0224] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0225] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.
[0226] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0227] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the following claims.
[0228] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.
Claims
1. A pointing method, characterized in that, The method is applied to an electronic device, the electronic device comprising: a foldable screen and a magnetic sensor; the foldable screen comprising at least: a first sub-display and a second sub-display; the method comprising: In response to the foldable screen being in an open state, an equivalent plane for the magnetic sensor is determined; wherein, determining the equivalent plane for the magnetic sensor includes one of the following: determining a plane perpendicular to the horizontal plane as the equivalent plane for the magnetic sensor; determining a plane parallel to the horizontal plane as the equivalent plane for the magnetic sensor. Obtain the opening angle of the foldable screen in its non-folded state; Based on the opening and closing angle, the equivalent angle of the equivalent plane is determined; wherein, determining the equivalent angle of the equivalent plane based on the opening and closing angle includes at least one of the following: if the magnetic sensor corresponds to the first sub-display screen, the equivalent angle is determined based on a first angle in the opening and closing angle; if the magnetic sensor corresponds to the second sub-display screen, the equivalent angle is determined based on a second angle in the opening and closing angle; the first angle is the angle between the first sub-display screen and the horizontal plane; the second angle is the angle between the second sub-display screen and the horizontal plane; The detected motion data is mapped to the equivalent plane to obtain equivalent motion data, and the direction data detected by the magnetic sensor is mapped to the equivalent plane to obtain equivalent direction data; wherein, the step of mapping the detected motion data to the equivalent plane to obtain equivalent motion data and mapping the direction data detected by the magnetic sensor to the equivalent plane to obtain equivalent direction data includes: mapping the detected motion data to the equivalent plane based on the equivalent angle to obtain the equivalent motion data; and mapping the direction data detected by the magnetic sensor to the equivalent plane based on the equivalent angle to obtain the equivalent direction data. The equivalent motion data and the equivalent direction data are used to provide the magnetic sensor, which is equivalent to the equivalent plane, with indication of the operating direction of the electronic device.
2. The method according to claim 1, characterized in that, The first sub-display includes a first accelerometer and the second sub-display includes a second accelerometer; The process of obtaining the opening angle of the foldable screen in its unfolded state includes at least one of the following: Based on the first acceleration sensor, the first angle between the first sub-display screen and the horizontal plane is obtained; Based on the second acceleration sensor, the second angle between the second sub-display and the horizontal plane is obtained; The opening and closing angle of the foldable screen is obtained based on the first angle and the second angle.
3. The method according to claim 2, characterized in that, The determination of the equivalent angle of the equivalent plane based on the opening angle includes one of the following: In response to the electronic device being in a stationary state, the equivalent angle is determined based on the opening / closing angle; In response to the electronic device being in a moving state, the equivalent angle is determined based on whether the magnetic sensor is included in the sub-display targeted by the opening and closing angle and the visual range.
4. The method according to claim 3, characterized in that The magnetic sensor corresponds to the first sub-display screen; The step of determining the equivalent angle based on the opening / closing angle in response to the electronic device being in a stationary state includes: In response to the electronic device being in a stationary state, the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening / closing angle.
5. The method according to claim 3, characterized in that, In response to the electronic device being in a moving state, the equivalent angle is determined based on whether the magnetic sensor is included in the sub-display screen corresponding to the opening angle and visual range, including one of the following: In response to the electronic device being in a moving state, if the first sub-display screen targeted by the visual range includes the magnetic sensor, the equivalent angle is determined based on the difference between the first angle and 90 degrees in the opening and closing angle; In response to the electronic device being in a moving state, if the first sub-display screen to which the visual range is directed does not include the magnetic sensor and the second sub-display screen does include the magnetic sensor, the equivalent angle is determined based on the opening and closing angle.
6. The method according to claim 5, characterized in that, The visual range refers to the first sub-display screen, which includes the magnetic sensor. Based on the difference between the first angle and 90 degrees in the opening / closing angle, the equivalent angle is determined, including one of the following: If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is parallel to the equivalent plane, then the equivalent angle is determined to be 0. If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is not parallel to the equivalent plane, the equivalent angle is determined to be the difference between the first angle and 90 degrees.
7. The method according to claim 2, characterized in that, The step of mapping the detected motion data onto the equivalent plane to obtain equivalent motion data includes one of the following: The motion data detected by the first accelerometer is mapped onto the equivalent plane, and the motion data detected by the second accelerometer is mapped onto the equivalent plane to obtain the equivalent motion data; If the first sub-display screen targeted by the visual range includes the magnetic sensor, and the first sub-display screen is parallel to the equivalent plane, the motion data detected by the first accelerometer is mapped to the equivalent plane to obtain the equivalent motion data.
8. A pointing device, characterized in that, Applied to an electronic device, the electronic device comprising: a foldable screen and a magnetic sensor; the foldable screen comprising at least: a first sub-display and a second sub-display; the device comprising: A determining module is configured to determine the equivalent plane of the magnetic sensor in response to the folding screen being in an unfolded state; wherein, the determining module is specifically configured to: determine a plane perpendicular to the horizontal plane as the equivalent plane of the magnetic sensor; determine a plane parallel to the horizontal plane as the equivalent plane of the magnetic sensor; The acquisition module is used to acquire the opening angle of the foldable screen when it is in the non-folded state; The determining module is used to determine the equivalent angle of the equivalent plane based on the opening and closing angle; wherein, the determining module is specifically used for at least one of the following: if the magnetic sensor corresponds to the first sub-display screen, determining the equivalent angle based on a first angle in the opening and closing angle; if the magnetic sensor corresponds to the second sub-display screen, determining the equivalent angle based on a second angle in the opening and closing angle; the first angle is the angle between the first sub-display screen and the horizontal plane; the second angle is the angle between the second sub-display screen and the horizontal plane; A processing module is configured to map the detected motion data onto the equivalent plane to obtain equivalent motion data, and to map the direction data detected by the magnetic sensor onto the equivalent plane to obtain equivalent direction data; wherein, the processing module is configured to map the detected motion data onto the equivalent plane based on the equivalent angle to obtain the equivalent motion data; and to map the direction data detected by the magnetic sensor onto the equivalent plane based on the equivalent angle to obtain the equivalent direction data; The equivalent motion data and the equivalent direction data are used to provide the magnetic sensor, which is equivalent to the equivalent plane, with indication of the operating direction of the electronic device.
9. The apparatus according to claim 8, characterized in that, The first sub-display includes a first accelerometer and the second sub-display includes a second accelerometer; The acquisition module is used for at least one of the following: Based on the first acceleration sensor, the first angle between the first sub-display screen and the horizontal plane is obtained; Based on the second acceleration sensor, the second angle between the second sub-display and the horizontal plane is obtained; The opening and closing angle of the foldable screen is obtained based on the first angle and the second angle.
10. The apparatus according to claim 9, characterized in that, The determining module is configured to determine the equivalent angle based on the opening / closing angle in response to the electronic device being in a stationary state; or... The determining module is configured to, in response to the electronic device being in a moving state, determine the equivalent angle based on whether the magnetic sensor is included in the sub-display screen targeted by the opening / closing angle and the visual range.
11. The apparatus according to claim 10, characterized in that, The magnetic sensor corresponds to the first sub-display screen; The determining module is configured to determine the equivalent angle based on the difference between the first angle and 90 degrees in the opening / closing angle, in response to the electronic device being in a stationary state.
12. The apparatus according to claim 10, characterized in that, The determining module is configured to, in response to the electronic device being in a moving state, if the first sub-display screen targeted by the visual range includes the magnetic sensor, determine the equivalent angle based on the difference between the first angle and 90 degrees in the opening / closing angle; or... The determining module is configured to, in response to the electronic device being in a moving state, determine the equivalent angle based on the opening and closing angle if the first sub-display screen to which the visual range is directed does not include the magnetic sensor and the second sub-display screen does include the magnetic sensor.
13. The apparatus according to claim 12, characterized in that, The determining module is configured to determine the equivalent angle as 0 if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is parallel to the equivalent plane; or, The determining module is configured to determine the equivalent angle as the difference between the first angle and 90 degrees if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is not parallel to the equivalent plane.
14. The apparatus according to claim 9, characterized in that, The processing module is configured to map the motion data detected by the first accelerometer to the equivalent plane and to map the motion data detected by the second accelerometer to the equivalent plane to obtain the equivalent motion data; or... The processing module is configured to, if the first sub-display screen targeted by the visual range includes the magnetic sensor and the first sub-display screen is parallel to the equivalent plane, map the motion data detected by the first accelerometer to the equivalent plane to obtain the equivalent motion data.
15. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the pointing method according to any one of claims 1-7 when running the executable instructions.
16. A computer-readable storage medium, characterized in that, The readable storage medium stores an executable program, wherein the executable program, when executed by a processor, implements the pointing method according to any one of claims 1-7.
Citation Information
Patent Citations
Folding screen state detection method and device, electronic equipment and display system
CN112099717A
KR20200126317A