Method and electronic device for image stabilization, and recording medium

Abstract

An electronic device according to one embodiment of the present disclosure comprises a communication circuit, one or more sensors, a display, one or more processors, and one or more memories for storing one or more instructions, wherein, by executing the one or more instructions, the one or more processors can be configured to set a reference surface while displaying content through the display, calculate, with respect to the reference surface, a rotation angle or a movement distance of the electronic device, and correct a display angle or a display position of the content on the display on the basis of the rotation angle or the movement distance.

Description

Methods for compensating for shaking, electronic devices and recording media

[0001] The present disclosure relates to a method for compensating for shaking, an electronic device and a recording medium.

[0002] When a user plays and watches a video on an electronic device, the video is displayed according to the screen size of the device. If the user holds the device in their hand rather than holding it still, the shaking can interfere with viewing the video or increase eye fatigue. In particular, when watching a video on an electronic device while on the move, the distance between the user's eyes and the display, as well as the user's field of view and the display's orientation, can constantly change due to shaking, causing focus to shift.

[0003] According to one embodiment of the present disclosure, when shaking occurs while displaying content (e.g., an image) through an electronic device, a technical problem is to correct (or compensate) the shaking in real time to display the content.

[0004] According to one embodiment of the present disclosure, a technical problem is to detect a movement distance and rotation angle of an electronic device and correct a display position and display angle of content being played.

[0005] An electronic device according to one embodiment of the present disclosure includes: a communication circuit; one or more sensors; a display; one or more processors; and one or more memories storing one or more instructions, wherein the one or more processors are configured to set a reference plane while displaying content through the display by executing the one or more instructions, calculate an angle by which the electronic device is rotated or a distance by which it is moved with respect to the reference plane, and correct a display angle or a display position of the content on the display based on the rotation angle or the distance by which it is moved.

[0006] According to one embodiment, the one or more sensors may include a gyro sensor that measures angular velocity along three axes and an acceleration sensor that measures acceleration along three axes.

[0007] According to one embodiment, the one or more processors may be configured to calculate an angle at which the electronic device is rotated about three axes with respect to the reference plane based on sensing information obtained from the gyro sensor by executing the one or more instructions, calculate a rotation correction amount based on the rotation angle, and correct a display angle of the content on the display based on the rotation correction amount.

[0008] According to one embodiment, the one or more processors may be configured to compare the rotated angle with a first threshold angle by executing the one or more instructions, calculate the rotation correction amount based on the first threshold angle when the rotated angle is greater than or equal to the first threshold angle, and calculate the rotation correction amount based on the rotated angle when the rotated angle is less than the first threshold angle.

[0009] According to one embodiment, the one or more processors may be configured to calculate a distance by which the electronic device has moved in a three-axis direction with respect to the reference plane based on sensing information obtained from the acceleration sensor by executing the one or more instructions, calculate a movement correction amount based on the movement distance, and correct a display position of the content on the display based on the movement correction amount.

[0010] According to one embodiment, the one or more processors may be configured to compare the moved distance with a first threshold distance by executing the one or more instructions, and if the moved distance is greater than or equal to the first threshold distance, calculate the movement correction amount based on the first threshold distance, and if the moved distance is less than the first threshold distance, calculate the movement correction amount based on the first threshold distance.

[0011] According to one embodiment, the one or more processors may be configured to periodically reset the reference plane while displaying content through the display by executing the one or more instructions.

[0012] According to one embodiment, the one or more processors may be configured to, by executing the one or more instructions, compare the rotated angle or the moved distance with a second threshold angle or a second threshold distance, and, if the rotated angle is greater than or equal to the second threshold angle or the moved distance is greater than or equal to the second threshold distance, correct the display angle or the display position of the content on the display based on the rotated angle or the moved distance.

[0013] According to one embodiment, the one or more processors may be configured to determine not to correct the display angle or display position of the content on the display when the rotated angle is less than the second threshold angle and the moved distance is less than the second threshold distance by executing the one or more instructions.

[0014] In one embodiment, the one or more processors may be configured to display a pop-up window for determining whether to activate a shake correction function while displaying content through the display by executing the one or more instructions, and to set the reference plane when a user input for activating the shake correction function is received.

[0015] A method for compensating for shaking performed by an electronic device according to one embodiment of the present disclosure may include: setting a reference plane while displaying content through a display; detecting an angle by which the electronic device is rotated or a distance by which it has moved with respect to the reference plane based on sensing information acquired from one or more sensors; and correcting a display angle or a display position of the content on the display based on the rotation angle or the distance by which it has moved.

[0016] A computer-readable, non-transitory recording medium having recorded thereon a program for executing a method for compensating for shaking performed by an electronic device according to an embodiment of the present disclosure, the method for compensating for shaking may include: a step of setting a reference plane while displaying content through a display; a step of detecting an angle of rotation or a distance moved by the electronic device with respect to the reference plane based on sensing information acquired from one or more sensors; and a step of correcting a display angle or a display position of the content on the display based on the rotation angle or the distance moved.

[0017] According to one embodiment of the present disclosure, when shaking occurs while displaying content (e.g., an image) through an electronic device, the content can be displayed by correcting (or compensating) the shaking in real time.

[0018] According to one embodiment of the present disclosure, the display position and display angle of content being played can be corrected by detecting the movement distance and rotation angle of the electronic device.

[0019] FIG. 1 is a diagram illustrating an electronic device according to one embodiment of the present disclosure.

[0020] FIG. 2 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.

[0021] FIG. 3 is a flowchart of the operation of an electronic device according to one embodiment of the present disclosure.

[0022] FIG. 4A is a front view of an electronic device when displaying content according to one embodiment. FIG. 4B is a view of an electronic device according to one embodiment when the display is viewed from an oblique direction while the electronic device is rotated at a certain angle around the z-axis with respect to a reference plane, and FIG. 4C is a front view of a display of an electronic device according to one embodiment when the display is rotated at a certain angle around the z-axis with respect to a reference plane.

[0023] FIG. 5a is a drawing of a display viewed from an oblique direction while the electronic device is rotated at a certain angle around the y-axis with respect to a reference plane, and FIG. 5b is a drawing of a display viewed from the front while the electronic device is rotated at a certain angle around the y-axis with respect to a reference plane according to one embodiment.

[0024] FIG. 6 is a flowchart of the operation of an electronic device according to one embodiment of the present disclosure.

[0025] FIG. 7A is a front view of an electronic device when displaying content according to an embodiment of the present disclosure. FIG. 7B is a front view of an electronic device when the electronic device has moved by h in the (-) direction of the z-axis with respect to a reference plane.

[0026] FIG. 8A is a drawing of a display viewed from the front, with the electronic device moved in the (+) direction of the x-axis with respect to a reference plane, according to one embodiment of the present disclosure. FIG. 8B is a drawing of the electronic device adjusting the size of content with respect to the reference plane, with respect to the (+) direction of the x-axis.

[0027] The terms used in the embodiments have been selected from widely used and common terms, taking into account the functions of the present disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, in which case their meanings will be described in detail in the relevant description. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the present disclosure.

[0028] When a part of the specification is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part" and "module" used in the specification mean a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0029] The expression “at least one of a, b, and c” described throughout the specification may encompass ‘a alone’, ‘b alone’, ‘c alone’, ‘a and b’, ‘a and c’, ‘b and c’, or ‘all of a, b, and c’.

[0030] The "terminal" mentioned below may be implemented as a computer or portable terminal that can connect to a server or other terminal via a network. Here, the computer includes, for example, a notebook, desktop, laptop, etc. equipped with a web browser, and the portable terminal may include, for example, a wireless communication device that guarantees portability and mobility, and may include all types of handheld-based wireless communication devices such as communication-based terminals such as IMT (International Mobile Telecommunication), CDMA (Code Division Multiple Access), W-CDMA (W-Code Division Multiple Access), LTE (Long Term Evolution), smartphones, tablet PCs, etc.

[0031] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

[0032] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0033] In describing the embodiments, descriptions of technical details that are well known in the technical field to which the present invention pertains and are not directly related to the present invention will be omitted. This is to avoid obscuring the gist of the present invention by omitting unnecessary explanations and to convey the gist more clearly.

[0034] For the same reason, some components in the attached drawings are exaggerated, omitted, or schematically depicted. Furthermore, the dimensions of each component do not entirely reflect its actual size. Identical or corresponding components in each drawing are assigned the same reference numbers.

[0035] The advantages and features of the present invention, and the methods for achieving them, will become clearer with reference to the embodiments described in detail below together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. These embodiments are provided only to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims. Like reference numerals designate like elements throughout the specification.

[0036] At this time, it will be understood that each block of the processing flow diagrams and combinations of the flow diagrams can be performed by computer program instructions. These computer program instructions can be installed in a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing equipment, so that the instructions executed by the processor of the computer or other programmable data processing equipment create a means for performing the functions described in the flow diagram block(s). These computer program instructions can also be stored in a computer-available or computer-readable memory that can direct a computer or other programmable data processing equipment to implement the functions in a specific manner, so that the instructions stored in the computer-available or computer-readable memory can also produce a manufactured item that includes an instruction means for performing the functions described in the flow diagram block(s). Since the computer program instructions may be installed on a computer or other programmable data processing device, a series of operational steps may be performed on the computer or other programmable data processing device to create a computer-executable process, and the instructions that cause the computer or other programmable data processing device to perform the steps for performing the functions described in the flowchart block(s) may also provide steps for performing the functions described in the flowchart block(s).

[0037] Additionally, each block may represent a module, segment, or portion of code that contains one or more executable instructions for performing a specific logical function(s). It should also be noted that in some alternative implementation examples, the functions described in the blocks may occur out of order. For example, two blocks depicted in succession may actually be executed substantially concurrently, or the blocks may sometimes be executed in reverse order, depending on their respective functions.

[0038] FIG. 1 is a diagram illustrating an electronic device (100) according to one embodiment of the present disclosure. The electronic device (100) according to one embodiment may include a processor (110), a memory (120), a communication circuit (130), a sensor (140), and a display. At least one of the components included in the electronic device (100) may be omitted, or another component may be added to the electronic device (100). Additionally or alternatively, some of the components may be implemented in an integrated manner, or may be implemented as a single or multiple entities. At least some of the components within the electronic device (100) may be implemented in an integrated manner, or may be implemented as a single or multiple entities. At least some of the components within the electronic device (100) may be connected to each other via a bus, a general purpose input / output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI), and may exchange data and / or signals.

[0039] According to one embodiment, the processor (110) of the electronic device (100) is a component that can perform calculations or data processing related to control and / or communication of each component of the electronic device (100), and can be operatively connected to the components of the electronic device (100). The processor (110) can load commands or data received from other components of the electronic device (100) into the memory (120), process the commands or data stored in the memory (120), and store the resulting data. Unless there are special circumstances, the processor (110) in the present disclosure may mean a set of one or more processors (110).

[0040] The memory (120) of the electronic device (100) according to one embodiment may store various data used by at least one component (e.g., the processor (110)). The memory (120) may store instructions for the operation of the processor (110) described above. The program may be stored as software in the memory (120) and may include, for example, an operating system, middleware, or an application. Unless otherwise specified, the memory (120) in the present disclosure may mean a set of one or more memories (120).

[0041] According to one embodiment, the communication circuit (130) of the electronic device (100) can establish a wired or wireless communication channel with an external device (e.g., a server device) and transmit and receive various data with the external device. The communication circuit (130) of the electronic device (100) can include at least one port for connecting to the external device via a wired cable in order to communicate with the external device via a wire. The communication circuit (130) of the electronic device (100) can be configured to be connected to a cellular network (e.g., 3G, LTE, 5G, Wibro, or Wimax) by including a cellular communication module. According to one embodiment, the communication circuit (130) of the electronic device (100) can include a short-range communication module to transmit and receive data with the external device using short-range communication (e.g., Wi-Fi, Bluetooth, Bluetooth Low Energy (BLE), UWB), but is not limited thereto.

[0042] According to one embodiment, a sensor (140) of an electronic device (100) may detect an operating state (e.g., power or temperature) of the electronic device (100) or an external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. The sensor (140) may include a gyro sensor and an acceleration sensor. Unless otherwise specified, the sensor (140) in the present disclosure may refer to a set of one or more sensors. The sensor (140) of the electronic device (100) may include a gyro sensor that measures angular velocity along three axes and an acceleration sensor that measures acceleration along three axes.

[0043] A gyro sensor may be a sensor that measures (or senses) angular velocities about three axes. The gyro sensor may generate sensing information by detecting angular velocities about three axes that represent rotations about three axes. For example, the gyro sensor may detect angular velocities about three axes that represent rotations about the x-axis, y-axis, and z-axis. The processor (110) may calculate a rotation angle about three axes based on the sensing information acquired from the gyro sensor. For example, the processor (110) may calculate a roll value, which is a rotation angle about the x-axis, a pitch value, which is a rotation angle about the y-axis, and a yaw value, which is a rotation angle about the z-axis, based on the sensing information acquired from the gyro sensor.

[0044] An acceleration sensor may be a sensor that measures (or senses) acceleration along three axes. The acceleration sensor may measure the acceleration or intensity of an impact of an electronic device. The acceleration sensor may generate sensing information by detecting three-axis acceleration indicating movement in three directions. For example, the acceleration sensor may detect three-axis acceleration corresponding to the x-axis, y-axis, and z-axis directions. The processor (110) may calculate a movement distance of the electronic device (100) in the x-axis, y-axis, and z-axis directions based on the sensing information obtained from the acceleration sensor.

[0045] According to one embodiment, a display (150) of an electronic device (100) can visually provide information to an external party (e.g., a user). The display (150) can display content under the control of a processor (110). The content may be, for example, video content. The display (150) may include a touch circuit configured to detect a touch, or a sensor circuit (e.g., a pressure sensor) configured to measure the intensity of a force generated by a touch.

[0046] A camera (not shown) of an electronic device (100) according to one embodiment can capture still images or moving images. According to one embodiment, the camera may include one or more lenses, image sensors, image signal processors, or flashes.

[0047] FIG. 2 is a flowchart illustrating the operation of an electronic device (100) according to one embodiment of the present disclosure.

[0048] Referring to the flowchart 200, the processor (110) of the electronic device (100) according to one embodiment may set a reference plane while displaying content through the display (150) in step 210. The processor (110) may play content based on a user input and display the content on the display (150). The content may be, for example, video content. The processor (110) may set a reference plane to be used for shake correction while displaying the content. The reference plane may mean a virtual plane corresponding to the display (150) of the electronic device (100) in a three-dimensional space. The three-dimensional space may mean a three-dimensional space of the real world or may be a virtual three-dimensional space centered on the electronic device (100). The reference plane may represent information about the position and posture (or direction) of the electronic device (100) in the three-dimensional space at a set point in time. The processor (110) may periodically reset the reference plane while displaying content through the display (150). For example, the processor (110) may reset the reference plane every 3 seconds.

[0049] According to one embodiment, the processor (110) may, in step 220, calculate the angle by which the electronic device (100) rotates or the distance by which it moves with respect to the reference plane. The processor (110) may calculate the angle by which the electronic device (100) rotates or the distance by which it moves with respect to the reference plane based on sensing information obtained from the sensor (140).

[0050] The processor (110) can calculate an angle at which the electronic device (100) is rotated around three axes with respect to a reference plane based on sensing information acquired from a gyro sensor. For example, the processor (110) can calculate at least one of a roll value, which is an angle at which the electronic device is rotated around the x-axis, a pitch value, which is an angle at which the electronic device is rotated around the y-axis, and a yaw value, which is an angle at which the electronic device is rotated around the z-axis, with respect to the reference plane.

[0051] The processor (110) can calculate the distance that the electronic device (100) has moved in the three-axis direction with respect to a reference plane based on sensing information obtained from an acceleration sensor. For example, the processor (110) can calculate at least one of the distance moved in the x-axis direction, the distance moved in the y-axis direction, and the distance moved in the z-axis direction with respect to the reference plane.

[0052] According to one embodiment, the processor (110) may, in step 230, correct the display angle or display position of the content on the display (150) based on the rotation angle or movement distance. A specific method for correcting the display angle or display position of the content will be described later.

[0053] FIG. 3 is a flowchart illustrating an operation of an electronic device (100) according to one embodiment of the present disclosure. Specifically, FIG. 3 relates to a method for correcting a display angle of content when the electronic device (100) rotates.

[0054] Referring to the flowchart 300, the processor (110) of the electronic device (100) according to one embodiment may set a reference plane while displaying content through the display (150) in step 310. The processor (110) may display image content through the display (150) based on a user input. The processor (110) may set a reference plane while displaying content. The reference plane may be, for example, a plane identical to the surface of the display (150) and may be a plane that serves as a reference for compensating for shaking. FIG. 4A is a drawing of the electronic device (100) viewed from the front when displaying content on the electronic device (100) according to one embodiment. The front may refer to the front of the display (150) of the electronic device (100) and may refer to the display direction of the display (150). Referring to FIG. 4A, the processor (110) may display content (C) on one area of ​​the display (150). In the drawing, let us assume that the surface of the display (150) of the electronic device (100) is parallel to the yz plane perpendicular to the x-axis. In the above case, the processor (110) can set the reference plane as the surface of the display (150) of the electronic device (100).

[0055] For reference, the x-axis may be a direction perpendicular to the surface of the display (150) of the electronic device (100), the y-axis may be a horizontal direction of the display (150) of the electronic device (100), and the z-axis may be a vertical direction of the display (150) of the electronic device (100). The three axes described above may be determined by a reference plane. The x-axis, y-axis, and z-axis may be three axes that constitute a virtual three-dimensional space coordinate system with the location of the electronic device (100) as the origin.

[0056] According to one embodiment, the processor (110) may, in step 320, calculate an angle at which the electronic device (100) rotates around three axes with respect to a reference plane. The processor (110) may calculate an angle at which the electronic device (100) rotates around three axes with respect to the reference plane based on sensing information obtained from a gyro sensor that measures angular velocity along three axes. The processor (110) may calculate an angle at which the electronic device (100) rotates around the reference plane with respect to each of the three axes.

[0057] According to one embodiment, the processor (110) may, in step 330, compare the rotation angle with a first threshold angle. The processor (110) may compare the rotation angle around each of the three axes with the first threshold angle. The first threshold angle may be set by the user or may be determined as a default value. The first threshold angle may be determined based on the size of the display (150) of the electronic device (100). In the present embodiment, the same first threshold angle is described as being applied to the three axes, but different threshold angles may be set for each of the three axes. For example, the threshold angle may be set to 30 degrees for rotation around the x-axis, 40 degrees for rotation around the y-axis, and 50 degrees for rotation around the z-axis.

[0058] According to one embodiment, the processor (110), if the rotated angle is greater than or equal to a first threshold angle in step 340, branches to step 350 (step 340 -> Yes) and calculates a rotation correction amount based on the first threshold angle. That is, if the rotated angle is greater than or equal to the first threshold angle, the rotation correction amount can be calculated using the first threshold angle. The rotation correction amount can be calculated for each rotation centered on the x-axis, y-axis, and z-axis.

[0059] According to one embodiment, the processor (110), if the rotated angle is less than the first threshold angle in step 340, branches to step 360 (step 340 -> No) and calculates a rotation correction amount based on the rotated angle. That is, if the rotated angle is less than the second threshold angle, the rotation correction amount can be calculated using the actual rotated angle. The rotation correction amount may be a value expressed in degrees.

[0060] According to one embodiment, the processor (110) may correct the display angle of the content on the display (150) in step 370. FIG. 4b is a drawing of the display (150) viewed from an oblique direction while the electronic device (100) according to one embodiment is rotated at a certain angle around the z-axis with respect to a reference plane, and FIG. 4c is a drawing of the display (150) viewed from the front while the electronic device (100) according to one embodiment is rotated at a certain angle around the z-axis with respect to a reference plane.

[0061] Referring to FIGS. 4B and 4C, the electronic device (100) can rotate by an angle a in a first rotation direction (e.g., counterclockwise when viewed from above the z-axis) around the z-axis with respect to a reference plane. If the angle a rotated around the z-axis is less than a first threshold angle, the processor (110) can calculate a rotation correction amount corresponding to the z-axis rotation based on the angle a. In this case, the rotation correction amount can be determined as a rotation by an angle a in a second rotation direction (e.g., clockwise when viewed from above the z-axis) opposite to the first rotation direction around the z-axis. According to FIG. 4C, it can be confirmed that the content (C) is rotated by an angle a in the second rotation direction around the z-axis on the display (150). A method for correcting the display direction of the content (C) can use a method that uses the orthographic projection in reverse.

[0062] According to FIG. 4b, when the display angle of the content (C) is corrected as in FIG. 4c, even if the user looks at the display (150) at an angle while the electronic device (100) is rotated, the content (C) can be displayed straight in front in the user's field of view. In other words, by correcting the display direction of the content (C) in the opposite direction to the rotation direction of the electronic device (100), the user can view the content (C) in its original size regardless of the rotation of the electronic device (100).

[0063] Meanwhile, when the reference plane is periodically reset, the processor (110) can restore the display direction and display position of the content (C) to their original state (i.e., the state before correction) in response to the reset of the reference plane. In the above case, the processor (110) can control the display direction and display position of the content (C) to gradually change to their original state.

[0064] FIG. 5A is a view of the display (150) viewed from an oblique direction while the electronic device (100) is rotated at a certain angle around the y-axis with respect to a reference plane, and FIG. 5B is a view of the display (150) viewed head-on while the electronic device (100) is rotated at a certain angle around the y-axis with respect to a reference plane, according to one embodiment. Referring to FIGS. 5A and 5B, when the electronic device (100) is rotated in a third rotational direction around the y-axis with respect to the reference plane, the processor (110) can correct the display angle at which the content (C) is displayed on the display (150) in a fourth rotational direction opposite to the third rotational direction around the y-axis. The rotational correction amount corresponding to the rotation around the y-axis can be determined based on a comparison between the actual rotation angle of the electronic device (100) with respect to the reference plane and the first threshold angle. This is the same as the technical feature described in FIG. 3 described above.

[0065] Although the above-described embodiment has been described assuming that the electronic device (100) rotates around the z-axis and around the y-axis, the above-described technical features can be equally applied to the case where the electronic device (100) rotates around the x-axis. Furthermore, even if the device rotates around two or more axes, the above-described technical features can be equally applied to each of the x-axis, y-axis, and z-axis. In other words, the rotation of the electronic device (100) in three-dimensional space can be compensated for in real time.

[0066] Even if the electronic device (100) is rotated while the user is viewing content (C) using the electronic device (100), the display angle of the content (C) is compensated according to the rotation angle of the electronic device (100), so that the content (C) can always be displayed in the user's field of view similar to the original. For example, if the user plays the video content (C) while walking while holding the electronic device (100), even if the electronic device (100) rotates according to the walking, the display angle of the content (C) is compensated in real time, so that the user can continuously view the content (C) similar to the original. This may be a reverse application of the orthographic projection phenomenon.

[0067] Additionally, the processor (110) of the electronic device (100) according to one embodiment can periodically reset the reference plane while displaying the content (C) through the display (150). That is, by periodically resetting the reference plane, the display angle of the content (C) can be corrected in real time.

[0068] According to one embodiment of the present disclosure, shaking can be compensated by correcting the display angle of content (C) in opposition to the shaking of the electronic device (100). The above-described function may be referred to as a shake compensation function or an active shake canceling function.

[0069] Meanwhile, when the reference plane is periodically reset, the processor (110) can restore the display direction and display position of the content (C) to their original state (i.e., the state before correction) in response to the reset of the reference plane. In the above case, the processor (110) can control the display direction and display position of the content (C) to gradually change to their original state.

[0070] FIG. 6 is a flowchart illustrating the operation of an electronic device (100) according to one embodiment of the present disclosure. Specifically, FIG. 6 relates to a method for correcting the display position of content when the electronic device (100) moves. Any details that overlap with those described in FIG. 3 will be omitted.

[0071] Referring to the operation flowchart 600, the processor (110) of the electronic device (100) according to one embodiment may set a reference plane while displaying content through the display (150) in step 610.

[0072] According to one embodiment, the processor (110) may calculate a distance by which the electronic device (100) has moved in a three-axis direction with respect to a reference plane in step 620. The processor (110) may calculate a distance by which the electronic device (100) has moved in a three-axis direction with respect to the reference plane based on sensing information obtained from an acceleration sensor that measures three-axis acceleration. That is, the processor (110) may calculate a distance by which the electronic device (100) has moved in each of the three-axis directions. For example, the processor (110) may calculate a distance by which the electronic device (100) has moved in the x-axis direction, a distance by which the electronic device (100) has moved in the y-axis direction, and a distance by which the electronic device (100) has moved in the z-axis direction with respect to the reference plane as the center.

[0073] According to one embodiment, the processor (110) may, at step 630, compare the distance moved with a first threshold distance. The processor (110) may compare the distance moved in each of the three-axis directions with the first threshold distance. The first threshold distance may be set by the user or may be determined as a default value. The first threshold distance may be determined based on the size of the display (150) of the electronic device (100). Although the present embodiment describes that the same first threshold distance is applied to the three-axis directions, different threshold distances may be set for each of the three-axis directions. For example, the threshold distance may be set to 20 cm for movement in the y-axis direction, and the threshold distance may be set to 15 cm for movement in the z-axis direction.

[0074] According to one embodiment, the processor (110), in step 640, if the distance moved is greater than or equal to a first threshold distance, branches to step 650 (step 640 -> Yes) and calculates a movement correction amount based on the first threshold distance. That is, if the distance moved is greater than or equal to the first threshold distance, the movement correction amount can be calculated using the first threshold distance.

[0075] According to one embodiment, the processor (110), if the distance moved is less than the first threshold distance in step 640, branches to step 660 (step 640 -> No), and calculates a movement compensation amount based on the first threshold distance. That is, if the distance moved is less than the first threshold distance, the movement compensation amount can be calculated using the actual distance moved. The movement compensation amount may be a value expressed as a length.

[0076] According to one embodiment, the processor (110) may correct the display position of the content on the display (150) based on the movement correction amount in step 670. FIG. 7A is a drawing of the electronic device (100) when displaying content (C) in the electronic device (100) according to one embodiment of the present disclosure, viewed from the front. The front may mean the front of the display (150) of the electronic device (100). Referring to FIG. 7A, the processor (110) may display the content (C) on one area of ​​the display (150). In the drawing, it is assumed that the surface of the display (150) of the electronic device (100) is parallel to the yz plane perpendicular to the x-axis. In the above case, the processor (110) may set the reference plane as the surface of the display (150) of the electronic device (100). That is, the reference plane may be a virtual plane that represents the position and posture (i.e., direction) of the current electronic device (100) in three-dimensional space.

[0077] FIG. 7b is a front view of the electronic device (100) when the electronic device (100) has moved by h in the (-) direction of the z-axis with respect to the reference plane. In the above case, the processor (110) can determine h as a movement correction amount in the (+) direction of the z-axis. The processor (110) can move the display position of the content (C) on the display (150) by h in the (+) direction of the z-axis from the display position of the existing content (C'). Through this, even if the electronic device (100) moves with respect to the reference plane, the content display position can be displayed at a location similar to the existing display position.

[0078] FIG. 8A is a drawing of a display (150) viewed from the front when the electronic device (100) is moved in the (+) direction of the x-axis with respect to a reference plane, according to one embodiment of the present disclosure. Specifically, FIG. 8A is a front view of the display (150) when the electronic device (100) is moved in the (+) direction of the x-axis in the state of FIG. 7A. FIG. 8B is a drawing of adjusting the size of the content (C) when the electronic device (100) is moved in the (+) direction of the x-axis with respect to the reference plane. Unlike the y-axis movement and the z-axis movement, in the case of the x-axis movement, the distance between the user and the display (150) is changed. In the above case, it is preferable to adjust the size of the content rather than adjusting the display position of the content on the display (150). That is, in the above case, the processor (110) can correct the size of the content (C) to be smaller than the size of the existing content (C') and display it.

[0079] According to one embodiment, the processor (110) may calculate a distance that the electronic device (100) has moved in the x-axis direction with respect to a reference plane. The processor (110) may compare the distance that the electronic device (100) has moved in the x-axis direction with a third threshold distance. If the distance that the electronic device (100) has moved in the x-axis direction is greater than or equal to the third threshold distance, the processor (110) may calculate a size correction amount based on the third threshold distance. If the distance that the electronic device (100) has moved in the x-axis direction is less than the third threshold distance, the processor (110) may calculate a size correction amount based on the actual movement distance. The processor (110) may correct the display size of the content on the display (150) based on the calculated size correction amount. The size correction amount may be a value expressed as a percentage. That is, if the electronic device (100) moves in a direction closer to the user, the size of the content may be reduced (i.e., zoomed out), and if the electronic device (100) moves in a direction away from the user, the size of the content may be increased (i.e., zoomed in).

[0080] Meanwhile, when the reference plane is periodically reset, the processor (110) can restore the size of the content (C) to its original state (i.e., the state before correction) in response to the reset of the reference plane. In the above case, the processor (110) can control the size of the content (C) to gradually return to its original state. Meanwhile, corrections for the display position, display direction, and / or size of the content displayed on the above-described display (150) can be performed simultaneously and in a complex manner.

[0081] According to one embodiment, the processor (110) of the electronic device (100) can capture a user's face through a camera and identify the user's eyes from the captured image. The processor (110) can determine the user's field of view based on the identified user's eyes. The processor (110) can determine whether the display (150) is included in the user's field of view. If the display (150) is not included in the user's field of view, the processor (110) can re-set the reference plane based on the current position and posture of the electronic device (100).

[0082] According to one embodiment, the processor (110) of the electronic device (100) may determine status information of a user using the electronic device (100) based on sensing information obtained from a sensor (140). For example, the user's status information may include a walking status, a subway travel status, a bus travel status, and a vehicle travel status. The processor (110) may analyze sensing information obtained over a certain period of time to determine the user's status information. Depending on the determined user's status information, the processor (110) may not use a specific sensor or adjust the sensitivity of a specific sensor. For example, when the processor (110) determines that the user's status information is a subway travel status, the processor (110) may not use sensing information of an acceleration sensor, but may only use sensing information of a gyro sensor to correct only the display angle of the content.

[0083] According to one embodiment, the shake correction function (or dynamic shake removal function) described above can be activated or deactivated based on user input. For example, the processor (110) can display a pop-up window for determining whether to activate the shake correction function while displaying content through the display (150). The user can select whether to activate the shake correction function in the displayed pop-up window. If the shake correction function is not activated, the position and angle at which the content is displayed on the display (150) may be fixed and not corrected according to the shaking of the electronic device (100). If the shake correction function is activated, the display position and display angle of the content on the display (150) may be corrected in real time according to the shaking of the electronic device (100).

[0084] According to one embodiment, the processor (110) may activate the shake correction function described above in response to the movement distance and rotation angle of the electronic device (100) exceeding a threshold value. The processor (110) may compare the rotation angle or the movement distance of the electronic device (100) with a second threshold angle or a second threshold distance. If the rotation angle is greater than or equal to the second threshold angle or the movement distance is greater than or equal to the second threshold distance, the processor (110) may correct the display angle or the display position of the content on the display (150) based on the rotation angle or the movement distance. If the rotation angle is less than the second threshold angle and the movement distance is less than the second threshold distance, the processor (110) may determine not to correct the display angle or the display position of the content on the display (150). Through this, when the shaking of the electronic device (100) is relatively small, the shake correction function can be disabled, and when the shaking of the electronic device (100) is relatively large, the shake correction function can be activated.

[0085] Meanwhile, the present specification and drawings disclose preferred embodiments of the present invention. Although specific terms have been used, they are used in a general sense only to easily explain the technical contents of the present invention and to assist in understanding the invention, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modified examples based on the technical concept of the present invention are possible in addition to the embodiments disclosed herein.

[0086] The device or terminal according to the above-described embodiments may include a processor, a memory for storing and executing program data, permanent storage such as a disk drive, a communication port for communicating with an external device, a user interface device such as a touch panel, a key, a button, etc. The methods implemented as software modules or algorithms may be stored on a computer-readable recording medium as computer-readable codes or program commands that can be executed on the processor. Here, the computer-readable recording medium includes a magnetic storage medium (e.g., a read-only memory (ROM), a random-access memory (RAM), a floppy disk, a hard disk, etc.) and an optical reading medium (e.g., a CD-ROM, a Digital Versatile Disc (DVD)). The computer-readable recording medium may be distributed to computer systems connected to a network, so that the computer-readable code can be stored and executed in a distributed manner. The medium is readable by a computer, stored in a memory, and executed by a processor.

[0087] The present embodiment may be represented by functional block configurations and various processing steps. These functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the embodiment may employ integrated circuit configurations such as memory, processing, logic, look-up tables, etc., which may perform various functions under the control of one or more microprocessors or other control devices. Similarly, the present embodiment may be implemented in a programming or scripting language such as C, C++, Java, assembler, Python, etc., including various algorithms implemented as a combination of data structures, processes, routines, or other programming configurations. Functional aspects may be implemented as algorithms that execute on one or more processors. Furthermore, the present embodiment may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as "mechanism," "element," "means," and "composition" can be used broadly and are not limited to mechanical or physical structures. These terms can also encompass a series of software routines, such as those associated with a processor.

[0088] The above-described embodiments are merely examples, and other embodiments may be implemented within the scope of the claims set forth below.

Claims

1. In electronic devices, communication circuit; One or more sensors; display; one or more processors; and Contains one or more memories that store one or more instructions, The one or more processors, by executing the one or more instructions, Set the reference plane while displaying content through the above display, Calculate the angle by which the electronic device is rotated or the distance by which it is moved with respect to the above reference plane, An electronic device configured to correct a display angle or display position of the content on the display based on the rotation angle or the movement distance.

2. In paragraph 1, An electronic device, wherein the one or more sensors include a gyro sensor that measures angular velocity along three axes and an acceleration sensor that measures acceleration along three axes.

3. In paragraph 2, The one or more processors, by executing the one or more instructions, Based on the sensing information obtained from the gyro sensor, the electronic device calculates the rotation angle around the three axes with respect to the reference plane, Based on the above rotation angle, the rotation correction amount is calculated, An electronic device configured to correct the display angle of the content on the display based on the rotation correction amount.

4. In paragraph 3, The one or more processors, by executing the one or more instructions, Compare the above rotated angle with the first critical angle, If the above-mentioned rotated angle is greater than or equal to the first threshold angle, the rotation correction amount is calculated based on the first threshold angle, An electronic device configured to calculate the rotation correction amount based on the rotated angle when the rotated angle is less than the first threshold angle.

5. In paragraph 2, The one or more processors, by executing the one or more instructions, Based on the sensing information obtained from the acceleration sensor, the distance the electronic device has moved in the three-axis direction with respect to the reference plane is calculated, Calculate the movement compensation amount based on the distance moved above, An electronic device configured to correct the display position of the content on the display based on the movement correction amount.

6. In paragraph 5, The one or more processors, by executing the one or more instructions, Compare the distance moved above with the first critical distance, If the distance moved is greater than or equal to the first threshold distance, the movement compensation amount is calculated based on the first threshold distance, An electronic device configured to calculate the movement compensation amount based on the first threshold distance when the distance moved is less than the first threshold distance.

7. In paragraph 1, The one or more processors, by executing the one or more instructions, An electronic device configured to periodically reset the reference plane while displaying content through the above display.

8. In paragraph 1, The one or more processors, by executing the one or more instructions, Compare the above-mentioned rotated angle or the above-mentioned moved distance with the second critical angle or the second critical distance, An electronic device configured to correct the display angle or display position of the content on the display based on the rotated angle or the moved distance, when the rotated angle is greater than or equal to the second threshold angle or the moved distance is greater than or equal to the second threshold distance.

9. In paragraph 8, The one or more processors, by executing the one or more instructions, An electronic device configured to determine not to correct the display angle or display position of the content on the display when the rotated angle is less than the second threshold angle and the moved distance is less than the second threshold distance.

10. In paragraph 1, The one or more processors, by executing the one or more instructions, Display a pop-up window to decide whether to activate the shake correction function while displaying content through the above display, An electronic device configured to set the reference plane when receiving a user input for activating the shake compensation function.

11. A method for compensating for shaking performed by an electronic device, A step for setting a reference plane while displaying content through a display; A step of detecting an angle by which the electronic device is rotated or a distance by which the electronic device is moved with respect to the reference plane based on sensing information obtained from one or more sensors; and A method for correcting shaking, comprising a step of correcting the display angle or display position of the content on the display based on the rotation angle or the movement distance.

12. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of compensating for shaking performed by an electronic device, The method for correcting the above shaking is as follows: A step for setting a reference plane while displaying content through a display; A step of detecting an angle by which the electronic device is rotated or a distance by which the electronic device is moved with respect to the reference plane based on sensing information obtained from one or more sensors; and A non-transitory recording medium comprising a step of correcting the display angle or display position of the content on the display based on the rotation angle or the movement distance.

Images