Electronic device and method for capturing image of celestial object

Abstract

An electronic device and a method for capturing an image of a celestial object are provided. The method for an electronic device to capture an image of a celestial object includes: displaying a preview image generated by a camera of the electronic device; measuring a position of the electronic device; measuring an orientation of the electronic device; identifying a celestial object corresponding to a capture direction of a camera of the electronic device based on the measured position and the measured orientation; identifying a camera exposure time set for capturing the celestial body object; and displaying a graphical user interface (GUI) on the preview image to guide a reference position for displaying the celestial body object within the captured result image of the celestial body object based on the exposure time.

Description

Technical Field

[0001] The present disclosure relates to electronic devices and methods for capturing images of moving celestial objects. Background Art

[0002] In order to provide users with information about celestial objects in the night sky, a technology has been developed to provide information about celestial objects (e.g., constellation information) located in the direction facing the electronic device based on the position and orientation of the electronic device. However, considerable resources and time are required to identify the celestial objects in the direction facing the electronic device, and accordingly, there is a problem that it is difficult for the electronic device to continuously provide the user with the exact position of the celestial object in real time. In addition, if the electronic device needs to capture a celestial object through a long exposure time, it is difficult to provide guidance to the user to allow the user to accurately capture the image of the celestial object with the user's desired composition, because the celestial object moves during the exposure time. In addition, when capturing a moving celestial object through a long exposure time, the captured resulting image is affected by degradation. Summary of the invention

[0003] Technical Solution

[0004] A first aspect of the present disclosure may provide a method for an electronic device to capture an image of a celestial object, the method comprising: displaying a preview image generated by a camera of the electronic device; measuring the position of the electronic device using a global positioning system (GPS) sensor of the electronic device; measuring the orientation of the electronic device using an inertial measurement unit (IMU) sensor of the electronic device; identifying a celestial object corresponding to a capture direction of the camera of the electronic device based on the measured position and the measured orientation; identifying a camera exposure time set for capturing the celestial object; displaying a graphical user interface (GUI) on the preview image based on the exposure time to guide a reference position for displaying the celestial object within a capture result image of the celestial object; receiving user input for capturing the celestial object; and capturing the celestial object during the exposure time when the user input is received.

[0005] In addition, a second aspect of the present disclosure may provide an electronic device, which includes: a camera for capturing an image of a celestial object; a GPS sensor for measuring the position of the electronic device; an IMU sensor for measuring the orientation of the electronic device; a display; a memory for storing one or more instructions; and a processor for executing the one or more instructions, and the processor executes the one or more instructions to display a preview image generated by the camera on the display, measure the position of the electronic device using the GPS sensor, measure the orientation of the electronic device using the IMU sensor, identify the celestial object corresponding to the capture direction of the camera based on the measured position and the measured orientation, identify the camera exposure time set for capturing the celestial object, display a GUI on the preview image based on the exposure time to guide the display of a reference position of the celestial object in a captured result image of the celestial object, receive user input for capturing the celestial object, and upon receiving the user input, capture the celestial object during the exposure time.

[0006] In addition, a third aspect of the present disclosure may provide a computer-readable recording medium for executing the method of the first aspect.

[0007] In addition, a fourth aspect of the present disclosure may provide a method for an electronic device to capture an image of a celestial object, the method comprising: displaying a preview image generated by a camera of the electronic device; determining whether the electronic device is stationary; when it is determined that the electronic device is stationary, identifying the position coordinates of a virtual image of the celestial object on the preview image; identifying the position coordinates of the celestial object in the preview image; correcting the orientation of the electronic device by comparing the position coordinates of the celestial object with the position coordinates of the virtual image of the celestial object; and displaying a preview image of the celestial object on the preview image based on the corrected orientation. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is a diagram showing an overview of a process in which an electronic device captures an image of a celestial object and obtains a capture-result image according to an embodiment.

[0009] Figure 2 is a flowchart of a method in which an electronic device captures an image of a celestial object such that the celestial object is displayed at a reference position in a captured result image according to an embodiment.

[0010] Figure 3 is a flowchart of a method in which an electronic device guides a celestial object to be displayed at a reference position within a captured result image according to an embodiment.

[0011] Figure 4 is a diagram illustrating an example of a celestial object moving during image capturing according to an embodiment.

[0012] Figure 5is a diagram illustrating an example of guiding a user to display a preview image of a celestial object at a reference position in a captured result image according to an embodiment.

[0013] Figure 6 is a diagram illustrating an example of guiding a user to display a preview image of a celestial object at a reference position in a captured result image according to an embodiment.

[0014] Figure 7 is a flowchart of a method in which an electronic device generates a capture result image by combining a plurality of capture image frames according to an embodiment.

[0015] Figure 8 is a diagram illustrating a plurality of captured image frames generated by an electronic device by capturing an image of a celestial object during an exposure time according to an embodiment.

[0016] Fig. 9 is a diagram illustrating an example of arranging a plurality of captured image frames such that a celestial object is located at a reference position within a captured result image according to an embodiment.

[0017] Fig.10 is a diagram illustrating a captured image of a celestial object displayed at a reference position according to an embodiment.

[0018] Fig.11 is a flowchart of a method in which an electronic device corrects an orientation of the electronic device and displays a virtual image of a celestial object on a preview image based on the corrected orientation according to an embodiment.

[0019] Fig.12 is a diagram illustrating a preview image displayed on a screen of an electronic device to capture a celestial object according to an embodiment.

[0020] Fig.13 is a block diagram of an electronic device according to an embodiment.

[0021] Fig.14 is a block diagram of an electronic device in a network environment according to various embodiments. Specific embodiments

[0022] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement and practice the present disclosure. However, the present disclosure can be implemented in various forms and is not limited to the embodiments described herein. Parts not related to the detailed description are omitted in the accompanying drawings to ensure the clarity of the present disclosure, and similar parts are given similar reference numerals throughout the specification.

[0023] The terms used in the present disclosure are general terms that are currently widely used in consideration of the functions in the present disclosure, and various terms may be indicated according to the intentions of ordinary technicians in the field, precedents, or new technologies in the field. Therefore, the terms used in the present disclosure should not be interpreted solely based on the names of the terms, but should be interpreted based on the meaning of the terms and the entire context of the present disclosure.

[0024] In addition, although terms such as "first" and "second" may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element.

[0025] Throughout the specification, when an element is referred to as being "connected" to another element, it may be "directly connected" to another element or "electrically connected" to another element with an intervening element therebetween. In addition, when a component "includes" an element, unless otherwise disclosed, the component may further include other elements without excluding other elements.

[0026] The phrases "in an embodiment" appearing in various parts of the specification do not necessarily refer to the same embodiment.

[0027] Embodiments of the present disclosure can be represented by function block components and various processing steps. Some or all of such function blocks can be implemented by various hardware and / or software components configured to perform specified functions. For example, the function blocks of the present disclosure can be implemented by one or more microprocessors, or by circuit components for specific functions. In addition, for example, the function blocks of the present disclosure can be implemented with various programming or scripting languages. The function blocks can be implemented in algorithms running on one or more processors. In addition, the present disclosure can adopt conventional techniques for electronic environment settings, signal processing and / or data processing. Terms such as "mechanism", "element", "means" and "configuration" can be used extensively and are not limited to mechanical or physical configurations.

[0028] In addition, the connecting lines or connecting members between components shown in the drawings only illustrate functional connections and / or physical or circuit connections. In actual devices, the connections between components can be represented by various alternative or additional functional connections, physical connections or circuit connections.

[0029] According to one embodiment of the present disclosure, a method for an electronic device to capture an image of a celestial object may include: displaying a preview image generated by a camera of the electronic device; measuring the position of the electronic device using a global positioning system (GPS) sensor of the electronic device; measuring the orientation of the electronic device using an inertial measurement unit (IMU) sensor of the electronic device; identifying a celestial object corresponding to a capture direction of the camera of the electronic device based on the measured position and the measured orientation; identifying a camera exposure time set for capturing the celestial object; and displaying a graphical user interface (GUI) on the preview image based on the exposure time to guide a reference position for displaying the celestial object within a captured result image of the celestial object. In addition, the method may include receiving a user input for capturing the celestial object; and capturing the celestial object during the exposure time when the user input is received.

[0030] Furthermore, the method may include: acquiring a plurality of captured image frames by capturing the celestial object during an exposure time; and generating a captured result image by combining the plurality of captured image frames.

[0031] In addition, when the celestial object moves during the exposure time, the positions of the celestial object in multiple captured image frames may be different from each other, and generating a captured result image may include combining the multiple captured image frames at a reference position for displaying the celestial object in the captured result image so that the celestial object in the multiple captured image frames is superimposed.

[0032] Furthermore, a reference position for displaying the celestial object in the captured image may be determined based on the exposure time, the capture start position of the celestial object, and the capture end position of the celestial object to prevent degradation around the position of the celestial object in the captured image.

[0033] In addition, the method may also include: determining that the electronic device is stationary; when the electronic device is stationary: identifying the coordinates of a virtual image used to display the celestial object in the preview image; comparing the position coordinates of the celestial object in the preview image with the coordinates used to display the virtual image; and correcting the sensing value of the IMU sensor of the electronic device based on the comparison result.

[0034] In addition, determining that the electronic device is stationary may use an IMU sensor to determine whether the shaking of the electronic device falls within a preset threshold range.

[0035] In addition, the method may further include: correcting coordinates for displaying a virtual image based on a sensing value of an IMU sensor of the correction electronic device; and displaying the virtual image of the celestial object at a position corresponding to the corrected coordinates on the preview image.

[0036] In addition, the method may further include: determining that the capturing direction of the electronic device is changed; and recalibrating the sensing value and the corrected coordinates of the IMU sensor of the electronic device when the capturing direction of the electronic device is changed.

[0037] Furthermore, determining that the capturing direction is changed may determine whether the capturing direction of the electronic device deviates from a preset threshold.

[0038] Furthermore, identifying the celestial object may identify the celestial object corresponding to the capturing direction of the camera of the electronic device from a database (DB) storing celestial object information corresponding to the measured position and the measured orientation.

[0039] In addition, according to an embodiment, an electronic device for capturing an image of a celestial object may include: a camera for capturing an image of a celestial object; a GPS sensor for measuring a position of the electronic device; an IMU sensor for measuring an orientation of the electronic device; a display; a memory for storing one or more instructions; and a processor for executing the one or more instructions, and the processor may execute the one or more instructions to display a preview image generated by the camera on the display, measure the position of the electronic device using the GPS sensor, measure the orientation of the electronic device using the IMU sensor, identify a celestial object corresponding to a capturing direction of the camera based on the measured position and the measured orientation, identify a camera exposure time set for capturing the celestial object, and based on the exposure time, display a GUI on the preview image to guide a reference position for displaying the celestial object in a captured result image of the celestial object.

[0040] Additionally, the processor may execute one or more instructions to receive user input for capturing the celestial object, and upon receiving the user input, capture the celestial object during the exposure time.

[0041] Furthermore, the processor may execute one or more instructions to obtain a plurality of captured image frames by capturing the celestial object during the exposure time, and generate a captured result image by combining the plurality of captured image frames.

[0042] In addition, when the celestial object moves during the exposure time, the position of the celestial object in multiple captured image frames may be different from each other, and the processor may execute one or more instructions to combine the multiple captured image frames so that the celestial object in the multiple captured image frames is superimposed at a reference position for displaying the celestial object in the captured result image.

[0043] Furthermore, a reference position for displaying the celestial object in the captured image may be determined based on the exposure time, the capture start position of the celestial object, and the capture end position of the celestial object to prevent degradation around the position of the celestial object in the captured image.

[0044] In addition, the processor can run one or more instructions to determine that the electronic device is stationary, and when the electronic device is stationary, identify the coordinates of the virtual image used to display the celestial object in the preview image, compare the position coordinates of the celestial object in the preview image with the coordinates used to display the virtual image, and correct the sensing value of the IMU sensor of the electronic device based on the comparison result.

[0045] In addition, the processor may execute one or more instructions to determine that the electronic device is stationary and use the IMU sensor to determine whether the shaking of the electronic device falls within a preset threshold range.

[0046] In addition, the processor can execute one or more instructions to correct the coordinates for displaying the virtual image based on the sensing values ​​of the IMU sensor of the correction electronic device, and display the virtual image of the celestial object at a position corresponding to the corrected coordinates on the preview image.

[0047] In addition, the processor may execute one or more instructions to determine that the capture direction of the electronic device is changed, and when the capture direction of the electronic device is changed, recalibrate the sensing value and the corrected coordinates of the IMU sensor of the electronic device.

[0048] In addition, the processor may execute one or more instructions to determine a capture direction change and determine whether the capture direction of the electronic device deviates from a preset threshold.

[0049] In addition, according to an embodiment, a computer-readable recording medium may be provided for recording a program to execute a method for an electronic device to capture an image of a celestial object, the method comprising: displaying a preview image generated by a camera of the electronic device; measuring the position of the electronic device using a GPS sensor of the electronic device; measuring the orientation of the electronic device using an IMU sensor of the electronic device; identifying a celestial object corresponding to a capture direction of the camera of the electronic device based on the measured position and the measured orientation; identifying a camera exposure time set for capturing the celestial object; and displaying a GUI on the preview image based on the exposure time to guide a reference position for displaying the celestial object within a captured result image of the celestial object. In addition, the method may include receiving a user input for capturing the celestial object; and capturing the celestial object during the exposure time when the user input is received.

[0050] In this document, a celestial object is an object that exists in space and can be an object captured by a camera of an electronic device. Celestial objects can include, for example, stars, planets, satellites, comets, star clusters, nebulae, and / or interstellar matter. Celestial objects can include, for example, stars that form a constellation.

[0051] Furthermore, the captured-result image of the celestial object may be an image stored in the electronic device or another device as a result generated by the electronic device by capturing the celestial object.

[0052] In addition, the celestial object image on the preview image may be an image of an actual celestial object displayed in the preview image displayed on the screen by the electronic device in order to capture the celestial object. If the brightness of the celestial object is dim, the user may not be able to recognize the celestial object image displayed in the preview image.

[0053] In addition, the virtual image of the celestial object on the preview image may be a virtual image displayed to indicate the position of the actual celestial object on the preview image. The virtual image of the celestial object may be displayed by being overlapped on the preview image separately from the actual celestial object. The virtual image of the celestial object may be created based on the celestial information of the actual celestial object, and the virtual image of the celestial object may be virtually generated to allow a user who captures the actual celestial object to recognize the current position of the actual celestial object on the preview image.

[0054] In addition, the guide image of the celestial object on the preview may be a virtual image provided to the user capturing the image of the celestial object for capturing the composition of the celestial object. For example, the guide image of the celestial object may be generated to guide the user to the position of the celestial object in the captured result image, but is not limited thereto.

[0055] Hereinafter, the present disclosure is described in detail with reference to the accompanying drawings.

[0056] Figure 1 is a diagram showing an overview of a process in which an electronic device captures an image of a celestial object and obtains a capture-result image according to an embodiment.

[0057] refer to Figure 1 , the electronic device 1000 can capture the celestial object 10 in the sky. If the celestial object 10 in the sky is not bright enough, the electronic device 1000 can capture the celestial object 10 at a specific exposure time, and due to the rotation of the earth, the position of the celestial object 10 may move in the sky while the electronic device 1000 captures the celestial object 10.

[0058] According to an embodiment, the electronic device 1000 may display the GUI 12 for guiding the user on the preview image so that the celestial object 10 is located at a specific position within the captured result image 30 of the moving celestial object 10. The electronic device 1000 may display the GUI 12 at a position spaced apart from the celestial object image 14 of the celestial object 10 on the preview image by considering the moving trajectory of the celestial object 10 during the exposure time. In addition, if the celestial object 10 is not bright enough, the celestial object image 14 on the preview image may not be clearly visible to the user, and in this case, the electronic device 1000 may display a virtual image of the celestial object 10 on the preview.

[0059] According to an embodiment, the electronic device 1000 can acquire a plurality of captured image frames 20 by capturing the celestial object 10 during the exposure time. The electronic device 1000 can generate a captured result image 30 by combining the plurality of captured image frames 20 so that each celestial object image in the plurality of captured image frames 20 is placed at a specific position in the captured result image 30.

[0060] According to an embodiment, the electronic device 1000 may include, but is not limited to, a smart phone, a tablet personal computer (PC), a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop computer, a media player, a GPS device, an e-book reader, a digital broadcast terminal, a navigation, a self-service terminal, an MP3 player, a digital camera, a home appliance, and other mobile or non-mobile computing devices. In addition, the electronic device 1000 may be a wearable device equipped with a data processing function, such as a watch, glasses, a hairband, and a ring. However, it is not limited thereto, and the electronic device 1000 may include all types of devices that use a camera to provide an image capture function.

[0061] Figure 2 is a flowchart of a method in which an electronic device captures an image of a celestial object such that the celestial object is displayed at a reference position in a captured result image according to an embodiment.

[0062] In the following embodiments, the operations may be performed sequentially, but not necessarily sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0063] According to the embodiment, it can be understood that operations S200 to S270 are performed in an electronic device (eg, Figure 1 The electronic device 1000, Fig.13 and / or Fig.14 The electronic device 10001) has a processor (eg, Fig.13 and / or Fig.14 is executed in processor 10020).

[0064] According to an embodiment, in operation S200, the electronic device 1000 (eg, Fig.13 and / or Fig.14 The electronic device 10001) can display the image through a camera (for example, Fig.13 and / or Fig.14 When the image capture function of the electronic device 1000 is activated, the electronic device 1000 can capture an image of a celestial object using the camera and display the image on the display of the electronic device 1000 (eg, Fig.13 and / or Fig.14 The electronic device 1000 may display a preview image including a celestial object image on the display module 10060 of the electronic device 1000. For example, when a camera application of the electronic device 1000 is executed and a function of capturing a celestial object is activated, the electronic device 1000 may display a preview image including a celestial object image on the screen of the electronic device 1000.

[0065] According to an embodiment, the celestial object image on the preview image may be an image of the actual celestial object presented in the preview image and displayed on the screen by the electronic device in order to capture the celestial object. If the brightness of the celestial object is dim, the celestial object image displayed in the preview image may not be recognizable by the user.

[0066] According to an embodiment, in operation S210, the electronic device 1000 may measure the position of the electronic device 1000. The electronic device 1000 may use a sensor module (eg, Fig.13 and / or Fig.14 The electronic device 1000 may be configured to measure the position of the electronic device 1000 using the sensor module 10076 of the electronic device 1000. When the camera application of the electronic device 1000 is executed and the function for capturing a celestial object is activated, the electronic device 1000 may obtain the position information of the electronic device 1000. For example, the electronic device 1000 may measure the position of the electronic device 1000 using a GPS sensor and obtain information related to the latitude and longitude of the electronic device 1000. The position of the electronic device 1000 may be used to identify the position of a celestial object captured by the electronic device 1000 from a celestial object database (DB) to be described.

[0067] According to an embodiment, in operation S220, the electronic device 1000 may measure an orientation of the electronic device 1000. When a camera application of the electronic device 1000 is executed and a function for capturing a celestial object is activated, the electronic device 1000 may use a sensor module (eg, Fig.13 and / or Fig.14The electronic device 1000 may use a sensor module 10076 to obtain the orientation information of the electronic device 1000. For example, the electronic device 1000 may use an IMU sensor to measure the orientation of the electronic device 1000. For example, the IMU sensor may include, but is not limited to, at least one of a geomagnetic sensor, an acceleration sensor, or a gyroscope sensor. For example, the IMU sensor may only include a geomagnetic sensor and an acceleration sensor. For example, the electronic device 1000 may use a geomagnetic sensor to obtain information of three-axis information based on the geomagnetic direction. For example, the electronic device 1000 may use an acceleration sensor to obtain three-axis information based on the gravity direction.

[0068] According to an embodiment, the orientation of the electronic device 1000 may be used to identify an image capturing direction of the electronic device 1000 and may be used to identify the position of a celestial object captured by the electronic device 1000 from a celestial object DB to be described.

[0069] According to an embodiment, in operation S230, the electronic device 1000 may identify a celestial object corresponding to the position and orientation of the electronic device 1000 from the celestial object DB. The celestial object DB may store information related to a celestial object located in an image capturing direction of the electronic device 1000 according to the position and orientation of the electronic device 1000 at a specific time. For example, the celestial object DB may include information related to the position information of the celestial object and identification information of the celestial object, but is not limited thereto. For example, the information related to the position of the celestial object may include information related to the azimuth and altitude of the celestial object. For example, the identification information of the celestial object may include information related to the name of the celestial object, the shape of the celestial object, the size of the celestial object, and the color of the celestial object.

[0070] According to an embodiment, the electronic device 1000 may identify the image capture direction of the camera of the electronic device 1000 based on the orientation information of the electronic device 1000. The electronic device 1000 may identify the current time at which the celestial object is captured, and based on the current time, the position of the electronic device 1000, and the image capture direction of the electronic device 1000, identify information related to the celestial object captured by the electronic device 1000 from the celestial object DB. For example, the electronic device 1000 may obtain information related to the right ascension, declination, viewing angle, and rotation of the portion to which the camera of the electronic device 1000 is currently facing based on the position information measured using the GPS sensor, the orientation information measured using the IMU sensor, and the camera information. In addition, for example, the electronic device 1000 may identify information related to the celestial object captured by the electronic device 1000 from the celestial object DB using plate solving technology.

[0071] According to an embodiment, in operation S240, the electronic device 1000 may identify an exposure time for capturing a celestial object. If the brightness of the celestial object is not high enough, the celestial object image on the preview image may not be recognized by the user, and the electronic device 1000 may capture the celestial object at a specific exposure time so that the celestial object in the capture result image can be recognized by the user. For example, the exposure time for capturing the celestial object may be preset as a default value for capturing the celestial object. Alternatively, for example, the exposure time for capturing the celestial object may be set to a specific value according to a user input when the function for capturing the celestial object is activated. Alternatively, for example, the exposure time for capturing the celestial object may be automatically set based on the brightness of the celestial object in the preview image.

[0072] According to an embodiment, in operation S250, the electronic device 1000 may display a GUI on the preview image based on the exposure time, the GUI guiding a reference position for displaying the celestial object within the captured result image of the celestial object. The electronic device 1000 may calculate a moving trajectory of the celestial object to be captured at the position of the electronic device 1000 based on the exposure time. The electronic device 1000 may calculate a moving direction and a moving distance of the celestial object during the exposure time based on the latitude and longitude of the position of the electronic device 1000.

[0073] According to an embodiment, the electronic device 1000 may identify a capture start position of the celestial object on the preview image, and identify a capture end position of the celestial object on the preview image based on the capture start position and a movement trajectory of the celestial object.

[0074] According to an embodiment, the electronic device 1000 may determine a specific position between the capture start position and the capture end position on the preview image as a reference position. In addition, the electronic device 1000 may display a GUI on the preview image that guides the user to display the celestial object at a position on the preview image corresponding to the reference position within the capture result image. For example, the capture start position and the capture end position on the preview image may be located near the border of the preview image, and the GUI that guides the display of the reference position of the celestial object within the capture result image of the celestial object may be located in the central portion of the preview image.

[0075] Will be in Figure 3 , Figure 5 and Figure 6 The GUI for guiding the user is described in more detail in .

[0076] According to an embodiment, in operation S260, the electronic device 1000 may capture an image of a celestial object during the exposure time. The electronic device 1000 may acquire a plurality of captured image frames by capturing the celestial object during the exposure time. The plurality of captured image frames may each include an image of the celestial object. As the celestial object moves during the exposure time, each celestial object image in the plurality of captured image frames may be displayed at a different position.

[0077] According to an embodiment, in operation S270, the electronic device 1000 may generate a capture result image by combining a plurality of capture image frames. The electronic device 1000 may superimpose a plurality of capture frames so that the celestial object images within the plurality of capture frames are located at a reference position within the capture result image. In addition, the electronic device 1000 may generate a capture result image by combining a plurality of superimposed capture images.

[0078] According to an embodiment, the electronic device 1000 may identify the position of the celestial object from each of a plurality of capture frames, arrange the plurality of capture frames so that the celestial object is located at a reference position in a capture result image, thereby generating a capture result image.

[0079] Will be in Figures 7 to 10 A method of the electronic device 1000 for generating a capture result image from a plurality of capture image frames is described in more detail in FIG.

[0080] Figure 3 is a flowchart of a method in which an electronic device guides a celestial object to be displayed at a reference position within a captured result image according to an embodiment. Figure 3 The operation can correspond to Figure 2 Operation S250 may be performed, but is not limited thereto.

[0081] In the following embodiments, the operations may be performed sequentially, but not necessarily sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0082] According to the embodiment, it can be understood that operations S300 to S340 are performed in an electronic device (eg, Figure 1 The electronic device 1000, Fig.13 and / or Fig.14 The electronic device 10001) has a processor (eg, Fig.13 and / or Fig.14 The process is executed at processor 10020).

[0083] According to an embodiment, in operation S300, the electronic device 1000 may calculate a moving trajectory of a celestial object during an exposure time based on the position and orientation of the electronic device 1000. The electronic device 1000 may calculate a moving trajectory of a celestial object to be captured at the position of the electronic device 1000 based on the exposure time. The electronic device 1000 may calculate a moving direction and a moving distance of the celestial object during the exposure time based on the latitude and longitude of the position of the electronic device 1000. The electronic device 1000 may pre-store information related to the moving trajectory of the celestial object according to the position on the earth, and calculate the moving trajectory of the celestial object during the exposure time based on the stored information and the position of the electronic device 1000.

[0084] According to an embodiment, in operation S310, the electronic device 1000 may identify a capture start position of a celestial object. The electronic device 1000 may identify a current position of a celestial object on a preview image as the capture start position. The electronic device 1000 may identify a celestial object image currently displayed in the preview image, and determine a position at which the identified celestial object image is displayed on the preview image as the capture start position of the celestial object.

[0085] According to an embodiment, in operation S320, the electronic device 1000 may identify the capture end position of the celestial object based on the capture start position and the movement trajectory of the celestial object. For example, the electronic device 1000 may calculate the capture end position of the celestial object by using the coordinate value of the capture start position of the celestial object and the coordinate value of the movement trajectory.

[0086] According to an embodiment, in operation S330, the electronic device 1000 may identify a reference position for displaying a celestial object within a captured image of the celestial object based on the capture start position and the capture end position. For example, if the capture start position and the capture end position are located at the edge of the captured image, the electronic device 1000 may determine the central portion of the captured image as the reference position for displaying the celestial object. For example, if the exposure time for capturing the celestial object is about 5 minutes, the electronic device 1000 may determine the position at which the celestial object is displayed in a captured image frame corresponding to about 2 minutes and 30 seconds among captured image frames generated by capturing the celestial object for about 5 minutes as the reference position.

[0087] According to an embodiment, in operation S340, the electronic device 1000 may display a GUI for guiding the reference position on the preview image. The GUI for guiding the reference position to the user may include information indicating that the celestial object is displayed at the reference position in the captured result image. For example, the GUI may be text such as "Display the celestial object here in the captured image." Or "If the celestial object to be captured is placed here, the celestial object will be centered within the captured image." For example, the GUI may include an object indicating a position on the preview image corresponding to the position of the celestial object in the captured result image. For example, the GUI may include a guiding image for displaying the celestial object at a position on the preview image that corresponds to the position of the celestial object in the captured result image.

[0088] According to an embodiment, the guide image of the celestial object may be a virtual image provided to a user capturing an image of the celestial object for capturing a composition of the celestial object. For example, the guide image of the celestial object may be generated to guide the user to the position of the celestial object in the captured image, but is not limited thereto.

[0089] According to an embodiment, if a celestial object is captured at a specific exposure time, a user may identify a reference position for displaying the celestial object in a capture result image through a GUI, thereby capturing the celestial object in his / her desired composition.

[0090] Figure 4 is a diagram illustrating an example of a celestial object moving during image capturing according to an embodiment.

[0091] refer to Figure 4 In an embodiment, if the electronic device 1000 captures a celestial object at a specific exposure time due to the rotation of the earth, the celestial object may move from a first position 40 on the celestial sphere to a second position 42 due to the rotation of the earth. Therefore, in a plurality of celestial object image frames generated by capturing the celestial object during the exposure time, the position where the celestial object is displayed may be different.

[0092] Figure 5 is a diagram illustrating an example of guiding a user to display a preview image of a celestial object at a reference position in a captured result image according to an embodiment.

[0093] refer to Figure 5In an embodiment, a guide image 50 of a celestial object and an object 52 for guiding the reference position may be displayed at a reference position determined based on a capture start position and a capture end position. In addition, a text 54 “Show celestial object here in captured image” may be displayed on the preview image. A currently captured celestial object image 56 may indicate a capture start position, and a guide image 50 of a celestial object may be located on a moving track between a capture start position and a capture end position of the celestial object. Therefore, a user may start image capture by placing the guide image 50 and the object 52 of a celestial object at his / her desired position on the preview image, thereby displaying the celestial object at the user's desired position within the capture result image generated by the electronic device 1000.

[0094] Figure 6 is a diagram illustrating an example of guiding a user to display a preview image of a celestial object at a reference position in a captured result image according to an embodiment.

[0095] refer to Figure 6 In an embodiment, text may be displayed that guides display of a celestial object at a position on the capture result image corresponding to a reference position determined based on the capture start position and the capture end position. For example, text 64 such as "If you place the target celestial object here, it will be centered in the image." may be displayed on the preview image. In addition, an object 62 for guiding the position of the celestial object to be captured to a specific position and a guide image 60 of the celestial object may be displayed on the preview image. Therefore, the user can start image capture by placing the celestial object at the position of the guide image 60 and the object 62 of the celestial object, thereby displaying the celestial object at the reference position within the capture result image generated by the electronic device 1000.

[0096] Figure 7 is a flowchart of a method in which an electronic device generates a capture result image by combining a plurality of capture image frames according to an embodiment. Figure 7 The operation can correspond to Figure 2 Operation S270 may be performed as described above, but is not limited thereto.

[0097] In the following embodiments, the operations may be performed sequentially, but not necessarily sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0098] According to an embodiment, it can be understood that operations S700 to S720 are performed in an electronic device (eg, Figure 1 The electronic device 1000, Fig.13 and / or Fig.14 The electronic device 10001) has a processor (eg, Fig.13 and / or Fig.14The process is executed at processor 10020).

[0099] According to an embodiment, in operation S700, the electronic device 1000 may acquire a plurality of captured image frames by capturing a celestial object at an exposure time. A celestial object image may be displayed in each of the plurality of captured image frames.

[0100] According to an embodiment, in operation S710, the electronic device 1000 may identify the position of the celestial object from each of the plurality of capture frames. If the electronic device 1000 captures the celestial object during the exposure time, the celestial object may move on the celestial sphere, and the position of the celestial object may be different in the plurality of celestial object image frames generated by capturing the celestial object during the exposure time.

[0101] According to an embodiment, in operation S720, the electronic device 1000 may arrange a plurality of capture frames to place a celestial object at a reference position within a capture result image.

[0102] According to an embodiment, the electronic device 1000 may determine the central portion of the moving trajectory of the celestial object as a reference position for displaying the celestial object to reduce degradation of a portion including the celestial object in the captured result image. In this case, the electronic device 1000 may select a captured image frame that displays the celestial object in the central portion of the moving trajectory from the captured image frames as a reference frame, and superimpose multiple captured image frames so that the celestial object in the selected reference frame overlaps with the celestial objects in the other captured image frames.

[0103] For example, if the exposure time for capturing a celestial object is about 5 minutes, the electronic device 1000 may select a captured image frame corresponding to about 2 minutes and 30 seconds among captured image frames generated by capturing the celestial object for about 5 minutes as a reference frame. In addition, a plurality of captured image frames may be superimposed and arranged so that the celestial object included in the reference frame overlaps with the celestial object in other captured image frames. The electronic device 1000 may generate a captured result image by combining a plurality of arranged captured image frames.

[0104] Alternatively, according to an embodiment, the electronic device 1000 may determine the central portion of the captured result image as a reference position for displaying the celestial object. In this case, the electronic device 1000 may select a captured image frame in which the celestial object is displayed in the central portion of the captured image frame as a reference frame, and superimpose multiple captured image frames so that the celestial object in the selected reference frame overlaps with the celestial objects in other captured image frames.

[0105] Figure 8 is a diagram illustrating a plurality of captured image frames generated by an electronic device by capturing a celestial object during an exposure time according to an embodiment.

[0106] refer to Figure 8 In an embodiment, the electronic device 1000 may generate a plurality of captured image frames 1, 2, 3, 4, and 5 by capturing a celestial object during an exposure time. Since the celestial object is captured while moving on the celestial sphere, the position of each celestial object may be different from one another in the plurality of captured image frames 1, 2, 3, 4, and 5. For example, the position of the celestial object in the first captured image frame 1, the position of the celestial object in the second captured image frame 2, the position of the celestial object in the third captured image frame 3, the position of the celestial object in the fourth captured image frame 4, and the position of the celestial object in the fifth captured image frame 5 may be different from one another. The electronic device 1000 may select the third captured image frame 3 in which the celestial object is located at the central portion of the moving trajectory of the celestial object as a reference system.

[0107] Fig. 9 is a diagram illustrating an example of arranging a plurality of captured image frames to place a celestial object at a reference position within a captured result image according to an embodiment.

[0108] refer to Fig. 9 In an embodiment, the first captured image frame 1, the second captured image frame 2, the third captured image frame 3, the fourth captured image frame 4 and the fifth captured image frame 5 can be arranged to be superimposed so that the celestial object image in the third captured image frame 3 as a reference frame overlaps with each celestial object image in the other captured image frames 1, 2, 4 and 5.

[0109] According to an embodiment, when the first captured image frame 1, the second captured image frame 2, the third captured image frame 3, the fourth captured image frame 4, and the fifth captured image frame 5 are superimposed, the captured image frames 1, 2, 3, 4, and 5 may overlap the most in the central portion including the celestial object in the third image frame 3. Therefore, degradation of the central portion including the celestial object in the captured result image may be reduced.

[0110] Fig.10 is a diagram showing a captured result image representing a celestial object at a reference position according to an embodiment.

[0111] refer to Fig.10 In an embodiment, the image of the celestial object 102 may be located at a reference position at which the resulting image 100 is captured. Fig. 9 , when the first captured image frame 1, the second captured image frame 2, the third captured image frame 3, the fourth captured image frame 4, and the fifth captured image frame 5 are superimposed, the captured image frames 1, 2, 3, 4, and 5 may overlap the most in the central portion including the celestial object in the third image frame 3. Fig.10Deterioration in the central portion including the celestial object image 102 in the captured result image 100 may occur less than degradation in the edge portion of the captured result image 100 .

[0112] Fig.11 is a flowchart of a method in which an electronic device corrects an orientation of the electronic device and displays a virtual image of a celestial object on a preview image based on the corrected orientation according to an embodiment. Fig.11 The operation can be Figure 2 The operation S230 is executed thereafter, but is not limited thereto.

[0113] In the following embodiments, the operations may be performed sequentially, but not necessarily sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0114] According to an embodiment, it can be understood that operations S1100 to S1135 are performed in an electronic device (eg, Figure 1 The electronic device 1000, Fig.14 The electronic device 10001) has a processor (eg, Fig.14 The process is executed at processor 10020).

[0115] According to an embodiment, the virtual image of the celestial object on the preview image may be a virtual image displayed to indicate the position of the actual celestial object on the preview image. The virtual image of the celestial object may be displayed by being overlapped on the preview image separately from the actual celestial object. The virtual image of the celestial object may be generated based on the celestial information of the actual celestial object, and the virtual image of the celestial object may be virtually created to allow a user who captures the actual celestial object to recognize the current position of the actual celestial object on the preview image.

[0116] According to an embodiment, in operation S1100, the electronic device 1000 may display a virtual image of the identified celestial object on the preview image. The electronic device 1000 may obtain information related to the celestial object captured by the electronic device 1000 from the celestial object DB based on the current time when the celestial object is captured, the position of the electronic device 1000, and the capturing direction of the electronic device 1000. The information related to the celestial object may include, for example, identification information of the celestial object, and information related to the orientation angle and elevation angle of the celestial object. For example, the identification information of the celestial object may include information related to the name of the celestial object, the shape of the celestial object, the size of the celestial object, and the color of the celestial object.

[0117] According to an embodiment, using the information related to the celestial object obtained from the celestial object DB, the electronic device 1000 can generate a virtual image of the celestial object and display the generated virtual image on the preview image. For example, the electronic device 1000 can generate a virtual image of the celestial object based on the shape, size and color of the celestial object.

[0118] According to an embodiment, the electronic device 1000 may determine a position for displaying a virtual image on a preview image based on information related to the orientation angle and elevation angle of the celestial object, orientation information of the electronic device 1000, and a viewing angle of a camera of the electronic device 1000. The electronic device 1000 may display a virtual image of the celestial object at a position on the preview image corresponding to the orientation angle and elevation angle of the celestial object. In addition, the electronic device 1000 may display the name of the celestial object around the virtual image of the celestial object.

[0119] According to an embodiment, in operation S1105, the electronic device 1000 may determine whether the electronic device 1000 is stationary. The electronic device 1000 may determine whether the electronic device 1000 is shaking based on a sensing value sensed by the IMU sensor. The electronic device 1000 may determine whether the electronic device 1000 is shaking beyond a specific threshold. For example, the specific threshold may be determined by considering, but not limited to, whether the position of the celestial object on the preview is outside the error tolerance if the electronic device 1000 captures the celestial object.

[0120] According to an embodiment, as a result of the determination in operation S1105, if it is determined that the electronic device 1000 is not stationary, the electronic device 1000 may repeat operation S1105.

[0121] According to an embodiment, as a result of the determination in operation S1105 , if it is determined that the electronic device 1000 is stationary, the electronic device 1000 may perform operations S1110 to S1125 to correct the orientation of the electronic device 1000 .

[0122] According to an embodiment, in operation S1110, the electronic device 1000 may acquire the coordinates of the virtual image of the celestial object on the preview image. When the electronic device 1000 is stationary, the electronic device 1000 may obtain information related to the celestial object captured by the electronic device 1000 from the celestial object DB based on the current time when the celestial object is captured, the position of the electronic device 1000, and the capturing direction of the electronic device 1000. The celestial object information may include, for example, identification information of the celestial object, and the orientation angle and elevation angle of the celestial object. The electronic device 1000 may calculate the coordinates of the position for displaying the virtual image of the celestial object on the preview image based on the orientation angle and elevation angle of the celestial object, the orientation information of the electronic device 1000, and the viewing angle of the camera of the electronic device 1000.

[0123] According to an embodiment, in operation S1115, the electronic device 1000 may identify the position coordinates of the celestial object in the preview image. The electronic device 1000 may identify the celestial object image within the preview image and identify the coordinates of the position where the celestial object image is displayed.

[0124] According to an embodiment, in operation S1120, the electronic device 1000 may compare the position coordinates of the celestial object with the position coordinates of the virtual image of the celestial object.

[0125] According to an embodiment, in operation S1125, the electronic device 1000 may correct the orientation of the electronic device 1000 based on the comparison result. The electronic device 1000 may correct the orientation of the electronic device 1000 so that the position coordinates of the celestial object and the position coordinates of the virtual image of the celestial object substantially match. The electronic device 1000 may calibrate the sensing value of the IMU sensor of the electronic device 1000 so that the position coordinates of the virtual image of the celestial object substantially match the position coordinates of the celestial object and the position coordinates of the virtual image of the celestial object.

[0126] For example, the sensed value sensed from the geomagnetic sensor can provide three-axis information based on the magnetic north direction, and the three-axis information sensed from the acceleration sensor can provide three-axis information based on the gravity direction. Therefore, the geomagnetic sensor may not detect the rotation of the electronic device 1000 based on the magnetic north direction, and the acceleration sensor may not detect the rotation of the electronic device 1000 based on the gravity direction. However, since the information based on the captured image including the celestial object includes information related to the rotation of the electronic device 1000 based on the magnetic north direction and the rotation based on the gravity direction, the sensed value from the geolocation sensor can be expressed as an equation in which the rotation information is a variable, and the acceleration sensor can be expressed as an equation in which the rotation based on the gravity direction is a variable. Therefore, information related to the rotation of the electronic device 1000 based on the magnetic north direction and the rotation based on the gravity direction can be calculated according to the two equations represented for the two variables. The electronic device 1000 can use the calculated rotation information to predict the sensed value after correction. The difference between the current value and the predicted value used in the calculation is a correction value, and the electronic device 1000 may reflect the correction value in the sensing value of the geomagnetic sensor and the sensing value of the acceleration sensor.

[0127] According to an embodiment, in operation S1130, the electronic device 1000 may display a virtual image of the identified celestial object on the preview image based on the corrected orientation. The electronic device 1000 may correct the coordinates for displaying the virtual image of the celestial object and display the virtual image of the celestial object at a position corresponding to the corrected coordinates.

[0128] If the sensing values ​​are frequently corrected, it is difficult to provide a virtual image of the celestial object in real time while capturing the celestial object, but a virtual image of the celestial object can be more effectively provided to the user by correcting the orientation of the electronic device 1000 only when the electronic device 1000 is stationary.

[0129] According to an embodiment, in operation S1135, the electronic device 1000 may determine whether the capture direction of the electronic device 1000 has changed. The electronic device 1000 may determine whether the capture direction of the electronic device 1000 has changed by more than a specific threshold. For example, if the difference between the camera facing direction and the previously corrected camera facing direction is greater than a specific angle (e.g., about 20 degrees to about 30 degrees), the electronic device 1000 may determine that the capture direction is changed. For example, if a preview image before the capture direction of the electronic device 1000 is changed and a preview image after the capture direction of the electronic device 1000 is changed do not overlap, the electronic device 1000 may determine that the capture direction of the electronic device 1000 is changed.

[0130] According to an embodiment, as a result of the determination in operation S1135 , if it is determined that the capturing direction of the electronic device 1000 is changed, the electronic device 1000 may execute operation S220 .

[0131] According to an embodiment, as a result of the determination in operation S1135, if it is determined that the capturing direction of the electronic device 1000 has not changed, the electronic device 1000 may determine operation S240.

[0132] Fig.12 is a diagram illustrating a preview image displayed on a screen of an electronic device to capture an image of a celestial object according to an embodiment.

[0133] refer to Fig.12 In an embodiment, if the brightness of the celestial object is low, the user may not be able to recognize the celestial object image on the preview image 120 displayed on the screen of the electronic device 1000 that captures the celestial object.

[0134] Next, the electronic device 1000 may display a preview image 122 including a virtual image of a celestial object captured by the electronic device 1000 on the screen of the electronic device 1000. The electronic device 1000 may obtain information related to the celestial object being captured by the electronic device 1000 from the celestial object DB based on the position of the electronic device 1000, the current time and the orientation of the electronic device 1000. In addition, the electronic device 1000 may generate a virtual image of the celestial object based on the obtained information related to the celestial object, and display the virtual image of the celestial object on the preview image 122.

[0135] According to an embodiment, if the orientation of the electronic device 1000 is not corrected, within the preview image 124 including the virtual image 132 of the celestial object, the position of the virtual image 132 of the celestial object and the position of the celestial object image 133 may be different.

[0136] According to an embodiment, if the electronic device 1000 is stationary without shaking, the electronic device 1000 may correct the orientation of the electronic device 1000 so that the virtual image 132 of the celestial object and the celestial object image 133 substantially match. When the orientation of the electronic device 1000 is corrected, the position of the virtual image 132 of the celestial object and the position of the celestial object image 133 may substantially match on the preview image 126.

[0137] According to an embodiment, next, the electronic device 1000 may change the composition for capturing the celestial object based on the user manipulation, and may display the preview image 128 on the screen of the electronic device 1000 as the composition changes. In order to allow the user to change the composition for capturing the celestial object by manipulating the capturing direction of the electronic device 1000, the electronic device 1000 may provide the user with a GUI for guiding the capturing position of the celestial object, such as Figure 5 and Figure 6 shown.

[0138] According to an embodiment, next, the electronic device 1000 may capture a celestial object based on a user input. The electronic device 1000 may capture a celestial object at a specific exposure time. While capturing a celestial object, the electronic device 1000 may display text on the preview image 130 to guide that a celestial object is being captured.

[0139] Fig.13 is a block diagram of an electronic device according to an embodiment.

[0140] like Fig.13 As shown, the electronic device 10001 according to some embodiments may include a processor 10020, a memory 10030, a display module 10060, a sensor module 10076, and a camera module 10080. However, Fig.13 Not all components shown are necessary for the electronic device 10001. Fig.13 10001 may be implemented with more components than those shown in FIG. Fig.13 The components shown in the figure can be implemented with fewer components.

[0141] For example, Fig.14As shown, according to some embodiments, the electronic device 10001 may include an input module 10050, a sound output module 10055, an audio module 10070, an interface 10077, a connection terminal 10078, a tactile module 10079, a power management module 10088, a battery 10089, a communication module 10090, a subscriber identification module 10096 and / or an antenna module 10097, in addition to the processor 10020, the memory 10030, the display module 10060, the sensor module 10076 and the camera module 10080.

[0142] Figure 4 1 is a block diagram showing an electronic device 10001 in a network environment 10000 according to various embodiments. Figure 4 , the electronic device 10001 in the network environment 10000 may communicate with the electronic device 10002 via the first network 10098 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 10004 or the server 10008 via the second network 10099 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 10001 may communicate with the electronic device 10004 via the server 10008. According to an embodiment, the electronic device 10001 may include a processor 10020, a memory 10030, an input module 10050, a sound output module 10055, a display module 10060, an audio module 10070, a sensor module 10076, an interface 10077, a connection terminal 10078, a haptic module 10079, a camera module 10080, a power management module 10088, a battery 10089, a communication module 10090, a subscriber identification module (SIM) 10096, or an antenna module 10097. In some embodiments, at least one of the above components (e.g., the connection terminal 10078) may be omitted from the electronic device 10001, or one or more other components may be added to the electronic device 10001. In some embodiments, some of the above components (e.g., the sensor module 10076, the camera module 10080, or the antenna module 10097) may be implemented as a single integrated component (e.g., the display module 10060).

[0143] The processor 10020 may run, for example, software (e.g., program 10040) to control at least one other component (e.g., hardware component or software component) of the electronic device 10001 connected to the processor 10020, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 10020 may store a command or data received from another component (e.g., sensor module 10076 or communication module 10090) in the volatile memory 10032, process the command or data stored in the volatile memory 10032, and store the resultant data in the non-volatile memory 10034. According to an embodiment, the processor 10020 may include a main processor 10021 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 10023 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 10021 in operation. For example, when the electronic device 10001 includes a main processor 10021 and an auxiliary processor 10023, the auxiliary processor 10023 may be adapted to consume less power than the main processor 10021, or may be adapted to be dedicated to a specific function. The auxiliary processor 10023 may be implemented to be separate from the main processor 10021, or to be implemented as part of the main processor 10021.

[0144] When the main processor 10021 is in an inactive (e.g., sleep) state, the auxiliary processor 10023 (rather than the main processor 10021) may control at least some of the functions or states related to at least one component (e.g., display module 10060, sensor module 10076, or communication module 10090) among the components of the electronic device 10001, or when the main processor 10021 is in an active state (e.g., running an application), the auxiliary processor 10023 may control at least some of the functions or states related to at least one component (e.g., display module 10060, sensor module 10076, or communication module 10090) among the components of the electronic device 10001 together with the main processor 10021. According to an embodiment, the auxiliary processor 10023 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 10080 or communication module 10090) that is functionally related to the auxiliary processor 10023. According to an embodiment, the auxiliary processor 10023 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. For example, such learning may be performed by the electronic device 10001 where the artificial intelligence is executed or via a separate server (e.g., server 10008). The learning algorithm may include, but is not limited to, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to the hardware structure.

[0145] The memory 10030 may store various data used by at least one component of the electronic device 10001 (e.g., the processor 10020 or the sensor module 10076). The various data may include, for example, software (e.g., the program 10040) and input data or output data for commands related thereto. The memory 10030 may include a volatile memory 10032 or a non-volatile memory 10034.

[0146] The program 10040 may be stored as software in the memory 10030 , and the program 10040 may include, for example, an operating system (OS) 10042 , middleware 10044 , or an application 10046 .

[0147] The input module 10050 may receive commands or data to be used by other components (e.g., the processor 10020) of the electronic device 10001 from outside the electronic device 10001 (e.g., a user). The input module 10050 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0148] The sound output module 10055 can output a sound signal to the outside of the electronic device 10001. The sound output module 10055 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive an incoming call. According to an embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.

[0149] The display module 10060 may visually provide information to the outside (e.g., user) of the electronic device 10001. The display device 10060 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 10060 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.

[0150] The audio module 10070 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 10070 may obtain sound via the input module 10050, or output sound via the sound output module 10055 or an earphone of an external electronic device (e.g., electronic device 10002) directly (e.g., wired) or wirelessly connected to the electronic device 10001.

[0151] The sensor module 10076 may detect an operating state (e.g., power or temperature) of the electronic device 10001 or an environmental state (e.g., a state of a user) outside the electronic device 10001, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 10076 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0152] The interface 10077 may support one or more specific protocols to be used to connect the electronic device 10001 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 10002). According to an embodiment, the interface 10077 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0153] The connection end 10078 may include a connector, wherein the electronic device 10001 can be physically connected to an external electronic device (e.g., the electronic device 10002) via the connector. According to an embodiment, the connection end 10078 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0154] The haptic module 10079 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 10079 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0155] The camera module 10080 may capture a still image or a moving image. According to embodiments, the camera module 10080 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0156] The power management module 10088 may manage power supply to the electronic device 10001. According to an embodiment, the power management module 10088 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0157] The battery 10089 may supply power to at least one component of the electronic device 10001. According to an embodiment, the battery 10089 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0158] The communication module 10090 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 10001 and an external electronic device (e.g., electronic device 10002, electronic device 10004, or server 10008), and perform communication via the established communication channel. The communication module 10090 may include one or more communication processors capable of operating independently from the processor 10020 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 10090 may include a wireless communication module 10092 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 10094 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 10098 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 10099 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 10092 may identify and authenticate the electronic device 10001 in a communication network (such as the first network 10098 or the second network 10099) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the subscriber identification module 10096.

[0159] The wireless communication module 10092 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 10092 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 10092 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 10092 can support various requirements specified in the electronic device 10001, an external electronic device (e.g., electronic device 10004), or a network system (e.g., a second network 10099). According to an embodiment, the wireless communication module 10092 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less for a round trip).

[0160] The antenna module 10097 may transmit or receive a signal or power to or from the outside of the electronic device 10001 (e.g., an external electronic device). According to an embodiment, the antenna module 10097 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 10097 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 10098 or the second network 10099) may be selected from the plurality of antennas by, for example, the communication module 10090 (e.g., the wireless communication module 10092). A signal or power may then be transmitted or received between the communication module 10090 and the external electronic device via the selected at least one antenna. According to an embodiment, a component other than the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 10097.

[0161] According to various embodiments, the antenna module 10097 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high frequency band.

[0162] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.

[0163] According to an embodiment, a command or data may be sent or received between the electronic device 10001 and the external electronic device 10004 via the server 10008 connected to the second network 10099. Each of the electronic device 10002 or the electronic device 10004 may be a device of the same type as the electronic device 10001, or a device of a different type from the electronic device 10001. According to an embodiment, all or some operations to be executed on the electronic device 10001 may be executed on one or more of the external electronic device 10002, the external electronic device 10004, or the server 10008. For example, if the electronic device 10001 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 10001 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 10001 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute at least part of the requested function or service, or execute additional functions or additional services related to the request, and transmit the result of the execution to the electronic device 10001. The electronic device 10001 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology, for example, may be used. The electronic device 10001 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 10004 may include an Internet of Things (IoT) device. The server 10008 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 10004 or the server 10008 may be included in the second network 10099. The electronic device 10001 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology or IoT-related technologies.

[0164] According to an embodiment, the electronic device 10001 may be Figures 1 to 12 The electronic device 1000 of FIG. 1007 may include an IMU sensor. The IMU sensor may include, for example, at least one of a geomagnetic sensor, an acceleration sensor, or a gyroscope sensor. Alternatively, for example, the IMU sensor may include a geomagnetic sensor and an acceleration sensor. In addition, the memory 10030 may store a celestial object DB.

[0165] The processor 10020 of the electronic device 10001 can execute the instructions stored in the memory 10030. Figures 1 to 12 Operation of the electronic device 1000.

[0166] The electronic device 10001 may display a preview image generated by a camera. When an image capture function of the electronic device 10001 is activated, the electronic device 10001 may capture an image of a celestial object using the camera, and display a preview image including the image of the celestial object on the screen of the electronic device 10001. For example, when a camera application of the electronic device 10001 is run and a function of capturing a celestial object is activated, the electronic device 10001 may display a preview image including the image of the celestial object on the screen of the electronic device 10001.

[0167] The electronic device 10001 may measure the position of the electronic device 10001. When a camera application of the electronic device 10001 is executed and a function for capturing a celestial object is activated, the electronic device 10001 may obtain position information of the electronic device 10001. For example, the electronic device 10001 may measure the position of the electronic device 10001 using a GPS sensor and obtain latitude and longitude information of the electronic device 10001. The position of the electronic device 10001 may be used to identify the position of a celestial object captured by the electronic device 10001 from a celestial object DB to be described.

[0168] The electronic device 10001 can measure the orientation of the electronic device 10001. When the camera application of the electronic device 10001 is run and the function of capturing celestial objects is activated, the electronic device 10001 can obtain the orientation information of the electronic device 10001. For example, the electronic device 10001 can use an IMU sensor to measure the orientation of the electronic device 10001. For example, the IMU sensor may include but is not limited to at least one of a geomagnetic sensor, an acceleration sensor, or a gyroscope sensor. For example, the IMU sensor may only include a geomagnetic sensor and an acceleration sensor. For example, the electronic device 10001 can use a geomagnetic sensor to obtain three-axis information based on the geomagnetic direction. For example, the electronic device 10001 can use an acceleration sensor to obtain three-axis information based on the gravity direction.

[0169] The orientation of the electronic device 10001 may be used to identify a capturing direction of the electronic device 10001 and may be used to identify a position of a celestial object captured by the electronic device 10001 from a celestial object DB, which will be described later.

[0170] The electronic device 10001 can identify a celestial object corresponding to the position and orientation of the electronic device 10001 from the celestial object DB. The celestial object DB can store information related to the celestial object located in the capture direction of the electronic device 10001 according to the position and orientation of the electronic device 10001 at a specific time. For example, the celestial object DB may include, but is not limited to, the position information of the celestial object and the identification information of the celestial object. For example, the position information of the celestial object may include information related to the orientation angle and elevation angle of the celestial object. For example, the identification information of the celestial object may include information related to the name of the celestial object, the shape of the celestial object, the size of the celestial object, and the color of the celestial object.

[0171] The electronic device 10001 may identify the capture direction that the camera of the electronic device 10001 faces based on the orientation information of the electronic device 10001. The electronic device 10001 may identify the current time at which the celestial object is captured, and identify information related to the celestial object captured by the electronic device 10001 from the celestial object DB based on the current time, the position of the electronic device 10001, and the capture direction of the electronic device 10001. For example, the electronic device 10001 obtains information related to the right ascension, declination, viewing angle, and rotation of the portion that the camera of the electronic device 10001 currently faces based on the position information measured using the GPS sensor, the orientation information measured using the IMU sensor, and the camera information. In addition, for example, the electronic device 10001 may identify information related to the celestial object captured by the electronic device 10001 from the celestial object DB using a parsing technique.

[0172] The electronic device 10001 may identify an exposure time for capturing a celestial object. If the brightness of the celestial object is not high enough, the image of the celestial object on the preview image may not be recognizable by the user, and the electronic device 10001 may capture the celestial object at a specific exposure time so that the celestial object in the capture result image can be recognizable by the user. For example, the exposure time for capturing a celestial object may be preset as a default value for capturing a celestial object. Alternatively, for example, the exposure time for capturing a celestial object may be set to a specific value according to a user input when a function for capturing a celestial object is activated. Alternatively, for example, the exposure time for capturing a celestial object may be automatically set based on the brightness of the celestial object in the preview image.

[0173] Based on the exposure time, the electronic device 10001 may display a GUI on the preview image that guides the reference position of the celestial object displayed within the captured result image of the celestial object. The electronic device 10001 may calculate the moving trajectory of the celestial object to be captured at the position of the electronic device 10001 based on the exposure time. The electronic device 10001 may calculate the moving direction and moving distance of the celestial object during the exposure time based on the latitude and longitude of the position of the electronic device 10001.

[0174] The electronic device 10001 may identify a capture start position of the celestial object on the preview image, and identify a capture end position of the celestial object on the preview image based on the capture start position and the movement trajectory of the celestial object.

[0175] The electronic device 10001 may determine a specific position between the capture start position and the capture end position on the preview image as a reference position. In addition, the electronic device 10001 may display a GUI on the preview image that guides the user to display the celestial object at a position on the preview image within the capture result image that corresponds to the reference position. For example, the capture start position and the capture end position on the preview image may be located near the border of the preview image, and the GUI that guides the display of the reference position of the celestial object within the capture result image of the celestial object may be located in the central portion of the preview image.

[0176] The electronic device 10001 may capture a celestial object during the exposure time. The electronic device 10001 may acquire a plurality of captured image frames by capturing the celestial object during the exposure time. Each of the plurality of captured image frames may include a celestial object image. As the celestial object moves during the exposure time, each celestial object image within the plurality of captured image frames may be displayed at a different position.

[0177] The electronic device 10001 can generate a captured result image by combining multiple captured image frames. The electronic device 10001 can superimpose multiple captured frames so that the celestial object images in the multiple captured frames are located at a reference position within the captured result image. In addition, the electronic device 10001 can generate a captured result image by combining multiple superimposed captured images.

[0178] The electronic device 10001 may identify the position of the celestial object from each of the plurality of capture frames, and generate a capture result image by arranging the plurality of capture frames so that the celestial object is located at a reference position in the capture result image.

[0179] The electronic device 10001 according to the embodiment may display a virtual image of the identified celestial object on the preview image. The electronic device 10001 may obtain information of the celestial object captured by the electronic device 10001 from the celestial object DB based on the current time when the celestial object is captured, the position of the electronic device 10001, and the capturing direction of the electronic device 10001. The celestial object information may include, for example, identification information of the celestial object, and the orientation angle and elevation angle of the celestial object. For example, the identification information of the celestial object may include information related to the name of the celestial object, the shape of the celestial object, the size of the celestial object, and the color of the celestial object.

[0180] The electronic device 10001 can generate a virtual image of the celestial object using the celestial object information obtained from the celestial object DB and display the generated virtual image on the preview image. For example, the electronic device 10001 can generate a virtual image of the celestial object based on the shape, size and color of the celestial object.

[0181] The electronic device 10001 may determine a position for displaying a virtual image on the preview image based on the orientation angle and elevation angle of the celestial object, the orientation information of the electronic device 10001, and the viewing angle of the camera of the electronic device 10001. The electronic device 10001 may display the virtual image of the celestial object at a position on the preview image corresponding to the orientation angle and elevation angle of the celestial object. In addition, the electronic device 10001 may display the name of the celestial object around the virtual image of the celestial object.

[0182] The electronic device 10001 may determine whether the electronic device 10001 is stationary. The electronic device 10001 may determine whether the electronic device 10001 is shaking based on a sensing value sensed by the IMU sensor. The electronic device 10001 may determine whether the electronic device 10001 is shaking beyond a specific threshold. For example, if the electronic device 10001 captures a celestial object, the specific threshold may be determined by considering whether the position of the celestial object on the preview is outside the error tolerance, but is not limited thereto.

[0183] If it is determined that the electronic device 10001 is not stationary, the electronic device 10001 may repeatedly determine whether the electronic device 10001 is stationary.

[0184] If it is determined that the electronic device 10001 is stationary, the electronic device 10001 may perform an operation to correct the orientation of the electronic device 10001. Correcting the orientation of the electronic device 10001 may include correcting a sensed value of an IMU sensor of the electronic device 10001.

[0185] The electronic device 10001 may acquire the coordinates of the virtual image of the celestial object on the preview image. When the electronic device 10001 is stationary, the electronic device 10001 may obtain information of the celestial object captured by the electronic device 10001 from the celestial object DB based on the current time when the celestial object is captured, the position of the electronic device 10001, and the capturing direction of the electronic device 10001. The celestial object information may include, for example, identification information of the celestial object, and the orientation angle and elevation angle of the celestial object. The electronic device 10001 may calculate the coordinates of the position for displaying the virtual image of the celestial object on the preview image based on the orientation angle and elevation angle of the celestial object, the orientation information of the electronic device 10001, and the viewing angle of the camera of the electronic device 10001.

[0186] The electronic device 10001 may identify the position coordinates of the celestial object in the preview image. The electronic device 10001 may identify the celestial object image within the preview image and identify the coordinates of the position where the celestial object image is displayed.

[0187] The electronic device 10001 may compare the position coordinates of the celestial object and the position coordinates of the virtual image of the celestial object.

[0188] The electronic device 10001 may correct the orientation of the electronic device 10001 based on the comparison result. The electronic device 10001 may correct the orientation of the electronic device 10001 so that the position coordinates of the celestial object match the position coordinates of the virtual image of the celestial object. The electronic device 10001 may calibrate the sensing value of the IMU sensor of the electronic device 10001 so that the position coordinates of the virtual image of the celestial object match the position coordinates of the celestial object and the position coordinates of the virtual image of the celestial object.

[0189] For example, the sensed value sensed from the geomagnetic sensor can provide three-axis information based on the magnetic north direction, and the three-axis information sensed from the acceleration sensor can provide three-axis information based on the gravity direction. Therefore, the geomagnetic sensor may not detect the rotation of the electronic device 10001 based on the magnetic north direction, and the acceleration sensor may not detect the rotation of the electronic device 10001 based on the gravity direction. However, since the information based on the captured image including the celestial object includes information related to the rotation based on the magnetic north direction of the electronic device 10001 and the rotation based on the gravity direction, the sensed value from the geolocation sensor can be expressed as an equation in which the rotation information is a variable, and the acceleration sensor can be expressed as an equation in which the rotation based on the gravity direction is a variable. Therefore, information related to the rotation of the electronic device 10001 based on the magnetic north direction and the rotation based on the gravity direction can be calculated according to the two equations represented for the two variables. The electronic device 10001 can use the calculated rotation information to predict the sensed value after correction. The difference between the current value and the predicted value used in the calculation is a correction value, and the electronic device 10001 may reflect the correction value in the sensing value of the geomagnetic sensor and the sensing value of the acceleration sensor.

[0190] The electronic device 10001 may display a virtual image of the identified celestial object on the preview image based on the corrected orientation.

[0191] If the sensing values ​​are corrected frequently, it is difficult to provide a virtual image of the celestial object in real time while capturing the celestial object, but a virtual image of the celestial object can be more effectively provided to the user by correcting the orientation of the electronic device 10001 only when the electronic device 10001 is stationary.

[0192] The electronic device 10001 may determine whether the capture direction of the electronic device 10001 has changed. The electronic device 10001 may determine whether the capture direction of the electronic device 10001 has changed by more than a certain threshold. For example, if the difference between the camera facing direction and the previously corrected camera facing direction is greater than a certain angle (e.g., approximately 20 degrees to approximately 30 degrees), the electronic device 10001 may determine that the capture direction of the electronic device 10001 has been changed. For example, if a preview image before the capture direction of the electronic device 10001 is changed and a preview image after the capture direction of the electronic device 10001 is changed do not overlap, the electronic device 10001 may determine that the capture direction of the electronic device 10001 has changed.

[0193] If it is determined that the capturing direction of the electronic device 10001 is changed, the electronic device 10001 may display a virtual image of the celestial object on the preview image and perform correction of the orientation of the electronic device 10001 .

[0194] If it is determined that the capturing direction of the electronic device 10001 has not changed, the electronic device 10001 may perform image capturing of a guided celestial object.

[0195] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0196] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that, when the terms "operably" or "communicatively" are used or when the terms "operably" or "communicatively" are not used, if an element (e.g., a first element) is referred to as "combined with another element (e.g., a second element)", "combined to another element (e.g., a second element)", "connected with another element (e.g., a second element)" or "connected to another element (e.g., a second element)", it means that the one element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element. As used in connection with various embodiments of the present disclosure, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic", "logic block", "portion", or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0197] The various embodiments described herein may be implemented as software (e.g., program 10040) including one or more instructions stored in a storage medium (e.g., internal memory 10036 or external memory 10038) that can be read by a machine (e.g., electronic device 10001). For example, under the control of a processor, a processor (e.g., processor 10020) of the machine (e.g., electronic device 10001) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0198] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) the computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, a server of an application store, or a forwarding server).

[0199] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities, and some of the multiple entities may be separately arranged in different components. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding one of the multiple components performs the one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

Claims

1. A method for capturing an image of a celestial object by an electronic device, include: displaying a preview image generated by a camera of the electronic device; measuring a location of the electronic device using a global positioning system (GPS) sensor of the electronic device; measuring an orientation of the electronic device using an inertial measurement unit (IMU) sensor of the electronic device; identifying a celestial object corresponding to a capture direction of the camera of the electronic device based on the measured position and the measured orientation; identifying a camera exposure time set to capture the celestial object; Based on the exposure time, displaying a graphical user interface (GUI) on the preview image to guide displaying a reference position of the celestial object within a captured result image of the celestial object; receiving user input for capturing the celestial object; as well as Upon receiving the user input, the celestial object is captured during the exposure time.

2. The method according to claim 1, further comprising: include: acquiring a plurality of captured image frames by capturing the celestial object during the exposure time; as well as The captured result image is generated by combining the plurality of captured image frames.

3. The method according to claim 2, in, When the celestial object moves during the exposure time, positions of the celestial object in the plurality of captured image frames are different from each other, and Wherein, generating the captured result image comprises: combining the multiple captured image frames so that the celestial objects in the multiple captured image frames are superimposed at the reference position, and the reference position is used to display the celestial objects in the captured result image.

4. The method according to claim 3, in, The reference position for displaying the celestial object in the captured image is determined based on the exposure time, the capture start position of the celestial object, and the capture end position of the celestial object to prevent degradation around the position of the celestial object in the captured image.

5. The method according to claim 1, further comprising: include: determining that the electronic device is stationary, Wherein, when the electronic device is stationary: identifying coordinates for displaying a virtual image of the celestial object in the preview image, comparing the position coordinates of the celestial object in the preview image with the coordinates used to display the virtual image, and Based on the comparison result, the sensed value of the IMU sensor of the electronic device is corrected.

6. The method according to claim 5, in, Determining that the electronic device is stationary includes: using the IMU sensor to determine whether the shaking of the electronic device falls within a preset threshold range.

7. The method according to claim 5, further comprising: include: Correcting coordinates for displaying the virtual image based on correcting a sensed value of an IMU sensor of the electronic device; as well as The virtual image of the celestial object is displayed at a position corresponding to the corrected coordinates on the preview image.

8. The method according to claim 5, further comprising: include: determining that a capture direction of the electronic device is changed; as well as When the capture direction of the electronic device changes, the sensing value of the IMU sensor of the electronic device and the corrected coordinates are recalibrated.

9. The method according to claim 8, in, Determining that the capturing direction is changed includes: determining whether the capturing direction of the electronic device deviates from a preset threshold.

10. The method according to claim 1, in, Identifying the celestial object is identifying the celestial object corresponding to the capturing direction of the camera of the electronic device from a database (DB), the database storing celestial object information corresponding to the measured position and the measured orientation.

11. An electronic device for capturing an image of a celestial object, the electronic device include: a camera for capturing images of said celestial object; a global positioning system (GPS) sensor for measuring the location of the electronic device; an inertial measurement unit (IMU) sensor for measuring the orientation of the electronic device; monitor; a memory storing one or more instructions; as well as a processor for executing the one or more instructions, The processor executes the one or more instructions to displaying a preview image generated by the camera on the display, measuring the location of the electronic device using the GPS sensor, measuring the orientation of the electronic device using the IMU sensor, identifying a celestial object corresponding to a capture direction of the camera based on the measured position and the measured orientation, identifying a camera exposure time set to capture the celestial object, displaying a GUI on the preview image to guide displaying a reference position of the celestial object within a captured image of the celestial object based on the exposure time, receiving user input for capturing the celestial object, and Upon receiving the user input, the celestial object is captured during the exposure time.

12. The electronic device according to claim 11, in, The processor executes the one or more instructions to: obtaining a plurality of captured image frames by capturing the celestial object during the exposure time, and The captured result image is generated by combining the plurality of captured image frames.

13. The electronic device according to claim 12, when the celestial object moves during the exposure time, positions of the celestial object in the plurality of captured image frames are different from each other, and The processor executes the one or more instructions to combine the multiple captured image frames so that the celestial objects in the multiple captured image frames are superimposed at the reference position, and the reference position is used to display the celestial objects in the captured result image.

14. The electronic device according to claim 13, in, The reference position for displaying the celestial object in the captured image is determined based on the exposure time, the capture start position of the celestial object, and the capture end position of the celestial object to prevent degradation around the position of the celestial object in the captured image.

15. The electronic device according to claim 11, in, The processor executes the one or more instructions to: determining that the electronic device is stationary; identifying coordinates for displaying a virtual image of the celestial object in the preview image when the electronic device is stationary; comparing the position coordinates of the celestial object in the preview image with the coordinates used to display the virtual image; as well as Based on the comparison result, the sensed value of the IMU sensor of the electronic device is corrected.

Images