Electronic device and method for controlling same
The electronic device addresses the issue of distorted user appearances on large screen TVs by using sensors to detect movement and estimate camera installation locations, allowing for corrected image output based on camera angles, thereby enhancing user experience.
Patent Information
- Application Number
- PCT/KR2024/012883
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-25
- Filing Date
- 2024-08-28
- Publication Date
- 2025-05-01
AI Technical Summary
Large screen TVs with external cameras installed at varying heights cause differences in camera angles, leading to distorted user appearances on screen, especially when the camera is installed at the top or bottom of the TV.
An electronic device with a processor that detects the movement of the device using sensors, estimates the camera's installation location, and adjusts the display output to correct the image based on the camera's shooting angle, ensuring accurate user representation on screen.
The solution effectively corrects the user's appearance on screen by adjusting the display output based on the camera's installation location and shooting angle, providing a more accurate and consistent user experience across different camera installations.
Smart Images

Figure KR2024012883_01052025_PF_FP_ABST
Abstract
Description
Electronic device and method of controlling the same
[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof for estimating the installation position of a camera and correcting and displaying the coordinates of an object.
[0002] As artificial intelligence and machine learning technologies advance, technology exists that uses cameras to recognize human poses and motions.
[0003] Accordingly, technology that recognizes human poses and motions can be utilized to provide interactions tailored to those poses and movements. Among these, various services, such as AI home training and motion games, are expanding, primarily on mobile devices, and the trend is also expanding to services utilizing large screens like TVs.
[0004] At this time, external cameras installed on large screens can be installed mainly at the top or bottom of the screen. However, as TV screen sizes have recently increased to 70-80 inches or more, height differences arise depending on the camera installation location (top / bottom of the TV). This can lead to differences in the camera angle that captures the user, and thus, the user's appearance reflected on the screen.
[0005] An electronic device according to one or more embodiments of the present disclosure includes a communication interface connected to a camera, a display, a sensor for detecting movement of the electronic device, a memory storing at least one command, and a processor connected to the memory for controlling the electronic device, wherein the processor, by executing the at least one command, obtains information corresponding to an installation location of the camera based on movement of the electronic device detected through the sensor while the camera is installed in the electronic device, and controls the display to output an image processed to correspond to a shooting angle of the camera obtained based on the information corresponding to the installation location.
[0006] The above processor can obtain information corresponding to a shooting angle of the camera capable of shooting an object located at a preset distance from the electronic device based on information corresponding to the installation location.
[0007] The above object corresponds to the user's entire body, and the preset distance may be a distance based on the running application.
[0008] The electronic device further includes a speaker that outputs audio, and the processor can obtain information corresponding to a distance between the camera and the electronic device based on a time at which the audio is output through the speaker and a time at which the output audio is detected by the camera.
[0009] The processor may obtain information corresponding to the camera being installed at the top of the electronic device when movement in a downward direction of the electronic device is detected while the camera is installed in the electronic device, and may obtain information corresponding to the camera being installed at the bottom of the electronic device when movement in a downward direction of the electronic device is not detected while the camera is installed in the electronic device.
[0010] The processor can obtain information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device obtained through the sensor when the connection of the camera with the electronic device is detected.
[0011] When information corresponding to the installation location of the camera is acquired and an application that uses the image acquired through the camera is executed, information corresponding to the installation location of the camera can be re-acquired based on information corresponding to the movement of the electronic device acquired through the sensor.
[0012] The processor can control the display to display an object at a display position corrected based on the shooting angle of the camera in an image processed to correspond to the shooting angle of the camera.
[0013] The processor may control the display to display a UI for guiding the user so that the user's entire body is captured when the user's entire body is not captured at the installation location of the camera and the shooting angle of the camera.
[0014] A method for controlling an electronic device according to one or more embodiments of the present disclosure includes a step of obtaining information corresponding to an installation location of the camera based on movement of the electronic device detected through a sensor while the camera is installed in the electronic device, and a step of outputting an image processed to correspond to a shooting angle of the camera obtained based on the information corresponding to the installation location.
[0015] The above control method may include a step of obtaining information corresponding to a shooting angle of the camera capable of shooting an object located at a preset distance from the electronic device based on information corresponding to the installation location.
[0016] A control method wherein the above object corresponds to the user's entire body, and the above preset distance corresponds to the running application.
[0017] The above control method may further include a step of outputting audio and a step of obtaining information corresponding to a distance between the camera and the electronic device based on a time at which the audio is output and a time at which the output audio is detected by the camera.
[0018] The above control method may include a step of acquiring information corresponding to the camera being installed at the top of the electronic device when movement in a downward direction of the electronic device is detected while the camera is installed in the electronic device, and a step of acquiring information corresponding to the camera being installed at the bottom of the electronic device when movement in a downward direction of the electronic device is not detected while the camera is installed in the electronic device.
[0019] The above control method may include a step of obtaining information corresponding to the installation location of the camera based on information corresponding to movement of the electronic device when a connection of the camera with the electronic device is detected.
[0020] The above control method may include a step of obtaining information corresponding to the installation location of the camera, and re-obtaining information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device when an application using an image obtained through the camera is executed.
[0021] The step of outputting an image processed to correspond to the shooting angle of the camera may display an object at a display position corrected based on the shooting angle of the camera in the image processed to correspond to the shooting angle of the camera.
[0022] The above control method may further include a step of displaying a UI for guiding the user so that the user's entire body is captured, when the user's entire body is not captured at the installation location of the camera and the shooting angle of the camera.
[0023] A non-transitory computer-readable recording medium comprising a program for executing a control method of an electronic device according to one or more embodiments of the present disclosure, wherein the control method comprises the steps of: obtaining information corresponding to an installation location of the camera based on movement of the electronic device detected through a sensor while the camera is installed in the electronic device; and outputting an image processed to correspond to a shooting angle of the camera obtained based on the information corresponding to the installation location.
[0024] The above control method may include a step of obtaining information corresponding to a shooting angle of the camera capable of shooting an object located at a preset distance from the electronic device based on information corresponding to the installation location.
[0025] FIG. 1 is a block diagram illustrating a configuration of an electronic device according to one or more embodiments of the present disclosure.
[0026] FIG. 2 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments of the present disclosure.
[0027] FIG. 3 is a drawing for explaining the movement of an electronic device according to one or more embodiments of the present disclosure.
[0028] FIGS. 4, 5 and 6 are drawings illustrating the point in time when installation of a camera according to one or more embodiments of the present disclosure is completed.
[0029] FIGS. 7, 8, 9, 10, and 11 are drawings for explaining the installation location of a camera according to one or more embodiments of the present disclosure.
[0030] FIG. 12, FIG. 13 and FIG. 14 are drawings for explaining the shooting angle of a camera according to one or more embodiments of the present disclosure.
[0031] FIG. 15, FIG. 16, FIG. 17, and FIG. 18 are diagrams illustrating a method for an electronic device according to one or more embodiments of the present disclosure to correct an image captured by a camera.
[0032] The present embodiments may be modified and have various embodiments. Therefore, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.
[0033] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.
[0034] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.
[0035] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.
[0036] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.
[0037] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to instances where (1) at least one A is included, (2) at least one B is included, or (3) at least one A and at least one B are included.
[0038] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.
[0039] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).
[0040] On the other hand, when it is said that a component (e.g., a first component) is “directly connected” or “directly connected” to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.
[0041] The expression “configured to” as used in this disclosure may be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of,” depending on the context. The term “configured to” may not necessarily mean only “specifically designed to” in terms of hardware.
[0042] Instead, in some contexts, the phrase “a device configured to” may mean that the device, in conjunction with other devices or components, is “capable of” performing A, B, and C. For example, the phrase “a processor configured (or set) to perform A, B, and C” may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.
[0043] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.
[0044] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.
[0045] Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that a person having ordinary knowledge in the technical field to which the present disclosure pertains can easily implement the present disclosure.
[0046] FIG. 1 is a block diagram illustrating the configuration of an electronic device (100) according to one or more embodiments of the present disclosure.
[0047] The electronic device (100) may include a memory (110), a communication interface (120), a display (130), a user interface (140), an input / output interface (150), a speaker (160), a microphone (170), and a processor (190). The electronic device (100) may omit some of the above components and may further include other components.
[0048] And, the electronic device (100) may be implemented as a TV, but this is only one example, and the electronic device (100) may be implemented in various forms such as a smartphone, a smart TV, a set-top box, a mobile phone, a server, a PDA (personal digital assistant), a laptop, a media player, an e-book reader, a digital broadcasting terminal, a navigation device, a kiosk, an MP3 player, a wearable device, a home appliance, and other mobile or non-mobile computing devices.
[0049] The memory (110) can store at least one instruction regarding the electronic device (100). The memory (110) can store an operating system (O / S) for driving the electronic device (100). In addition, the memory (110) can store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. In addition, the memory (110) can include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.
[0050] Specifically, the memory (110) can store various software modules for operating the electronic device (100) according to various embodiments of the present disclosure, and the processor (190) can control the operation of the electronic device (100) by executing various software modules stored in the memory (110). That is, the memory (110) is accessed by the processor (190), and data reading / recording / modifying / deleting / updating, etc. can be performed by the processor (190).
[0051] Meanwhile, in the present disclosure, the term memory (110) may be used to mean a memory (110), a ROM (not shown), a RAM (not shown) in a processor (190), or a memory card (not shown) (e.g., a micro SD card, a memory stick) mounted on an electronic device (100).
[0052] And, the communication interface (120) includes a circuitry and is a configuration capable of communicating with external devices and servers. The communication interface (120) can communicate with external devices or servers based on a wired or wireless communication method. The communication interface (120) can include a Bluetooth module (not shown), a Wi-Fi module (not shown), an IR (infrared) module, a LAN (Local Area Network) module, an Ethernet module, etc. Here, each communication module can be implemented in the form of at least one hardware chip. In addition to the above-described communication method, the wireless communication module can include Zigbee, USB (Universal Serial Bus), MIPI CSI (Mobile Industry Processor Interface Camera Serial Interface), 3G (3 rd Generation), 3GPP(3 rd Generation Partnership Project), Long Term Evolution (LTE), LTE Advanced (LTE-A), 4G (4 th Generation), 5G(5 th The communication interface (120) may include at least one communication chip that performs communication according to various wireless communication standards such as the Wireless Generation (WG). However, this is only one embodiment, and the communication interface (120) may utilize at least one communication module among various communication modules.
[0053] The display (130) may be implemented as a display of various forms, such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, a PDP (Plasma Display Panel), etc. The display (130) may also include a driving circuit, a backlight unit, etc., which may be implemented as a form, such as an a-si TFT (amorphous silicon thin film transistor), an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. Meanwhile, the display (130) may be implemented as a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display, three-dimensional display), etc.
[0054] According to various embodiments, the electronic device (100) may not include a display (130). The electronic device (100) may be connected to an external display device and may transmit images or content stored in the electronic device (100) to the external display device. Specifically, the electronic device (100) may transmit images or content to the external display device together with a control signal for controlling the display of the images or content on the external display device. Here, the external display device may be connected to the electronic device (100) through a communication interface (120) or an input / output interface (150). For example, the electronic device (100) may not include a display, such as a set-top box (STB). In addition, the electronic device (100) may include only a small display capable of displaying simple information such as text information. Here, the electronic device (100) may transmit images or content to the external display device through the communication interface (120) wired or wirelessly, or through the input / output interface (150).
[0055] The user interface (140) may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or as a touch screen capable of performing the above-described display function and operation input function. Here, the button may be a mechanical button, a touch pad, a wheel, or any other type of button formed in any area of the front, side, or back of the main body of the electronic device (100).
[0056] The input / output interface (150) may be any one of HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). The input / output interface (150) may input / output at least one of audio and video signals. Depending on the implementation example, the input / output interface (150) may include a port that inputs / outputs only audio signals and a port that inputs / outputs only video signals as separate ports, or may be implemented as a single port that inputs / outputs both audio signals and video signals. Meanwhile, the electronic device (100) may transmit at least one of the audio and video signals to an external device (e.g., an external display device or an external speaker) through the input / output interface (150). Specifically, an output port included in the input / output interface (150) can be connected to an external device, and the electronic device (100) can transmit at least one of an audio and video signal to the external device through the output port.
[0057] Here, the input / output interface (150) can be connected to the communication interface (120). The input / output interface (150) can transmit information received from an external device to the communication interface (120) or transmit information received through the communication interface (120) to the external device.
[0058] The speaker (160) is a component that outputs an audio signal. In particular, the speaker (160) may include an audio output mixer, an audio signal processor, and an audio output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to various embodiments, the audio output module may include a plurality of speakers, and in this case, the audio output module may be arranged inside the main body, and sound emitted by covering at least a portion of the diaphragm of the audio output module may pass through a waveguide and be transmitted to the outside of the main body. The audio output module may include a plurality of audio output units, and the plurality of audio output units may be arranged symmetrically on the exterior of the main body, thereby radiating sound in all directions, that is, in a 360-degree omnidirectional manner. In addition, the speaker (160) may be a component that outputs various audio data as well as various notification sounds or voice messages.
[0059] The microphone (170) is a component for receiving a user's voice or other sounds and converting them into audio data. The microphone (170) can receive the user's voice in an activated state. For example, the microphone (170) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (170) can include various components such as a microphone for collecting the user's voice in analog form, an amplifier circuit for amplifying the collected user's voice, an A / D conversion circuit for sampling the amplified user's voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.
[0060] And, the electronic device (100) can obtain the user's voice through the microphone (170) included in the electronic device (100). Alternatively, the electronic device (100) can obtain the user's voice from an external device equipped with a microphone. Specifically, the microphone can be provided in a separate external device, such as a remote control, a smartphone, a speaker, etc., that transmits a signal to the electronic device (100). Here, the microphone provided in the external device can digitize an analog voice signal, and the electronic device (100) can perform a communication connection with the external device through a communication interface (120) to receive the digitized voice signal.
[0061] At this time, a remote control application may be installed on the external device. The external device may control the electronic device (100) and perform user voice recognition functions through the remote control application. At this time, the external device may communicate with the electronic device (100) and the server through multiple communication interfaces.
[0062] And, the external device on which the remote control application is installed may be a smartphone, but this is only one example, and the application may be implemented through various devices on which the application can be installed, such as an AI speaker.
[0063] In addition, the electronic device (100) can be connected to an external device via a communication interface (120) or an input / output interface (150) wired or wirelessly, and the electronic device (100) can receive an audio signal for a user's voice from the external device.
[0064] Meanwhile, the electronic device (100) may be connected to the camera via a communication interface (120) or an input / output interface (150) via a wired connection. For example, the electronic device (100) may be connected to the camera via a USB port via a wired connection, or may be connected wirelessly via a Bluetooth communication standard.
[0065] When an electronic device (100) and a camera are connected, the electronic device (100) can receive an image captured by the camera through a communication interface (120) or an input / output interface (150). Furthermore, the electronic device (100) can display the image received through the camera through a display (130). At this time, the image displayed on the display (130) may be a corrected image of the image received through the camera.
[0066] The sensor (180) can detect the movement of the electronic device (100) or the display (130). At this time, the sensor (180) may be an acceleration sensor, but this is only one embodiment, and may be implemented with various sensors for detecting the user's movement, such as a gyroscope sensor.
[0067] The processor (190) can control the overall operation and function of the electronic device (100). Specifically, the processor (190) is connected to the configuration of the electronic device (100) including the memory (110), and can control the overall operation of the electronic device (100) by executing at least one command stored in the memory (110) as described above.
[0068] The processor (190) may be implemented in various ways. For example, the processor (190) may be implemented as at least one of an application specific integrated circuit (ASIC), a logic integrated circuit (Logic Integrated Circuit), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), and a digital signal processor (DSP). Meanwhile, the term processor (190) in the present disclosure may be used to mean a central processing unit (CPU), a graphic processing unit (GPU), and a main processing unit (MPU).
[0069] In particular, the processor (190) may include one or more processors. Specifically, the one or more processors may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors may control one or any combination of other components of the electronic device, and may perform operations related to communication or data processing. The one or more processors may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory.
[0070] When a method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. That is, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).
[0071] One or more processors may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include internal processor memory, such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure.
[0072] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.
[0073] In embodiments of the present disclosure, the processor (190) may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.
[0074] The operation of the processor (190) for implementing various embodiments of the present disclosure may be implemented through a plurality of modules.
[0075] Specifically, data for a plurality of modules according to the present disclosure can be stored in a memory (110), and the processor (190) can access the memory (110) to load the data for the plurality of modules into a memory or buffer within the processor (190), and then implement various embodiments according to the present disclosure using the plurality of modules.
[0076] However, at least one of the plurality of modules according to the present disclosure may be implemented in hardware and included in the processor (190) in the form of a system on chip.
[0077] Alternatively, at least one of the plurality of modules according to the present disclosure may be implemented as a separate external device, and the electronic device (100) and each module may communicate and perform operations according to the present disclosure.
[0078] FIG. 2 is a flowchart illustrating a method for estimating a camera installation location by an electronic device (100) according to one or more embodiments of the present disclosure. In the present disclosure, the camera installation location may be, but is not limited to, the top or bottom of the electronic device (100).
[0079] Referring to FIG. 2, the processor (190) can detect the movement of the electronic device (100) through the sensor (180) while the camera is being installed (S210). That is, the processor (190) can obtain a sensing value indicating the movement of the display (130) through the sensor (180). Meanwhile, in the present disclosure, the movement of the electronic device (100) may be replaced with the movement of the display (130).
[0080] In the present disclosure, “installation” may mean a case where a camera is physically mounted or attached to one side of an electronic device (100). Alternatively, “installation” may mean a case where a connection between a camera and an electronic device (100) is completed through an interface of the electronic device (100). Alternatively, “installation” may mean a case where a camera is physically mounted or attached to one side of an electronic device (100) and a connection between the camera and the electronic device (100) is completed through an interface of the electronic device (100). Here, one side of the electronic device (100) may mean the top, side, or bottom of the electronic device (100). Alternatively, one side of the electronic device (100) may mean one side of a component (e.g., a display (130)) included in the electronic device (100).
[0081] Referring to FIG. 3, the sensing values of the sensor (180) may include sensing values for the x, y, and z axes. Here, the sensing value for the x-axis may indicate movement toward the front or rear of the electronic device (100). In addition, the sensing value for the y-axis may indicate movement toward the left or right of the electronic device (100). In addition, the sensing value for the z-axis may indicate movement toward the upper side of the electronic device (100) or the lower side of the electronic device (100).
[0082] For example, a sensing value in the (+) direction of the z-axis may indicate movement in the upward direction of the electronic device (100). And, a sensing value in the (-) direction of the z-axis may indicate movement in the downward direction of the electronic device (100).
[0083] In addition, the processor (190) can obtain information corresponding to the installation location of the camera based on the detected movement of the electronic device (100). That is, the processor (190) can recognize or estimate information about the installation location of the camera based on the detected movement of the electronic device (100).
[0084] Specifically, while the camera is being installed, the processor (190) can identify whether movement toward the lower side of the display (130) is detected (S220).
[0085] When movement toward the lower side of the electronic device (100) is detected (S220-Y), the processor (190) can obtain information corresponding to the camera being installed at the top of the electronic device (100). That is, the processor (190) can recognize or estimate the installation location of the camera as being at the upper side of the electronic device (100).
[0086] And, if no movement toward the lower side of the electronic device (100) is detected (S220-N), the processor (190) can obtain information corresponding to the camera being installed at the bottom of the electronic device (100). That is, the processor (190) can recognize or estimate the installation location of the camera as being at the lower side of the electronic device (100).
[0087] Meanwhile, the processor (190) can accumulate and acquire sensing values representing the movement of the electronic device (100) obtained through the sensor (180) while the camera is installed. Then, the processor (190) can detect movement toward the upper side of the electronic device (100) or the lower side of the electronic device (100) from the accumulated sensing values.
[0088] And, based on information corresponding to movement in the upper or lower direction of the electronic device (100), the processor (190) can obtain information corresponding to the installation position of the camera.
[0089] FIG. 4 is a drawing illustrating a point in time when a camera according to one or more embodiments of the present disclosure is installed.
[0090] Referring to FIG. 4, at time T1, a camera may be connected to an electronic device (100) by a user. Then, at time T2, following T1, the electronic device (100) may detect the connection of the camera. Then, at time T3, following T2, camera installation may begin. Then, camera installation may be completed at time T4.
[0091] At this time, the sensing value acquired through the sensor (180) may include a sensing value acquired between time points T1 and T2, a sensing value acquired between time points T2 and T3, and a sensing value acquired between time points T3 and T4.
[0092] At this time, when a connection with the electronic device (100) of the camera is detected, the processor (190) can obtain information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device (100) obtained through the sensor (180).
[0093] That is, the processor (190) can obtain a sensing value from which noise has been removed among the sensing values obtained after time point T2. Here, the sensing value obtained after time point T2 may be an accumulated value of the sensing values obtained after time point T2. In addition, noise may mean a sensing value that is lower than a preset value among the sensing values.
[0094] And, based on the sensing value for the movement of the z-axis among the sensing values from which noise has been removed, the processor (190) can estimate the installation position of the camera.
[0095] For example, if the sensing value for the movement along the z-axis among the sensing values from which noise has been removed is (-), the processor (190) can estimate that the camera is installed at the top of the electronic device (100).
[0096] And, if the sensing value for the movement of the z-axis among the sensing values from which noise has been removed is 0 or (+), the processor (190) can estimate that the camera is installed at the bottom of the electronic device (100).
[0097] FIG. 5 is a drawing for explaining the point at which a camera according to one or more embodiments of the present disclosure is installed.
[0098] Referring to FIG. 5, the installation of the camera may begin at time T1, the installation of the camera may be completed at time T2 after time T1, the camera may be connected at time T3 after time T2, and the connection of the camera may be detected at time T4 after time T3.
[0099] At this time, the sensing value acquired through the sensor (180) may include the sensing value acquired between time points T1 and T2, the sensing value acquired between time points T2 and T3, and the sensing value acquired between time points T3 and T4.
[0100] When movement of the electronic device (100) is detected before the electronic device (100) and the camera are connected (e.g., before a preset time range from the time the electronic device (100) and the camera are connected), the processor (190) can obtain information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device (100) obtained through the sensor (180).
[0101] That is, the processor (190) can obtain a sensing value from which noise has been removed among the sensing values obtained after time point T3. Here, the sensing value obtained after time point T3 may be an accumulated value of the sensing values obtained after time point T3. In addition, noise may mean a sensing value that is lower than a preset value among the sensing values.
[0102] And, based on the sensing value for the movement of the z-axis among the sensing values from which noise has been removed, the processor (190) can estimate the installation position of the camera.
[0103] For example, if the sensing value for the movement along the z-axis among the sensing values from which noise has been removed is (-), the processor (190) can estimate that the camera is installed at the top of the electronic device (100).
[0104] If the sensing value for the movement of the z-axis among the sensing values from which noise has been removed is 0 or (+), the processor (190) can estimate that the camera is installed at the bottom of the electronic device (100).
[0105] FIG. 6 is a drawing for explaining the point at which a camera according to one or more embodiments of the present disclosure is installed.
[0106] Referring to Figure 6, the camera installation is completed at time T1, an application is executed at time T2 after time T1, and the camera installation position can be adjusted at time T3 after time T2. At this time, the application may be an application that utilizes images acquired through the camera.
[0107] At this time, the sensing value acquired through the sensor (180) may include the sensing value acquired between time points T1 and T2 and the sensing value acquired between time points T2 and T3.
[0108] After the execution of an application using an image acquired through a camera is detected, if movement of the electronic device (100) is detected, the processor (190) can acquire information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device (100).
[0109] Meanwhile, in the present disclosure, the application, according to embodiments of the present disclosure, may refer to software that is executed on a computer OS (Operating System) or a mobile OS and used by a user. In addition, the application may refer to an application executed on an electronic device (100), but this is only one embodiment, and the application may be executed on a camera, and the electronic device (100) may receive information corresponding to the screen of the application executed on the camera from the camera through an interface and display it on the display (130).
[0110] That is, when information corresponding to the installation location of the camera is acquired and an application using the image acquired through the camera is executed, the electronic device (100) can re-acquire information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device (100) acquired through the sensor (180).
[0111] The processor (190) can obtain a sensing value from which noise has been removed among the sensing values obtained after time point T2. Here, the sensing value obtained after time point T2 may be an accumulated value of the sensing values obtained after time point T2. In addition, noise may mean a sensing value that is lower than a preset value among the sensing values.
[0112] And, based on the sensing value for the movement of the z-axis among the sensing values from which noise has been removed, the processor (190) can estimate the installation position of the camera.
[0113] For example, if the sensing value for the movement along the z-axis among the sensing values from which noise has been removed is (-), the processor (190) can estimate that the camera is installed at the top of the electronic device (100).
[0114] If the sensing value for the movement of the z-axis among the sensing values from which noise has been removed is 0 or (+), the processor (190) can estimate that the camera is installed at the bottom of the electronic device (100).
[0115] And, the processor (190) can estimate the installation height of the camera according to the installation location of the camera (S250).
[0116] FIGS. 7 to 10 are drawings for explaining a method for an electronic device (100) to estimate an installation height of a camera according to an installation position of the camera according to one or more embodiments of the present disclosure.
[0117] Referring to FIG. 7, the electronic device (100) may be positioned on a stand (20) located on the ground (10). And, the camera (200) may be positioned on the top of the electronic device (100).
[0118] At this time, the processor (190) can estimate the installation height of the camera (200) using the height information of the electronic device (100). Here, the installation height (h) of the camera (200) may be the distance at which the camera (200) is separated from the ground (10). At this time, the distance at which the camera (200) is separated from the ground (10) may be the sum of the distance (h1) at which the electronic device (100) is separated from the ground (10) and the height (h2) of the electronic device (100). At this time, the height of the electronic device (100) may be stored in the memory (110). In addition, the height of the stand (20) may be a preset value or a value set by the user.
[0119] Referring to FIG. 8, the camera (200) can be positioned on a stand (20) on which the electronic device (100) is placed.
[0120] Referring to FIG. 9, the camera (200) may be positioned on the ground (10). At this time, the camera (200) may be positioned within a preset distance from the stand (20) on which the electronic device (100) is placed.
[0121] Referring to FIG. 10, the camera (200) may be positioned on the sound bar (101). At this time, the sound bar (101) may be connected to the electronic device (100) wirelessly or by wire, and may output audio of the image output by the electronic device (100). Meanwhile, the sound bar (101) may be placed on the stand (20), but this is only one embodiment, and may be placed on the ground (10). In addition, the camera (200) may be installed on the sound bar (101) placed on the ground (10). As described with reference to FIGS. 8 to 10, when the camera (200) is installed at the bottom of the electronic device (100), the processor (190) may estimate the installation height of the camera (200).
[0122] Meanwhile, the processor (190) can control the speaker (160) to output specific audio. At this time, the audio output through the speaker (160) may be an inaudible sound that cannot be recognized by the user. In addition, based on the time at which the audio is output through the speaker (160) and the time at which the output audio is detected by the camera, the electronic device (100) can obtain information corresponding to the distance between the camera and the electronic device (100). Specifically, the processor (190) can identify the time at which the audio output through the speaker (160) is detected by the microphone of the camera (200). Accordingly, the processor (190) can identify the distance at which the camera (200) is located from the electronic device (100) based on the difference between the time at which the audio is output through the speaker (160) and the time at which the audio output through the speaker (160) is detected by the microphone of the camera (200).
[0123] Based on the distance that the camera (200) is from the electronic device (100), the processor (190) can estimate the installation height of the camera (200). For example, if the distance that the electronic device (100) is from the ground is h1 and the distance from the electronic device (100) to the camera (200) is d, the installation height of the camera (200) can be (h1 – d).
[0124] According to one or more embodiments of the present disclosure, the camera (200) may be implemented in the form of an IP camera, a webcam, etc., but this is only one embodiment, and may be implemented as a user terminal device (e.g., a smartphone) including an image sensor. That is, the user terminal device including the image sensor may be installed on one side of the electronic device (100). Accordingly, an image captured by the user terminal device may be displayed through the display (130) of the electronic device (100). In this case, the image displayed through the display (130) may be a corrected image of the image captured by the user terminal device.
[0125] Meanwhile, the electronic device (100) may include a stand for mounting a camera (200) on one side (e.g., the upper side or the side) of the electronic device (100). In this case, when the camera (200) is mounted on the stand, the electronic device (100) can identify the height of the camera (200) based on information corresponding to the position of the stand.
[0126] For example, referring to FIG. 11, the electronic device (100) may include a stand (1110) on the upper side of the electronic device (100). And, a camera (200) may be installed on the stand (1110). At this time, the camera (200) may be implemented as a smartphone as described above, but is not limited thereto. And, based on the installation position of the stand (1110), the electronic device (100) may estimate the installation height of the camera (200). For example, if the distance between the electronic device (100) and the ground is h1, the height of the electronic device (100) is h2, and the length of the stand installed on the upper side of the electronic device (100) is d, the installation height (h) of the camera (200) may be (h1 + h2 + d).
[0127] And, according to one or more embodiments of the present disclosure, the camera (200) may include various types of structures for being installed on one side of the electronic device (100). For example, the camera (200) may include a clip for being fixed to one side of the electronic device (100). Alternatively, the camera (200) may include a magnet for being attached to one side of the electronic device (100). In this case, the magnet included in the camera (200) may be magnetically coupled to a magnet built into the electronic device (100). Alternatively, the camera (200) may include an adhesive surface for being attached to one side of the electronic device (100).
[0128] In addition to the above, the camera (200) may be installed on one side of the electronic device (100) in various forms. Then, when the camera (200) is installed, the electronic device (100) can estimate the installation height of the camera (200). When the installation height of the camera is estimated, the processor (190) can estimate the shooting angle (θ) of the camera (S260).
[0129] Here, the camera (200) can be rotated toward the ground or the ceiling. Accordingly, the angle of view of the camera corresponding to the shooting range of the camera (200) can be changed. As illustrated in FIG. 12, the camera (200) can be rotated by an angle θ toward the ground. Alternatively, as illustrated in FIG. 13, the camera (200) can be rotated by an angle θ toward the ceiling. Meanwhile, the shooting angle of the camera (200) can be rotated by the user, but this is merely an embodiment, and the processor (190) can also control the camera (200) to rotate the camera (200). That is, the shooting angle of the camera (200) can mean the angle at which the camera (200) is rotated or the angle at which the camera (200) is tilted. Accordingly, the angle of view of the camera (200) can be adjusted to satisfy a specific condition (e.g., the user's entire body is included in the angle of view).
[0130] Specifically, based on information corresponding to the installation location of the camera, the processor (190) can obtain information corresponding to the user's location. Here, the information corresponding to the user's location may refer to an estimated or recognized user's location. In addition, the user's location may refer to a distance between the electronic device (100) and the user, and the user's location may be located at a preset distance from the electronic device (100). In this case, the preset distance may correspond to an application running on the electronic device (100). In addition, the distance between the electronic device (100) and the user corresponding to the application running on the electronic device (100) may be stored in the memory (110).
[0131] For example, if a first application is running on an electronic device (100), the processor (190) may estimate the distance between the electronic device (100) and the user as 1 m corresponding to the first application. Alternatively, if a second application is running on the electronic device (100), the processor (190) may estimate the distance between the electronic device (100) and the user as 2 m corresponding to the second application.
[0132] That is, depending on the application running on the electronic device (100), the optimal location for the user to perform an action according to the application may vary. Accordingly, the electronic device (100) can estimate the user's location based on information about the running application.
[0133] And, based on the information corresponding to the installation height of the camera and the user's position, the processor (190) can obtain information corresponding to the shooting angle of the camera (S260). Here, the shooting angle of the camera (200) may mean the angle at which the camera (200) is rotated based on the direction in which the ground or the front of the electronic device (100) is facing, but is not limited thereto. And, the information corresponding to the shooting angle of the camera may mean the estimated or recognized shooting angle of the camera.
[0134] At this time, the shooting angle of the camera may refer to a shooting angle of the camera capable of capturing at least a portion of an object located at a preset distance from the electronic device (100). At this time, the object may correspond to a user, but is not limited thereto, and may be implemented in various forms, such as a dynamic object or a static object.
[0135] Specifically, the processor (190) can estimate the shooting angle of the camera (200) for capturing at least a portion of the user's entire body.
[0136] At this time, at least a part of the user's entire body may mean, but is not limited to, the user's entire body, the user's face, the user's upper body, or the user's lower body.
[0137] Meanwhile, at least a portion of the user's entire body may correspond to an application running on the electronic device (100).
[0138] For example, when a first application is running on an electronic device (100), the processor (190) can estimate the shooting angle of a camera (200) for shooting a full body of a user. Alternatively, when a second application is running on an electronic device (100), the processor (190) can estimate the shooting angle of a camera (200) for shooting a full body of a user.
[0139] Referring to FIG. 13, the processor (190) can estimate the shooting angle (θ) of the camera (200) for shooting the full body of a user (30) located at a distance d from the display (130). At this time, the angle of view (200-1) of the camera (200) can include the full body of the user.
[0140] Meanwhile, the actual shooting angle (θ) of the camera (200) can be adjusted by the user. At this time, the processor (190) can provide a notification for adjusting the shooting angle (θ) of the camera. At this time, the processor (190) can provide a notification to the user guiding the user to adjust the shooting angle of the camera (200) by θ so that the angle of view of the camera (200) satisfies a specific condition (e.g., shooting the user's entire body).
[0141] Meanwhile, as described above, the electronic device (100) can control the shooting angle of the camera (200) so that the angle of view of the camera satisfies a specific condition. However, this is only one embodiment, and the electronic device (100) can also control the angle of view of the camera by controlling the focal length of the lens of the camera. That is, the electronic device (100) can increase the angle of view of the camera by reducing the focal length of the lens of the camera.
[0142] Specifically, when the camera's shooting mode is the first mode, the angle of view of the camera (200) may not satisfy certain conditions. Accordingly, the electronic device (100) may control the focal length of the camera's lens so that the angle of view of the camera (200) satisfies certain conditions, thereby switching the shooting mode of the camera (200) to the second mode.
[0143] For example, when the camera's shooting mode is a normal shooting mode, the angle of view of the camera (200) may include only a portion of the user's entire body. In this case, the electronic device (100) may control the focal length of the camera's lens so that the angle of view of the camera (200) includes the entire user's entire body, thereby switching the camera's shooting mode to a wide-angle shooting mode.
[0144] Meanwhile, although the electronic device (100) according to the present disclosure individually describes the operation of adjusting the shooting angle of the camera or controlling the focal length of the lens of the camera, it is not limited thereto, and the electronic device (100) may perform the operation of adjusting the shooting angle of the camera and the operation of controlling the focal length of the lens of the camera together.
[0145] For example, if the condition that the camera's angle of view must satisfy is a condition that includes the user's entire body, the electronic device (100) can control the camera's shooting angle so that the center of the camera's angle of view is positioned at a point corresponding to the center of the user's entire body. In addition, the electronic device (100) can control the focal length of the camera's lens so that the camera's angle of view includes the user's entire body.
[0146] Meanwhile, according to one or more embodiments of the present disclosure, even if the electronic device (100) rotates the camera or controls the focal length of the camera lens as described above, the conditions that the camera's angle of view must satisfy may not be satisfied. Specifically, the electronic device (100) may analyze an image captured by the camera to determine whether the conditions that the camera's angle of view must satisfy are satisfied in the image captured by the camera. For example, when the camera's angle of view should include the user's entire body, at least a portion of the user's entire body may not be included in the camera's angle of view. In this case, the electronic device (100) may control the display (130) to display a UI that guides the user's movement so that the user's entire body can be included in the camera's angle of view. For example, the electronic device (100) may control the display (130) to display a UI that includes text such as "Please move forward 50 cm." Accordingly, when the user's position changes, the electronic device (100) may control the display (130) to display a UI corresponding to the changed user's position.
[0147] Meanwhile, when the ground (10) is as illustrated in FIG. 14, the ground (10) in the image captured by the camera (200) located at the top of the display (130) may be displayed as illustrated in FIG. 15. And, when the ground (10) is as illustrated in FIG. 14, the ground (10) in the image captured by the camera (200) located at the top of the display (130) may be displayed as illustrated in FIG. 16. That is, depending on the installation position of the camera (200), the image captured by the camera may be displayed in a distorted manner. At this time, if the user is included in the image captured by the camera, at least a part of the user's entire body may be displayed in a distorted manner. The degree of image distortion may correspond to the shooting angle of the camera (200). That is, the greater the shooting angle of the camera (200), the greater the degree of image distortion.
[0148] FIG. 15 is a drawing for explaining an image captured by a camera installed on the top of an electronic device (100) according to one or more embodiments of the present disclosure.
[0149] Referring to FIG. 15, an image (1510) of a user (30) captured by a camera installed on the top of an electronic device (100) may be displayed in a distorted manner. In this case, the user's (30) upper body may be displayed long and the user's lower body may be displayed short.
[0150] Accordingly, the electronic device (100) can correct the distortion of the image (1510) captured by the camera and display it on the display (130). The electronic device (100) can correct the distortion of the image (1510) captured by the camera of the user (30) and display the image (1520) with the distortion corrected on the display (130). At this time, the corrected image (1520) can correspond to the image captured by the camera from the front of the user (30).
[0151] FIG. 16 is a drawing for explaining an image captured by a camera installed at the bottom of an electronic device (100) according to one or more embodiments of the present disclosure.
[0152] Referring to FIG. 16, an image (1610) of a user captured by a camera installed at the bottom of an electronic device (100) may be displayed in a distorted manner. In this case, the user's upper body may be displayed as short, and the user's lower body may be displayed as long.
[0153] Accordingly, the electronic device (100) can correct the distortion of the image (1610) captured by the camera and display it on the display (130). The electronic device (100) can correct the distortion of the image (1610) captured by the camera of the user (30) and display the image (1620) with the distortion corrected on the display (130). At this time, the corrected image (1620) can correspond to the image captured by the camera of the user from the front of the user (30).
[0154] Meanwhile, an electronic device (100) according to one or more embodiments of the present disclosure can display at least one object overlapping an image captured by a camera of a user (30) on a display (130).
[0155] Specifically, the electronic device (100) can display at least one object at specific coordinates on a screen displayed on the display (130). At this time, the electronic device (100) can correct the coordinates at which at least one object is displayed on the screen in response to the degree of distortion in the image captured by the camera, and display at least one object on the display (130) screen according to the corrected coordinates.
[0156] According to one or more embodiments of the present disclosure, an application running on an electronic device (100) may be an application in which a user moves a specific part of the body (e.g., an arm or a leg) toward a specific object on a screen in which an image captured by a camera is displayed through a display (130), and a processor (190) identifies whether the specific part of the user's body reaches the specific object. In this case, if the coordinates in which a specific object is displayed on the screen are not corrected, a problem may arise in which the user must move the body a distance greater or less than the distance corresponding to the distance displayed on the display (130).
[0157] For example, when a camera is installed at the top of an electronic device (100) to capture a user (30), an object may be displayed at the top of the screen displayed on the display (130). At this time, the distance that a specific part of the user's body moves to position the object displayed at the top of the screen displayed on the display (130) may be shorter than the distance that a specific part of the user's body moves to position the object displayed at the bottom of the screen displayed on the display (130).
[0158] Accordingly, the electronic device (100) according to the present disclosure can correct the coordinates of an object displayed on the display (130) to the extent that the image is distorted, and display the object on the display (130) according to the corrected coordinates (S270).
[0159] At this time, the electronic device (100) according to the present disclosure can correct the xy coordinates of the object in the image before correction based on information corresponding to the degree of image distortion. Then, based on the corrected xy coordinates, the electronic device (100) can display the object on the display (130) according to the corrected coordinates. The method in which the electronic device (100) according to the present disclosure corrects the display position of the object using the xy coordinates of the object has the effect of reducing the amount of computation when compared to a conventional image processing process.
[0160] FIG. 17 is a drawing for explaining a method for correcting coordinates of an object when a camera (200) is installed on the top of an electronic device (100) according to one or more embodiments of the present disclosure.
[0161] Referring to FIG. 17, the processor (190) can display objects (171, 172, 173, 174) by overlapping them in an image captured by a camera installed on the top of the electronic device (100).
[0162] At this time, the image (1710) displayed based on the coordinates before correction of the objects (171, 172, 173, 174) may be as illustrated in FIG. 17. At this time, the electronic device (100) may correct the coordinates of the objects (171, 172, 173, 174) and display an image (1720) in which the objects (171, 172, 173, 174) are displayed based on the corrected coordinates on the display (130).
[0163] Specifically, the processor (190) can correct the x-coordinate of an object (171, 172) located at the top of the image to move away from the center of the image. In addition, the processor (190) can correct the y-coordinate of an object (171, 172) located at the top of the image to move closer to the center of the image.
[0164] At this time, the processor (190) can correct the x-coordinate of the object (173, 174) located at the bottom of the image to become closer to the center of the image. In addition, the processor (190) can correct the y-coordinate of the object (173, 174) located at the bottom of the image to become closer to the center of the image.
[0165] At this time, the degree to which the x-coordinate of the object (131, 132, 133, 134) is corrected and the degree to which the y-coordinate of the object (131, 132, 133, 134) is corrected may correspond to the shooting angle (θ) of the camera. That is, as the shooting angle (θ) of the camera increases, the degree to which the x-coordinate is corrected and the degree to which the y-coordinate is corrected may increase.
[0166] And, the degree to which the x-coordinate and y-coordinate of the object (131, 132) located at the top of the image are corrected may increase as the object (131, 132) is located at the top of the image. And, the degree to which the x-coordinate and y-coordinate of the object (133, 134) located at the bottom of the image are corrected may increase as the object (133, 134) is located at the bottom of the image.
[0167] In addition, the processor (190) can control the display (130) to display an object (131, 132, 133, 134) whose x-coordinate and y-coordinate are corrected by overlapping it with an image captured by the camera (200).
[0168] FIG. 18 is a drawing for explaining a method for correcting coordinates of an object when a camera (200) is installed at the bottom of an electronic device (100) according to one or more embodiments of the present disclosure.
[0169] Referring to FIG. 18, the processor (190) can display objects (181, 182, 183, 184) by overlapping them in an image captured by a camera installed at the bottom of the electronic device (100).
[0170] At this time, the image (1810) displayed based on the coordinates before correction of the objects (181, 182, 183, 184) may be as illustrated in FIG. 18. At this time, the electronic device (100) may correct the coordinates of the objects (181, 182, 183, 184) and display an image (1820) in which the objects (181, 182, 183, 184) are displayed based on the corrected coordinates on the display (130). At this time, the electronic device (100) may correct the coordinates of the objects (181, 182, 183, 184) and display an image (1820) in which the objects (181, 182, 183, 184) are displayed based on the corrected coordinates on the display (130).
[0171] Specifically, the processor (190) can correct the x-coordinate of the object (181, 182) located at the top of the image to become closer to the center of the image. In addition, the processor (190) can correct the y-coordinate of the object (181, 182) located at the top of the image to become closer to the center of the image.
[0172] In addition, the processor (190) can correct the x-coordinate of the object (183, 184) located at the bottom of the image to move away from the center of the image. In addition, the processor (190) can correct the y-coordinate of the object (183, 184) located at the bottom of the image to move closer to the center of the image.
[0173] At this time, the degree to which the x-coordinate of the object (181, 182, 183, 184) is corrected and the degree to which the y-coordinate of the object (181, 182, 183, 184) is corrected may correspond to the shooting angle (θ) of the camera. That is, as the shooting angle (θ) of the camera increases, the degree to which the x-coordinate is corrected and the degree to which the y-coordinate is corrected may increase.
[0174] And, the degree to which the x-coordinate and y-coordinate of the object (181, 182) located at the top of the image are corrected may increase as the object (131, 132) is located at the top of the image. And, the degree to which the x-coordinate and y-coordinate of the object (183, 184) located at the bottom of the image are corrected may increase as the object (133, 134) is located at the bottom of the image.
[0175] In addition, the processor (190) can control the display (130) to display an object (181, 182, 183, 184) whose x-coordinate and y-coordinate are corrected by overlapping it with an image captured by the camera (200).
[0176] Meanwhile, according to the above, the electronic device (100) can individually perform an operation of correcting the degree of distortion of a displayed image and displaying the corrected image on the display (130), and an operation of correcting the position coordinates of an object in the distorted image and overlapping and displaying the distorted image and the object whose position coordinates have been corrected. However, this is only one embodiment, and the electronic device (100) according to the present disclosure can also perform the two operations described above together.
[0177] That is, the electronic device (100) can control the display (130) to display an object at a display position corrected based on the shooting angle of the camera in an image processed to correspond to the shooting angle of the camera.
[0178] Specifically, the electronic device (100) can correct the distortion of an image captured by a camera installed on one side of the electronic device (100) based on information corresponding to the degree of distortion of the displayed image, and display the image with the distortion corrected on the display (130). In addition, the electronic device (100) can control the display (130) to correct the position coordinates of an object in an image captured by a camera installed on one side of the electronic device (100) based on information corresponding to the degree of distortion of the image, and to display the object with the position coordinates corrected by overlapping it with the image with the distortion corrected.
[0179] Although various embodiments have been described above, each embodiment is not necessarily implemented individually, and may be implemented together in a single product by being combined in whole or in part with at least one other embodiment. Meanwhile, the term "part" or "module" used in the present disclosure includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A "part" or "module" may be an integrally configured component, a minimum unit performing one or more functions, or a part thereof. For example, a module may be composed of an application-specific integrated circuit (ASIC).
[0180] Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device, which is a device capable of calling instructions stored in the storage medium and operating according to the called instructions, may include an electronic device (100) according to the disclosed embodiments. When the instructions are executed by a processor, the processor may directly or under the control of the processor perform a function corresponding to the instructions using other components. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" means that the storage medium does not contain signals and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.
[0181] According to one or more embodiments, the methods according to the various embodiments disclosed herein may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0182] Each component (e.g., a module or a program) according to various embodiments may be composed of one or more entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., a module or a program) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by a module, program, or other component according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.
Claims
1. In electronic devices, Communication interface connecting to the camera; display; A sensor for detecting movement of the electronic device; a memory storing at least one instruction; and A processor connected to said memory and controlling said electronic device, The processor, by executing at least one instruction, While the camera is installed on the electronic device, information corresponding to the installation location of the camera is acquired based on the movement of the electronic device detected through the sensor, An electronic device that controls the display to output an image processed to correspond to the shooting angle of the camera obtained based on information corresponding to the installation location.
2. In paragraph 1, The above processor, An electronic device that obtains information corresponding to a shooting angle of the camera capable of shooting an object located at a preset distance from the electronic device based on information corresponding to the installation location.
3. In paragraph 2, The above object corresponds to the user's entire body, An electronic device wherein the above preset distance is a distance based on the running application.
4. In paragraph 1, The above electronic device, further comprising a speaker for outputting audio; The above processor, An electronic device that obtains information corresponding to the distance between the camera and the electronic device based on the time at which the audio is output through the speaker and the time at which the output audio is detected by the camera.
5. In paragraph 1, The above processor, While the camera is installed on the electronic device, if movement toward the bottom of the electronic device is detected, information corresponding to the camera being installed on the top of the electronic device is acquired, An electronic device that acquires information corresponding to the camera being installed at the bottom of the electronic device when no movement in a downward direction of the electronic device is detected while the camera is installed in the electronic device.
6. In paragraph 1, The above processor, When the connection between the above camera and the above electronic device is detected, An electronic device that acquires information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device acquired through the sensor.
7. In paragraph 1, An electronic device that acquires information corresponding to the installation location of the camera, and when an application that uses an image acquired through the camera is executed, re-acquires information corresponding to the installation location of the camera based on information corresponding to the movement of the electronic device acquired through the sensor.
8. In paragraph 1, The above processor, An electronic device that controls the display to display an object at a display position corrected based on the shooting angle of the camera in an image processed to correspond to the shooting angle of the camera.
9. In paragraph 1, The above processor, An electronic device that controls the display to display a UI for guiding the user so that the user's whole body is captured when the user's whole body is not captured at the installation location of the camera and the shooting angle of the camera.
10. In a method for controlling an electronic device, A step of obtaining information corresponding to the installation location of the camera based on the movement of the electronic device detected through a sensor while the camera is installed in the electronic device; and A control method, comprising: a step of outputting an image processed to correspond to the shooting angle of the camera obtained based on information corresponding to the installation location; 11. In paragraph 10, The above control method is, A control method, comprising: a step of obtaining information corresponding to a shooting angle of the camera capable of shooting an object located at a preset distance from the electronic device based on information corresponding to the installation location.
12. In paragraph 11, The above object corresponds to the user's entire body, A control method in which the above preset distance corresponds to a running application.
13. In paragraph 10, The above control method is, Step of outputting audio; and A control method further comprising: a step of obtaining information corresponding to a distance between the camera and the electronic device based on a time at which the audio is output and a time at which the output audio is detected by the camera.
14. In paragraph 10, The above control method is, While the camera is installed on the electronic device, when movement in a downward direction of the electronic device is detected, a step of obtaining information corresponding to the camera being installed on the top of the electronic device; and A control method, comprising: a step of obtaining information corresponding to the camera being installed at the bottom of the electronic device, if no movement in a downward direction of the electronic device is detected while the camera is installed in the electronic device; 15. A non-transitory computer-readable recording medium including a program for executing a method of controlling an electronic device, The above control method is, A step of obtaining information corresponding to the installation location of the camera based on the movement of the electronic device detected through a sensor while the camera is installed in the electronic device; and A non-transitory computer-readable recording medium, comprising: a step of outputting an image processed to correspond to the shooting angle of the camera obtained based on information corresponding to the installation location;
Citation Information
Patent Citations
Display system, display method, and display program
JP7118383B1
Display system and method with large wall surface screen usage type using user movement reaction based on motion sensor
KR101535992B1
Graphic component for adusting three dimensional tooth data and method for adusting three dimensional tooth data using the same
KR102728585B1
Camera system and control method therefor, and electronic device and control program therefor
US20170142323A1
KR20190122594A