Method for providing auto-framing function and electronic device supporting same

The electronic device automatically activates auto-framing when in a specified angle range and detects an object, addressing the inconvenience of manual input and enhancing user experience by ensuring objects are centered or zoomed within the display.

WO2024242323A1PCT designated stage expired Publication Date: 2024-11-28SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/005025
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-06-26
Filing Date
2024-04-15
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing electronic devices with flexible displays, such as foldable or rollable devices, require manual user input to activate or deactivate the auto-framing function, which can be inconvenient, especially when used in intermediate states or when an object is detected within the camera's field of view.

Method used

An electronic device equipped with sensors and cameras that automatically activate the auto-framing function when it is in a specified angle range and detects an object, allowing for hands-free operation and improved user experience.

Benefits of technology

Enables seamless auto-framing functionality without user input, enhancing the device's usability in various states and ensuring that recognized objects are centered or zoomed in/out within the display, improving user interaction and convenience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024005025_28112024_PF_FP_ABST
    Figure KR2024005025_28112024_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device, according to one embodiment, may comprise: a housing that includes a first housing and a second housing; a hinge unit that enables the first housing and the second housing to rotate; a first display that is disposed in the first housing and the second housing; at least one camera; at least one sensor; at least one processor; and a memory that stores instructions. The instructions may, when executed by the at least one processor, cause the electronic device to identify, by using the at least one sensor, whether the electronic device is in a folded state within a specified angular range. The instructions may, when executed by the at least one processor, cause the electronic device to identify whether an object is detected in an image acquired by means of the at least one camera. The instructions may, when executed by the at least one processor, cause the electronic device to activate an auto-framing function on the basis of the electronic device being in a folded state within a specified angular range and the object being detected in the image.
Need to check novelty before this filing date? Find Prior Art

Description

Method for providing an auto-framing function and an electronic device supporting the same

[0001] The present disclosure relates to a method for providing an auto-framing function and an electronic device supporting the same.

[0002] Advances in electronic technology are driving the development of electronic devices featuring various types of flexible displays. For example, electronic devices featuring flexible displays may include foldable, bendable, or rollable displays.

[0003] Electronic devices (e.g., electronic devices including foldable displays) may provide various functions not only in a fully folded or fully unfolded state, but also in an intermediate state between the fully folded and fully unfolded states (hereinafter also referred to as an "intermediate state"). For example, the electronic device may provide a camera function (e.g., an auto-framing function) in an intermediate state and when placed on an object (e.g., a desk or stand).

[0004] The auto-framing function may refer to a function of cropping an area determined based on the position of the recognized subject (and movement of the recognized subject) within the field of view of the camera when a subject (e.g., a person, an animal, a car) is recognized in the field of view of the camera during video shooting, and providing the cropped area within the image acquired through the camera. For example, an electronic device may use the auto-framing function during video shooting to perform a zoom (e.g., zoom in or zoom out) on a subject recognized in the field of view of the camera (e.g., centered on the recognized subject). Through this, the electronic device may display an object corresponding to the recognized subject in an enlarged (or reduced) manner at the center of an image to be displayed through the display, or move to a location close to the center and display it.

[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0006] The electronic device may activate (e.g., run) or deactivate (e.g., terminate) the auto-framing function based on an input selecting an object related to the auto-framing function within a menu provided by the camera application. For example, the electronic device may activate the auto-framing function based on a user input to an icon displayed on the display for activating the auto-framing function. Alternatively, the electronic device may activate the auto-framing function based on a user input to an icon for activating the auto-framing function via the quick panel. In such cases, the user may experience the inconvenience of having to manually input an input to the electronic device for activating (or deactivating) the auto-framing function.

[0007] Various embodiments of the present disclosure relate to a method for providing an auto-framing function and an electronic device supporting the same, which can automatically activate the auto-framing function (e.g., without user input for activating the auto-framing function) when a specified condition is satisfied.

[0008] The technical problems to be solved by the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0009] An electronic device according to one embodiment may include a housing including a first housing and a second housing, a hinge portion that allows the first housing and the second housing to rotate, a first display disposed in the first housing and the second housing, at least one camera, at least one sensor, at least one processor, and a memory storing instructions. The instructions, when executed by the at least one processor, may cause the electronic device to determine, through the at least one sensor, whether the electronic device is in a folded state within a specified angular range. The instructions, when executed by the at least one processor, may cause the electronic device to determine, through the at least one sensor, whether an object is detected within an image acquired through the at least one camera. The instructions, when executed by the at least one processor, may cause the electronic device to activate an auto-framing function based on whether the electronic device is in a folded state within a specified angular range and the object is detected within the image.

[0010] A method for providing an auto-framing function in an electronic device according to one embodiment may include an operation of determining, via at least one sensor of the electronic device, whether the electronic device is in a folded state within a specified angular range. The method may include an operation of determining whether an object is detected within an image acquired via at least one camera of the electronic device. The method may include an operation of activating the auto-framing function based on the electronic device being in a folded state within a specified angular range and the object being detected within the image.

[0011] In one embodiment, a non-transitory computer-readable medium having computer-executable instructions recorded thereon may cause an electronic device including at least one processor to determine, through at least one sensor of the electronic device, whether the electronic device is in a folded state within a specified angular range. The computer-executable instructions, when executed, may cause the electronic device to determine whether an object is detected within an image acquired through at least one camera of the electronic device. The computer-executable instructions, when executed, may cause the electronic device to activate an auto-framing function based on whether the electronic device is in a folded state within a specified angular range and the object is detected within the image.

[0012] An electronic device according to one embodiment may include at least one camera, at least one sensor, at least one processor, and a memory storing instructions. The instructions, when executed by the at least one processor, may cause the electronic device to determine, through the at least one sensor, whether a posture of the electronic device is in a designated posture. The instructions, when executed by the at least one processor, may cause the electronic device to determine whether an object is detected in an image acquired through the at least one camera. The instructions, when executed by the at least one processor, may cause the electronic device to activate an auto-framing function based on determining that the posture of the electronic device is in the designated posture and detecting the object in the image.

[0013] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0014] FIG. 2 is a block diagram illustrating a camera module according to one embodiment.

[0015] FIG. 3A is a diagram illustrating an unfolded state of an electronic device according to one embodiment.

[0016] FIG. 3b is a diagram illustrating a folded state of an electronic device according to one embodiment.

[0017] FIG. 4 is a block diagram of an electronic device according to one embodiment.

[0018] FIG. 5 is a flowchart illustrating a method for providing an auto-framing function according to one embodiment.

[0019] FIG. 6 is an explanatory drawing for explaining a first mode and a second mode of an electronic device according to one embodiment.

[0020] FIG. 7 is an explanatory drawing for explaining a first mode and a second mode of an electronic device according to one embodiment.

[0021] FIG. 8 is a flowchart illustrating a method for providing an auto-framing function according to one embodiment.

[0022] FIG. 9 is a flowchart illustrating a method for providing an auto-framing function according to one embodiment.

[0023] FIG. 10 is a diagram illustrating a method for providing an auto-framing function according to one embodiment.

[0024] FIG. 11 is a flowchart illustrating a method for providing an auto-framing function according to one embodiment.

[0025] FIG. 12 is a flowchart illustrating a method for activating an auto-framing function while a camera function is performed, according to one embodiment.

[0026] FIG. 13 is a diagram illustrating a method for activating an auto-framing function while a camera function is performed, according to one embodiment.

[0027] FIG. 14 is a flowchart illustrating a method for disabling an auto-framing function while the auto-framing function is performed, according to one embodiment.

[0028] FIG. 15 is a flowchart illustrating a method for providing an auto-framing function according to one embodiment.

[0029] FIG. 16 is a diagram illustrating a method for providing an auto-framing function according to one embodiment.

[0030] FIG. 17 is a diagram illustrating a method for providing an auto-framing function according to one embodiment.

[0031] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment.

[0032] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0033] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0034] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0035] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0036] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0037] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0038] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0039] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0040] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0041] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0042] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0043] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0045] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0046] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0047] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0048] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0049] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0050] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0051] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0052] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0053] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0054] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0055] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0056] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0057] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0058] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0059] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0060] FIG. 2 is a block diagram (200) illustrating a camera module (180) according to one embodiment.

[0061] Referring to FIG. 2, the camera module (180) may include a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250) (e.g., a buffer memory), or an image signal processor (260). The lens assembly (210) may collect light emitted from a subject that is a target of image capturing. The lens assembly (210) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (210). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (210) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties that are different from the lens properties of the other lens assemblies. A lens assembly (210) may include, for example, a wide-angle lens or a telephoto lens.

[0062] The flash (220) can emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (220) can include one or more light-emitting diodes (e.g., red-green-blue (RGB) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. The image sensor (230) can acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly (210) into an electrical signal. According to one embodiment, the image sensor (230) can include one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same property, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (230) can be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0063] The image stabilizer (240) can move at least one lens or image sensor (230) included in the lens assembly (210) in a specific direction or control the operating characteristics of the image sensor (230) (e.g., adjusting the read-out timing, etc.) in response to the movement of the camera module (180) or the electronic device (101) including the same. This allows compensating for at least some of the negative effects of the movement on the captured image. In one embodiment, the image stabilizer (240) can detect such movement of the camera module (180) or the electronic device (101) using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module (180). In one embodiment, the image stabilizer (240) can be implemented as, for example, an optical image stabilizer. The memory (250) can temporarily store at least a portion of the image acquired through the image sensor (230) for the next image processing task. For example, when image acquisition is delayed due to the shutter, or when multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in the memory (250), and a corresponding copy image (e.g., a low-resolution image) can be previewed through the display module (160). Thereafter, when a specified condition is satisfied (e.g., a user input or a system command), at least a portion of the original image stored in the memory (250) can be acquired and processed, for example, by the image signal processor (260). According to one embodiment, the memory (250) can be configured as at least a portion of the memory (130) or as a separate memory that operates independently therefrom.

[0064] The image signal processor (260) can perform one or more image processing operations on an image acquired through an image sensor (230) or an image stored in a memory (250). The one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor (260) may perform control (e.g., exposure time control, read-out timing control, etc.) for at least one of the components included in the camera module (180) (e.g., image sensor (230)). The image processed by the image signal processor (260) may be stored back in the memory (250) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display module (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (260) may be a processor (120). It may be configured as a separate processor that is at least partially composed of, or operates independently of, the processor (120). If the image signal processor (260) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (260) may be displayed through the display module (160) by the processor (120) as is or after undergoing additional image processing.

[0065] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different properties or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera, and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera, and at least another may be a rear camera.

[0066] FIG. 3A is a diagram illustrating an unfolded state of an electronic device according to one embodiment.

[0067] FIG. 3b is a diagram illustrating a folded state of an electronic device according to one embodiment.

[0068] Referring to FIGS. 3A and 3B , the electronic device (301) may include a housing (302) and a flexible display (e.g., a front display (330)) positioned within a space formed by the housing (302). In one embodiment, the housing (302) may be referred to as a foldable housing. In one embodiment, the front display (330) may be referred to as a foldable display.

[0069] According to one embodiment, the housing (302) may include a first housing (310) and a second housing (320) configured to rotate relative to the first housing (310).

[0070] According to one embodiment, the first housing (310) and / or the second housing (320) may form at least a portion of the exterior of the electronic device (301). According to one embodiment, the surface on which the front display (330) is visually exposed is defined as the front surface (e.g., the first front surface (310a) and the second front surface (320a)) of the electronic device (301) and / or the housing (302). The surface opposite the front surface is defined as the back surface (e.g., the first back surface (310b) and the second back surface (320b)) of the electronic device (301). The surface surrounding at least a portion of the space between the front surface and the back surface is defined as the side surface (e.g., the first side surface (310c) and the second side surface (320c)) of the electronic device (301).

[0071] According to one embodiment, the first housing (310) may be rotatably connected to the second housing (320) using a hinge structure (also referred to as a “hinge” or a “hinge portion”). For example, the first housing (310) and the second housing (320) may each be rotatably connected to the hinge structure. Accordingly, the electronic device (301) may be variable between a fully folded state (e.g., FIG. 3b) and a fully unfolded state (e.g., FIG. 3a). In the fully folded state, the first front surface (310a) may face the second front surface (320a), and in the fully unfolded state, the direction in which the first front surface (310a) faces may be substantially the same as the direction in which the second front surface (320a) faces. For example, in a fully unfolded state, the first front surface (310a) may be positioned substantially on the same plane as the second front surface (320a). In one embodiment, the second housing (320) may provide relative motion with respect to the first housing (310).

[0072] According to one embodiment, the first housing (310) and the second housing (320) are arranged on both sides with respect to the folding axis (A) as the center, and may have a shape that is overall symmetrical with respect to the folding axis (A). The angle (hereinafter also referred to as the “folding angle”) between the first housing (310) and the second housing (320) may be changed depending on whether the state of the electronic device (301) is a fully unfolded state, a fully folded state, or an intermediate state between the fully unfolded state and the fully folded state (hereinafter referred to as the “intermediate state”).

[0073] According to one embodiment, the electronic device (301) may include a hinge cover (340). At least a portion of the hinge cover (340) may be disposed between the first housing (310) and the second housing (320). According to one embodiment, the hinge cover (340) may be covered by a portion of the first housing (310) and the second housing (320) or may be exposed to the outside of the electronic device (301) depending on the state of the electronic device (301). According to one embodiment, the hinge cover (340) may protect a hinge structure (not shown) from an external impact of the electronic device (301). According to one embodiment, the hinge cover (340) may be interpreted as a hinge housing for protecting the hinge structure.

[0074] According to one embodiment, as illustrated in FIG. 3A, when the electronic device (301) is in a fully unfolded state, the hinge cover (340) may be covered by the first housing (310) and the second housing (320) and may not be exposed. As another example, as illustrated in FIG. 3B, when the electronic device (301) is in a folded state (e.g., a fully folded state), the hinge cover (340) may be exposed to the outside between the first housing (310) and the second housing (320). As another example, when the first housing (310) and the second housing (320) are in an intermediate state where they are folded at a certain angle, the hinge cover (340) may be partially exposed to the outside between the first housing (310) and the second housing (320). However, in this case, the exposed area may be less than in the fully folded state. In one embodiment, the hinge cover (340) may include a curved surface.

[0075] In one embodiment, the front display (330) may be disposed in a first housing (310) (e.g., a first front (310a)) and a second housing (320) (e.g., a second front (320a)). For example, the front display (330) may be disposed in the first housing (310) and the second housing (320) across a hinge portion.

[0076] In one embodiment, the front display (330) can visually provide information to an external party (e.g., a user) of the electronic device (301). The front display (330) can include, for example, a holographic device or a projector and a control circuit for controlling the device. In one embodiment, the front display (330) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the strength of a force generated by the touch.

[0077] According to one embodiment, the front display (330) may be a display in which at least a portion of the display can be transformed into a flat or curved surface. For example, the front display (330) may be formed to vary in response to the relative movement of the second housing (320) with respect to the first housing (310). According to one embodiment, the front display (330) may include a folding area (333), a first display area (331) positioned on one side (e.g., above (in the +Y direction)) of the folding area (333), and a second display area (332) positioned on the other side (e.g., below (in the -Y direction)). According to one embodiment, the folding area (333) may be positioned above the hinge structure. For example, at least a portion of the folding area (333) may face the hinge structure. According to one embodiment, the first display area (331) may be disposed on the first housing (310), and the second display area (332) may be disposed on the second housing (320). According to one embodiment, the front display (330) may be accommodated in the first housing (310) and the second housing (320).

[0078] However, the division of the areas of the front display (330) illustrated in the above-described FIG. 3a is exemplary, and the front display (330) may be divided into multiple areas (for example, four or more or two) depending on the structure or function.

[0079] Also, in the embodiment illustrated in FIG. 3A, the front display (330) may be divided into regions by a folding region (333) extending parallel to the X-axis or a folding axis (A-axis), but in other embodiments, the front display (330) may be divided into regions based on another folding region (e.g., a folding region parallel to the Y-axis) or another folding axis (e.g., a folding axis parallel to the Y-axis). According to one embodiment, the front display (330) may be coupled to or disposed adjacent to a touch detection circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer configured to detect a magnetic field-type stylus pen.

[0080] According to one embodiment, the electronic device (301) may include a rear display (334). The rear display (334) may be arranged to face a different direction than the front display (330). For example, the front display (330) may be visually exposed through the front side of the electronic device (301) (e.g., the first front side (310a) and / or the second front side (320a)), and the rear display (334) may be visually exposed through the rear side of the electronic device (301) (e.g., the first rear side (310b)).

[0081] According to one embodiment, the electronic device (301) may include at least one camera module (304, 306) and a flash (308). According to one embodiment, the electronic device (301) may include a front camera module (304) exposed through a front side (e.g., a first front side (310a)) and / or a rear camera module (306) exposed through a rear side (e.g., a first rear side (310b)). The camera modules (304, 306) may include one or more lenses, an image sensor, a flash, and / or an image signal processor. The flash (308) may include a light emitting diode or a xenon lamp. According to one embodiment, two or more lenses (an infrared camera, a wide-angle lens, and a telephoto lens) and image sensors may be arranged on one side of the electronic device (301). The configuration of the front camera module (304) and / or the rear camera module (306) may be partially or entirely identical to the configuration of the camera module (180) of FIGS. 1 and 2.

[0082] FIG. 4 is a block diagram of an electronic device (401) according to various embodiments.

[0083] Referring to FIG. 4, in one embodiment, the electronic device (401) may be the electronic device (101) of FIG. 1, or the electronic device (301) of FIGS. 3A and 3B. For example, the electronic device (401) may be a foldable electronic device including a housing (202) (e.g., the first housing (210) and the second housing (220)) and a hinge portion (hinge structure) described through FIGS. 3A and 3B.

[0084] In one embodiment, the electronic device (401) (301) may include a display module (410), a sensor module (420), a camera module (430), a memory (440), and / or a processor (450).

[0085] In one embodiment, the display module (410) may be the display module (160) of FIG. 1.

[0086] In one embodiment, the display module (410) may include a first display (411) and a second display (412).

[0087] In one embodiment, the first display (411) may be disposed in a first housing (e.g., a first front surface (310a) of the first housing (310)) and a second housing (e.g., a second front surface (320a) of the second housing (320)). For example, the first display (411) may be visually exposed through a front surface (e.g., the first front surface (310a) and / or the second front surface (320a)) of the electronic device (401).

[0088] In one embodiment, the first display (411) may be a foldable display. For example, the first display (411) may be the front display (330) of FIG. 3A. For example, the first display (411) may be disposed across the hinge portion in the first housing and the second housing. For example, the first display (411) may be folded or unfolded as the first housing or the second housing rotates around the hinge portion. Examples of the first display (411) folding or unfolding are described below, but the present invention is not limited thereto. For example, the first display (411) may be implemented in a bending (or curved) form, and examples of the first display (411) being implemented in a bending form may be applied identically or similarly to the examples of the first display (411) being folded or unfolded.

[0089] In one embodiment, the second display (412) may be positioned on the rear surface (e.g., the first rear surface (310b)) of the first housing (e.g., the first housing (310)). For example, the second display (412) may be visually exposed through the rear surface (e.g., the first rear surface (310b)) of the electronic device (401).

[0090] In one embodiment, the second display (412) may be a non-foldable display. For example, the second display (412) may be the rear display (334) of FIGS. 3A and 3B.

[0091] In one embodiment, the electronic device (401) may not include a second display (412).

[0092] In one embodiment, the sensor module (420) may be the sensor module (176) of FIG. 1.

[0093] In one embodiment, the sensor module (420) may include a sensor (hereinafter referred to as a “first sensor”) for detecting a folded or unfolded state of the electronic device (401) (or a folding angle of the electronic device (401). For example, the first sensor may detect a folded or unfolded state of the electronic device (401) (or a folding angle formed by the first housing and the second housing). For example, the first sensor may include a hall sensor disposed in one of the first housing and the second housing, and a magnet disposed in one of the housings and the other. The Hall sensor can detect a folded or unfolded state of the electronic device (401), or a folding angle formed by the first housing and the second housing, by detecting a change in an electromagnetic field (or magnetic flux density) generated by a magnet when at least one of the first housing or the second housing rotates around a hinge. However, the first sensor is not limited to a Hall sensor (and a magnet). For example, the first sensor can include at least one of a proximity sensor, an angle sensor, a load cell, an infrared sensor, a pressure sensor, an acceleration sensor, a gyro sensor, or an electromagnetic sensor that can detect a folded or unfolded state of the electronic device (401).

[0094] In one embodiment, the sensor module (420) may include a sensor (hereinafter referred to as a “second sensor”) capable of detecting movement of the electronic device (401) and / or posture of the electronic device (401). For example, the second sensor may include an inertial sensor (e.g., an acceleration sensor, a gyro sensor, a geomagnetic sensor). However, the second sensor is not limited to an inertial sensor.

[0095] In one embodiment, the camera module (430) may be the camera module (180) of FIG. 1 or FIG. 2.

[0096] In one embodiment, the camera module (430) may include one or more cameras.

[0097] In one embodiment, the camera module (430) may include at least one front camera and / or at least one rear camera.

[0098] In one embodiment, the at least one rear camera may include multiple cameras having different angles of view (e.g., different focal lengths). For example, the at least one rear camera may include a first camera (hereinafter referred to as a "first camera" or "wide-angle camera") that acquires images in a zoom magnification range of greater than or equal to 1x (1.0x) and less than or equal to 3x (3.0x), and a second camera (hereinafter referred to as a "second camera" or "ultra-wide-angle camera") that acquires images in a zoom magnification range of greater than or equal to 0.5x (0.5x) and less than or equal to 1x (1.0x). However, the cameras included in the at least one rear camera are not limited to the first camera and the second camera. For example, the at least one rear camera may further include, in addition to the first camera and the second camera, at least one of a third camera that acquires images in a zoom magnification range of 3 times (3.0x) or more and less than 5 times (5.0x) or a fourth camera that acquires images in a zoom magnification range of 5 times (5.0x) or more and less than 10 times (10.0x). In one embodiment, the first camera to the fourth camera may be a camera that supports digital zoom, and at least one of the first camera to the fourth camera (e.g., the third camera) may be a camera that supports optical zoom (e.g., optical continuous zoom that acquires images by moving a lens to a position corresponding to a zoom magnification and then using light passing through the lens at the moved position) in addition to digital zoom.

[0099] In one embodiment, the memory (440) may be the memory (130) of FIG. 1.

[0100] In one embodiment, the memory (440) may store information for performing an operation that provides an auto-framing function.

[0101] In one embodiment, the processor (450) may be the processor (120) of FIG. 1.

[0102] In one embodiment, the processor (450) may perform overall operations for providing an auto-framing function. In one embodiment, the processor (450) may include one or more processors for performing operations for providing the auto-framing function. The operations of the processor (450) for providing the auto-framing function will be described in detail with reference to FIG. 5 and below.

[0103] In FIG. 4, the electronic device (401) is illustrated as including, but not limited to, a display module (410), a sensor module (420), a camera module (430), a memory (440), and / or a processor (450). For example, the electronic device (401) may further include at least one component (e.g., a communication module (190)) illustrated in FIG. 1.

[0104] In the examples described above, the electronic device (401) is described as a foldable electronic device including a first housing (210) and a second housing (220) that are rotatable around one hinge portion, but is not limited thereto. For example, the electronic device (401) may be a foldable electronic device including three or more housings that are rotatable around two or more hinge portions.

[0105] FIG. 5 is a flowchart (500) for explaining a method of providing an auto-framing function according to one embodiment.

[0106] Referring to FIG. 5, in operation 501, in one embodiment, the processor (450) may determine, via the sensor module (420), whether the electronic device (401) is in a folded state within a specified angle range. For example, the processor (450) may determine, via the sensor module (420), whether the folded angle of the electronic device (401) falls within a specified angle range.

[0107] In one embodiment, the processor (450) may execute a camera application based on an input (e.g., user input). Based on the execution of the camera application, the processor (450) may display an execution screen of the camera application through a display module (410) (e.g., a first display (411) and / or a second display (412)).

[0108] In one embodiment, the processor (450) may obtain input (e.g., user input) for executing a video function while the camera application is running. Based on the input for executing the video function, the processor (450) may determine whether the electronic device (401) is in a folded state within a specified angular range.

[0109] In one embodiment, the act of determining whether the electronic device (401) is in a folded state within a specified angular range may include the act of determining whether the electronic device (401) is operating in a specified mode.

[0110] Hereinafter, with reference to FIGS. 6 and 7, an operation for checking whether the electronic device (401) is operating in a specified mode will be described.

[0111] FIG. 6 is an explanatory drawing for explaining a first mode and a second mode of an electronic device (401) according to one embodiment.

[0112] FIG. 7 is an explanatory drawing for explaining a first mode and a second mode of an electronic device (401) according to one embodiment.

[0113] Referring to FIGS. 6 and 7, in one embodiment, the first mode (hereinafter referred to as “first mode” or “tent mode”) of the electronic device (401) may refer to a mode in which an image acquired through the camera module (430) is displayed through the second display (412) in a state in which the electronic device (401) is folded within a specified angular range. For example, the first mode may be a mode in which an image acquired through a rear camera (e.g., at least one camera of the rear cameras (611, 612)) is displayed through the second display (610) in a state in which the electronic device (401) is folded within a specified angular range (e.g., an angular range from about 20 degrees to about 160 degrees), as illustrated in reference numeral 601, 602, or 603 of FIG. 6.

[0114] In one embodiment, the processor (450) may execute a camera application based on a user input when the electronic device (401) is in a fully folded state. For example, the processor (450) may execute the camera application based on an input to a physical key (e.g., the physical key (341) of FIG. 3A) disposed on the side of the electronic device (401) when the electronic device (401) is in a fully folded state. When the camera application is executed, the processor (450) may display an image (e.g., a preview image) acquired through the rear camera (611, 612) through the second display (610). While displaying the image through the second display (610), the processor (450) may obtain an input for executing a video function. The processor (450) can determine whether the electronic device (401) is operating in the first mode based on obtaining an input for executing a video function.

[0115] In one embodiment, the second mode (hereinafter referred to as “second mode” or “flex mode”) of the electronic device (401) may refer to a mode in which an image acquired through the camera module (430) is displayed through the first display (411) while the electronic device (401) is folded at a specified angle range. For example, the second mode may be a mode in which an image acquired through the front camera (621) (or the rear cameras (611, 612)) is displayed through the first display (620) while the electronic device (401) is folded at an angle within a specified angle range (e.g., an angle range from about 20 degrees to about 160 degrees), as illustrated in reference numeral 604 of FIG. 6 .

[0116] In one embodiment, the processor (450) may execute a camera application based on a user input when the electronic device (401) is fully unfolded (or folded within a specified angle range). For example, the processor (450) may execute the camera application when the electronic device (401) is fully unfolded. Based on the execution of the camera application, the processor (450) may display an image (e.g., a preview image) acquired through the front camera (621) (or the rear cameras (611, 612)) through the first display (620). While displaying the image through the first display (620), the processor (450) may obtain an input for executing a video function. Based on obtaining the input for executing the video function, the processor (450) may determine whether the electronic device (401) is operating in the second mode.

[0117] In one embodiment, the processor (450) can determine, through the sensor module (420), whether the electronic device (401) is in a folded state within a specified angular range to determine whether the electronic device (401) is operating in the first mode or the second mode.

[0118] In one embodiment, reference numeral 701 of FIG. 7 may indicate a state in which the first housing (710) of the electronic device (401) and the second housing (720) of the electronic device (401) are completely folded. The state in which the first housing (710) and the second housing (720) of the electronic device (401) are completely folded may be a state in which an angle (hereinafter, also referred to as a “folding angle”) formed by the first housing (710) and the second housing (720) of the electronic device (401) is approximately 0 degrees. Reference numeral 702 of FIG. 7 may indicate a state in which a folding angle (θ1) formed by the first housing (710) and the second housing (720) of the electronic device (401) is approximately 20 degrees as the first housing (710) of the electronic device (401) is rotated about the hinge portion (730). Reference numeral 703 of FIG. 7 may indicate a state in which the folding angle (θ2) formed by the first housing (710) of the electronic device (401) and the second housing (720) of the electronic device (401) is approximately 160 degrees as the first housing (710) of the electronic device (401) is further rotated around the hinge portion. Reference numeral 704 of FIG. 7 may indicate a state in which the first housing (710) of the electronic device (401) and the second housing (720) of the electronic device (401) are fully unfolded. The state in which the first housing (710) and the second housing (720) of the electronic device (401) are fully unfolded may be a state in which the folding angle formed by the first housing (710) and the second housing (720) is approximately 180 degrees.

[0119] In one embodiment, the processor (450) can set multiple states of the electronic device (401). For example, the processor (450) can set a state in which the first housing (710) and the second housing (720) of the electronic device (401) are completely folded as a first state, as indicated by reference numeral 701, and can set a state between the first state and a state in which the folding angle is about 20 degrees as indicated by reference numeral 702 as a second state. The processor (450) can set a state between a state in which the folding angle is about 20 degrees as indicated by reference numeral 702 and a state in which the folding angle is about 160 degrees as indicated by reference numeral 703 as a third state. The processor (450) can set a state between a state in which the folding angle is about 160 degrees, as shown by reference numeral 703, and a state in which the first housing (710) and the second housing (720) of the electronic device (401) are completely folded, as shown by reference numeral 704, as the fourth state, and can set a state in which the first housing (710) and the second housing (720) of the electronic device (401) are completely folded, as the fifth state.

[0120] In one embodiment, a state folded within a specified angle range may be the third state. In FIG. 7, folding angles that serve as criteria for distinguishing states are exemplified as about 20 degrees and about 160 degrees, but are not limited thereto. For example, the folding angles that serve as criteria for distinguishing states may be set differently depending on the shape of the electronic device (401) (e.g., the direction in which the electronic device (401) is folded) and / or characteristics.

[0121] In one embodiment, the processor (450) (e.g., sensor hub processor) may detect a folding angle through the sensor module (420). For example, the sensor module (420) (e.g., first sensor) may include a hall sensor disposed in one of the first housing (710) and the second housing (720), and a magnet disposed in one of the housings and the other. The hall sensor may transmit a signal representing a change in an electromagnetic field (or magnetic flux density) generated by the magnet to the processor (450) (e.g., sensor hub processor) when at least one of the first housing (710) or the second housing (720) rotates about the hinge portion (730). The processor (450) (e.g., sensor hub processor) may detect a folding angle based on a signal received from the hall sensor. A processor (450) (e.g., a sensor hub processor) can determine a state of the electronic device (401) (e.g., one of the first to fifth states) based on the folding angle. The processor (450) (e.g., a sensor hub processor) can transmit information indicating the determined state to a processor (450) (e.g., an application processor). Based on the information, the processor (450) (e.g., an application processor) can determine whether the electronic device (401) is in a folded state within a specified angle range.

[0122] Although the above-described example illustrates detecting the folding angle using a Hall sensor (and a magnet), it is not limited thereto. For example, the processor (450) may detect the folding angle using at least one of a proximity sensor, an angle sensor, a load cell, an infrared sensor, a pressure sensor, an acceleration sensor, a gyro sensor, or an electromagnetic sensor.

[0123] Although the operation of checking whether the electronic device (401) is in a folded state within a specified angle range has been described with reference to FIGS. 6 and 7 as including, but not limited to, the operation of checking whether the electronic device (401) is operating in a specified mode (first mode or second mode). For example, the operation of checking whether the electronic device (401) is in a folded state within a specified angle range may include the operation of checking whether the electronic device (401) is operating in a mode (e.g., dual display mode) in which the electronic device (401) displays an image acquired through the camera module (430) through the first display (411) and the second display (412) when the electronic device (401) is in a folded state within a specified angle range. For example, an operation of determining whether the electronic device (401) is in a folded state within a specified angular range may include an operation of determining whether the electronic device (401) is in a folded state within a specified angular range while a camera function is being executed in the electronic device (401) (e.g., displaying a preview image acquired through a camera module (430) through a first display (411) and / or a second display (412).

[0124] Referring to FIG. 5, in operation 503, in one embodiment, the processor (450) may determine whether an object is detected within an image acquired through the camera module (430).

[0125] In one embodiment, the processor (450) may acquire an image through a camera (e.g., a wide-angle camera) set as default when executing a camera application. Based on the acquired image, the processor (450) may determine whether an object is detected within the acquired image.

[0126] In one embodiment, the auto-framing function may be a function that, when a specified subject (e.g., a specified type of subject) is recognized in the field of view of the camera while the camera function is being executed, crops an area determined based on the position of the recognized subject (and movement of the recognized subject) within the field of view within an image acquired through the camera, and displays the cropped area through the display module (410).

[0127] In one embodiment, the auto-framing function may be a function that can acquire an image in which a zoom (e.g., zoom in or zoom out) is performed on a subject recognized in the field of view of the camera (e.g., centered on the recognized subject). For example, the auto-framing function may be a function that crops an area of ​​an image acquired through the camera so that an object corresponding to the recognized subject is displayed at a central position of the image to be displayed through the display or moved to a position close to the central position, and displays the cropped area through the display module (410). For example, the auto-framing function may be a function that, while the auto-framing function is being executed, when a first subject is positioned within the field of view of the camera and a second subject moves from outside the field of view of the camera to inside the field of view of the camera, crops an area of ​​an image acquired through the camera so that the first subject and the second subject, respectively, corresponding to the first subject and the second subject are displayed at the center position of an image to be displayed through the display or are moved to a position close to the center position, and displays the cropped area through the display module (410).

[0128] In one embodiment, the processor (450) may designate (e.g., set) a subject to be recognized while the auto-framing function is executed. For example, the processor (450) may designate (e.g., set) at least one of a person, an animal (e.g., a dog, a cat), or a subject moving within the field of view of the camera (e.g., a car) as a subject (e.g., a type of subject) to be recognized while the auto-framing function is executed.

[0129] In one embodiment, the processor (450) can determine whether an object corresponding to the specified subject (hereinafter referred to as a “specified object”) is detected within the acquired image (e.g., whether a specified type of object is detected within the acquired image).

[0130] In one embodiment, the operation of determining whether an object is detected in an image acquired through a camera may include the operation of determining whether a specified object is detected in the image acquired through the camera. However, the operation of determining whether a specified object is detected in an image acquired through the camera is not limited to the above-described example. For example, if a person making a specific gesture is recognized within the field of view of the camera, the processor (450) may determine that an object (e.g., an object corresponding to the recognized person) is detected in the acquired image. For example, if an input for selecting an object by a user (e.g., an input for touching an object) is obtained within the acquired image, the processor (450) may determine that an object (e.g., the selected object) is detected in the acquired image.

[0131] In one embodiment, the processor (450) can determine whether an object is detected in an image acquired through the camera module (430) using an algorithm for recognizing an object or an artificial intelligence model for recognizing an object.

[0132] In FIG. 5, operation 501 is illustrated as being performed before operation 503, but this is not limited thereto. For example, the processor (450) may perform operation 503 before operation 501, or may perform operations 501 and 507 simultaneously (e.g., in parallel).

[0133] In operation 505, in one embodiment, the processor (450) may activate the auto-framing function based on the electronic device (401) being in a folded state within a specified angular range and an object being detected in an image acquired through the camera module (430). For example, the processor (450) may execute the auto-framing function based on the determination that the electronic device (401) is in a folded state within a specified angular range within operation 501 and the determination that an object is detected in an image acquired through the camera module (430) within operation 503. For example, the processor (450) may not execute the auto-framing function (e.g., the auto-framing function may remain disabled) based on the determination that the electronic device (401) is not in a folded state within a specified angular range within operation 501 or the determination that an object is not detected in an image acquired through the camera module (430) within operation 503.

[0134] In one embodiment, the processor (450) may perform a camera function using the auto-framing function when auto-framing is activated. For example, the processor (450) may acquire an image to which the auto-framing function has been applied (e.g., a video to which the auto-framing function has been applied) and display the acquired image through the display module (410). When the video function is terminated, the processor (450) may store the acquired image in the memory (440).

[0135] FIG. 8 is a flowchart (800) for explaining a method of providing an auto-framing function according to one embodiment.

[0136] Referring to FIG. 8, in operation 801, in one embodiment, the processor (450) can determine, through the sensor module (420), whether the electronic device (401) is in a folded state within a specified angular range.

[0137] Since operation 801 is at least partially identical or similar to operation 501 of FIG. 5, a detailed description thereof will be omitted.

[0138] In operation 803, in one embodiment, the processor (450) may determine, through the sensor module (420), whether the size of the movement of the electronic device (401) is less than or equal to a specified size (e.g., a threshold size).

[0139] In one embodiment, the processor (450) may obtain information about the movement of the electronic device (401) (e.g., the magnitude of the movement of the electronic device (401)) through an inertial sensor (e.g., an acceleration sensor). The processor (450) may compare the obtained magnitude of the movement of the electronic device (401) with a specified magnitude, thereby determining whether the magnitude of the movement of the electronic device (401) is less than or equal to a specified magnitude (e.g., a threshold magnitude).

[0140] In one embodiment, the operation of determining whether the magnitude of the movement of the electronic device (401) is less than or equal to a specified magnitude may include determining whether the electronic device (401) is substantially still. For example, the operation of determining whether the magnitude of the movement of the electronic device (401) is less than or equal to a specified magnitude may include determining whether a value representing the magnitude of the movement of the electronic device (401) is equal to a value representing substantially no movement.

[0141] In one embodiment, when the magnitude of the movement of the electronic device (401) is less than or equal to a specified magnitude, it may be when the electronic device (401) is substantially motionless (e.g., in a fixed state), such as when the electronic device (401) is placed on an object such as a desk surface or mounted on an object (e.g., a fixed stand).

[0142] In operation 805, in one embodiment, the processor (450) may determine whether an object is detected within an image acquired through the camera module (430).

[0143] Since operation 805 is at least partially identical or similar to operation 503 of FIG. 5, a detailed description thereof will be omitted.

[0144] In operation 807, in one embodiment, the processor (450) may activate the auto-framing function based on the electronic device (401) being in a folded state within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and an object being detected within an image acquired through the camera module (430). For example, the processor (450) may execute the auto-framing function based on the determination that the electronic device (401) is in a folded state within a specified angular range within operation 801, the determination that the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude within operation 803, and the determination that an object is detected within an image acquired through the camera module (430) within operation 805. For example, the processor (450) may not execute the auto-framing function (e.g., the auto-framing function may remain disabled) based on whether it is determined in operation 801 that the electronic device (401) is not folded within a specified angular range, or whether the magnitude of the movement of the electronic device (401) exceeds a specified magnitude in operation 803 and whether an object is not detected within an image acquired through the camera module (430) in operation 805.

[0145] In one embodiment, the processor (450) may deactivate the image stabilization function when the auto-framing function is activated (or based on the electronic device (401) being folded within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to a specified magnitude, and an object being detected in an image acquired through the camera module (430). For example, the processor (450) may turn off the optical image stabilization (OIS) function, the digital image stabilizer (DIS) function, and / or the electronic image stabilizer (EIS) function when the auto-framing function is activated. Through this, the electronic device (401) may reduce unnecessary power consumption by deactivating the image stabilization function when the electronic device (401) is substantially motionless.

[0146] In one embodiment, the processor (450) may perform a camera function using the auto-framing function when auto-framing is activated. For example, the processor (450) may acquire an image to which the auto-framing function has been applied (e.g., a video to which the auto-framing function has been applied) and display the acquired image through the display module (410). When the video function is terminated, the processor (450) may store the acquired image in the memory (440).

[0147] FIG. 9 is a flowchart (900) for explaining a method of providing an auto-framing function according to one embodiment.

[0148] FIG. 10 is a diagram illustrating a method for providing an auto-framing function according to one embodiment.

[0149] Referring to FIGS. 9 and 10, in operation 901, in one embodiment, the processor (450) may determine, through the sensor module (420), whether the electronic device (401) is in a folded state within a specified angular range.

[0150] Since operation 901 is at least partially identical or similar to operation 501 of FIG. 5, a detailed description thereof will be omitted.

[0151] In operation 903, in one embodiment, the processor (450) may determine whether an object is detected within an image acquired through the camera module (430).

[0152] Since operation 903 is at least partially identical or similar to operation 503 of FIG. 5, a detailed description thereof will be omitted.

[0153] In operation 905, in one embodiment, the processor (450) may activate a designated camera for an auto-framing function based on the electronic device (401) being folded at a designated angle and an object being detected within an image acquired through the camera module (430).

[0154] In one embodiment, the electronic device (401) may include a first camera (wide-angle camera) and a second camera (ultra-wide-angle camera). The size of the field of view of the second camera may be larger than the size of the field of view of the first camera. For example, in reference numeral 1001 of FIG. 10, reference numeral 1010 may indicate the field of view of the second camera, and reference numeral 1020 may indicate the field of view of the first camera. As illustrated in reference numeral 1001, the size of the field of view (1010) of the second camera may be larger than the size of the field of view (1020) of the first camera, and the second camera may be able to acquire an image for a wider field of view (or scene) than the first camera. For example, the field of view (1010) of the second camera may further include a margin area (1030) (e.g., an area included in the field of view (1010) of the second camera but not included in the field of view (1020) of the first camera) compared to the field of view (1020) of the first camera.

[0155] In one embodiment, the camera designated for the auto-framing function may be a camera having the largest angle of view among a plurality of cameras arranged on the same side of the electronic device (401) as the currently activated camera. For example, the processor (450) may be configured such that the electronic device (401) includes a front camera and a rear camera including a first camera and a second camera. The processor (450) may activate the second camera as the camera designated for the auto-framing function based on the electronic device (401) being folded at a specified angle while currently acquiring a preview image through the first camera and an object being detected in the image acquired through the camera module (430).

[0156] In one embodiment, the act of activating a camera designated for the auto-framing function may include the act of switching the camera for acquiring an image to the camera designated for the auto-framing function. For example, if the electronic device (401) is currently acquiring an image through the first camera, and an object is detected in the image acquired through the camera module (430), the processor (450) may switch the camera for acquiring an image from the first camera to the second camera (e.g., deactivate the first camera and activate the second camera). For example, if the electronic device (401) is currently acquiring an image through the second camera (or if the second camera is activated), and an object is detected in the image acquired through the camera module (430), the processor (450) may maintain the second camera as the camera for acquiring an image.

[0157] In operation 907, in one embodiment, the processor (450) may activate the auto-framing function based on the electronic device (401) being in a folded state within a specified angular range and an object being detected within an image acquired through the camera module (430).

[0158] In one embodiment, the processor (450) may perform the auto-framing function based on an image acquired through the second camera when the second camera is activated as a camera designated for the auto-framing function. For example, the processor (450) may acquire an image corresponding to the field of view area (1010) of the second camera using the second camera. As illustrated in reference numerals 1001 and 1003, the processor (450) may crop an area in which a zoom (e.g., zoom in) is performed on an object (1060) corresponding to the subject (1040) within the image corresponding to the field of view area (1010) of the second camera, and display the cropped area (e.g., image (1050)) through the display module (410).

[0159] In one embodiment, although FIGS. 9 and 10 illustrate examples in which the electronic device (401) includes multiple cameras, the present invention is not limited thereto. For example, the electronic device (401) may include one camera (e.g., a first camera). In this case, the processor (450) may perform the operations described with reference to FIGS. 9 and 10 using the one camera. For example, the processor (450) may determine, via the sensor module (420), whether the electronic device (401) is in a folded state within a specified angular range. The processor (450) may determine whether an object is detected within an image acquired through the one camera. The processor (450) may activate the auto-framing function based on whether the electronic device (401) is in a folded state within a specified angular range and an object is detected within an image acquired through the one camera.

[0160] Although not illustrated in FIG. 9, the processor (450) may further perform an operation of checking whether the magnitude of the movement of the electronic device (401) is less than or equal to a specified magnitude through the sensor module (420), as described through operation 803 of FIG. 8. In this case, the processor (450) may activate a designated camera for the auto-framing function based on the electronic device (401) being folded at a designated angle, the magnitude of the movement of the electronic device (401) being less than or equal to the designated magnitude, and an object being detected in an image acquired through the camera module (430). When the designated camera is activated, the processor (450) may perform the auto-framing function based on an image acquired through the designated camera.

[0161] FIG. 11 is a flowchart (1100) for explaining a method of providing an auto-framing function according to one embodiment.

[0162] Referring to FIG. 11, in operation 1101, in one embodiment, the processor (450) may detect movement of the electronic device (401) through the sensor module (420) while the auto-framing function is being performed (e.g., after the auto-framing function is activated).

[0163] In one embodiment, the processor (450) may determine, through the sensor module (420), whether movement of an electronic device (401) having a size larger than a specified size (e.g., a threshold size) is detected while acquiring (e.g., generating) an image (e.g., a video) using an auto-framing function based on an image acquired through the camera module (430).

[0164] In operation 1103, the processor (450) may output information (e.g., a notification) indicating that movement of the electronic device (401) is detected. For example, when movement of the electronic device (401) having a size larger than a specified size is detected, the processor (450) may display information indicating that movement of the electronic device (401) having a size larger than a specified size is detected through the display module (410). For example, when movement of the electronic device (401) having a size larger than a specified size is detected, the processor (450) may output audio indicating that movement of the electronic device (401) having a size larger than a specified size is detected through a speaker. For example, when movement of an electronic device (401) having a size larger than a specified size is detected, the processor (450) may transmit information indicating that movement of the electronic device (401) having a size larger than a specified size is detected to an external electronic device (e.g., an external electronic device connected wirelessly or wiredly to the electronic device (401)) through a communication module of the electronic device (401).

[0165] In operation 1105, in one embodiment, the processor (450) may determine, based on user input, whether to disable the auto-framing feature.

[0166] In one embodiment, the processor (450) may obtain input from the user to select whether to activate (e.g., maintain the activated auto-framing function) or deactivate the auto-framing function after information indicating that movement of the electronic device (401) is detected is output.

[0167] In one embodiment, the processor (450) may deactivate the auto-framing function based on a user input received for deactivating the auto-framing function. For example, when a user input for deactivating the auto-framing function is received, the processor (450) may output information indicating that the auto-framing function will be deactivated. The processor (450) may deactivate the auto-framing function before, after, or simultaneously with outputting the information indicating that the auto-framing function will be deactivated. In one embodiment, the user input for deactivating the auto-framing function may include a user input input into the electronic device (401) or a user input input from an external electronic device when information indicating that movement of the electronic device (401) is detected is output through the external electronic device.

[0168] In one embodiment, while the auto-framing function is being performed, movement of the electronic device (401) may occur regardless of the user's intention. For example, the auto-framing function may be performed while the electronic device (401) is placed on an object (e.g., a desk). While the auto-framing function is being performed, movement of the electronic device (401) may occur if the object or electronic device (401) temporarily collides with a person (or object).

[0169] In one embodiment, while the auto-framing function is being performed, movement of the electronic device (401) may occur according to the user's intention. For example, if the auto-framing function is being performed while the electronic device (401) is placed on an object (e.g., a desk), and the user lifts the electronic device (401) by hand to continuously perform a camera function (e.g., a video function) while holding the electronic device (401) by hand, movement of the electronic device (401) may occur.

[0170] In one embodiment, the user's intention related to the movement of the electronic device (401) may be reflected by the processor (450) outputting information indicating that movement of the electronic device (401) has been detected and determining whether to disable the auto-framing function based on user input.

[0171] Although not illustrated in FIG. 11, in one embodiment, the processor (450) may determine, through the sensor module (420), while the auto-framing function is being performed, whether movement of the electronic device (401) having a size greater than a specified size (e.g., a threshold size) is detected for a specified period of time (e.g., more than a specified period of time). The processor (450) may deactivate the auto-framing function based on whether movement of the electronic device (401) having a size greater than the specified size is detected for the specified period of time. For example, if movement of the electronic device (401) having a size greater than the specified size is detected for the specified period of time, the processor (450) may deactivate the auto-framing function without performing an operation of outputting information indicating that movement of the electronic device (401) is detected and / or an operation of obtaining a user input for deactivating the auto-framing function. The processor (450) can maintain the activation of the auto-framing function if the time for which movement of an electronic device (401) having a size larger than a specified size is detected is less than a specified time.

[0172] FIG. 12 is a flowchart (1200) illustrating a method for activating an auto-framing function while a camera function is performed, according to one embodiment.

[0173] FIG. 13 is a diagram illustrating a method for activating an auto-framing function while a camera function is performed, according to one embodiment.

[0174] Referring to FIGS. 12 and 13, in operation 1201, in one embodiment, the processor (450) may acquire an image through the camera module (430). For example, the processor (450) may perform an operation of acquiring an image (e.g., a video) through the camera module (430) with the auto-framing function disabled.

[0175] In operation 1203, in one embodiment, the processor (450) may determine whether at least one first condition (hereinafter also referred to as “at least one first condition”) specified for activating the auto-framing function is satisfied while an image (e.g., a video) is being acquired.

[0176] In one embodiment, the processor (450) may determine that at least one first condition is satisfied when a second subject (e.g., a designated second subject) is newly recognized within the field of view of the camera module (430) while a first subject (e.g., a designated first subject) is recognized. For example, in reference numerals 1301 and 1302 of FIG. 13, reference numeral 1310 may indicate the field of view of the first camera, reference numeral 1320 may indicate the field of view of the second camera, and reference numeral 1330 may indicate a margin area (an area included in the field of view of the second camera (1320) but not included in the field of view of the first camera (1310).

[0177] In one embodiment, as illustrated at reference numeral 1301, at a first point in time, a first person (1341) may be located within a field of view area (1310) of a first camera, and a second person (1342) may be located outside a field of view area (1320) of a second camera.

[0178] In one embodiment, the processor (450) may recognize a first person (1341) (e.g., the full body of the first person (1341)) located within the field of view area (1310) of the first camera at a first point in time, based on an image acquired through the first camera.

[0179] In one embodiment, as illustrated in reference numeral 1302, at a second point in time after the first point in time, the first person (1341) may be positioned within the field of view area (1310) of the first camera, and the second person (1342) may move to be positioned within the field of view area (1320) of the second camera.

[0180] In one embodiment, the processor (450) may determine that the first condition is satisfied when, at a second point in time, a second person (1342) (e.g., the full body of the first person (1342)) is recognized, and a second person (1342) is newly recognized within the field of view (1320) of the second camera (or the field of view (1310) of the first camera).

[0181] However, the at least one first condition is not limited to, in one embodiment, when a second subject is newly recognized within the field of view of the camera module (430) in a state where a first subject is recognized. For example, the at least one first condition may include a case where, based on an image acquired through the camera module (430), a first subject (e.g., a first person) is recognized, and a speech of a second subject (e.g., a second person) located within the field of view of the camera module (430) is detected. For example, the at least one first condition may include a case where, based on an image acquired through the camera module (430), a first subject (e.g., a first person) is recognized, and a direction in which the gaze of the first subject is directed is detected toward a second subject (e.g., a second person) located within the field of view of the camera module (430). For example, at least one first condition may include a case where, based on an image acquired through the camera module (430), a first subject (e.g., a first person) is recognized, and movement of the first subject (e.g., a movement of the first subject moving within the field of view of the camera module (430)) is detected within the field of view of the camera module (430). For example, at least one first condition may include a case where, based on an image acquired through the camera module (430), a first subject (e.g., a first person) is recognized, and the first subject performs a specified motion (e.g., a dancing motion).

[0182] In one embodiment, the processor (450) may determine that at least one first condition is satisfied when at least one first condition includes a plurality of first conditions to activate the auto-framing function, and when one or more of the plurality of first conditions are satisfied.

[0183] In operation 1205, in one embodiment, the processor (450) may activate the auto-framing function if at least one first condition is satisfied in operation 1203.

[0184] In one embodiment, the processor (450) may continue to perform operation 1201 if at least one first condition is not satisfied in operation 1203.

[0185] In one embodiment, the processor (450) may activate a designated camera for the auto-framing function if at least one first condition is satisfied. For example, the processor (450) may switch the image acquisition from the first camera to the second camera if at least one first condition is satisfied.

[0186] In one embodiment, the processor (450) may perform an auto-framing function based on an image acquired through a designated camera. For example, the processor (450) may perform a zoom on the first person (1341) and the second person (1342) recognized in the field of view area (1320) of the second camera at reference numeral 1302, thereby cropping an area corresponding to a portion (1350) of the field of view area (1320) of the second camera, and displaying the cropped area through a display.

[0187] In one embodiment, the processor (450) may activate the auto-framing function when at least one first condition is satisfied and the electronic device (401) is in a folded state within a specified angular range.

[0188] In one embodiment, the processor (450) may activate the auto-framing function when at least one first condition is satisfied, the electronic device (401) is in a folded state within a specified angular range, and the magnitude of the movement of the electronic device (401) is less than or equal to a specified magnitude.

[0189] FIG. 14 is a flowchart (1400) illustrating a method for disabling an auto-framing function while the auto-framing function is being performed, according to one embodiment.

[0190] Referring to FIG. 14, in operation 1401, in one embodiment, the processor (450) may acquire an image through the camera module (430). For example, the processor (450) may acquire an image (e.g., a video) through the camera module (430) while the auto-framing function is activated (e.g., while the auto-framing function is being performed).

[0191] In operation 1403, in one embodiment, the processor (450) may determine whether at least one second condition (hereinafter also referred to as “at least one second condition”) is satisfied to disable the auto-framing function while the image is being acquired.

[0192] In one embodiment, the at least one second condition may include at least one of: when movement of the electronic device (401) having a size greater than a specified size is detected; when the electronic device (401) transitions from a folded state within a specified angular range to another state (e.g., a fully folded state (a first state), a state between a fully folded state and a state having a folding angle of about 20 degrees (a second state), a fully unfolded state (a fifth state), or a state between a fully folded state and a state having a folding angle of about 160 degrees (a fourth state)); when a specified time has passed since the recognized subject moved outside the field of view area of ​​the camera module (430) (e.g., the field of view area of ​​the second camera) (e.g., the recognized subject is not recognized for a specified time within the field of view area of ​​the camera module (430)); or when a value representing the degree of movement of the recognized subject (e.g., the moving speed of the subject) exceeds a threshold value at which subject recognition is possible (or a threshold value at which subject tracking is possible). there is.

[0193] In one embodiment, the processor (450) may determine that at least one second condition is satisfied when at least one of the plurality of second conditions is satisfied, in order to disable the auto-framing function, when the at least one second condition includes a plurality of second conditions.

[0194] In operation 1405, in one embodiment, the processor (450) may disable the auto-framing function if at least one second condition is satisfied in operation 1403.

[0195] In one embodiment, the processor (450) may continue to perform operation 1401 if at least one second condition is not satisfied in operation 1403.

[0196] FIG. 15 is a flowchart (1500) illustrating a method for providing an auto-framing function according to one embodiment.

[0197] FIG. 16 is a drawing (1600) for explaining a method for providing an auto-framing function according to one embodiment.

[0198] FIG. 17 is a drawing (1700) for explaining a method for providing an auto-framing function according to one embodiment.

[0199] Although methods for providing an auto-framing function in a flexible electronic device have been described with reference to FIGS. 3A to 14, the present invention is not limited thereto. Hereinafter, a method for providing an auto-framing function in an electronic device that is not a flexible electronic device (e.g., an electronic device that does not include a flexible display or a bar-type electronic device) will be described with reference to FIGS. 15 to 17.

[0200] Referring to FIGS. 15 to 17, in operation 1501, in one embodiment, the electronic device (101) (e.g., processor (120)) can determine, through a sensor module (176) (e.g., inertial sensor), whether the posture of the electronic device (101) is in a specified posture.

[0201] In one embodiment, the operation of determining whether the posture of the electronic device (101) is in a specified posture may include the operation of determining whether the direction in which the electronic device (101) is facing (e.g., the direction in which the front of the electronic device (101) or the center of the field of view of the camera module (180) is facing) is the same as the specified direction (or falls within a specified direction range).

[0202] In one embodiment, the specified direction may be a direction substantially perpendicular to the direction of gravity. For example, as illustrated in FIG. 16, when the electronic device (1601) is mounted on an object (e.g., a stand (1602)), the direction in which the electronic device (1601) faces may be a direction substantially perpendicular to the direction of gravity (e.g., the direction in which the -Y axis faces) (e.g., the direction in which the +Z axis faces).

[0203] In one embodiment, the specified direction range may range from a direction rotated clockwise by a specified angle relative to a direction perpendicular to the direction of gravity to a direction rotated counterclockwise by a specified angle relative to a direction perpendicular to the direction of gravity.

[0204] In one embodiment, the electronic device (1601) may execute a camera application based on an input (e.g., user input). The electronic device (1601) may display an execution screen of the camera application through the display module (1610) based on the execution of the camera application. While the camera application is executing, the electronic device (1601) may obtain an input (e.g., user input) for executing a video function. Based on the input for executing the video function, the electronic device (1601) may determine whether the posture of the electronic device (1601) is in a specified posture.

[0205] In one embodiment, the electronic device (1601) may further perform an operation of checking, through the sensor module, whether the magnitude of the movement of the electronic device (1601) is less than or equal to a specified magnitude.

[0206] In operation 1503, in one embodiment, the electronic device (101) (e.g., processor (120)) can determine whether an object (e.g., subjects (1611, 1612) of FIG. 16) is detected within an image acquired through the camera module.

[0207] Action 1503 is at least partially identical or similar to Action 503, so a detailed description thereof will be omitted.

[0208] In operation 1505, in one embodiment, the electronic device (101) (e.g., the processor (120)) may activate an auto-framing function based on the electronic device (101) being in a designated posture and an object being detected within an image acquired through the camera module (180).

[0209] Action 1505 is at least partially identical or similar to Action 505, so any overlapping description will be omitted.

[0210] In one embodiment, the electronic device (101) may activate the auto-framing function based on the direction in which the electronic device (101) is facing (e.g., the direction in which the front of the electronic device or the center of the field of view of the camera module is facing) being substantially the same as (or belonging to a specified direction range) a designated direction, and an object being detected within an image acquired through the camera module (180).

[0211] In one embodiment, the electronic device (101) may activate the auto-framing function based on the direction in which the electronic device is facing being substantially the same as the designated direction, the magnitude of the movement of the electronic device (101) being less than or equal to the designated magnitude, and an object being detected within an image acquired through the camera module (180).

[0212] In the examples described above, the auto-framing function is activated based on confirming that the posture of the electronic device (101) is in a specified posture, but is not limited thereto.

[0213] In one embodiment, the electronic device (101) (e.g., the processor (120)) may additionally or alternatively determine whether the electronic device (101) is mounted on an external electronic device, in addition to or in place of the operation of determining that the electronic device (101) is in a specified position. For example, as illustrated in FIG. 17, the electronic device (1701) may be mounted on an external electronic device (1702) placed on a desk surface (1720) (e.g., a stand capable of wirelessly charging the electronic device (1701) while the electronic device (1701) is mounted thereon). When the electronic device (1701) is mounted on the external electronic device (1702), the electronic device (1701) may be wirelessly (or wiredly) connected to the external electronic device (1702) via a communication module (e.g., a near field communication (NFC) communication module). The electronic device (1701) can determine that the electronic device (1701) is mounted on the external electronic device (1702) based on the establishment of a connection with the external electronic device (1702). The electronic device (1701) can activate the auto-framing function when the electronic device (1701) is mounted on the external electronic device (1702) and a subject (e.g., a subject corresponding to an object (1711) included in an image displayed through the display module (1710)) is recognized in an image acquired through the camera module (180) of the electronic device (1701).

[0214] An electronic device (401) according to one embodiment may include a housing including a first housing and a second housing, a hinge part that allows the first housing and the second housing to rotate, a first display (411) disposed in the first housing and the second housing, at least one camera (e.g., a camera module (430)), at least one sensor, at least one processor (450), and a memory (440) storing instructions. The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to determine, through the at least one sensor, whether the electronic device (401) is in a folded state within a specified angular range. The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to determine, through the at least one sensor, whether an object is detected within an image acquired through the at least one camera (e.g., the camera module (430)). The above instructions, when executed by the at least one processor (450), may cause the electronic device (401) to activate an auto-framing function based on the electronic device (401) being in a folded state within a specified angular range and the object being detected within the image.

[0215] In one embodiment, the instructions, when executed by the at least one processor (450), may cause the electronic device (401) to determine, via the at least one sensor, whether a magnitude of movement of the electronic device (401) is less than or equal to a specified magnitude. The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to activate an auto-framing function based on the electronic device (401) being in a folded state within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

[0216] In one embodiment, the instructions, when executed by the at least one processor (450), may cause the electronic device (401) to deactivate a shake correction function based on the electronic device (401) being in a folded state within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

[0217] In one embodiment, the at least one camera (e.g., camera module (430)) may include a first camera having a first angle of view and a second camera having a second angle of view larger than the size of the first angle of view. The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to switch a camera for acquiring an image from the first camera to the second camera based on the electronic device (401) being in a folded state within the specified angular range and the object being detected within the image.

[0218] In one embodiment, the electronic device (401) may further include a second display (412) disposed on a second side of the housing facing in a direction opposite to a direction in which the first side of the housing, in which the first display (411) is disposed, faces. The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to determine whether the electronic device (401) is operating in a specified mode, as at least part of an operation of determining whether the electronic device (401) is in a folded state within the specified angular range. The above-mentioned specified mode may include a first mode in which the electronic device (401) displays an image acquired through the at least one camera (e.g., camera module (430)) through the second display (412) while the electronic device (401) is folded within the specified angle range, or a second mode in which the electronic device (401) displays an image acquired through the at least one camera (e.g., camera module (430)) through the first display (411) while the electronic device (401) is folded within the specified angle range.

[0219] In one embodiment, the instructions, when executed by the at least one processor (450), may cause the electronic device (401) to detect movement of the electronic device (401) via the at least one sensor while the auto-framing function is performed. The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to output information indicating that movement of the electronic device (401) is detected based on the detected movement of the electronic device (401). The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to determine, after the information is output, whether to deactivate the auto-framing function based on a user input.

[0220] In one embodiment, the instructions, when executed by the at least one processor (450), may cause the electronic device (401) to detect movement of the electronic device (401) via the at least one sensor while the auto-framing function is performed. The instructions, when executed by the at least one processor (450), may cause the electronic device (401) to deactivate the auto-framing function based on detection of movement of the electronic device (401) having a size greater than or equal to a specified size for a specified period of time.

[0221] In one embodiment, the instructions, when executed by the at least one processor (450), may cause the electronic device (401) to determine whether at least one first condition specified for activating the auto-framing function is satisfied while acquiring an image through the at least one camera (e.g., camera module (430)). The at least one first condition may include at least one of: when a second subject is newly recognized within the field of view of the at least one camera (e.g., camera module (430)) in a state where the first subject is recognized; when an utterance of the second subject located within the field of view of the at least one camera (e.g., camera module (430)) is detected in a state where the first subject is recognized; when a direction in which the gaze of the first subject is directed toward the second subject is detected in a state where the first subject is recognized; when movement of the first subject is detected within the field of view of the at least one camera (e.g., camera module (430)) in a state where the first subject is recognized; or when the first subject performs a specified motion in a state where the first subject is recognized.

[0222] In one embodiment, the instructions, when executed by the at least one processor (450), may cause the electronic device (401) to determine whether at least one second condition specified for deactivating the auto-framing function is satisfied while the auto-framing function is performed. The at least one second condition may include at least one of: when movement of the electronic device (401) having a size greater than a specified size is detected; when the electronic device (401) is switched from a folded state to another state within a specified angular range; when a specified time has elapsed since the recognized subject moved outside the field of view of the at least one camera (e.g., camera module (430)); or when a value representing the degree of movement of the recognized subject exceeds a threshold value capable of subject recognition.

[0223] A method for providing an auto-framing function in an electronic device (401) according to one embodiment may include an operation of determining, through at least one sensor of the electronic device (401), whether the electronic device (401) is in a folded state within a specified angular range. The method may include an operation of determining, through at least one camera (e.g., a camera module (430)) of the electronic device (401), whether an object is detected within an image acquired. The method may include an operation of activating the auto-framing function based on the electronic device (401) being in a folded state within a specified angular range and the object being detected within the image.

[0224] In one embodiment, the method may further include an operation of determining, via the at least one sensor, whether a magnitude of movement of the electronic device (401) is less than or equal to a specified magnitude. The operation of activating the auto-framing function may include an operation of activating the auto-framing function based on the electronic device (401) being in a folded state within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

[0225] In one embodiment, the method may further include an action of deactivating a shake correction function based on the electronic device (401) being in a folded state within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

[0226] In one embodiment, the method may further include switching a camera for acquiring an image from a first camera to a second camera based on the electronic device (401) being in a folded state within the specified angular range and the object being detected within the image.

[0227] In one embodiment, the operation of determining whether the electronic device (401) is in a folded state within the specified angular range may include an operation of determining whether the electronic device (401) is operating in a specified mode. The specified mode may include a first mode in which the electronic device (401) displays an image acquired through the at least one camera (e.g., the camera module (430)) through the second display (412) while the electronic device (401) is folded within the specified angular range, or a second mode in which the electronic device (401) displays an image acquired through the at least one camera (e.g., the camera module (430)) through the first display (411) while the electronic device (401) is folded within the specified angular range.

[0228] In one embodiment, the method may further include an operation of detecting movement of the electronic device (401) through the at least one sensor while the auto-framing function is performed. The method may further include an operation of outputting information indicating that movement of the electronic device (401) is detected based on the detection of movement of the electronic device (401). The method may further include an operation of determining, after the information is output, whether to deactivate the auto-framing function based on a user input.

[0229] In one embodiment, the method may further include an operation of detecting movement of the electronic device (401) through the at least one sensor while the auto-framing function is performed. The method may further include an operation of deactivating the auto-framing function based on detection of movement of the electronic device (401) having a size greater than a specified size for a specified period of time.

[0230] In one embodiment, the method may further include an operation of determining whether at least one first condition specified for activating the auto-framing function is satisfied while acquiring an image through the at least one camera (e.g., camera module (430)). The at least one first condition may include at least one of: when a second subject is newly recognized within the field of view of the at least one camera (e.g., camera module (430)) in a state where the first subject is recognized; when an utterance of the second subject located within the field of view of the at least one camera (e.g., camera module (430)) is detected in a state where the first subject is recognized; when a direction in which the gaze of the first subject is directed toward the second subject is detected in a state where the first subject is recognized; when movement of the first subject is detected within the field of view of the at least one camera (e.g., camera module (430)) in a state where the first subject is recognized; or when the first subject performs a specified motion in a state where the first subject is recognized.

[0231] In one embodiment, the method may further include an operation of checking whether at least one second condition specified for deactivating the auto-framing function is satisfied while the auto-framing function is performed. The at least one second condition may include at least one of: when a movement of the electronic device (401) having a size larger than a specified size is detected; when the electronic device (401) is switched from a folded state within a specified angular range to another state; when a specified time has passed since the recognized subject moved outside the field of view of the at least one camera (e.g., the camera module (430)); or when a value representing the degree of movement of the recognized subject exceeds a threshold value capable of recognizing the subject.

[0232] An electronic device (101) according to one embodiment may include at least one camera (e.g., a camera module (180)), at least one sensor (e.g., a sensor module (176)), at least one processor (120), and a memory (130) storing instructions. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to determine, through the at least one sensor (176), whether a posture of the electronic device (101) is in a specified posture. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to determine, through the at least one camera (e.g., a camera module (180)), whether an object is detected in an image acquired through the at least one camera. The above commands, when executed by the at least one processor (120), may cause the electronic device (101) to activate an auto-framing function based on determining that the posture of the electronic device (101) is in the specified posture and that the object is detected within the image.

[0233] In one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device (101) to determine that the electronic device (101) is mounted on an external electronic device. The instructions, when executed by the at least one processor (120), may cause the electronic device (101) to activate an auto-framing function based on determining that the posture of the electronic device (101) is in the specified posture, determining that the electronic device (101) is mounted on an external electronic device, and detecting the object within the image.

[0234] Additionally, the structure of the data used in the embodiments of the present disclosure described above can be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).

Claims

1. In an electronic device (401), A housing comprising a first housing and a second housing; A hinge portion that allows the first housing and the second housing to rotate; A first display (411) arranged in the first housing and the second housing; At least one camera (430); At least one sensor (420); At least one processor (450); and Contains a memory (440) that stores commands, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: Through at least one sensor (420), it is determined whether the electronic device (401) is in a folded state within a specified angle range, Checking whether an object is detected in an image acquired through at least one camera (430), and An electronic device (401) that causes an auto framing function to be activated based on the electronic device (401) being folded within a specified angular range and the object being detected within the image.

2. In paragraph 1, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: Through at least one sensor (420), it is checked whether the size of the movement of the electronic device (401) is less than or equal to a specified size, An electronic device (401) that causes an auto-framing function to be activated based on the electronic device (401) being in a folded state within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

3. In paragraph 1 or 2, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: An electronic device (401) that causes a shake correction function to be deactivated based on the electronic device (401) being in a folded state within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

4. In any one of paragraphs 1 to 3, The at least one camera (430) includes a first camera having a first angle of view and a second camera having a second angle of view larger than the size of the first angle of view, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: An electronic device (401) configured to switch a camera for acquiring an image from the first camera to the second camera based on detection of the object within the image, wherein the electronic device (401) is in a folded state within the specified angular range.

5. In any one of paragraphs 1 to 4, It further includes a second display (412) arranged on a second surface of the housing facing in a direction opposite to the direction in which the first surface of the housing in which the first display (411) is arranged faces, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: As at least part of the operation of determining whether the electronic device (401) is in a folded state within the specified angular range, the electronic device (401) is configured to determine whether the electronic device (401) is operating in a specified mode, An electronic device (401) including a first mode in which the electronic device (401) displays an image acquired through the at least one camera (430) through the second display (412) in a state in which the electronic device (401) is folded in the specified angular range, or a second mode in which the electronic device (401) displays an image acquired through the at least one camera (430) through the first display (411) in a state in which the electronic device (401) is folded in the specified angular range.

6. In any one of paragraphs 1 to 5, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: While the above auto-framing function is performed, the movement of the electronic device (401) is detected through the at least one sensor (420), Based on the detection of movement of the electronic device (401), information indicating that movement of the electronic device (401) is detected is output, and An electronic device (401) that causes a user to determine whether to disable the auto-framing function based on user input after the above information is output.

7. In any one of paragraphs 1 to 6, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: While the above auto-framing function is performed, the movement of the electronic device (401) is detected through the at least one sensor (420), and An electronic device (401) that causes the auto-framing function to be deactivated based on detection of movement of the electronic device (401) having a size greater than a specified size for a specified period of time.

8. In any one of paragraphs 1 to 7, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: While acquiring an image through at least one camera (430), causing it to be checked whether at least one first condition specified for activating the auto-framing function is satisfied, At least one of the above first conditions is, When a second subject is newly recognized within the field of view of at least one camera (430) while the first subject is recognized, In the state where the first subject is recognized, if the ignition of the second subject located in the field of view area of ​​at least one camera (430) is detected, In a state where the first subject is recognized, if it is detected that the direction of the gaze of the first subject is directed toward the second subject, In a state where the first subject is recognized, if movement of the first subject is detected within the field of view area of ​​at least one camera (430), or An electronic device (401) comprising at least one of the cases in which the first subject performs a specified motion while the first subject is recognized.

9. In any one of paragraphs 1 to 8, The above instructions, when executed by the at least one processor (450), cause the electronic device (401) to: While the above auto-framing function is being performed, causing it to be checked whether at least one second condition specified for disabling the above auto-framing function is satisfied; At least one of the second conditions above is, If movement of the electronic device (401) having a size larger than the specified size is detected, When the above electronic device (401) is switched from a folded state to another state within a specified angle range, If a specified time has elapsed since the recognized subject has moved outside the field of view of at least one camera (430), or An electronic device (401) including at least one of the cases where a value representing the degree of movement of the recognized subject exceeds a threshold value capable of recognizing the subject.

10. A method for providing an auto-framing function in an electronic device (401), An operation of determining whether the electronic device (401) is in a folded state within a specified angle range through at least one sensor (420) of the electronic device (401); An operation of checking whether an object is detected in an image acquired through at least one camera (430) of the electronic device (401); and A method comprising: activating an auto-framing function based on the detection of an object within the image, wherein the electronic device (401) is in a folded state within a specified angular range.

11. In Article 10, Further comprising an operation of checking whether the size of the movement of the electronic device (401) is less than or equal to a specified size through at least one sensor (420). The action to activate the above auto framing function is: A method comprising: activating an auto-framing function based on the electronic device (401) being folded within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

12. In clause 10 or 11, A method further comprising an action of deactivating a shake correction function based on the electronic device (401) being folded within a specified angular range, the magnitude of the movement of the electronic device (401) being less than or equal to the specified magnitude, and the object being detected within the image.

13. In any one of paragraphs 10 to 12, A method further comprising: switching a camera for acquiring an image from a first camera to a second camera based on detection of an object within the image, wherein the electronic device (401) is in a folded state within the specified angular range.

14. In any one of paragraphs 10 to 13, The operation of checking whether the electronic device (401) is in a folded state within the specified angle range includes the operation of checking whether the electronic device (401) is operating in a specified mode. A method in which the above-mentioned specified mode includes a first mode in which the electronic device (401) displays an image acquired through the at least one camera (430) through the second display (412) in a state in which the electronic device (401) is folded in the above-mentioned specified angular range, or a second mode in which the electronic device (401) displays an image acquired through the at least one camera (430) through the first display (411) in a state in which the electronic device (401) is folded in the above-mentioned specified angular range.

15. In a non-transitory computer-readable medium having recorded thereon computer-executable instructions, the computer-executable instructions, when executed by at least one processor (450) of an electronic device (401), cause the electronic device (401) to: Through at least one sensor (420) of the electronic device (401), it is determined whether the electronic device (401) is in a folded state within a specified angle range, Checking whether an object is detected in an image acquired through at least one camera (430) of the electronic device (401), and A non-transitory computer-readable medium that causes the electronic device (401) to activate an auto-framing function based on detection of the object within the image while the electronic device (401) is in a folded state within a specified angular range.

Citation Information

Patent Citations

  • Image capture device

    JP2000138862A

  • Photographing control device, and photographing control method

    JP2011097502A

  • Digital camera

    JP2015012437A

  • Image capturing apparatus, method for capturing image, and non-transitory recordable medium

    KR1020160011533A

  • Method and apparatus for training models in machine translation, electronic device and storage medium

    KR102554758B1