Electronic device for providing camera preview image and operating method thereof
By integrating multiple cameras and displays in a foldable electronic device and using a processor to analyze the preview image to automatically select a camera, the problems of fixed field of view and inconvenient parameter setting are solved, and convenient preview image adjustment and shooting environment adaptation are achieved.
Patent Information
- Application Number
- CN202080056133.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-08-07
- Filing Date
- 2020-08-07
- Publication Date
- 2025-09-19
- Estimated Expiration
- 2040-08-07
AI Technical Summary
Since the display size of foldable electronic devices is fixed, the field of view of multiple cameras cannot be flexibly adjusted, making selfies and wide-angle shooting inconvenient. Users need to manually set photography-related parameters and there is a lack of a convenient automatic adjustment mechanism.
By integrating multiple cameras and displays in a foldable electronic device and using a processor and memory to analyze objects in the preview image, the appropriate camera is automatically selected to respond to the device folding or unfolding event and the preview image display settings are adjusted.
Implemented automatic adjustment of the preview image’s camera and display settings during folding or unfolding, providing a continuous camera environment tailored to the user’s shooting situation without requiring explicit user input.
Smart Images

Figure CN114208150B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an electronic device for providing a preview image of a camera in response to folding or unfolding a foldable device including a plurality of cameras, and an operating method thereof. Background Art
[0002] With the recent development of digital technology, various types of electronic devices such as mobile communication terminals, smart phones, tablet personal computers (PCs), personal digital assistants (PDAs), electronic notebooks, laptops, or wearable devices are widely used. Electronic devices have reached a mobile convergence stage that includes the functions of other devices. For example, an electronic device may provide a call function (such as voice call and video call), a message sending / receiving function (such as short message service (SMS) / multimedia message service (MMS) and email), an electronic notebook function, a photography function, a broadcast playback function, a video playback function, a music playback function, an Internet function, a messenger function, a game function, or a social network service (SNS) function.
[0003] In addition, the electronic device may include multiple cameras to meet various user needs related to photography functions, wherein the multiple cameras include at least one front camera and at least one rear camera. Summary of the Invention
[0004] Technical issues
[0005] Because such electronic devices include a single display of a fixed size, the fields of view of the multiple cameras are largely fixed. Consequently, it is inconvenient to provide additional equipment, such as a selfie stick, to capture more individuals or a wider landscape. However, even with additional equipment, capturing images with the camera itself is difficult. As the electronic device becomes further away, the size of the subject decreases compared to the fixed display size, making it difficult to accurately identify the subject's state while capturing it.
[0006] In addition, such an electronic device may be implemented as foldable. That is, the electronic device may be foldable based on a central area. An electronic device implemented as a foldable device (hereinafter, a foldable electronic device) may include more available surfaces than a non-foldable electronic device. Therefore, a foldable electronic device may include multiple cameras and multiple displays with different functions and performances. However, when taking photos using the multiple cameras and the multiple displays, even if the camera to be used for taking photos or the display for displaying the camera preview image is changed, the parameters related to photography (for example, field of view, resolution, aspect ratio) remain the same. That is, there is the inconvenience that the user needs to manually set (or change) the parameters related to photography. Therefore, it is necessary to provide the user with various services related to photography by using the folding (or unfolding) foldable electronic device as a trigger event even if there is no explicit user input for setting (or changing) functions or effects related to photography.
[0007] Solution to the problem
[0008] A foldable electronic device according to an embodiment of the present invention may include: multiple cameras, at least one display, at least one processor operably connected to the multiple cameras and the at least one display, and at least one memory operably connected to the at least one processor, and the at least one memory may store instructions, wherein the instructions, when executed, cause the at least one processor to perform the following operations: while a first preview image corresponding to a first camera among the multiple cameras is displayed on the at least one display, selecting at least one other camera based on an analysis result of at least one object included in the first preview image, displaying a second preview image corresponding to the selected at least one other camera in response to detecting that the electronic device is folded or unfolded, and obtaining a captured image based on the displayed second preview image.
[0009] A method for operating a foldable electronic device according to an embodiment of the present invention may include: while a first preview image corresponding to a first camera among multiple cameras of the electronic device is displayed on at least one display of the electronic device, selecting at least one other camera of the electronic device based on an analysis result of at least one object included in the first preview image, displaying a second preview image corresponding to the selected at least one other camera in response to detecting that the electronic device is folded or unfolded, and obtaining a captured image based on the displayed second preview image.
[0010] Beneficial effects of the present invention
[0011] According to an embodiment of the present invention, a foldable electronic device can change settings related to preview image display (e.g., the camera providing the preview image or the aspect ratio) in response to folding and / or unfolding the foldable electronic device in the camera preview state. Even without explicit input from the user, the foldable electronic device according to an embodiment of the present invention can select a camera for providing a preview image and, in response to folding and / or unfolding the foldable electronic device, provide a new preview image based on optimal setting values according to the usage of the foldable electronic device. Therefore, a continuous camera shooting environment suitable for the user's shooting situation can be provided. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 is a block diagram of an electronic device in a network environment according to an embodiment.
[0013] Figure 2 is a diagram illustrating a flat state of an electronic device according to an embodiment.
[0014] Figure 3 is a diagram illustrating a folded state of an electronic device according to an embodiment.
[0015] Figure 4 is an exploded perspective view of an electronic device according to an embodiment.
[0016] Figure 5 is a block diagram of an electronic device according to an embodiment.
[0017] Figure 6 An operation sequence of the electronic device according to the embodiment is shown.
[0018] Figure 7 is a detailed operation sequence of an electronic device for analyzing at least one object displayed in a first preview image and selecting at least one camera based on the analysis result according to an embodiment.
[0019] Figure 8 An example is shown in which the electronic device according to an embodiment analyzes at least one object displayed in a first preview image.
[0020] Figure 9 An operation sequence of the electronic device according to the embodiment is shown.
[0021] Figure 10 A detailed operation sequence of the electronic device for displaying a second preview image corresponding to a selected camera according to an embodiment is illustrated.
[0022] Figure 11 An electronic device according to an embodiment is shown.
[0023] Figure 12is a detailed operation sequence of an electronic device for analyzing at least one object displayed in a first preview image and selecting at least one camera based on the analysis result according to an embodiment.
[0024] Figure 13 An electronic device according to an embodiment is shown.
[0025] Figure 14 A detailed operation sequence of an electronic device for outputting a guidance notification according to an embodiment is illustrated.
[0026] Figure 15 An example in which the electronic device outputs a guidance notification according to an embodiment is shown.
[0027] Figure 16 An example in which the electronic device outputs a guidance notification according to an embodiment is shown.
[0028] Figure 17 A detailed operation sequence of an electronic device for outputting a guidance notification according to an embodiment is illustrated.
[0029] Figure 18 An example in which the electronic device outputs a guidance notification according to an embodiment is shown.
[0030] Figure 19 An operation sequence of the electronic device according to the embodiment is shown.
[0031] Regarding the description of the drawings, the same or similar drawing numbers may be used for the same or similar components. DETAILED DESCRIPTION
[0032] Figure 1 1 is a block diagram illustrating an electronic device 10 in a network environment 1 according to various embodiments. Figure 1, the electronic device 10 in the network environment 1 can communicate with the electronic device 12 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 14 or the server 18 via the second network 199 (e.g., a long-range wireless communication network). Depending on the embodiment, the electronic device 10 can communicate with the electronic device 14 via the server 18. Depending on the embodiment, the electronic device 10 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identification module (SIM) 196, or an antenna module 197. In various embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 10, or one or more other components may be added to the electronic device 10. In various embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).
[0033] The processor 120 may run, for example, software (e.g., program 141) to control at least one other component of the electronic device 10 (e.g., a hardware component or a software component) in conjunction with the processor 120, and may perform various data processing or calculations. According to an embodiment, as at least part of the data processing or calculation, the processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the commands or data stored in the volatile memory 132, and store the resulting data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent of or in conjunction with the main processor 121. Additionally or alternatively, the auxiliary processor 123 may be configured to consume less power than the main processor 121 or to be specifically configured for a designated function. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of the main processor 121 .
[0034] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (instead of the main processor 121) may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) among the components of the electronic device 10, or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) together with the main processor 121. Depending on the embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) that is functionally related to the auxiliary processor 123.
[0035] The memory 130 may store various data used by at least one component of the electronic device 10 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 141) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.
[0036] The program 141 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .
[0037] The input device 150 may receive commands or data from outside the electronic device 10 (e.g., a user) to be used by other components of the electronic device 10 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).
[0038] The sound output device 155 can output sound signals to the outside of the electronic device 10. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0039] The display device 160 can visually provide information to the outside of the electronic device 10 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. Depending on the embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit adapted to measure the strength of the force caused by the touch (e.g., a pressure sensor).
[0040] The audio module 170 can convert sound into an electrical signal, and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 12) directly (e.g., wired) or wirelessly coupled to the electronic device 10.
[0041] The sensor module 176 can detect the operating state of the electronic device 10 (e.g., power or temperature) or the environmental state outside the electronic device 10 (e.g., the state of the user), and then generate an electrical signal or data value corresponding to the detected state. Depending on the embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0042] The interface 177 may support one or more specific protocols for connecting the electronic device 10 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 12). Depending on the embodiment, the interface 177 may include, for example, a High-Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.
[0043] The connection end 178 may include a connector, wherein the electronic device 10 can be physically connected to an external electronic device (e.g., the electronic device 12) via the connector. Depending on the embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0044] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
[0045] The camera module 180 may capture still images or moving images. Depending on the embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
[0046] The power management module 188 may manage power supply to the electronic device 10. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0047] The battery 189 may power at least one component of the electronic device 10. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0048] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 10 and an external electronic device (e.g., electronic device 12, electronic device 14, or server 18), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate via a first network 198 (e.g., a short-range communication network such as Bluetooth TM , Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-distance communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN)))) to communicate with an external electronic device. These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 may identify and authenticate the electronic device 10 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.
[0049] Antenna module 197 can transmit or receive signals or power to or from the outside of electronic device 10 (e.g., an external electronic device). Depending on the embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a PCB). Depending on the embodiment, antenna module 197 may include multiple antennas. In this case, at least one antenna suitable for the communication scheme used in a communication network (such as first network 198 or second network 199) may be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. Depending on the embodiment, additional components other than the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may also be formed as part of antenna module 197.
[0050] At least some of the above components may be coupled to each other via an inter-peripheral communication scheme (e.g., a bus, general purpose input output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.
[0051] According to an embodiment, commands or data may be sent or received between electronic device 10 and external electronic device 14 via server 18 coupled to second network 199. Each of electronic device 12 and electronic device 14 may be of the same type as electronic device 10, or a different type. According to an embodiment, all or some operations to be executed on electronic device 10 may be executed on one or more of external electronic device 12, external electronic device 14, or server 18. For example, if electronic device 10 is to automatically execute a function or service or to execute a function or service in response to a request from a user or another device, electronic device 10 may request one or more external electronic devices to execute at least part of the function or service instead of, or in addition to, executing the function or service. Upon receiving the request, the one or more external electronic devices may execute the requested at least part of the function or service, or execute another function or service related to the request, and transmit the results of the execution to electronic device 10. The electronic device 10 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology, or client-server computing technology may be used, for example.
[0052] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a home appliance, etc. According to an embodiment of the present disclosure, the electronic device is not limited to those described above.
[0053] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but rather include various changes, equivalents or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the project may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding phrases in the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish a corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., a second element)”, “combined to another element (e.g., a second element)”, “connected with another element (e.g., a second element)”, or “connected to another element (e.g., a second element)”, when the term “operably” or “communicatively” is used or when the term “operably” or “communicatively” is not used, it means that the element can be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.
[0054] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or the smallest unit or portion of the single integrated component. For example, depending on an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0055] The various embodiments described herein can be implemented as software (e.g., program 141) comprising one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 10). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 10) can call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to be operable to perform at least one function according to the called at least one instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium can be provided in the form of a non-transitory storage medium. Here, a "non-transitory" storage medium is a tangible device and may not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.
[0056] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store). TM ) The computer program product may be published online (e.g., downloaded or uploaded) or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smartphones). If published online, at least part of the computer program product may be temporarily generated or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).
[0057] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as a corresponding one of the multiple components performed one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.
[0058] Reference Figure 2 and Figure 3 In an embodiment, the electronic device 10 may include a foldable housing 500, a hinge cover 530, and a flexible or foldable display 552, wherein the hinge cover 530 covers the foldable portion of the foldable housing 500, and the flexible or foldable display 552 (hereinafter referred to as the second display) is arranged in the space formed by the foldable housing 500. In this document, the surface on which the second display 552 is arranged is defined as the first surface or front surface of the electronic device 10. The surface opposite to the front surface is defined as the second surface or rear surface of the electronic device 10. In addition, the surface around the space between the front surface and the rear surface is defined as the third surface or side surface of the electronic device 10. The electronic device 10 can be used with Figure 1 The electronic device 10 disclosed in the embodiment corresponds to the embodiment of the present invention.
[0059] In an embodiment, the foldable housing 500 may include a first housing structure 510, a second housing structure 520 including a sensor area 524, a first back cover 580, and a second back cover 590. The foldable housing 500 of the electronic device 10 is not limited to Figure 2 and Figure 3 The shapes and combinations shown in , and may be implemented by other shapes or combinations and / or combinations of components. For example, in an embodiment, the first housing structure 510 and the first back cover 580 may be integrally formed, and the second housing structure 520 and the second back cover 590 may be integrally formed.
[0060] In the illustrated embodiment, the first housing structure 510 and the second housing structure 520 may be arranged on both sides of the folding axis (axis A) and may have shapes that are symmetrical overall with respect to the folding axis A. Depending on whether the state of the electronic device 10 is a flat state, a folded state, or an intermediate state to be explained, the first housing structure 510 and the second housing structure 520 may have different angles or distances. In the illustrated embodiment, unlike the first housing structure 510, the second housing structure 520 may also include a sensor area 524 in which various sensors are arranged. In embodiments, the second housing structure 520 and the first housing structure 510 may have mutually symmetrical shapes in areas other than the sensor area 524.
[0061] In an embodiment, Figure 2 As shown in FIG, the first housing structure 510 and the second housing structure 520 may together form a recess for accommodating the second display 552. In the embodiment shown, due to the sensor area 524, the recess may have two or more different widths in a direction perpendicular to the folding axis A.
[0062] For example, the recess may have (1) a first width w1 between a first portion 510a of the first housing structure 510 parallel to the folding axis A and a first portion 520a of the second housing structure 520 formed at an edge of the sensor region 524, and (2) a second width w2 formed by the second portion 510b of the first housing structure 510 and the second portion 520b of the second housing structure 520 that does not correspond to the sensor region 524 and is parallel to the folding axis A. In this case, the second width w2 may be formed to be longer than the first width w1. In other words, the first portion 510a of the first housing structure 510 and the first portion 520a of the second housing structure 520 having an asymmetric shape may form the first width w1 of the recess, and the second portion 510b of the first housing structure 510 and the second portion 520b of the second housing structure 520 having a symmetric shape may form the second width w2 of the recess. In an embodiment, the first portion 520a and the second portion 520b of the second housing structure 520 may be at different distances from the folding axis A. The width of the recess is not limited to the example shown. In various embodiments, the recess may have multiple widths based on the shape of the sensor region 524 or based on portions of the first and second housing structures 510 and 520 having asymmetrical shapes.
[0063] In an embodiment, at least a portion of the first housing structure 510 and the second housing structure 520 may be formed of a metallic material or a non-metallic material having a rigidity selected to a size for supporting the second display 552 .
[0064] In an embodiment, the sensor area 524 may be formed to have a designated area adjacent to one corner of the second housing structure 520. However, the arrangement, shape, and size of the sensor area 524 are not limited to the illustrated example. For example, in another embodiment, the sensor area 524 may be located at another corner of the second housing structure 520, or at any area between the upper and lower corners. In an embodiment, components embedded in the electronic device 10 for performing various functions may be exposed to the front surface of the electronic device 10 through the sensor area 524 or through one or more openings provided in the sensor area 524. In an embodiment, the components may include various sensors. The sensors may include, for example, at least one of a front-facing camera, a receiver, or a proximity sensor. The front-facing camera may correspond to at least one of the second front-facing camera 542 and the third front-facing camera 543. In an embodiment, the front-facing camera may further include a fourth front-facing camera (not shown), wherein the fourth front-facing camera (not shown) is a camera for applying special effects to captured images. For example, the fourth front-facing camera (not shown) may be a camera for applying special effects (e.g., defocus, telephoto, blur) to captured images.
[0065] The first rear cover 580 may be arranged on one side of the folding axis on the rear surface of the electronic device 10 and may have, for example, a substantially rectangular edge, and the edge may be surrounded by the first housing structure 510. Similarly, the second rear cover 590 may be arranged on the other side of the folding axis on the rear surface of the electronic device 10, and the edge of the second rear cover 590 may be surrounded by the second housing structure 520.
[0066] In the illustrated embodiment, the first rear cover 580 and the second rear cover 590 may have shapes that are substantially symmetrical about the folding axis (axis A). However, this is merely an example, and the first rear cover 580 and the second rear cover 590 do not necessarily have symmetrical shapes. In embodiments, the electronic device 10 may include first and second rear covers 580, 590 of various shapes. In embodiments, the first rear cover 580 may be integrally formed with the first housing structure 510, and the second rear cover 590 may be integrally formed with the second housing structure 520.
[0067] In an embodiment, the first rear cover 580, the second rear cover 590, the first housing structure 510, and the second housing structure 520 may form a space for mounting various components of the electronic device 10 (e.g., a printed circuit board or a battery). In an embodiment, one or more components may be arranged on the rear surface of the electronic device 10 or visually exposed to the rear surface of the electronic device 10. For example, at least a portion of at least one front camera (e.g., the first front camera 541) may be visually exposed in the first rear cover 580. For example, at least a portion of the first display 551 may be visually exposed through the first rear area 582 of the first rear cover 580. In an embodiment, one or more components or sensors may be visually exposed through the second rear area 592 of the second rear cover 590. In an embodiment, the sensor may include a proximity sensor and / or a rear camera. The rear camera may correspond to at least one of the first rear camera 341, the second rear camera 342, and the third rear camera 343. In an embodiment, the rear camera may further include a fourth rear camera (not shown), wherein the fourth rear camera (not shown) is a camera for applying special effects to captured images. For example, the fourth rear camera (not shown) may be a camera for applying special effects (e.g., defocus or out-of-focus, telephoto, blur) to captured images.
[0068] In an embodiment, the first front camera 541 may support a first field of view (or correspond to a first field of view). The first field of view may be a field of view for displaying a preview image in a normal mode. The first field of view may correspond to a range of 40 degrees to 60 degrees.
[0069] In an embodiment, the second front camera 542 and the third front camera 543 may correspond to different functions or performances, and may have higher specifications than the first front camera 541. For example, the second front camera 542 may correspond to (or support) a second field of view range (e.g., 60 degrees to 90 degrees), the third front camera 543 may correspond to a third field of view range (90 degrees to 180 degrees), and the second and third field of view ranges may be wider than the first field of view range corresponding to the first front camera 541. The third field of view range may be a field of view range wider than the second field of view range. As another example, the second front camera 542 and the third front camera 543 may support a higher resolution than the first front camera 541.
[0070] In an embodiment, the first rear camera 341, the second rear camera 342, and the third rear camera 343 may correspond to different functions or capabilities. For example, the first rear camera 341 may correspond to (or support) a second field of view range, and the second rear camera 342 may correspond to a first field of view range, wherein the first field of view range is narrower than the second field of view range, and the first field of view range may correspond to a telephoto or close-up mode. The third rear camera 343 may correspond to a third field of view range, wherein the third field of view range is wider than the second field of view range.
[0071] In an embodiment, the second field of view range corresponding to the first rear camera 341 may correspond to a field of view range for displaying a preview image in a wide-angle mode.
[0072] In an embodiment, the second rear camera 342 may correspond to a telephoto camera for zooming in and capturing a subject.
[0073] In an embodiment, the third field of view range corresponding to the third rear camera 343 may correspond to a field of view range for displaying a preview image in an ultra-wide-angle mode.
[0074] Reference Figure 3 The hinge cover 530 may be disposed between the first housing structure 510 and the second housing structure 520 and configured to cover internal components (e.g., the hinge structure). In an embodiment, depending on the state of the electronic device 10 (flat state or folded state), the hinge cover 530 may be covered by a portion of the first housing structure 510 and a portion of the second housing structure 520, or exposed to the outside.
[0075] For example, if the electronic device 10 is in Figure 2 , the hinge cover 530 may be covered by the first housing structure 510 and the second housing structure 520 without being exposed. Figure 3 folded state (e.g., fully folded state) shown in FIG, the hinge cover 530 may be exposed to the outside between the first housing structure 510 and the second housing structure 520. For example, if the first housing structure 510 and the second housing structure 520 are folded at a certain angle in the intermediate state, the hinge cover 530 may be partially exposed to the outside between the first housing structure 510 and the second housing structure 520. However, in this case, the exposed area may be smaller than in the fully folded state. In an embodiment, the hinge cover 530 may include a curved surface.
[0076] The second display 552 may be disposed on a space formed by the foldable housing 500. For example, the second display 552 may be mounted on a recess formed by the foldable housing 500 and constitute most of the front surface of the electronic device 10.
[0077] Therefore, the front surface of the electronic device 10 may include the second display 552, some areas of the first housing structure 510 adjacent to the second display 552, and some areas of the second housing structure 520 adjacent to the second display 552. The rear surface of the electronic device 10 may include the first back cover 580, some areas of the first housing structure 510 adjacent to the first back cover 580, the second back cover 590, and some areas of the second housing structure 520 adjacent to the second back cover 590.
[0078] The second display 552 may represent a display in which at least some areas can be transformed into a flat surface or a curved surface. In an embodiment, the second display 552 may include a folding area 103, a display arranged on one side ( Figure 2 The first area 101 on the left side of the folding area 103 shown in FIG) and the first area 101 arranged on the other side ( Figure 2 The second area 102 is on the right side of the folding area 103 shown in FIG.
[0079] exist Figure 2 The area division of the second display 552 shown in FIG is only an example, and the second display 552 may be divided into a plurality of (eg, four or more, or two) areas according to its structure or function. Figure 2 In the embodiment shown in , the area of the second display 552 may be divided by the folding area 103 or the folding axis (axis A) extending parallel to the y-axis, but in an embodiment, the second display 552 may be divided based on another folding area (e.g., a folding area parallel to the x-axis) or another folding axis (e.g., a folding axis parallel to the x-axis).
[0080] The first region 101 and the second region 102 may have shapes that are symmetrical overall based on the folding region 103. However, unlike the first region 101, the second region 102 may include a notch cut out according to the presence of the sensor region 524, but may have shapes symmetrical to the first region 101 in other regions. In other words, the first region 101 and the second region 102 may include portions having symmetrical shapes and portions having asymmetrical shapes.
[0081] Hereinafter, operations of each area of the first and second case structures 510 and 520 and the second display 552 are described according to states (eg, a flat state and a folded state) of the electronic device 10 .
[0082] In an embodiment, if the electronic device 10 is in a flat state (eg, Figure 2), the first housing structure 510 and the second housing structure 520 can be arranged to form a 180-degree angle and face the same direction. The surface of the first region 101 and the surface of the second region 102 of the second display 552 can form a 180-degree angle and face the same direction (for example, the front direction of the electronic device). The folding region 103 can form the same plane as the first region 101 and the second region 102.
[0083] In an embodiment, if the electronic device 10 is in a folded state (eg, Figure 3 ), the first housing structure 510 and the second housing structure 520 may be arranged to face each other. The surface of the first region 101 and the surface of the second region 102 of the second display 552 may form a narrow angle (e.g., between 0 and 10 degrees) and face each other. At least a portion of the folding region 103 may be formed as a curved surface having a specified curvature.
[0084] In an embodiment, when the electronic device 10 is in an intermediate state, the first housing structure 510 and the second housing structure 520 may be arranged at a certain angle. The surface of the first area 101 and the surface of the second area 102 of the second display 552 may form an angle greater than that in the folded state and less than that in the flat state. At least a portion of the folding area 103 may be formed as a curved surface having a specified curvature, wherein the curvature may be less than that in the folded state.
[0085] Figure 4 is an exploded perspective view of an electronic device according to various embodiments.
[0086] Reference Figure 4 In an embodiment, the electronic device 10 may include a display unit 20, a bracket assembly 30, a substrate unit 600, a first housing structure 510, a second housing structure 520, a first back cover 580, and a second back cover 590. In this document, the display unit 20 may be referred to as a display module or a display assembly.
[0087] The display unit 20 may include a second display 552 and one or more boards or layers 140 on which the second display 552 is mounted. In an embodiment, the board 140 may be disposed between the second display 552 and the support assembly 30. The second display 552 may be disposed on one surface of the board 140 (e.g., based on a Figure 3 The board 140 may be formed in a shape corresponding to the second display 552. For example, some areas of the board 140 may be formed in a shape corresponding to the notch 104 of the second display 552.
[0088] The bracket assembly 30 may include a first bracket 410, a second bracket 420, a hinge structure arranged between the first bracket 410 and the second bracket 420, a hinge cover 530 for covering the hinge structure when viewed from the outside, and a wiring member 430 (e.g., a flexible printed circuit (FPC)) that crosses the first bracket 410 and the second bracket 420.
[0089] In an embodiment, the bracket assembly 30 may be disposed between the board 140 and the substrate unit 600. For example, the first bracket 410 may be disposed between the first area 101 of the second display 552 and the first substrate 610. The second bracket 420 may be disposed between the second area 102 of the second display 552 and the second substrate 620.
[0090] In an embodiment, the wiring member 430 and at least a portion of the hinge structure 300 may be disposed within the bracket assembly 30. The wiring member 430 may be disposed in a direction intersecting the first bracket 410 and the second bracket 420 (e.g., in the x-axis direction). The wiring member 430 may be disposed in a direction intersecting the first bracket 410 and the second bracket 420 (e.g., in the x-axis direction). Figure 1 The y-axis or folding axis A) is arranged perpendicular to the direction (e.g., the x-axis direction).
[0091] As described above, the substrate unit 600 may include a first substrate 610 disposed on the first bracket 410 and a second substrate 620 disposed on the second bracket 420. The first substrate 610 and the second substrate 620 may be disposed in a space formed by the bracket assembly 30, the first housing structure 510, the second housing structure 520, the first back cover 580, and the second back cover 590. Components for implementing various functions of the electronic device 10 may be mounted on the first substrate 610 and the second substrate 620.
[0092] While the display unit 20 is coupled to the bracket assembly 30, the first housing structure 510 and the second housing structure 520 may be assembled to be coupled to both sides of the bracket assembly 30. As will be described later, the first housing structure 510 and the second housing structure 520 may slide on both sides of the bracket assembly 30 to be coupled thereto.
[0093] In an embodiment, the first housing structure 510 may include a first rotation support surface 512, and the second housing structure 520 may include a second rotation support surface 522 corresponding to the first rotation support surface 512. The first rotation support surface 512 and the second rotation support surface 522 may include curved surfaces corresponding to the curved surface included in the hinge cover 530.
[0094] In an embodiment, if the electronic device 10 (eg, Figure 1) is in a flat state, the first rotation support surface 512 and the second rotation support surface 522 may cover the hinge cover 530 so as not to expose the hinge cover 530 to the rear surface of the electronic device 10 or to minimize the exposure of the hinge cover 530. In addition, if the electronic device 10 is in a folded state (e.g., Figure 2 ), the first rotation support surface 512 and the second rotation support surface 522 can rotate along the curved surface included in the hinge cover 530 to expose the hinge cover 530 to the rear surface of the electronic device 10 to the greatest extent.
[0095] Figure 5 is a block diagram of an electronic device 10 according to an embodiment of the present invention.
[0096] Reference Figure 5 , the electronic device 10 may include a processor 120, a communication module 190, a memory 130, an input device 150, a first display 551, a second display 552, and first to Nth cameras 561 to 569. In an embodiment, N may be a natural number equal to or greater than 3.
[0097] In an embodiment, the processor 120 may control at least one component included in the electronic device 10. For example, the processor 120 may control the first display 551 to display a first preview image corresponding to the first camera 561. For example, the processor 120 may analyze at least one object included in the first preview image.
[0098] In an embodiment, the processor 120 may include an image analysis module 525 and a camera module 526. In an embodiment, the processor 120 may execute the image analysis module 525 and the camera module 526. In an embodiment, the processor 120 may control at least one component included in the electronic device 10 through the image analysis module 525 and the camera module 526. In an embodiment, the image analysis module 525 and the camera module 526 may be implemented as physical circuits or software programs.
[0099] In an embodiment, the image analysis module 525 may analyze at least one object included in a preview image (e.g., the first preview image) displayed on a display (e.g., the first display 551). In an embodiment, when analyzing the at least one object, the image analysis module 525 may determine characteristic information of the at least one object (e.g., size, color, shape, shadow, geometric characteristics, motion information, or movement direction information). In an embodiment, when analyzing the at least one object, the image analysis module 525 may determine the type of the at least one object (e.g., a person, an animal, a building, or food). The characteristic information of the at least one object may be used to determine the type of the at least one object.
[0100] In an embodiment, the object analysis result information generated at the image analysis module 525 may be provided to the camera module 526 .
[0101] In an embodiment, the camera module 526 may process camera preview image data input from the first camera 561 to the Nth camera 569. For example, the camera module 526 may forward the first preview image data input from the first camera 561 to the image analysis module 525, or receive object analysis result information from the image analysis module 525. For example, the camera module 526 may control the first display 551 corresponding to the first camera 561 to display the first preview image input from the first camera 561.
[0102] In an embodiment, based on the object analysis result information received from the image analysis module 525, the camera module 526 may select at least one camera (e.g., the second camera 562) to be activated in response to the electronic device 10 being folded and / or unfolded. In an embodiment, the camera module 526 may forward the object analysis result information received from the image analysis module 525 (or information generated by processing the object analysis result information) to the selected at least one camera. In an embodiment, the camera module 526 may provide information to the selected at least one camera if a specified condition is met. In an embodiment, the specified condition may be activation of the selected at least one camera (e.g., the second camera 562). In an embodiment, the specified condition may be detection of folding the electronic device 10 or detection of unfolding the electronic device 10. In an embodiment, if the selected at least one camera (e.g., the second camera 562) is activated (e.g., if folding and / or unfolding of the electronic device 10 is detected), the camera module 526 may forward the object analysis result information received from the image analysis module 525 or information generated by processing the object analysis result information to the selected at least one camera. The activated at least one camera may recognize at least one subject using information from the camera module 526. By using the information from the camera module 526, the activated at least one camera may recognize at least one subject faster than without using the information.
[0103] In an embodiment, the first camera 561 to the Nth camera 569 may include a plurality of cameras included in the electronic device 10. For example, the first camera 561 may be connected to the Figure 2 The first front camera 541 disclosed in FIG. 5 corresponds to the first front camera 541, and the second camera 562 and the third camera (not shown) can be used with the Figure 2 The second front camera 542 and the third front camera 543 disclosed in FIG respectively correspond to each other. However, this is only an example, and the first camera 561, the second camera 562 and the third camera (not shown) may be the same as those disclosed in FIG. Figure 3The first rear camera 341, the second rear camera 342 and the third rear camera 343 shown in FIG correspond respectively.
[0104] In an embodiment, at least one camera (e.g., the first camera 561) among the first to N-th cameras 561 to 569 may correspond to the first display 551, and at least another camera (e.g., the second camera 562 and the third camera (not shown)) may correspond to the second display 552. For example, a preview image of the first camera 561 may be displayed on the first display 551, and a preview image of the second camera 562 or the third camera (not shown) may be displayed on the second display 552.
[0105] In an embodiment, the first to N-th cameras 561 to 569 may support different field of view ranges. However, this is merely an example, and at least two cameras among the first to N-th cameras 561 to 569 may support the same field of view range.
[0106] In an embodiment, the first camera 561 may support a first field of view range. In an embodiment, the second camera 562 may support a second field of view range. In an embodiment, the third camera (not shown) may support a third field of view range.
[0107] In an embodiment, the first field of view range may be a viewing angle range for displaying a preview image in normal mode. In an embodiment, the second field of view range may be a viewing angle range for displaying a preview image in wide-angle mode. In an embodiment, the third field of view range may be a viewing angle range for displaying a preview image in ultra-wide-angle mode. In an embodiment, the first field of view range may be in a range of 40 to 60 degrees (°). In an embodiment, the second field of view range may be in a range of 60 to 90 degrees (°). In an embodiment, the third field of view range may be in a range of 90 to 180 degrees (°).
[0108] In an embodiment, the first to N-th cameras 561 to 569 may have different resolutions. However, this is merely an example, and at least two cameras among the first to N-th cameras 561 to 569 may have the same resolution.
[0109] In an embodiment, the first display 551 and the second display 552 may display content, such as an application execution screen, an image (eg, a preview image of a camera), a video, a call / message notification, etc.
[0110] In an embodiment, the first display 551 may have a vertical length longer than a horizontal length. Therefore, even if preview images corresponding to the same camera are displayed based on an aspect ratio in which the horizontal length is longer than the vertical length, margins may be increased compared to the opposite case.
[0111] In an embodiment, the second display 552 may have a horizontal length longer than a vertical length. Therefore, even if a preview image corresponding to the same camera is displayed based on an aspect ratio in which the vertical length is longer than the horizontal length, the margins may be increased compared to the opposite case.
[0112] In an embodiment, the memory 130 may store instructions for the electronic device 10 to perform one or more operations according to an embodiment of the present invention under the control of the processor 120. For example, the memory 130 may store instructions for causing the processor 120 to select at least one camera based on the analysis result of at least one object displayed in the first preview image.
[0113] In an embodiment, the memory 130 may store user history data or user preference information related to camera shooting.
[0114] In an embodiment, the input device 150 may be used to receive user input for the electronic device 10. For example, the input device 150 may include a physical user interface such as a button. Through the input device 150, the electronic device 10 may receive user input for obtaining a captured image and user input for switching a camera or display.
[0115] In an embodiment, the sensor module 176 may be disposed within the foldable housing 500 or the hinged cover 530. In an embodiment, the sensor module 176 may include at least one of an angle sensor, a gyroscope sensor, an acceleration sensor, and a grip sensor. In an embodiment, sensor information from the sensor module 176 may be used by the processor 120 to identify whether the current state of the electronic device 10 corresponds to the flat state, the folded state, or an intermediate state, or to detect a state change of the electronic device 10 (e.g., folding (changing from the flat state to the folded state) or unfolding (changing from the folded state to the flat state)).
[0116] The sensor module 176 may provide sensor information for detecting folding or unfolding of the electronic device 10 to the processor 120 periodically or when an event occurs.
[0117] Figure 6 FIG. 1 shows an operation sequence of an electronic device (eg, electronic device 10) according to an embodiment of the present invention. Figures 1 to 5 The components of the electronic device 10 are described Figure 6 .
[0118] exist Figure 6 The operations disclosed in the Figure 5 The following describes how the electronic device 10 performs the following operations under the control of the processor 120. Figure 6 The operations disclosed in .
[0119] In operation 610, the electronic device 10 may display a first preview image. In an embodiment, the electronic device 10 displaying the first preview image may be in a folded (eg, folded inward) state.
[0120] In an embodiment, the first preview image may be a preview image corresponding to a first front camera (e.g., first front camera 541). The electronic device 10 may display the first preview image on a first display 551 corresponding to the first front camera 541. The first front camera 541 may correspond to a first field of view.
[0121] In an embodiment, the first preview image may be a preview image corresponding to the first rear camera (e.g., the first rear camera 341). The electronic device 10 may display the first preview image on the first display 551 corresponding to the first rear camera 341. The first rear camera 341 may correspond to the second field of view range.
[0122] At operation 620, the electronic device 10 may analyze at least one object displayed in the first preview image. The electronic device 10 may analyze the at least one object by performing a scene recognition function (e.g., a facial recognition function). When analyzing the at least one object, the electronic device 10 may determine characteristic information of the at least one object (e.g., size, color, shape, shadow, and geometric characteristics). When analyzing the at least one object, the electronic device 10 may determine the type of the at least one object (e.g., a person, an animal, a building, or food) based on the determined characteristic information.
[0123] In operation 630 , the electronic device 10 may select at least one camera based on the analysis result.
[0124] In an embodiment, the electronic device 10 may select at least one camera among all cameras included in the electronic device 10 .
[0125] In an embodiment, the electronic device 10 may select at least one camera among other cameras except a camera corresponding to a preview image currently being displayed (eg, the first front camera 541 ).
[0126] In an embodiment, if the camera corresponding to the currently displayed preview image is a front camera, at least one camera may be selected from other front cameras, and if the camera corresponding to the currently displayed preview image is a rear camera, at least one camera may be selected from other rear cameras.
[0127] In an embodiment, the electronic device 10 may select at least one camera by considering the current folding state of the electronic device 10. For example, if the electronic device 10 is currently in the folded state and is to be unfolded, the electronic device 10 may select at least one camera from cameras that can be effectively used for photography (e.g., the second front camera 542 and the third front camera 543). For example, if the electronic device 10 is currently in the flat state and is to be folded, the electronic device 10 may select at least one camera from cameras that can be effectively used for photography (e.g., the first front camera 541).
[0128] The electronic device 10 may also select at least one camera based on display properties (eg, display size and supported resolutions).
[0129] The at least one camera selected in operation 630 may be activated in response to folding / unfolding the electronic device 10. For example, if the second front camera 542 is selected in operation 630, the electronic device 10 may activate the selected second front camera 542 in response to unfolding the electronic device 10 and display a preview image of the selected second front camera 542.
[0130] In operation 640, the electronic device 10 may identify whether folding or unfolding of the electronic device 10 is detected. For example, the electronic device 10 may identify that the folded electronic device 10 is detected by identifying that the state of the electronic device 10 is changed from a flat state (or an intermediate state) to a folded state. For example, by identifying that the state of the electronic device 10 is changed from a folded state to a flat state, it may be identified that the unfolded electronic device 10 is detected. The electronic device 10 may use the sensor information of the sensor module 176 to identify whether folding or unfolding is detected. In an embodiment, the electronic device 10 may identify a state change of the electronic device 10. In an embodiment, the electronic device 10 may identify a state change of the electronic device 10 from a first state (e.g., a folded state) to a state other than the first state (e.g., an intermediate state or a flat state). In an embodiment, if a change in the folding state of the electronic device 10 is identified, the electronic device 10 may identify that folding or unfolding is detected.
[0131] In operation 650 , the electronic device 10 may display a second preview image corresponding to the selected camera.
[0132] In an embodiment, the electronic device 10 displaying the second preview image may be in an unfolded state.
[0133] In an embodiment, the electronic device 10 may display a second preview image corresponding to the selected camera on a corresponding display.
[0134] In an embodiment, the electronic device 10 may activate the selected camera and the display corresponding to the selected camera, and display the second preview image corresponding to the activated camera on the activated display. In an embodiment, the electronic device 10 may deactivate the camera corresponding to the first preview image and the display displaying the first preview image.
[0135] For example, if the selected camera is the second front camera (e.g., the second front camera 542), the electronic device 10 may activate the second front camera 542 and the second display 552 corresponding to the second front camera 542, and display a second preview image corresponding to the second front camera 542 on the second display 552.
[0136] In an embodiment, the electronic device 10 may display a second preview image corresponding to the second front camera 542 based on a specific field of view included in the field of view range corresponding to the second front camera 542. For example, if the second front camera 542 corresponds to a second field of view (e.g., 60 to 90 degrees) for displaying preview images in wide-angle mode, the electronic device 10 may display the second preview image based on a 75-degree field of view. In an embodiment, when determining the specific field of view within the second field of view range, the electronic device 10 may consider the properties (e.g., size, resolution) of the second display 552 corresponding to the second front camera 542.
[0137] In an embodiment, the electronic device 10 may determine an aspect ratio associated with display of the second preview image (eg, 16:9, 4:3, 1:1, 3:4, 9:16, Full), and display the second preview image based on the determined aspect ratio.
[0138] In an embodiment, the electronic device 10 may determine the aspect ratio of the preview image based on an analysis result of at least one object displayed in the first preview image (eg, arrangement information of at least one object) or user preference information stored in the memory 130 .
[0139] In an embodiment, the electronic device 10 may also determine the aspect ratio of the second preview image based on the size or aspect ratio of the display corresponding to the selected camera.
[0140] In operation 660 , the electronic device 10 may obtain a captured image.
[0141] In an embodiment, in response to a user input for obtaining a captured image, the electronic device 10 may acquire a captured image based on the displayed second preview image. The user input for obtaining the captured image may be a user input to a graphical user interface (e.g., a photography button) displayed on the second display 552 or a physical interface arranged on the foldable housing 500. In an embodiment, the graphical user interface may be displayed on the first display 551 and the second display 552 before and after folding or unfolding of the electronic device 10 is detected. However, if folding or unfolding of the electronic device 10 is detected, the display position of the graphical user interface may be changed. For example, if folding or unfolding of the electronic device 10 is detected, the photography button displayed at the lower center of the first display 551 may be displayed at the lower left of the second display 552 so that it is close to the hand (e.g., left hand) of the user holding the electronic device 10.
[0142] In an embodiment, even without explicit user input for obtaining a captured image, the electronic device 10 may automatically obtain a captured image if a preset time has passed after folding or unfolding is detected (or after the second preview image is displayed).
[0143] In yet another embodiment, if a user input for acquiring a captured image is received before folding or unfolding is detected, the electronic device 10 may acquire a captured image if a preset time elapses after folding or unfolding is detected (or after the second preview image is displayed).
[0144] Figure 7 is a detailed operation sequence of an electronic device (eg, electronic device 10 ) for analyzing at least one object displayed in a first preview image and selecting at least one camera based on the analysis result according to an embodiment of the present invention. Figure 8 FIG. 4 shows an example in which an electronic device (eg, electronic device 10) analyzes at least one object displayed in a first preview image according to an embodiment of the present invention. Figures 1 to 5 The configuration of the electronic device 10 is described Figure 7 and Figure 8 .
[0145] exist Figure 7 The operations disclosed in can be Figure 6 Detailed operations of operation 620 and operation 630 disclosed in .
[0146] If the first preview image is a preview image corresponding to a front camera (eg, the first front camera 541), the Figure 7 The operations disclosed in .
[0147] In operation 710, the electronic device 10 may recognize the face of at least one person. The electronic device 10 may recognize that the first preview image includes the face of at least one person, and determine at least one of the number, shape, size, or area ratio of the face of the at least one person recognized to exist. For example, referring to Figure 8 , the electronic device 10 may recognize faces 820 and 830 of two persons included in the first preview image 810 .
[0148] In an embodiment, the electronic device 10 may identify a face of a person that is completely included in the first preview image (e.g., face A 820), or may identify a face of a person that is partially included in the first preview image (e.g., face B 830). For example, if the electronic device 10 identifies a specific face that is completely included in the first preview image and then cuts off a portion of the specific face on the screen of the first preview image, it may be recognized that the specific face is partially included in the first preview image. As another example, by identifying a portion (e.g., one eye) of feature points that are generally considered to be included in a face (e.g., eyebrows, eyes, nose, ears), the electronic device 10 may recognize that the face is partially included in the first preview image.
[0149] In operation 720, the electronic device 10 may determine whether the number of the recognized faces of the at least one person is equal to or greater than a first threshold. In an embodiment, the first threshold may be 3. For example, if the first preview image includes four faces of people, the electronic device 10 may determine that the number of the recognized faces of the at least one person is equal to or greater than the first threshold.
[0150] If the number of the recognized faces of the at least one person is equal to or greater than the first threshold (yes in operation 720), the electronic device 10 may select a camera corresponding to a third field of view range (e.g., the third front camera 543) in operation 760. In an embodiment, the third field of view range may correspond to a field of view range for displaying a preview image in an ultra-wide-angle mode.
[0151] If the number of the recognized faces of the at least one person is less than the first threshold value (No in operation 720), the electronic device 10 may identify whether a partially displayed face of a person exists in operation 730. For example, it may be identified whether the at least one person's faces include a face of a person whose portion is cropped by an edge of the first preview image.
[0152] If there is a partially displayed face of a person (Yes in operation 730 ), in operation 760 , the electronic device 10 may select a camera corresponding to a third field of view range.
[0153] If there is no partially displayed human face (No in operation 730), in operation 740, the electronic device 10 may determine whether there is a human face whose distance from the boundary line of the first preview image is equal to or less than the second threshold. For example, the electronic device 10 may determine whether there is a human face close to the boundary of the first preview image among the fully displayed faces. Figure 8 , the electronic device 10 can determine a closed curve corresponding to the outline of the fully displayed person's face 820 and the center 815 of the closed curve, and determine the distance from the center 815 of the determined closed curve to the boundary line of the first preview image (e.g., left boundary line, right boundary line, lower boundary line, upper boundary line).
[0154] If there is a face of a person whose distance from the boundary line is equal to or less than the second threshold value (Yes in operation 740 ), in operation 760 , the electronic device 10 may select a camera corresponding to a third field of view range.
[0155] If there is no face of a person whose distance from the boundary line is equal to or less than the second threshold value (No in operation 740), in operation 750, the electronic device 10 may identify whether the ratio of the area occupied by the face of the at least one identified person in the first preview image (for example, the ratio of the entire area of the first preview image to the area of the face of the at least one identified person) is equal to or greater than a third threshold value.
[0156] If the ratio of the area is equal to or greater than the third threshold value (Yes in operation 750 ), in operation 760 , the electronic device 10 may select a camera corresponding to a third field of view range.
[0157] If the ratio of the area is less than the third threshold value (No in operation 750), the electronic device 10 may select a camera corresponding to the second field of view range (e.g., the second front camera 542) in operation 770. In an embodiment, the second field of view range may correspond to a field of view range that is relatively narrower than the third field of view range. In an embodiment, the second field of view range may correspond to a field of view range for displaying a preview image in a wide-angle mode.
[0158] According to Figure 7 According to the embodiment disclosed in , the electronic device 10 may select a camera to be activated in response to folding or unfolding of the electronic device 10 based on the analysis result of the face of the at least one person included in the first preview image.
[0159] Interchangeable Figure 7 For example, the electronic device 10 may perform operation 730 before operation 720, may omit operation 750 after performing operation 740, and may perform operation 770.
[0160] Figure 9 FIG. 1 shows an operation sequence of an electronic device (eg, electronic device 10) according to an embodiment of the present invention. Figures 1 to 5 The configuration of the electronic device 10 is described Figure 9 .
[0161] exist Figure 7 In the description of operation 750 , if the ratio of the area occupied by the recognized face of the at least one person in the first preview image is less than the third threshold, a camera corresponding to the second field of view range may be selected in operation 770 as described above.
[0162] Figure 9 Described is an operation that may be additionally performed before selecting a camera corresponding to a second field of view range if a ratio of an area occupied by the recognized face of the at least one person in the first preview image is less than a third threshold.
[0163] In an embodiment, if the ratio of the area occupied by the face of the at least one recognized person in the first preview image is less than a third threshold, the electronic device 10 may recognize that the electronic device 10 has moved in a first direction and then in a second direction opposite to the first direction in operation 910. Specifically, while the first preview image is displayed, the electronic device 10 may recognize whether the electronic device 10 has moved in the first direction and then in the second direction within a specified time.
[0164] In an embodiment, while the first preview image is displayed, the electronic device 10 may also identify whether the electronic device 10 has moved in a first direction at a first speed and then moved in a second direction at a second speed within a specified time.
[0165] In an embodiment, if the first direction is the gravity direction (z-direction), the second direction may be a direction opposite to the gravity direction (z+ direction).
[0166] In an embodiment, assuming that the direction toward the user is the x-direction and the direction away from the user is the x+ direction in the electronic device 10, the first direction may be the y+ direction perpendicular to the z axis and the x axis, and the second direction may be the y-direction.
[0167] In operation 910, movement of the electronic device along the first direction and the second direction is identified to identify whether the user wants a camera that shoots with a wider field of view. Generally, if multiple subjects (e.g., multiple people) are captured at a relatively narrow field of view, some of the multiple subjects may not be frequently included in the screen. If the electronic device 10 moves in a specific direction (e.g., the first direction) to include some subjects in the screen, a portion of other subjects included in the screen before the movement may not be included in the screen. In this case, the user typically moves the electronic device 10 again in the opposite direction (e.g., the second direction), and therefore, in operation 910, the electronic device 10 may perform operation 760 based on determining that the electronic device moves in the first direction and then moves in the second direction.
[0168] In an embodiment, at operation 760, the electronic device 10 may select a camera corresponding to the third field of view range. For example, if the electronic device 10 moves in a first direction and then in a second direction, it may be determined that the currently activated camera and display cannot be used to achieve the wider field of view shooting desired by the user. Therefore, the electronic device 10 may select a camera corresponding to the third field of view range (e.g., the third front camera 543), which is a relatively wide field of view, based on the determination that the user wants to shoot with a camera with a wider field of view.
[0169] In an embodiment, the electronic device 10 may select a camera corresponding to a second field of view range in operation 770. For example, if it is not recognized that the electronic device 10 moves in the first direction and then in the second direction (No in operation 910), the electronic device 10 may select the second front camera 542 corresponding to the second field of view range, wherein the second field of view range is a field of view range narrower than the third field of view range.
[0170] In the embodiment, operation 910 is shown to be performed after operation 750 is performed, but operation 910 may be performed between any of operation 710 and operation 720 , operation 720 and operation 730 , operation 730 and operation 740 , and operation 740 and operation 750 .
[0171] Figure 10 Detailed operation sequence of an electronic device (eg, electronic device 10) for displaying a second preview image corresponding to a selected camera according to an embodiment of the present invention is shown. Figures 1 to 5 The configuration of the electronic device 10 is described Figure 10 .
[0172] exist Figure 10 The operations disclosed in can be Figure 6 The detailed operation of operation 650 is disclosed in FIG.
[0173] In operation 1010 , the electronic device 10 may identify whether the second front camera 542 is selected.
[0174] If the second front camera 542 is selected (yes in operation 1010), the electronic device 10 may display a second preview image based on the second field of view included in the second field of view range in operation 1020. For example, if the second field of view range corresponds to 60 degrees to 90 degrees, the electronic device 10 may display the second preview image on the second display 552 based on a 75-degree field of view.
[0175] In an embodiment, the second field of view range may correspond to a field of view range for displaying a preview image in a wide-angle mode.
[0176] If the second front camera 542 is not selected (No in operation 1010), then in operation 1030, the electronic device 10 may determine whether to select the third front camera 543. If the third front camera 543 is not selected (No in operation 1030), the electronic device 10 may terminate the corresponding algorithm. If the third front camera 543 is selected (Yes in operation 1030), then in operation 1040, the electronic device 10 may display a second preview image based on the third field of view included in the third field of view range. For example, if the third field of view range corresponds to 90 degrees to 180 degrees, the electronic device may display the second preview image on the second display 552 based on a 120-degree field of view.
[0177] In an embodiment, the third field of view range may correspond to a field of view range for displaying a preview image in an ultra-wide-angle mode.
[0178] Figure 11 An electronic device 10 according to an embodiment of the present invention is shown.
[0179] Figure 11 (A) shows the electronic device in a folded state, and Figure 11 (B) shows the electronic device in a flat state.
[0180] Reference Figure 11 (A), the electronic device 10 may display a first preview image 1110 on the first display 551. The first preview image 1110 may be a preview image of the first front camera 541. The first front camera 541 may support or correspond to a first field of view range.
[0181] In an embodiment, the electronic device 10 may select at least one camera based on the analysis result of at least one object included in the first preview image 1110. For example, based on the distance between the faces of two persons included in the first preview image 1110 and the boundary line of the first preview image 1110, the electronic device 10 may select the third front camera 543 that supports a relatively wide field of view from among the second front camera 542 and the third front camera 543.
[0182] Reference Figure 11 (B), the electronic device 10 may detect the unfolding. In response to detecting the unfolding, the electronic device 10 may activate the selected third front camera 543 and display the second preview image 1120 corresponding to the activated third front camera 543. Therefore, even without explicit user input, the electronic device 10 may provide the user with a preview image of a camera that supports a wider field of view in response to the unfolding of the electronic device 10.
[0183] Figure 12 This is a detailed operation sequence of an electronic device (eg, electronic device 10) for analyzing at least one object displayed in a first preview image and selecting at least one camera based on the analysis result according to an embodiment of the present invention. Figures 1 to 5 The configuration of the electronic device 10 is described Figure 12 .
[0184] exist Figure 12 The operations disclosed in can be Figure 6 Detailed operations of operation 620 and operation 630 disclosed in .
[0185] If the first preview image is a preview image corresponding to the first rear camera 341, the Figure 12 The operations disclosed in .
[0186] In operation 1210 , the electronic device 10 may recognize that the first preview image corresponds to a landscape image.
[0187] For example, if the electronic device 10 may not recognize the face of at least one person in the first preview image, or if the size of the face of at least one person included in the first preview image is smaller than a reference value, the electronic device 10 may recognize that the first preview image corresponds to a landscape image.
[0188] For example, the electronic device 10 may determine the type (e.g., mountain, sea, tree, building) of a main subject (e.g., largest subject) included in the first preview image, and recognize that the first preview image corresponds to a landscape image based on the determined object type.
[0189] In operation 1220 , the electronic device 10 may identify whether an arrangement of at least one object included in the first preview image corresponds to at least one pre-designated arrangement.
[0190] For example, if main subjects (or subjects exceeding a certain size) included in the first preview image are arranged symmetrically (eg, bilaterally, vertically), the electronic device 10 may determine that it corresponds to at least one pre-specified arrangement.
[0191] As another example, if a portion of the main subject included in the first preview image is cropped and is not visible in the first preview image, the electronic device 10 may determine that it corresponds to at least one pre-designated arrangement.
[0192] As another example, if the length of a specific line or the size of a specific area calculated from the arrangement of at least one object included in the first preview image exceeds a specified value, the electronic device 10 may determine that it corresponds to at least one pre-specified arrangement. For example, if a horizontal line or horizon line exceeding a specified value is included in the first preview image, the electronic device 10 may determine that it corresponds to at least one predetermined arrangement. As another example, if the first preview image includes trees arranged in a row, and a line connecting the tops of the trees has a specific slope over a specific length, the electronic device 10 may determine that the at least one object included in the first preview image corresponds to at least one pre-specified arrangement.
[0193] If the arrangement of the at least one object included in the first preview image corresponds to the at least one pre-specified arrangement (Yes in operation 1220), the electronic device 10 may select a camera corresponding to the third field of view range in operation 1230. For example, the electronic device 10 may select the third rear camera 343 corresponding to the third field of view range.
[0194] If the arrangement of the at least one object included in the first preview image does not correspond to the at least one pre-specified arrangement (No in operation 1220), the electronic device 10 may select a camera corresponding to the second field of view range in operation 1240. For example, the electronic device 10 may select the first rear camera 341 corresponding to the first preview image as it is.
[0195] Figure 13 An electronic device 10 according to an embodiment of the present invention is shown.
[0196] Figure 13 (A) shows the electronic device in a folded state from various angles, Figure 13 (B) shows the electronic device in a flat state.
[0197] Reference Figure 13(A), the electronic device 10 including the first rear camera 341, the second rear camera 342, and the third rear camera 343 may display a first preview image 1310 on the first display 551. The first preview image 1310 may be a preview image of the first rear camera 341. The first rear camera 341 may correspond to a second field of view range.
[0198] In an embodiment, the electronic device 10 may display a first indicator 1330 by overlaying at least a portion of the first preview image 1310 on the first display 551, wherein the first indicator 1330 indicates which camera corresponds to the currently displayed preview image. The first indicator 1330 may include objects indicating the activation or deactivation status of the first rear-facing camera 341, the second rear-facing camera 342, and the third rear-facing camera 343 (a first object 1331 corresponding to the first rear-facing camera 341, a second object 1332 corresponding to the second rear-facing camera 342, and a third object 1333 corresponding to the third rear-facing camera 343). Since the preview image currently displayed on the first display 551 corresponds to the first rear-facing camera 341, the first object 1331 corresponding to the first rear-facing camera 341 may be displayed to be distinguishable (e.g., in color, shape, and shading) from the second object 1332 corresponding to the second rear-facing camera 342 and the third object 1333 corresponding to the third rear-facing camera 343.
[0199] In an embodiment, the electronic device 10 may recognize that the first preview image 1310 corresponds to a landscape image. Based on the determination that the objects (roads) included in the first preview image 1310 are arranged bilaterally symmetrically, the electronic device 10 may recognize that the arrangement of the at least one object included in the first preview image 1310 corresponds to at least one pre-specified arrangement. Therefore, the electronic device 10 may select the third rear camera 343 corresponding to a relatively wide field of view.
[0200] Reference Figure 13 In (B), in response to unfolding the electronic device 10, the electronic device 10 may display a second preview image 1320 on the second display 552. The second preview image 1320 may be a preview image of the selected third rear camera 343. The third rear camera 343 may correspond to a third field of view range, which is a field of view range wider than the second field of view range.
[0201] In an embodiment, the electronic device 10 may display a second indicator 1340 by overlaying at least a portion of the second preview image 1320 on the second display 552, wherein the second indicator 1340 indicates which camera corresponds to the currently displayed preview image. The second indicator 1340 may include objects (a first object 1341 corresponding to the first rear camera 341, a second object 1342 corresponding to the second rear camera 342, and a third object 1343 corresponding to the third rear camera 343) indicating the activation or deactivation status of the first rear camera 341, the second rear camera 342, and the third rear camera 343 after the electronic device 10 is unfolded. Since the preview image currently displayed on the second display 552 corresponds to the third rear camera 343, the third object 1343 corresponding to the third rear camera 343 may be displayed separately from the first object 1341 corresponding to the first rear camera and the second object 1342 corresponding to the second rear camera.
[0202] Figure 14 Detailed operation sequence of an electronic device (eg, electronic device 10) for outputting a guidance notification according to an embodiment of the present invention is shown. Figures 1 to 5 The configuration of the electronic device 10 is described Figure 14 .
[0203] Can be carried out in Figure 6 The operation 630 disclosed in Figure 14 The operations disclosed in .
[0204] In an embodiment, the electronic device 10 may output a notification for guiding folding or unfolding for photographing with a different field of view at operation 1410. For example, the electronic device 10 may output a notification for guiding unfolding the electronic device 10 for photographing with a wider field of view, and the electronic device 10 may output a notification for guiding folding for photographing with a narrower field of view.
[0205] In an embodiment, the electronic device 10 may display a notification for guiding unfolding in the form of a pop-up window on the first display 551, or may output a notification for guiding unfolding through a speaker (e.g., a sound output device 155). In an embodiment, the electronic device 10 may display a notification for guiding folding in the form of a pop-up window on the second display 552, or may output a notification for guiding folding through a speaker (e.g., a sound output device 155).
[0206] In an embodiment, the electronic device 10 may determine whether to output a notification for guiding folding (or unfolding). The electronic device 10 may determine whether to output a notification for guiding folding (or unfolding) based on the selected camera. For example, if the currently displayed subject can be captured using the selected camera even when the electronic device 10 is not folded (or unfolded), the electronic device 10 may not output a notification for guiding folding (or unfolding). As another example, if the camera is not changed, the electronic device 10 may not output a notification for guiding folding (or unfolding).
[0207] In an embodiment, the electronic device 10 may output a notification for guiding folding (or unfolding) at a specified timing. While the first preview image is displayed, if no user input for photographing is received for longer than a specified time, the electronic device 10 may output a notification for guiding folding (or unfolding).
[0208] In an embodiment, the electronic device 10 may output a notification for guiding folding (or unfolding) for a designated guiding time.
[0209] In an embodiment, while the notification is being output, if a user input for obtaining a captured image is detected based on the first preview image, the electronic device 10 may immediately remove the output notification.
[0210] Figure 15 An example is shown in which the electronic device 10 outputs a guidance notification according to an embodiment of the present invention.
[0211] Reference Figure 15 In (A), the electronic device 10 may display a first preview image 1510 on the first display 551. The first preview image 1510 may correspond to the first front camera 541. The first front camera 541 may correspond to a first field of view range.
[0212] In an embodiment, the electronic device 10 may select the third front camera 543 based on an analysis result of at least one object included in the first preview image 1510. In response to detecting that the electronic device 10 is unfolded, the selected third front camera 543 may be activated.
[0213] In an embodiment, the electronic device 10 may display an unfolding guidance notification 1530 on the first display 551 for guiding the unfolding of the electronic device 10. The unfolding guidance notification 1530 may include multiple objects. If the electronic device is unfolded, the multiple objects may correspond to multiple cameras that can be used to capture the currently displayed subject. For example, a first object 1531 corresponding to the second front camera 542, a second object 1532 corresponding to the third front camera 543, and a third object 1533 corresponding to the fourth front camera (not shown) may be included in the unfolding guidance notification 1530. The first object 1531, the second object 1532, and the third object 1533 may each include an indication of the performance or field of view of their respective cameras and the photography mode. For example, the first object 1531 may include a text object "Wide" indicating the field of view supported by the corresponding second front camera 542. For example, the second object 1532 may include a text object "Ultra-Wide" indicating the field of view supported by the corresponding third front camera 543. For example, the third object 1533 may include a text object “Telephoto” indicating a field of view range supported by the corresponding first front camera 541 .
[0214] In an embodiment, among the objects included in the expansion guidance notice 1530, the object corresponding to the camera selected based on the analysis result of at least one object included in the first preview image 1510 is displayed separately from the other objects. For example, if the third front camera 543 is selected, the electronic device 10 may display the second object 1532 corresponding to the third front camera 543 among the objects included in the expansion guidance notice 1530 separately from the other objects. The electronic device 10 can guide the user to select the second object 1532 by displaying the second object 1532 separately from the other objects.
[0215] Reference Figure 15 (B), the electronic device 10 may receive a user input for the expansion guide notification 1530. For example, the electronic device 10 may receive a user input for the second object 1532 included in the expansion guide notification 1530, wherein the second object 1532 is displayed to be distinguished from other objects. As another example, even if the second object 1532 is displayed to be distinguished from other objects, the electronic device 10 may receive a user input for an object different from the second object 1532 (e.g., the first object 1531).
[0216] Although not shown, if no user input for the expansion guide notification 1530 is received within a designated time after the expansion guide notification 1530 is displayed, the electronic device 10 may remove the displayed expansion guide notification 1530 .
[0217] Reference Figure 15In response to detecting that the electronic device 10 is unfolded, the electronic device 10 may display a second preview image 1520 on the second display 552. The second preview image 1520 may be a preview image of a camera (e.g., the third front camera 543) corresponding to the object (e.g., the second object 1532) for which the user input was received. The third front camera 543 may support a third field of view range as a field of view range for displaying a preview image in the ultra-wide-angle mode, and the electronic device 10 may display the second preview image 1520 based on a specific field of view included in the third field of view range.
[0218] In an embodiment, the electronic device 10 may display a field of view switching menu 1540. The field of view switching menu 1540 may indicate that the second preview image 1520 is currently displayed based on the ultra-wide-angle mode. The field of view switching menu 1540 may also include an icon for displaying the preview image in a field of view corresponding to the wide-angle mode or the telephoto mode. For example, if the icon for displaying the preview image in a field of view corresponding to the wide-angle mode is selected in the field of view switching menu 1540, the electronic device 10 may activate the second front camera 542 and display the preview image of the second front camera 542 on the second display 552.
[0219] Figure 16 An example is shown in which the electronic device 10 outputs a guidance notification according to an embodiment of the present invention.
[0220] Figure 16 (A) shows the electronic device 10 in a folded state from various angles, and Figure 16 (B) shows the electronic device 10 in a flat state.
[0221] Reference Figure 16 (A), the electronic device 10 may display a first preview image 1610 on the first display 551. The first preview image 1610 may be a preview image of the first rear camera 341. The first rear camera 341 may correspond to a second field of view range.
[0222] In an embodiment, the electronic device 10 may select the third rear camera 343 based on an analysis result of at least one object included in the first preview image 1610. The third rear camera 343 may correspond to a third field of view range that is wider than the second field of view range.
[0223] In an embodiment, the electronic device 10 may display the first indicator 1630 by overlapping at least a portion of the first preview image 1610 , wherein the first indicator 1630 indicates which camera corresponds to the currently displayed preview image.
[0224] In an embodiment, the first indicator 1630 may include objects indicating the activation or deactivation status of the first rear camera 341, the second rear camera 342, and the third rear camera 343 (a first object 1631 corresponding to the first rear camera 341, a second object 1632 corresponding to the second rear camera 342, and a third object 1633 corresponding to the third rear camera 343). Since the preview image currently displayed on the first display 551 corresponds to the first rear camera 341, the first object 1631 corresponding to the first rear camera 341 may be displayed to be distinguished (e.g., in color, shape, and shadow) from the second object 1632 corresponding to the second rear camera 342 and the third object 1633 corresponding to the third rear camera 343.
[0225] In an embodiment, the electronic device may display an unfolding guide notification 1650. The unfolding guide notification 1650 may include text or an image object for suggesting that the electronic device 10 be unfolded to capture the entire subject. By displaying the unfolding guide notification 1650, the electronic device 10 may provide the user with field of view information, wherein the field of view information may be used to capture the subject after the electronic device 10 is unfolded. The unfolding guide notification 1650 may include information about the selected camera. For example, the unfolding guide notification 1650 may include a text object such as "When unfolded to capture the entire subject, it switches to ultra-wide-angle shooting mode."
[0226] Reference Figure 16 In (B), in response to unfolding the electronic device 10, the electronic device 10 may display a second preview image 1620 on the second display 552. The second preview image 1620 may be a preview image of the selected third rear camera 343.
[0227] In an embodiment, the electronic device 10 may display the second indicator 1640 by overlapping at least a portion of the second preview image 1620 , wherein the second indicator 1640 indicates which camera corresponds to the currently displayed preview image.
[0228] The second indicator 1640 may include objects indicating activation or deactivation states of the first rear camera 341, the second rear camera 342, and the third rear camera 343 (a first object 1641 corresponding to the first rear camera 341, a second object 1642 corresponding to the second rear camera 342, and a third object 1643 corresponding to the third rear camera 343).
[0229] Figure 17 A detailed operation sequence of an electronic device (eg, the electronic device 10 ) for outputting a guidance notification according to an embodiment of the present invention is shown.
[0230] In progress Figure 6 After operation 650 disclosed in , before operation 660, the Figure 17 The operations disclosed in .
[0231] If the first preview image and the second preview image correspond to a landscape image, Figure 17 The operations disclosed in .
[0232] If at least one object included in the second preview image is aligned with at least one pre-specified arrangement (e.g., Figure 12 ) corresponding to the arrangement shown in Figure 17 The operations disclosed in .
[0233] In an embodiment, at operation 1710, the electronic device 10 may output a notification for guiding the movement of the electronic device 10. For example, the electronic device 10 may output a notification guiding the electronic device 10 to move or rotate in a designated direction in order to create a panoramic photo.
[0234] Referring to the electronic device showing the flat state Figure 18 (B), the electronic device 10 may output a notification 1850 suggesting a panoramic photography mode for complete landscape photography.
[0235] In an embodiment, in operation 1720, the electronic device 10 may detect movement of the electronic device. The electronic device 10 may detect the movement (or rotation) of the electronic device suggested in operation 1710. The electronic device 10 may obtain image information for creating a panoramic photo based on the camera movement caused by the detected movement of the electronic device 10. In operation 660, the obtained image information may be used to create a panoramic photo.
[0236] Figure 18 An example is shown in which the electronic device 10 outputs a guidance notification according to an embodiment of the present invention.
[0237] Figure 18 (A) shows the electronic device 10 in a flat state at a first viewpoint, Figure 18 (B) shows the electronic device 10 in a flat state from a second viewpoint.
[0238] In an embodiment, the electronic device 10 may select the third rear camera (eg, the third rear camera 343 ) based on an analysis result of at least one object included in the first preview image 1821 .
[0239] In the examples, reference Figure 18 (A), the electronic device 10 may display a second indicator 1840 by overlapping at least a portion of the first preview image 1821 , wherein the second indicator 1840 indicates which camera corresponds to the currently displayed preview image.
[0240] The second indicator 1840 may include objects (a first object 1841 corresponding to the first rear camera 341, a second object 1842 corresponding to the second rear camera 342, and a third object 1843 corresponding to the third rear camera 343) indicating the activation or deactivation status of the first rear camera (e.g., the first rear camera 341), the second rear camera (e.g., the second rear camera 342), and the third rear camera 343. Since the preview image currently displayed on the first display 551 corresponds to the third rear camera 343, the third object 1843 may be displayed to be distinguished from the first object 1841 and the second object 1842 (e.g., in color, shape, and shadow).
[0241] In the examples, reference Figure 18 (A), the electronic device 10 may determine the type (eg, mountain, tree) of a main subject (eg, the largest subject) included in the first preview image 1821 and recognize that the first preview image 1821 corresponds to a landscape image based on the determined object type.
[0242] In the examples, reference Figure 18 (B) may display a panoramic guidance notification 1850 for panoramic photography. Panoramic guidance notification 1850 may include text or an image object suggesting that the electronic device 10 be moved to capture the entire scenery. The electronic device 10 may provide the user with panoramic photography information of the electronic device 10 by displaying the panoramic guidance notification 1850 overlapping the second preview image 1825.
[0243] Figure 19 An operation sequence of an electronic device (eg, electronic device 10 ) according to an embodiment of the present invention is shown.
[0244] exist Figure 5 Under the control of the processor 120, the electronic device 10 may execute Figure 19 In the following, the electronic device 10 is described as performing the operation disclosed in Figure 19 The operations disclosed in .
[0245] Operation 1910, operation 1920, operation 1940 and operation 1950 are the same as in Figure 6 Operation 610, operation 640, operation 650, and operation 660 disclosed in are substantially the same, and thus their detailed descriptions will be omitted.
[0246] In an embodiment, at operation 1930 , the electronic device 10 may select at least one camera based on at least one of the at least one object analysis result displayed in the first preview image or user preference information.
[0247] In an embodiment, Figure 6Unlike the embodiment disclosed in , the electronic device 10 may perform an operation of selecting at least one camera after detecting that the electronic device is folded or unfolded.
[0248] In an embodiment, the electronic device 10 may select at least one camera based on at least one object analysis result displayed in the first preview image. For example, if the number of human faces included in the first preview image is equal to or greater than a first threshold, the electronic device 10 may select the third front-facing camera that supports a relatively wide field of view from among the second and third front-facing cameras.
[0249] In an embodiment, the electronic device 10 may select at least one camera based on user preference information stored in the memory 130 .
[0250] For example, the electronic device 10 may select the second front camera 542 using information about the type of the first preview image (e.g., portrait photo, landscape photo), the number of times the user has taken photos of a specific type using the second front camera 542, and the number of times the user has taken photos of a specific type using the third front camera 543.
[0251] For example, the electronic device 10 may compare the number of times the user takes photos using only the second front camera 542 with the number of times the user takes photos using both the second front camera 542 and the fourth front camera, and use the comparison result to select the second front camera 542 and the fourth front camera (not shown).
[0252] Computer-readable recording media may include hard disks, floppy disks, magnetic media (e.g., magnetic tapes), optical storage media (e.g., compact disk (CD) read-only memory (ROM) or digital versatile disk (DVD), magneto-optical media (e.g., floppy disks)), internal memories, and the like. Instructions may include codes created by a compiler or codes executable by an interpreter. Modules or program modules according to various embodiments may include at least one or more of the above-mentioned components, omit some of the above-mentioned components, or further include other components. Operations performed by a module, a program, or another component according to various embodiments may be performed sequentially, in parallel, repeatedly, or heuristically, or at least some operations may be performed in a different order, or at least some operations may be omitted, or other operations may be added.
[0253] The embodiments disclosed in the specification and the drawings are presented only as specific examples to easily explain the technical details of the present invention and facilitate understanding, and are not intended to limit the scope of the present invention. Therefore, the scope of the present invention should be interpreted as covering all changes or modifications derived from the technical concept of the present invention and the disclosed embodiments.
Claims
1. A foldable electronic device, comprising: A foldable housing comprising a first housing structure and a second housing structure; a sensor module providing sensor information for identifying a state of the foldable electronic device, wherein the state of the foldable electronic device includes a folded state and other states including an intermediate state and a flat state; a first display disposed on a first side of the first housing structure; a second display disposed on a second side of the first housing structure and a first side of the second housing structure, wherein the second side is an opposite side of the first side of the first housing structure, wherein the second display is configured to be folded in the folded state; a first front-facing camera positioned to capture images in a direction facing the first display; a second front-facing camera positioned to capture images in a direction facing the second display; at least one processor; and A memory storing instructions, wherein the instructions, when executed by the at least one processor, cause the foldable electronic device to perform the following operations: while the foldable electronic device is in the folded state, displaying a first preview image obtained by a first front camera via a first display; While displaying a first preview image obtained by a first front camera on a first display in the folded state, based on the sensor information provided by the sensor module, identifying that the state of the foldable electronic device has changed from the folded state to the other state; and In response to recognizing that the state of the foldable electronic device is changed from the folded state to the other state, activating the second display to display a second preview image obtained by the second front camera.
2. The electronic device according to claim 1, in, displaying a first preview image on a first display, and Wherein, the second preview image is displayed on the second display.
3. The electronic device according to claim 2, wherein: When executed, the instructions cause the at least one processor to perform the following operations: selecting, based on an analysis result of at least one object included in the first preview image, a second front camera or a third front camera disposed together with the second front camera on a first side of the second housing structure; The analysis result of the at least one object includes at least one of the shape of the at least one object, the size of the at least one object, the type of the at least one object, the number of the at least one object, or the proportion occupied by a specific size of the at least one object on the first preview image.
4. The electronic device according to claim 3, wherein: When executed, the instructions cause the at least one processor to perform the following operations: Based on at least one of a number of objects of a specific type, a number of objects of the specific type cropped by the first preview image, or a proportion of objects of the specific type occupied in the first preview image, one of the second front-facing camera or the third front-facing camera is selected, wherein the second front-facing camera supports a field of view wider than that of the first front-facing camera, and the third front-facing camera supports a field of view narrower than that of the second front-facing camera and wider than that of the first front-facing camera.
5. The electronic device according to claim 2, wherein: When executed, the instructions cause the at least one processor to perform the following operations: One of the second front camera or the third front camera is selected based on movement of the electronic device while the first preview image is displayed. The electronic device according to claim 4 , wherein: When executed, the instructions cause the at least one processor to perform the following operations: After selecting the second or third front camera, At least one of a field of view of a second front camera or a third front camera to be used to acquire a second preview image or an aspect ratio of the acquired second preview image to be displayed on the second display is determined based on properties of the second display.
7. The electronic device according to claim 6, wherein: The property of the second display is at least one of a size or a resolution of the second display.
8. The electronic device according to claim 4, wherein: The memory is configured to store at least one user preference information, and When executed, the instructions cause the at least one processor to perform the following operations: A fourth front camera corresponding to a special photographic effect is also selected based on at least one of the analysis result of the at least one object or the at least one user preference information.
9. The electronic device according to claim 1, wherein: When executed, the instructions cause the at least one processor to perform the following operations: Before detecting that the electronic device is folded or unfolded, a notification is outputted suggesting that the electronic device be folded or unfolded to perform photography of a different field of view.
10. The electronic device according to claim 9, wherein: The notification includes at least one object, wherein each object corresponds to at least one camera included in the first front camera, the second front camera, and the third front camera, and When executed, the instructions cause the at least one processor to perform the following operations: An object corresponding to the selected second front camera or third front camera among the at least one object included in the notification is output to be distinguished from other objects.
11. A method of operating a foldable electronic device, comprising: while the foldable electronic device is in a folded state, displaying a first preview image obtained by the first front camera via the first display; while displaying a first preview image obtained by a first front camera on a first display in the folded state, recognizing, based on sensor information provided by a sensor module, that the state of the foldable electronic device changes from the folded state to another state including an intermediate state and a flat state; as well as In response to recognizing that the state of the foldable electronic device is changed from the folded state to the other state, activating the second display to display a second preview image obtained by the second front camera.
12. The method according to claim 11, in, displaying a first preview image on a first display, and Wherein, the second preview image is displayed on the second display.
13. The method according to claim 12, selecting, based on an analysis result of at least one object included in the first preview image, a second front camera or a third front camera disposed together with the second front camera on a first side of the second housing structure; in, The analysis result of the at least one object includes at least one of a shape of the at least one object, a size of the at least one object, a type of the at least one object, a number of the at least one object, or a proportion occupied by a specific size of the at least one object in the first preview image.
14. The method according to claim 13, wherein The steps for selecting the second front camera or the third front camera include: Based on at least one of a number of objects of a specific type, a number of objects of the specific type cropped by the first preview image, or a proportion of objects of the specific type occupied in the first preview image, one of the second front-facing camera or the third front-facing camera is selected, wherein the second front-facing camera supports a field of view wider than that of the first front-facing camera, and the third front-facing camera supports a field of view narrower than that of the second front-facing camera and wider than that of the first front-facing camera.
15. The method according to claim 12, wherein: The steps for selecting the second front camera or the third front camera include: One of the second front camera or the third front camera is selected based on movement of the electronic device while the first preview image is displayed.
Citation Information
Patent Citations
Mobile terminal and method for controlling the same
US20170013179A1
Mobile terminal and method for controlling the same
US20170026582A1
Dynamic control of audio resources in a device with multiple displays
US20190007620A1