Electronic devices and methods for recording in electronic devices

Abstract

This disclosure relates to an electronic device comprising: a first housing structure including a first microphone; a second housing structure including a second microphone and foldably coupled to the first housing structure; a sensor module disposed in the first housing structure or the second housing structure; and a processor disposed in the first housing structure or the second housing structure and operatively connected to the first microphone, the second microphone, and the sensor module, the processor being configured to: receive a folding event related to the first housing structure and the second housing structure via the sensor module when executing a specific recording mode; determine folding state information in response to receiving the folding event; determine a recording function configuration related to the first microphone and the second microphone based on the folding state information and the specific recording mode; and perform recording via the recording function configuration.

Description

Technical Field

[0001] This disclosure relates to electronic devices and methods for recording audio in electronic devices. Background Technology

[0002] With the increasing integration of electronic devices and the widespread use of ultra-fast / high-capacity wireless communication, single electronic devices (e.g., mobile communication terminals) can now be equipped with a wide variety of functions. For example, not only communication functions, but also entertainment functions (e.g., games), multimedia functions (e.g., music / movie playback), communication and security functions for mobile banking, scheduling functions, and e-wallet functions are all tending to be integrated into a single electronic device.

[0003] Equipping electronic devices with large display panels to ensure user convenience when using multimedia services has become a recent trend. Furthermore, foldable electronic devices equipped with flexible display panels have recently been disclosed. Foldable electronic devices can refer to devices comprising multiple housing structures configured to rotate relative to each other.

[0004] The above information is presented as background information only to aid in understanding this disclosure. There is no determination or assertion as to whether any of the above content can be used as prior art in relation to this disclosure. Summary of the Invention

[0005] A foldable electronic device may include multiple housing structures, and each housing structure may include a microphone. The distance and orientation between each microphone in the multiple housing structures of the foldable electronic device can vary depending on the angle at which the electronic device is unfolded.

[0006] For example, suppose you are recording in interview mode using a foldable electronic device that includes multiple microphones, with the device held unfolded. If the device is folded during recording, the multiple microphones may be positioned in the same direction, potentially reducing sound quality or halting the recording.

[0007] The aspects of this disclosure will at least solve the aforementioned problems and / or disadvantages, and provide at least the following advantages. Therefore, one aspect of this disclosure is to provide an electronic device and a method for recording audio using the electronic device, wherein if the folding angle of the electronic device is changed while recording in a specific recording mode, the configuration of the recording function can be changed to suit the corresponding state.

[0008] Other aspects will be set forth in part in the description which follows, and will be apparent in part from the description, or may be learned by practice of the embodiments presented.

[0009] According to one aspect of this disclosure, an electronic device is provided. The electronic device includes: a first housing structure including a first microphone; a second housing structure including a second microphone and foldably coupled to the first housing structure; a sensor module disposed in the first housing structure and / or the second housing structure; and a processor disposed in the first housing structure and / or the second housing structure and operatively connected to the first microphone, the second microphone, and the sensor module. The processor can be configured to: receive a folding event related to the first housing structure and the second housing structure via the sensor module when executing a specific recording mode; identify folding state information in response to receiving the folding event; identify a recording function configuration related to the first microphone and the second microphone based on the folding state information and the specific recording mode; and perform a recording operation by applying the identified recording function configuration.

[0010] According to another aspect of this disclosure, a recording method for an electronic device is provided. The electronic device includes a first housing structure and a second housing structure, wherein the first housing structure includes a first microphone, and the second housing structure includes a second microphone and is foldably connected to the first housing structure. The recording method includes: receiving a folding event related to the first housing structure and the second housing structure via a sensor module when executing a specific recording mode; identifying folding state information in response to receiving the folding event; identifying a recording function configuration related to the first microphone and the second microphone based on the folding state information and the specific recording mode; and performing recording by applying the identified recording function configuration.

[0011] According to one aspect of this disclosure, an electronic device is provided. The electronic device includes: a first housing structure including a first microphone; a second housing structure including a second microphone and foldably coupled to the first housing structure; a sensor module disposed in the first housing structure and / or the second housing structure; and a processor disposed in the first housing structure and / or the second housing structure and operatively connected to the first microphone, the second microphone, and the sensor module. The processor can be configured to perform a recording operation by applying speech beamforming when a first recording mode is executed in an unfolded state of the electronic device, receive folding events related to the first and second housing structures via the sensor module, identify folding state information corresponding to the reception of the folding events, and, as a result of identifying the folding state information, perform a recording operation without applying speech beamforming when the electronic device is identified to be in a folded state.

[0012] According to various embodiments, even if the folding angle of the foldable electronic device changes when recording with the electronic device in a specific recording mode, the configuration of the recording function can be changed to suit the corresponding state, thereby maintaining the continuity of the recording function.

[0013] For example, suppose you are recording audio using a foldable electronic device in interview mode, with the device unfolded. Even if the device is folded back to its folded state, thus changing the relative position of the microphone, the recording configuration can automatically change to provide continuous and effective recording.

[0014] Other aspects, advantages, and salient features of this disclosure will become apparent to those skilled in the art from the following detailed description of various embodiments of the disclosure taken in conjunction with the accompanying drawings. Attached Figure Description

[0015] The above and other aspects, features, and advantages of certain embodiments of this disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, wherein:

[0016] Figure 1 This is a block diagram of an electronic device in a network environment according to embodiments of the present disclosure;

[0017] Figure 2 This is a view showing the unfolded state of an electronic device according to an embodiment of the present disclosure;

[0018] Figure 3A This is a view showing the unfolded state of an electronic device according to an embodiment of the present disclosure;

[0019] Figure 3B This is a view showing the folded state of an electronic device according to an embodiment of the present disclosure;

[0020] Figure 4 This is an exploded perspective view of an electronic device according to an embodiment of the present disclosure;

[0021] Figure 5 This is a view showing a pattern relating to the angle between the housings (e.g., a first housing and a second housing) of an electronic device according to an embodiment of the present disclosure;

[0022] Figure 6A This is a view showing a conventional mode of the recording mode of an electronic device according to an embodiment of the present disclosure;

[0023] Figure 6B This is a view illustrating an interview mode of an electronic device in recording mode according to an embodiment of the present disclosure;

[0024] Figure 6C This is a view showing a voice memo mode of an electronic device in recording mode according to an embodiment of the present disclosure;

[0025] Figure 7A This is a view showing voice beamforming in the unfolded state of an electronic device according to an embodiment of the present disclosure;

[0026] Figure 7B This is a view showing voice beamforming in a folded state of an electronic device according to an embodiment of the present disclosure;

[0027] Figure 8A This is a view showing the voice signal in the unfolded state of an electronic device according to an embodiment of the present disclosure;

[0028] Figure 8B This is a view showing the voice signal of an electronic device in a folded state according to an embodiment of the present disclosure;

[0029] Figure 9 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure;

[0030] Figure 10 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure;

[0031] Figure 11A This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure;

[0032] Figure 11B This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure;

[0033] Figure 11C This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure;

[0034] Figure 11D This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure;

[0035] Figure 12 This is a block diagram illustrating a detailed configuration of the application processor of an electronic device according to an embodiment of the present disclosure;

[0036] Figure 13 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure;

[0037] Figure 14 This is a view showing a user interface (UI) displayed on a screen of an electronic device according to an embodiment of the present disclosure;

[0038] Figure 15 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure;

[0039] Figure 16 This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure;

[0040] Figure 17 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure;

[0041] Figure 18 This is a graph showing the audio signal received by an electronic device in a folded state according to an embodiment of the present disclosure;

[0042] Figure 19A This is a view showing the voice beamforming of an electronic device in an unfolded state according to an embodiment of the present disclosure;

[0043] Figure 19B This is a view showing the voice reception direction of an electronic device in a folded state according to an embodiment of the present disclosure;

[0044] Figure 20 This is a view showing the audio signal received when the electronic device according to an embodiment of the present disclosure is in a folded state;

[0045] Figure 21 This is a view showing a UI displayed on a screen of an electronic device according to an embodiment of the present disclosure;

[0046] Figure 22A This is a view illustrating an example of an electronic device including three microphones according to an embodiment of the present disclosure;

[0047] Figure 22B This is a view illustrating an example of an interview mode using an electronic device according to an embodiment of this disclosure;

[0048] Figure 23 This is a view illustrating a flexible display including multiple microphones in an electronic device according to an embodiment of the present disclosure;

[0049] Figure 24 This is a view illustrating a flexible display including multiple microphones in an electronic device according to an embodiment of the present disclosure;

[0050] Figure 25A , Figure 25B , Figure 25C , Figure 25D and Figure 25E This is a view illustrating a flexible display including multiple microphones in an electronic device according to various embodiments of the present disclosure;

[0051] Figure 26A , Figure 26B , Figure 26C , Figure 26D and Figure 26EThis is a view illustrating a flexible display including multiple microphones in an electronic device according to various embodiments of the present disclosure;

[0052] Figure 27A , Figure 27B , Figure 27C , Figure 27D , Figure 27E and Figure 27F This is a view illustrating a flexible display including multiple microphones in an electronic device according to various embodiments of the present disclosure;

[0053] Figure 28A , Figure 28B , Figure 28C and Figure 28D This is a view illustrating a flexible display including multiple microphones in an electronic device according to various embodiments of the present disclosure; and

[0054] Figure 29A , Figure 29B , Figure 29C , Figure 29D , Figure 29E , Figure 29F , Figure 29G , Figure 29H , Figure 29I , Figure 29J and Figure 29K This is a view illustrating a flexible display in an electronic device including multiple microphones according to various embodiments of the present disclosure.

[0055] Throughout the accompanying drawings, the same reference numerals will be understood to refer to the same parts, components, and structures. Detailed Implementation

[0056] The following description, with reference to the accompanying drawings, is provided to aid in a full understanding of the various embodiments of this disclosure as defined by the claims and their equivalents. It includes various specific details to aid understanding, but these details are to be considered exemplary only. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of this disclosure. Additionally, for clarity and brevity, descriptions of well-known functions and constructions may be omitted.

[0057] The terms and words used in the following description and claims are not limited to their literal meaning, but are used solely by the inventors to enable a clear and consistent understanding of this disclosure. Therefore, it will be apparent to those skilled in the art that the following description, which provides various embodiments of this disclosure, is for illustrative purposes only and not for limiting the disclosure as defined by the appended claims and their equivalents.

[0058] It should be understood that the singular forms of “one,” “an,” and “the” include plural objects unless the context explicitly indicates otherwise. Thus, for example, referring to “the surface of a component” includes referring to one or more such surfaces.

[0059] Furthermore, unless the context is absolutely different, singular expressions used herein may include plural expressions. As used herein, expressions such as “comprising”, “including”, etc., should not be construed as necessarily including all elements or operations described in the specification, but should be construed as allowing the exclusion of some elements or operations or further including additional elements or operations.

[0060] Various elements may be described using ordinal terms, such as expressing "first" and "second," but the corresponding elements should not be limited by these terms. These terms are used only to distinguish one element from any other element. For example, without departing from the scope of this disclosure, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

[0061] It should be understood that when a component is referred to as "connected" or "coupled" to another component, it can be directly connected or coupled to the other component, or any other component can be inserted between them. Conversely, it should be understood that when a component is referred to as "directly connected" or "directly coupled" to another component, no component is inserted between them.

[0062] In the following, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Regardless of the reference numerals, identical or similar elements will have the same reference numerals, and repeated descriptions will be omitted. In describing the present disclosure, descriptions of technical content known in the art and not directly related to the present disclosure will be omitted. Furthermore, it should be noted that the accompanying drawings are presented only to aid in understanding the present disclosure and are not intended to limit the scope of the disclosure. In addition to the accompanying drawings, the technical concept of the present disclosure should be interpreted as encompassing all changes, equivalents, and substitutions.

[0063] In the following description, a mobile station will be depicted in the accompanying drawings; however, the mobile station may be referred to as an electronic device, terminal, mobile equipment (ME), user equipment (UE), user terminal (UT), user station (SS), wireless device, handheld device, or access terminal (AT). Furthermore, a mobile station may be a device with communication capabilities, such as a mobile phone, personal digital assistant (PDA), smartphone, wireless modem, or laptop.

[0064] Figure 1 This is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments.

[0065] Reference Figure 1In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input device 150, sound output device 155, display device 160, audio module 170, sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module (SIM) 196, or antenna module 197. In some embodiments, at least one of these components (e.g., display device 160 or camera module 180) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented as embedded in the display device 160 (e.g., a display).

[0066] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to an embodiment, as at least part of the data processing or calculation, processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. Non-volatile memory includes internal memory 136 and internal memory 138. According to an embodiment, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) and auxiliary processors 123 (e.g., graphics processing unit (GPU), image signal processor (ISP), sensor hub processor, or communication processor (CP)) that are operationally independent of or combined with the main processor 121. Alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to perform a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.

[0067] When the main processor 121 is in a deactivated (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states associated with at least one component of the electronic device 101 (other than the main processor 121) (e.g., display device 160, sensor module 176, or communication module 190), or when the main processor 121 is in an activated state (e.g., running an application), the auxiliary processor 123 may work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display device 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123.

[0068] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0069] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.

[0070] Input device 150 can receive commands or data from outside electronic device 101 (e.g., a user) that will be used by other components of electronic device 101 (e.g., processor 120). Input device 150 may include, for example, a microphone, mouse, keyboard, or digital pen (e.g., stylus).

[0071] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. According to an embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

[0072] Display device 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, display device 160 may include touch circuitry adapted to detect touch or sensor circuitry (e.g., a pressure sensor) adapted to measure the intensity of the force caused by touch.

[0073] The audio module 170 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0074] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0075] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic devices (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.

[0076] Connection end 178 may include a connector, through which electronic device 101 can be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0077] The tactile module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through his touch or kinesthesia. According to embodiments, the tactile module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0078] Camera module 180 can capture still or moving images. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0079] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0080] Battery 189 can power at least one component of electronic device 101. According to an embodiment, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.

[0081] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 192 can identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0082] Antenna module 197 can transmit or receive signals or power to or from the exterior of electronic device 101 (e.g., external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, antenna module 197 may include multiple antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 197.

[0083] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).

[0084] According to an embodiment, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to a second network 199. Each of electronic device 102 and electronic device 104 can be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some operations that would be performed on electronic device 101 can be performed on one or more of external electronic devices 102, external electronic devices 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, either with further processing or without further processing. For this purpose, technologies such as cloud computing, distributed computing, or client-server computing may be used.

[0085] Figure 2 This is a view showing the unfolded state of an electronic device according to an embodiment of the present disclosure. Figure 2 Various figures showing the front, rear, and side surfaces of the electronic device 101 are illustrated. Figure 2 A cross-sectional view is provided showing that the display of the electronic device 101 according to an embodiment is in a fully unfolded state or in an intermediate state where the electronic device is partially unfolded.

[0086] Reference Figure 2 According to an embodiment, the electronic device 101 may include a foldable housing of the electronic device 300 and a flexible or foldable display 200 (hereinafter referred to as 'display' 200) disposed in the space defined by the foldable housing of the electronic device 300. Figure 1 Display device 160).

[0087] According to an embodiment, the surface on which the display 200 is disposed can be defined as the front surface of the electronic device 101. The front surface of the electronic device 101 can be formed at least partially, substantially, of a transparent front panel (e.g., a glass plate or a polymer plate containing various coatings). The opposite surface of the front surface can be defined as the rear surface of the electronic device 101. The rear surface of the electronic device 101 can be formed substantially of an opaque rear panel (hereinafter referred to as the "rear cover"). The rear cover can be made, for example, of coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of these materials. The surface surrounding the space between the front and rear surfaces can be defined as the side surface of the electronic device 101. The side surface can be coupled to the front panel and the rear cover and can be made of a side bezel structure (or "side member") containing metal and / or polymer. In an embodiment, the rear cover and the side bezel structure can be integrated together and can contain the same material (e.g., a metallic material such as aluminum).

[0088] Electronic device 101 may include at least one or more of the following: display 200, audio modules 204, 205, 206, sensor module 209, camera modules 207 and 208, key input devices 211, 212, and 213, and connector hole 214. According to embodiments, electronic device 101 may not include at least one of these components (e.g., key input devices 211, 212, and 213), or may further include other components (e.g., light-emitting devices).

[0089] According to various embodiments, the display 200 may be a display in which at least a portion of its area can be deformed into a flat surface or a curved surface. According to embodiments, the display 200 may have a folding portion 203 disposed on one side of the folding portion 203 (e.g., on...). Figure 2 The first part 201 (above the folded portion 203 shown), and the part set on the other side (e.g., on the folded portion 203 shown) Figure 2 The second part 202 (below the folded portion 203 shown). However, Figure 2 The division of the display 200 shown is an example, and the display 200 can be divided into multiple parts (e.g., four or more parts, or two parts) depending on its structure or function. For example, in Figure 2 In the illustrated embodiment, a portion of the display 200 may be separated by a folding portion 203 or a folding axis AA', but in another embodiment, the display 200 may be separated by another folding portion or another folding axis perpendicular to the folding axis (e.g., folding axis A-A').

[0090] Audio modules 204, 205, and 206 may include a microphone hole 204 and speaker holes 205 and 206. A microphone for capturing external sound may be disposed in the microphone hole 204, and in embodiments, multiple microphones may be disposed therein to sense the direction of sound. Speaker holes 205 and 206 may include an external speaker hole 205 for telephone calls and a receiver hole 206. In embodiments, speaker holes 205 and 206 and microphone hole 204 may be integrated into a single hole, or a speaker (e.g., a piezoelectric speaker) may be included without speaker holes 205 and 206. Depending on the embodiment, the position and number of microphone holes 204 and speaker holes 205 and 206 may be varied in various ways.

[0091] Camera modules 207 and 208 may include a first camera module 207 disposed on a first surface 310a of a first housing 310 of electronic device 101 and a second camera module 208 disposed on a second surface 310b. Electronic device 101 may also include a flash (not shown). Camera modules 207 and 208 may include one or more lenses, image sensors, and / or image signal processors. The flash (not shown) may include, for example, a light-emitting diode or a xenon lamp.

[0092] Sensor module 209 can generate electrical signals or data values ​​corresponding to the internal operating state or external environmental state of electronic device 101. Although not shown in the figures, electronic device 101 may additionally or alternatively include a sensor module for sensor module 209, instead of sensor module 209 disposed on the second surface 310b of the first housing 310. Electronic device 101 may further include at least one of the following as sensor modules: proximity sensor, fingerprint sensor, HRM sensor, gesture sensor, gyroscope sensor, barometer sensor, magnetic sensor, accelerometer sensor, grip sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0093] Key input devices 211, 212, and 213 may be disposed on the side surface of the foldable housing of the electronic device 300. In another embodiment, the electronic device 101 may exclude some or all of the aforementioned key input devices 211, 212, and 213, and the excluded key input devices may be implemented in other types, such as soft keys on the display 200. In embodiments, the key input devices may be configured so that key input is achieved through a sensor module.

[0094] Connector hole 214 may accommodate a connector (e.g., a USB connector) for sending and receiving power and / or data to and from an external electronic device, or additionally or alternatively, may accommodate a connector for sending and receiving audio signals to and from an external electronic device.

[0095] According to various embodiments, the foldable housing of electronic device 300 may include a first housing structure 310, a second housing structure 320, a first rear cover 380, and a second rear cover 390. The foldable housing of electronic device 300 of electronic device 101 is not limited to... Figure 2 The types and combinations shown can be achieved by combining and / or combining other shapes or components. For example, in another embodiment, the first housing structure 310 and the first rear cover 380 can be integrally formed, and the second housing structure 320 and the second rear cover 390 can be integrally formed.

[0096] According to various embodiments, the first housing structure 310 may have a first surface 310a facing a first direction and a second surface 310b facing a second direction opposite to the first direction. The second housing structure 320 may have a third surface 320a facing a third direction and a fourth surface 320b facing a fourth direction opposite to the third direction. The electronic device 101 may be changed to a foldable state or an unfolded state, which will be referred to below. Figures 7A to 8B The following description is provided. According to an embodiment, the first surface 310a can face the third surface 320a in the fully folded state of the electronic device 101, and in the fully unfolded state, the third direction can be the same as the first direction.

[0097] According to various embodiments, a first housing structure 310 and a second housing structure 320 are disposed on both sides (or vertically) with a folding axis A-A' between them, and the overall shape is symmetrical with respect to the folding axis A-A'. The angle or distance between the first housing structure 310 and the second housing structure 320 may depend on whether the electronic device 101 is in an unfolded state, a folded state, or an intermediate state where the electronic device 101 is partially unfolded (or folded). According to embodiments, unlike the second housing structure 320, the first housing structure 310 also includes various sensors, but they may have a symmetrical shape in other areas.

[0098] According to various embodiments, a first rear cover 380 is disposed on one side of the folding axis A-A' on the rear surface of the electronic device 101, and may, for example, have a substantially rectangular edge, wherein the edge may be surrounded by a first housing structure 310. Similarly, a second rear cover 390 is disposed on the other side of the folding axis A-A' on the rear surface of the electronic device 101, and its edge may be surrounded by a second housing structure 320.

[0099] According to various embodiments, the first rear cover 380 and the second rear cover 390 may have substantially symmetrical shapes and have a folding axis A-A' therebetween. However, the first rear cover 380 and the second rear cover 390 need not have symmetrical shapes, and in another embodiment, the electronic device 101 may include the first rear cover 380 and the second rear cover 390 having various shapes. In another embodiment, the first rear cover 380 may be integrally formed with the first housing structure 310, and the second rear cover 390 may be integrally formed with the second housing structure 320.

[0100] According to various embodiments, the first rear cover 380, the second rear cover 390, the first housing structure 310, and the second housing structure 320 may define spaces in which various components (e.g., printed circuit boards or batteries) of the electronic device 101 are disposed. According to embodiments, one or more components may be disposed or visibly exposed on the rear surface of the electronic device 101. For example, at least a portion of the sub-display 210 may be visibly exposed through the first rear cover 380. In another embodiment, one or more components or sensors may be visibly exposed through the first rear cover 380. In various embodiments, sensors may include proximity sensors and / or a rear camera module. Furthermore, although not specifically shown in the figures, one or more components or sensors may be visibly exposed through the second rear cover 390.

[0101] According to various embodiments, a front camera module 207 exposed through one or more openings on the front surface of the electronic device 101, or a rear camera module 208 exposed through a first rear cover 380, may include one or more lenses, an image sensor, and / or an image signal processor. A flash (not shown) may, for example, include a light-emitting diode or a xenon lamp. In embodiments, two or more lenses (infrared camera, wide-angle lens, and telephoto lens) and an image sensor may be disposed on one surface of the electronic device 101.

[0102] Figure 3A This is a view showing the unfolded state of an electronic device according to an embodiment of the present disclosure.

[0103] Reference Figure 3A The electronic device 300 may include: a pair of housing structures 310 and 320 (e.g., foldable housing structures) that rotate relative to a folding axis B via a hinge structure 360 ​​to fold with each other; and a display 330 (e.g., a flexible display or a foldable display) disposed in the space defined by the pair of housing structures 310 and 320.

[0104] According to an embodiment, when the electronic device 101 is unfolded, the display 330 can be implemented in a first shape. For example, the first shape may have a first aspect ratio (e.g., 4:3). According to an embodiment, when Figure 3A When the electronic device 300 is unfolded, the display 330 can be implemented in a second shape different from the first shape. For example, the second shape can have a second aspect ratio (16:9) different from the first aspect ratio (e.g., 4:3).

[0105] According to various embodiments, the first housing structure 310 and the second housing structure 320 may be disposed on both sides and have a folding axis B (e.g., a lateral folding axis) between them.

[0106] According to an embodiment, unlike the second housing structure 320, the first housing structure 310 has an area in which the camera module 314 and various sensors 315 are disposed, but they may have a symmetrical shape in another area. As another embodiment, the area in which the camera module 314 and various sensors 315 are disposed may be additionally disposed or replaced in at least a portion of the second housing structure 320.

[0107] As another embodiment, at least some of the camera module 314 and various sensors 315 may be disposed in at least a portion of the first housing structure 310, while another sensor may be disposed in at least a portion of the second housing structure 320.

[0108] According to various embodiments, the first housing structure 310 may have a first surface 311, a second surface 312, and a first side member 313, the first surface 311 being configured to face the front surface of the electronic device 300 in the unfolded state, the second surface 312 facing the opposite direction of the first surface 311, and the first side member 313 surrounding at least a portion of the space between the first surface 311 and the second surface 312.

[0109] According to various embodiments, the second housing structure 320 may have a third surface 321, a fourth surface 322, and a second side member 323. The third surface 321 is configured to face the front surface of the electronic device 300 in the unfolded state, the fourth surface 322 faces the opposite direction of the third surface 321, and the second side member 323 surrounds at least a portion of the space between the third surface 321 and the fourth surface 322.

[0110] According to various embodiments, the camera module 314 may be exposed through the front surface of the electronics 300 via an opening formed at the corner of the first housing structure 310. The sensor 315 may include at least one of a proximity sensor, an illumination sensor, an iris sensor, an ultrasonic sensor, and an indicator. For example, the sensor 315 may be exposed through the front surface of the electronics 300 via an opening formed at the corner of the first housing structure 310, or it may be disposed at the lower end of at least a portion of the display 330.

[0111] According to various embodiments, the first housing structure 310 may include a receiver 316 disposed in at least a portion of the area. In embodiments, although not shown in the figures, the electronic device 300 may include a headphone jack, an external speaker module, a SIM card tray, an interface connector port, or at least one key button disposed in the first housing structure 310 and / or the second housing structure 320.

[0112] According to various embodiments, one or more components may be disposed on or visually exposed on the rear surface of the electronic device 300. According to embodiments, one or more components or sensors may be visually exposed through the rear surface (second surface) 312 of the electronic device 300. Sensors may include a rear camera module 372 and / or a proximity sensor 374. According to embodiments, the sub-display 370 may be at least partially visually exposed through the rear surface 312 of the first housing structure 310.

[0113] According to various embodiments, the angle or distance between the first housing structure 310 and the second housing structure 320 may depend on the unfolded state (or flat state) of the electronic device 300 (e.g., Figure 3A The state of folding (e.g., the state of folding). Figure 3B The state can be either a closed state, an open state, or a semi-folded state. Not limited to the above description, the closed state, open state, and semi-folded state of the electronic device can be determined based on the angle between the first housing structure 310 and the second housing structure 320, as will be described below. The term "state" can be replaced by "mode".

[0114] According to various embodiments, the electronic device 300 may include a first motion sensor 340 and a magnetic material (e.g., a magnet) 342 disposed in at least a portion of the first housing structure 310. According to embodiments, the first motion sensor 340 may be a combination of at least two of an accelerometer, an angular velocity sensor (e.g., a gyroscope sensor), or a geomagnetic sensor. For example, the electronic device 300 may sense the posture and gestures of the first housing structure 310 via the first motion sensor 340. Specifically, the posture of the first housing structure 310 may be sensed based on the accelerometer of the first housing structure 310, and the gestures of the first housing structure 310 may be sensed based on the angular velocity sensor of the first motion sensor 340. According to embodiments, the magnetic material 342 may be disposed in at least a portion of the first housing structure 310 adjacent to the hinge structure 360.

[0115] According to various embodiments, the electronic device 300 may include a second motion sensor 350 and a magnetic sensor module 352 disposed in at least a portion of the second housing structure 320. According to embodiments, the second motion sensor 350 may be a combination of at least two of an accelerometer, an angular velocity sensor (e.g., a gyroscope sensor), or a geomagnetic sensor. For example, the electronic device 300 may sense the posture of the second housing structure 320 via the accelerometer of the second motion sensor 350, and may sense gestures of the second housing structure 320 via the angular velocity sensor of the second motion sensor 350. According to embodiments, the magnetic sensor module 352 may be disposed in at least a portion of the second housing structure 320 adjacent to the hinge structure 360. For example… Figure 3B As shown, the magnetic material 342 of the first housing structure 310 and the magnetic sensor module 352 of the second housing structure 320 can be configured to face each other at least partially in the folded state of the electronic device 300.

[0116] Figure 3B This is a view showing the folded state of an electronic device according to an embodiment of the present disclosure.

[0117] Reference Figure 3B The electronic device 300 may include: a pair of housing structures 310 and 320 coupled to be rotated relative to a folding axis B (e.g., a lateral folding axis) via a hinge structure 360 ​​to fold with each other (e.g., a foldable housing structure); and a display 330 (e.g., a flexible display or a foldable display) disposed in the space defined by the pair of housing structures 310 and 320.

[0118] According to various embodiments, the sensor may include a rear camera module 372 and / or a proximity sensor 374. According to embodiments, the sub-display 370 may be at least partially visible through the rear surface 312 of the first housing structure 310.

[0119] According to various embodiments, one or more components may be disposed on or visually exposed on the rear surface of the electronic device 300. According to embodiments, one or more components or sensors may be visually exposed through the rear surface (second surface) 312 of the electronic device 300. Sensors may include a rear camera module 372 and / or a proximity sensor 374. According to embodiments, the sub-display 370 may be at least partially visually exposed through the rear surface 312 of the first housing structure 310.

[0120] Figure 4 An electronic device according to embodiments of this disclosure (e.g., Figure 1 Exploded perspective view of electronic device 101.

[0121] Reference Figure 4The electronic device 101 may include a display 330, a printed circuit board 450, a battery 460, a rear housing 470, a first rear cover 480, and a second rear cover 490. Figure 4 The electronic device 101, display 330, first back cover 480 and second back cover 490 can be connected with Figure 2 The electronic device 101, display 200, first back cover 380 and second back cover 490 are completely or partially identical.

[0122] According to various embodiments, the front housing 440 may be disposed within the electronic device 101 and connected to, or integrated with, the side bezel structure 441. For example, the front housing 440 may be made of a metallic material and / or a non-metallic material (e.g., a polymer). A display 330 may be coupled to a surface of the front housing 440, and a printed circuit board 450 may be coupled to another surface of the front housing 440. According to embodiments, the front housing 440 may be at least a portion of a first housing structure 310 or a second housing structure 320.

[0123] According to various embodiments, the camera module (e.g., Figure 2 The camera module 207 can be housed in the front housing 440. The camera module 207 can be exposed outside the electronics through an opening or recess formed in the display 330.

[0124] According to various embodiments, the processor, memory, and / or interface may be mounted on the printed circuit board 450. The processor may include, for example, one or more of a CPU, application processor, graphics processor, image signal processor, sensor hub processor, and communication processor. The memory may include volatile or non-volatile memory. The interface may include a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, an SD card interface, and / or an audio interface. The interface may, for example, electrically or physically connect the electronic device 101 to an external electronic device, and may include a USB connector, an SD card / MMC connector, or an audio connector.

[0125] According to various embodiments, the battery 460, as a means of supplying power to one or more components of the electronic device 101, may include a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. For example, at least a portion of the battery 460 may be disposed in a plane substantially the same as the printed circuit board 450. The battery 460 may be integrally disposed in the electronic device 101 and may be detachably attached to the electronic device 101.

[0126] According to various embodiments, the rear housing 470 may be disposed below the printed circuit board 450. According to one embodiment, the rear housing 470 may have a surface to which at least one of the printed circuit board 450 or the battery 460 is coupled. According to another embodiment, the rear housing 470 may have another surface to which an antenna is coupled. The antenna may be disposed between the first rear cover 480 and the battery 460. The antenna may, for example, include a near-field communication (NFC) antenna, a wireless charging antenna, and / or a magnetically secure transmission (MST) antenna. The antenna may, for example, perform near-field communication with an external device, or may wirelessly transmit and receive power for charging. In another embodiment, the antenna structure may be formed by a portion or combination of the side bezel structure 441 and / or the front housing 440.

[0127] According to various embodiments, the first rear cover 480 and the second rear cover 490 may form part of the appearance of the electronic device 101. For example, the first rear cover 480 and the second rear cover 490 may be disposed below the rear housing. According to an embodiment, the first rear cover 480 may be disposed below the first housing structure 310, while the second rear cover 490 may be disposed below the second housing structure 320.

[0128] According to various embodiments, in the printed circuit board of the electronic device 101, the first microphone 435a can be disposed at a position corresponding to the first housing structure 310, and the second microphone 435b can be disposed at a position corresponding to the second housing structure 320.

[0129] Figure 5 This is a view showing a pattern relating to the angle between the housings of the electronic device (e.g., the first housing 310 and the second housing 320) according to an embodiment of the present disclosure.

[0130] Reference Figure 5 The electronic device 101 (e.g., at least one processor 120) can identify the state of the housing (e.g., the angle between the first housing 310 and the second housing 320) and can identify a pattern corresponding to the identified state. For example, the electronic device can identify the angle between the first housing 310 and the second housing 320, and as... Figure 5 As shown, a second mode 502 can be identified that corresponds to a second angle range including the identified multiple modes 501.

[0131] For example, electronic device 101 (e.g., at least one processor 120) can recognize patterns corresponding to angles between housings (e.g., first housing 310 and second housing 320). Figure 5As shown, the electronic device 101 can store multiple patterns 501 related to the angle between the first housing 310 and the second housing 320 in the memory 130, and can identify the pattern corresponding to the current angle between the first housing 310 and the second housing 320. Pattern 501 (e.g., Figure 5 The first mode and the second mode can each correspond to a specific angular range (e.g., Figure 5 The first angle range and the second angle range). For example, mode 501 may include a closed mode corresponding to an angle range of 0° to 10°, a hysteresis mode corresponding to an angle range of 11° to 20°, a first open mode corresponding to an angle range of 21° to 90°, a half-fold mode corresponding to an angle range of 91° to 130°, and a second open mode corresponding to an angle range of 131° to 180°. The hysteresis mode may be a mode in which a predetermined event (e.g., performing an image background event) does not occur according to the angle between the first housing 310 and the second housing 320. The angle ranges corresponding to mode 501 may be configured in various ways and are not limited to those described above. A particular angle range may represent a specific range from one angle to another, or it may represent only a particular angle. For example, the first mode (e.g., the open mode) may be configured to correspond to a specific angle (e.g., 180°) or to a specific angle range (e.g., 131° to 180°). Depending on whether the electronic device 101 is in contact with the ground, the angle ranges corresponding to mode 501 may be configured to be different from each other.

[0132] According to various embodiments, this mode may be a concept for electronic device 101 (e.g., at least one processor 120) to identify the current state of a housing included in electronic device 101. Therefore, electronic device 101 can provide a user with services corresponding to the current state of the housing (e.g., the angle between housings) by controlling the operation of electronic device 101 generally based on the current mode.

[0133] According to various embodiments, this disclosure is not limited thereto, and the same description may be referenced even if more than two housings are provided. For example, when the electronic device 101 includes three housings (e.g., first housing 310 to third housing), a first pattern corresponding to a first angular range between the first housing 310 and the second housing 320 and a second angular range corresponding to the second housing 320 and the third housing can be identified.

[0134] In the following description, for ease of description, for example, when the first angle is included within a predetermined range, it means that the current angle is included within the angle range corresponding to the half-folding mode. Therefore, the following description may also be used not only when the current angle is included within the angle range corresponding to the half-folding mode, but also when the current angle is included within the angle range corresponding to another mode.

[0135] According to various embodiments, electronic device 101 (e.g., at least one processor 120) can identify the angle between the first housing 310 and the second housing 320 at various points in time.

[0136] For example, when at least one of the first housing 310 and the second housing 320 begins to rotate (clockwise or counterclockwise), the electronic device 101 (e.g., at least one processor 120) can identify the angle between the first housing 310 and the second housing 320.

[0137] For example, when at least one of the first housing 310 or the second housing 320 begins to rotate about a rotation axis and maintains that rotation, the electronic device 101 (e.g., at least one processor 120) can determine the angle between the first housing 310 and the second housing 320. As another example, when at least one of the first housing 310 or the second housing 320 stops rotating after starting to rotate about a rotation axis, the electronic device 101 can determine the angle between the first housing 310 and the second housing 320.

[0138] For example, electronic device 101 (e.g., at least one processor 120) can recognize the angle between the first housing 310 or the second housing 320, regardless of the rotation of at least one of the first housing 310 and the second housing 320.

[0139] Figure 6A This is a view showing a conventional mode of the recording mode of an electronic device according to an embodiment of the present disclosure.

[0140] Figure 6B This is a view illustrating an interview mode of an electronic device in recording mode according to an embodiment of the present disclosure.

[0141] Figure 6C This is a view showing the voice memo mode of an electronic device in recording mode according to an embodiment of the present disclosure.

[0142] According to various embodiments, a user can perform a recording function in electronic device 101 and select one of a variety of recording modes (e.g., regular mode, interview mode, and voice memo mode).

[0143] Reference Figure 6AWhen the normal mode 610 is selected, stereo or mono functions of multiple microphones included in the electronic device 101 can be configured.

[0144] Reference Figure 6B When interview mode 620 is selected, the voice beamforming function can be configured.

[0145] Reference Figure 6C When recording mode 630 is selected, the input voice can be converted into text and displayed on the monitor, and the stereo function of the mono function can also be set.

[0146] Figure 7A This is a view showing voice beamforming in the unfolded state of an electronic device according to an embodiment of the present disclosure.

[0147] Figure 7B This is a view showing voice beamforming in a folded state of an electronic device according to an embodiment of the present disclosure.

[0148] Figure 8A This is a view showing the voice signal in the unfolded state of an electronic device according to an embodiment of the present disclosure.

[0149] Figure 8B This is a view showing the voice signal of an electronic device in a folded state according to an embodiment of the present disclosure.

[0150] Reference Figure 7A The first microphone 710 can be disposed on the upper part of the electronic device 101, and the second microphone 720 can be disposed on the lower part. When the recording mode of the electronic device 101 is selected as interview mode, voice beamforming is applied to the voice signals input to the first microphone 710 and the second microphone 720, thereby enabling the input of directional voice signals. Voice beamforming can receive directional sounds and cancel ambient noise, and therefore can be applied to interview mode.

[0151] Reference Figure 7B When the user folds the electronic device 101 to its folded state, the first microphone 710 and the second microphone 720 are positioned in the same location. When voice beamforming is applied according to the interview mode in the folded state of the electronic device 101, an effect of offsetting the voice signal occurs, which may cause problems with normal recording.

[0152] Reference Figure 8AWhen the electronic device 101 is in the unfolded state, as shown in the figure, the upper and lower voices are separated, thus enabling normal recording. That is, it can be seen that at time point t1, signals input through the first microphone 710 and signals input through the second microphone 720 are detected; at time point t2, only the signal input through the first microphone 710 is detected; and at time point t3, only the signal input through the second microphone 720 is detected.

[0153] Reference Figure 8B When the electronic device 101 is folded, and voice beamforming is applied with the first microphone 710 and the second microphone 720 positioned in the same location, it can be seen that the voice signals input through the two microphones 710 and 720 are offset from each other, thus preventing normal recording. As described above, when the foldable electronic device is folded, the top / bottom physical microphones face the same direction, which may cause problems such as decreased sound quality and recording stoppage when beamforming is applied. Since the microphones can be used selectively when the electronic device 101 is folded, or the recording function configuration can be changed after recording is completed, for example by stopping voice beamforming, the normal function of the interview mode cannot be provided.

[0154] According to various embodiments, when the folded electronic device 101 is configured with a stereo function for recording, the first microphone 710 and the second microphone 720 are positioned in the same location, so the same operation as mono recording is performed without the substantial effect of stereo recording.

[0155] Figure 9 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0156] Reference Figure 9 The electronic device 101 may include a controller 900, a speaker 910, multiple microphones 915, a camera module 928, a GPS receiver 930, an RF processor 940, a sensor module 950, a touch screen 960, a touch screen controller 965, and an extended memory 970.

[0157] The controller 900 may include an interface 901, one or more processors 902 and 903, and internal memory 904. Depending on the circumstances, the entire controller 900 may be referred to as a processor. The interface 901, application processor 902, communication processor 903, and internal memory 904 may be separate components, or they may be integrated on one or more integrated circuits.

[0158] According to various embodiments, the electronic device 101 may include a plurality of microphones 915. For example, a first microphone 915a may be disposed in a first housing structure (e.g., Figure 2The first housing structure 310) is located therein, and the second microphone 915b can be disposed in the second housing structure (e.g., Figure 2 In the second shell structure 320).

[0159] In various embodiments, the extended memory 970 or internal memory 904 may be controlled by the application processor 920 to store speech beamformed by the microphone 915.

[0160] Figure 10 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0161] Reference Figure 10 Program 1000 (for example, Figure 1 The program 140 may include application 1051, frame 1060 and sensor driver 1080.

[0162] According to an embodiment, application 1051 may have a database of at least one or more applications executed in electronic device 101, and may provide a request for executing a specific application in correspondence with input from a user.

[0163] According to an embodiment, the display manager 1061 (or window manager) can control the state of the display 200. The display manager 1061 can determine the size, position, or transparency of windows displayed on the display 200, and can execute drawing control commands for the windows. The display manager and the window manager can be implemented separately.

[0164] According to an embodiment, the power manager 1067 can manage the power state of the entire electronic device 101 or certain modules to effectively control the power consumption of the electronic device 101. For example, power state management can be performed by controlling the voltage or clock frequency.

[0165] According to an embodiment, the input frame 1065 can receive various sensor values ​​for measuring the unfolded / folded state of the electronic device 101. The input frame 1065 can determine the unfolded / folded state of the electronic device 101 by identifying sensor values ​​obtained from at least one or more sensors and send them to the processor 120.

[0166] According to an embodiment, the folding event processor 1063 can receive folding / unfolding events sent to the electronic device 101 of the processor 120, and can control the display 200 and the sub-display 210 to open / close via the power manager.

[0167] According to an embodiment, the graphics editor 1069 can combine and store the graphical information of the windows on the display 200 into the frame buffer (memory) 1071. The frame buffer 1071 can store the graphical information to be output to the displays 200 and 210. The sensor driver 1080 (e.g., angle sensor driver 1083, distance sensor driver 1085, and gyroscope sensor driver 1087) can be a software module for controlling sensor integrated circuits (ICs).

[0168] According to an embodiment, electronic device 101 can determine the display that is enabled corresponding to a change from a first state to a second state of electronic device 101.

[0169] For example, sensor driver 1080 (e.g., at least one or more of angle sensor driver 1083, distance sensor driver 1085, and gyroscope sensor driver 1087) can send sensed values ​​to input frame 1065. Input frame 1065 can use the obtained sensed values ​​to send information about the electronics 101 being in a second state to folding event processor 1063.

[0170] For example, the folding event processor 1063 can send a request to power manager 1067 and display manager 1061 to enable display 200 and disable sub-display 210 based on the state of the currently running application, a pre-stored strategy corresponding to a change in the state of electronic device 101, and the enable / disable permission states of displays 200 and 210.

[0171] The power manager 1067 can cooperate with the power controller 1092 to control the display driver 1094 to enable the display 200 and disable the sub-display 210 in response to requests received from the folding event processor 1063. The disabling of the sub-display 210 and the enabling of the display 200 can be performed sequentially or simultaneously.

[0172] According to various embodiments, the activation or deactivation of displays 200 and 210 can be performed by controlling the current applied to displays 200 and 210 and by controlling the brightness of the light source elements of displays 200 and 210. The activation or deactivation of displays 200 and 210 can be performed using both or only one of power manager 1067 and display manager 1061.

[0173] Display manager 1061 can configure and display an image (which is displayed when displays 200 and 210 change from a disabled state to an enabled state), control the position and size of windows displayed on displays 200 and 210, remove the image displayed when displays 200 and 210 change from a disabled state to an enabled state, and then display windows on displays 200 and 210 in response to requests received from collapse event handler 1063.

[0174] Figure 11A This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure.

[0175] Reference Figure 11A In operation 1111, electronic device 101 can execute a recording mode. According to various embodiments, the recording mode may include at least one of a regular mode, an interview mode, and a voice memo mode.

[0176] According to various embodiments, in operation 1112, the electronic device 101 may receive a folding event. The folding event may include an event occurring due to a change in the folding angle between the first housing structure 310 and the second housing structure 320. According to various embodiments, the folding event may be an event occurring when the electronic device 101 is fully unfolded or fully folded.

[0177] According to various embodiments, in operation 1113, electronic device 101 can determine the fold angle based on the reception of the folding event, and can determine the direction of voice beamforming based on the determined fold angle.

[0178] Voice beamforming can include techniques that maintain the continuity of recording functionality even when the position of the microphone changes due to a change in the folding state of the electronic device. For example, voice beamforming can include techniques that amplify a signal by recognizing directionality when one of two signals comes from a first microphone located at the top of the electronic device and a second microphone located at the bottom, and reduce the volume by determining that the sound is ambient when the same signal is input.

[0179] According to various embodiments, in operation 1114, electronic device 101 can perform recording in accordance with the determined direction of voice beamforming. In operation 1115, electronic device 101 can complete recording upon receiving a signal corresponding to the end of the recording mode. If no signal corresponding to the end of the recording mode is received in operation 1115, electronic device 101 can enter operation 1112, and can repeat the above process upon receiving a folding event.

[0180] Figure 11B This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure.

[0181] Reference Figure 11B In operation 1121, the electronic device 101 can execute a specific recording mode. According to various embodiments, the specific recording mode may include at least one of a regular mode, an interview mode, and a voice memo mode.

[0182] According to various embodiments, in operation 1122, the electronic device 101 may receive a folding event. The folding event may include an event occurring due to a change in the folding angle between the first housing structure 310 and the second housing structure 320. According to various embodiments, the folding event may be an event occurring when the electronic device 101 is fully unfolded or fully folded.

[0183] According to various embodiments, in operation 1123, electronic device 101 can determine the folding state (e.g., unfolded state or folded state) based on the receipt of a folding event, and can identify the configuration of the recording function based on the folding state and a specific recording mode.

[0184] According to various embodiments, in operation 1214, electronic device 101 can perform recording by applying the configuration of the identified recording function. In operation 1125, electronic device 101 can complete recording when a signal corresponding to the end of recording is received. When no signal corresponding to the end of the recording mode is received in operation 1122, electronic device 101 can enter operation 1125, and can repeat the above process when a folding event is received.

[0185] According to various embodiments, the method for identifying the configuration of a recording function based on a folded state and a specific recording mode can be implemented in various ways. For example, as shown in Table 1 below, the configuration of the recording function corresponding to the recording mode and folded state can be mapped and stored in memory 130, and then the configuration of the recording function that meets the corresponding conditions can be identified.

[0186] Table 1

[0187]

[0188] The configuration of the mono function is shown in Table 1. When recording mode is executed in normal mode or voice memo mode, stereo function is configured when the electronic device 101 is in the unfolded state. However, since there is no stereo recording effect when the electronic device 101 is changed to the folded state, the configuration can be automatically changed to mono function.

[0189] According to various embodiments, referring to Table 1, when the recording mode is executed in the interview mode, the beamforming mode is configured when the electronic device 101 is in the unfolded state, but the beamforming mode is configured when the electronic device 101 is in the folded state. Due to the beamforming function, the sound quality may decrease or the recording may stop. Therefore, the configuration of the beamforming function can be automatically changed to an unused state, and the configuration can be automatically changed to stereo or mono function.

[0190] Figure 11C This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure.

[0191] Reference Figure 11C In operation 1131, electronic device 101 can execute interview mode in the unfolded state. According to various embodiments, when the recording mode of interview mode is executed in the unfolded state, in operation 1132, electronic device 101 can perform recording because voice beamforming is automatically applied.

[0192] According to various embodiments, the electronic device 101 can receive a folding event during operation 1133 while simultaneously executing an interview mode in the unfolded state. The folding event may include an event occurring due to a change in the folding angle between the first housing structure 310 and the second housing structure 320. According to various embodiments, the folding event may also occur when the electronic device 101 is fully unfolded or fully folded.

[0193] According to various embodiments, in operation 1133, electronic device 101 can determine the fold angle or fold state in response to the receipt of a folding event, and in operation 1134, when it is determined that electronic device 101 is in a folded state based on the determined fold state, recording can be performed without applying voice beamforming. When it is determined in operation 1134 that electronic device 101 is in an unfolded state rather than a folded state based on the determined fold state, electronic device 101 can continue to perform recording by applying voice beamforming in operation 1132.

[0194] In operation 1136, when a signal corresponding to the end of the recording mode is received, the electronic device 101 can complete the recording. When no signal corresponding to the end of the recording mode is received in operation 1133, the electronic device 101 can execute operation 1136, and can repeat the above process when a folding event is received.

[0195] Figure 11D This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure.

[0196] Reference Figure 11DIn operation 1141, the electronic device 101 can execute the interview mode in a folded state. According to various embodiments, when executing the recording mode of the interview mode in the folded state, in operation 1142, the electronic device 101 can perform recording without applying voice beamforming. According to various embodiments, in operation 1143, the electronic device 101 can display information about the currently executing interview mode. For example, since it is impossible to provide the user with the functionality of the regular interview mode due to the deterioration of the interview mode when the screen is folded, an image or text guiding the electronic device 101 to unfold can be displayed on the screen.

[0197] According to various embodiments, in operation 1144, the electronic device 101 may receive a folding event while simultaneously executing an interview mode in a folded state. The folding event may include an event occurring due to a change in the folding angle between the first housing structure 310 and the second housing structure 320. According to various embodiments, the folding event may also occur when the electronic device 101 is fully unfolded or fully folded.

[0198] According to various embodiments, in operation 1144, electronic device 101 can determine a folding angle or folding state corresponding to the reception of a folding event, and in operation 1145, based on the determined folding state, when it is determined that electronic device 101 is in an unfolded state, a recording operation can be performed by applying speech beamforming. When it is determined that electronic device 101 is in a folded state rather than an unfolded state, in operation 1145 based on the determined folding state, electronic device 101 can perform recording by continuing without applying speech beamforming as in operation 1142.

[0199] In operation 1147, when a signal corresponding to the end of the recording mode is received, the electronic device 101 can complete the recording. When no signal corresponding to the end of the recording mode is received in operation 1144, the electronic device 101 can execute operation 1147, and can repeat the above process when a folding event is received.

[0200] Figure 12 This is a block diagram illustrating a detailed configuration of the application processor of an electronic device according to an embodiment of the present disclosure.

[0201] Reference Figure 12 The application processor 902 may include a recording mode selector 1210 and a recording function setter 1220. The electronic device 101 may perform recording mode reception (execute application).

[0202] The recording mode selector 1210 can select one of the following modes based on user input: normal mode, interview mode, voice memo mode (or text mode). Information about the selected recording mode can be provided to the recording function setter 1220.

[0203] The recording function setter 1220 can control multiple microphones 915 to perform voice beamforming according to the selected recording mode. For example, when the normal mode is selected via the recording mode selector 1210, the recording function setter 1220 can configure the beamforming direction to receive voice signals in all directions, and can display the visual effect of the voice beamforming direction corresponding to the normal mode by controlling the display device.

[0204] According to various embodiments, when an interview mode is selected via the recording mode selector 1210, the recording function setter 1220 can configure the beamforming direction toward the microphone, and the visual effect corresponding to the voice beamforming direction of the interview mode can be displayed by controlling the display device. Alternatively, when a voice memo mode (or text mode) is selected, forward and backward beamforming directions can also be configured for the microphone, and the visual effect corresponding to the voice beamforming direction of the voice memo mode can be displayed by controlling the display device.

[0205] Figure 13 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure. The electronic device 101 can detect the folding angle of a display during a folding angle detection operation. For example, the detected folding angle of the display can be identified based on at least one of a motion sensor or a magnetic sensor. The processor can periodically identify whether the folding angle of the display, detected by at least one of the motion sensor or magnetic sensor modules, has changed.

[0206] Reference Figure 13 Electronic device 1300 (e.g., Figure 1 The electronic device 101 may include a processor 1310, a display 1360, a sensor module 1320, a display driver integrated circuit (DDI) 1350, a memory 1330, an audio module 1340, or a combination thereof.

[0207] The DDI 1350 can receive image information, such as image data or image control signals corresponding to commands for controlling the image data, from other components of the electronic device 1300 via an interface module. For example, the DDI 1350 can receive image information from the processor 1310 or an auxiliary processor (not shown) (e.g., a graphics processor) that operates independently of the processor 1310. According to an embodiment, the DDI 1350 can communicate with the interface module via touch circuitry, a sensor module 1320, etc. According to an embodiment, the DDI 1350 can store at least a portion of the received image information in the memory 1330, for example, in frames.

[0208] Audio module 1340 (e.g., Figure 1 The audio module 170 can convert sound into electrical signals, or vice versa. According to an embodiment, the audio module 1340 can use multiple microphones (e.g., ...). Figure 9 Sound can be obtained through the microphone 915, or it can be output through the sound output device 155 or through an external electronic device (e.g., electronic device 102) (e.g., speaker or headphones) directly or wirelessly connected to the electronic device 101.

[0209] Electronic device 1300 may include two or more displays (e.g., display 200 and sub-display 210). Sensor module 1320 may include motion sensors (e.g., Figure 3A Motion sensors 340 and 350) and magnetic sensor modules (e.g., Figure 3A (Magnetic sensor module 352). When the sensor module 1320 detects a change in the state of the electronic device 101, information from the display area corresponding to the changed state of the electronic device 101 can be sent to the processor 1310.

[0210] In this embodiment, when a change in the state of the electronic device is detected, the window manager can send information about the display area corresponding to the changed state of the electronic device 101 to an application configured with the continuity of the currently running application. In this embodiment, the display area of ​​the display based on the state of the electronic device before the change can be referred to as the first display area. The display area of ​​the display based on the state of the electronic device after the change can be referred to as the second display area. According to this embodiment, when a collapse event occurs while performing a recording function in interview mode, the recording status can be displayed in the second display area.

[0211] Figure 14 This is a view showing a UI displayed on a screen of an electronic device according to an embodiment of the present disclosure.

[0212] Reference Figure 14 The electronic device 101 can display the current recording status on the display 200 in the unfolded state. According to various embodiments, when the electronic device 101 changes to the folded state, the current recording status can be displayed on the sub-display 1410 (e.g., sub-display 210).

[0213] Figure 15 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0214] refer to Figure 15The electronic device 101 may include: a hardware layer, which includes a sensor module 1511, a microphone module 1512, and a display 1513; a kernel layer, which includes a state management module 1521, an audio driver 1523, and a display controller 1533; a library layer, which includes a beamforming module 1531 and a surface spreader 1532; a frame layer, which includes a window manager 1541, an audio management manager 1542, an audio service 1543, and a view manager 1544; and an application layer including an application 1551.

[0215] The kernel layer, library layer, framework layer, and application layer can be stored in memory as instruction types, so that the processor can perform the corresponding configured operations during execution.

[0216] Application 1551 can draw at least one layer based on the resolution of the second display area of ​​display 1513. In an embodiment, application 1551 can use a drawing library (e.g., a view) to draw at least one layer based on the resolution of the second display area of ​​display 1513.

[0217] When the sensor module 1511 detects a change in the state of the electronic device 101, the window manager 1541 can send information about the display area corresponding to the changed state of the electronic device 101 to the application 1551. For example, when a change in the electronic device 101 is detected, information about the display area corresponding to the changed state of the electronic device 101 can be sent to an application that is configured with the continuity of the currently running application.

[0218] View manager 1544 may be a program for drawing at least one layer based on the resolution of a second display area of ​​display 1513. In an embodiment, application 1551 may use view manager 1544 to draw at least one layer based on the resolution of the second display area of ​​display 1513.

[0219] When the state management module 1521 receives information about a change in the folding state, the audio management manager 1542 can perform screen, beamforming, and audio management based on the folding angle. For example, audio (e.g., beamforming) related to the running application can be configured based on the folding angle of the display 1513, and the audio can be notified to the framework of the application 1551 and the audio service 1543, thereby enabling the reconfiguration of the screen and audio states.

[0220] As a hardware abstraction layer (HAL), the library layer can represent an abstraction layer between multiple hardware modules included in the hardware layer and the software of electronic device 101. Surface applicator 1532 can combine multiple layers. In an embodiment, surface applicator 1532 can provide data representing multiple combined layers to display controller 1533.

[0221] The kernel layer may include various drivers for controlling various hardware modules included in the electronic device 101. The kernel layer may include a sensor driver (not shown) that includes an interface module for controlling a sensor controller connected to a sensor. The display controller 1333 may correspond to a display driving circuit (e.g., Figure 13 (DDI 1350). In embodiments, the processor configuration can be implemented in either hardware or software.

[0222] Figure 16 This is a flowchart illustrating an embodiment of the operation of an electronic device according to an embodiment of the present disclosure.

[0223] Reference Figure 16 In operation 1610, when the recording mode is executed, the electronic device 101 can receive a voice signal corresponding to the voice beamforming direction.

[0224] According to various embodiments, in operation 1620, the electronic device 101 can determine whether beamforming processing has been applied based on the current folded state. For example, in operation 1630, when an interview mode is executed in the unfolded state of the electronic device 101, it can be determined that beamforming processing is being applied and can be applied based on the received voice signal.

[0225] When the electronic device 101 determines in operation 1620 that beamforming processing has not been applied based on the current folding state, the electronic device 101 can operate in stereo mode in operation 1640.

[0226] Figure 17 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure. The electronic device 101 can receive a voice signal corresponding to a voice beamforming direction.

[0227] Reference Figure 17 The speaker's voice can be input to multiple microphones (e.g., first microphone 1710a, second microphone 1710b, and third microphone 1710c).

[0228] Speech (sound) input via microphone 1710 can be converted into an electrical signal by analog-to-digital converter (ADC) 1720. According to various embodiments, when speech (sound) is processed by ADC 1720, pulse-code modulation (PCM) sound can be extracted. For example, ADC 1720 can digitize the PCM-type signal by processing it via a third-party module (e.g., a PCM sound module, a PCM tone generator, etc.) and send the speaker's speech (sound) to recorder 1760, through which processor 120 can then perform recording.

[0229] According to various embodiments, the processor 120 can extract the folded angle, at which voice (sound) is input via the state management module 1740. The extracted angle can be stored in the system memory 1730.

[0230] According to various embodiments, the system memory 1730 can send the stored angles to the recorder 1760 in real time via the audio status management manager 1750.

[0231] According to various embodiments, processor 120 can perform recording based on PCM sound transmitted via recorder 1760, and can analyze the directionality of the PCM sound using folding angles transmitted during recording. Based on the analyzed directionality, processor 120 can display narrator information on a display. The directionality can be synchronized with the PCM sound and stored in memory 1730.

[0232] Figure 18 This is a graph 1800 showing the audio signal received by an electronic device in a folded state according to an embodiment of the present disclosure.

[0233] Figure 19A This is a view showing the voice beamforming of an electronic device in an unfolded state according to an embodiment of the present disclosure.

[0234] Figure 19B This is a view showing the voice reception direction of an electronic device in a folded state according to an embodiment of the present disclosure.

[0235] Reference Figure 18 According to various embodiments, when an interview mode is executed in the unfolded state (e.g., open state) of the electronic device 101, a signal 1810 to which voice beamforming has been applied can be received. Furthermore, when the electronic device 101 is folded (e.g., closed state), the applied voice beamforming is stopped and stereo recording signals 1820 and 1830 (e.g., R channel and L channel turned off) can be received.

[0236] Reference Figure 19A When the interview mode is executed in the unfolded state of the electronic device 101, voice beamforming is applied, the first microphone 710 can receive the voice of the speaker in front, and the second microphone 720 can receive the voice of the speaker behind.

[0237] Reference Figure 19B Even when the interview mode is being executed in the folded state of the electronic device 101, the stereo function of the mono function can be configured without applying voice beamforming.

[0238] Figure 20This is a view showing an audio signal received when the electronic device is in a folded state, according to an embodiment of the present disclosure.

[0239] Reference Figure 20 Voice beamforming can be applied in the unfolded state of electronic device 101, as shown in the left figure, and when electronic device 101 is folded, it can be changed to stereo function as shown in the right figure.

[0240] According to the embodiment, when recording voice in interview mode, if the electronic device 101 is folded based on a sensed fold, the beamforming process of the interview mode can be bypassed, and the electronic device 101 can be operated in the same mode as if it were folded during stereo recording. That is, recording continues even when the electronic device is folded in interview mode, but the recording can be performed using beamforming in stereo mode instead of interview mode.

[0241] Figure 21 This is a view showing a UI displayed on a screen of an electronic device according to an embodiment of the present disclosure. According to various embodiments, when specific recording mode and folding state information meet predetermined conditions (e.g., when it is determined that the electronic device 101 is in a folded state in interview mode), an image for guiding a change in the folding state can be displayed on the screen.

[0242] Reference Figure 21 The electronic device 101 can perform recording when the screen of the interview mode is open, and when the screen is folded, information 2110 related to the interview mode can be provided to the user through the screen due to the deterioration of the interview mode. For example, the electronic device 101 can display on the screen "Record in the unfolded state for best quality".

[0243] Figure 22A This is a view illustrating an example of an electronic device including three microphones according to an embodiment of the present disclosure.

[0244] Figure 22B This is a view illustrating an example of an interview mode using an electronic device according to an embodiment of this disclosure.

[0245] Reference Figure 22A and Figure 22B As described above, the first microphone 2210 can be disposed in the first housing structure 310, and the second microphone 2220 can be disposed in the second housing structure 320. According to various embodiments, the third microphone 2230 can be disposed in the rear camera module.

[0246] According to various embodiments, in the unfolded state of the electronic device 101, recording can be performed in interview mode using the upper first microphone 2210 and the lower second microphone 2220. Furthermore, when the electronic device 101 is in a semi-folded state, as shown in the figure, while recording is being performed in interview mode (e.g., the angle between the first housing structure 310 and the second housing structure 320 is α°, for example, 91° < α° < 130°), recording can also be performed in interview mode using the third microphone 2230.

[0247] Figure 23 This is a view illustrating a flexible display including multiple microphones in an electronic device according to an embodiment of the present disclosure.

[0248] Reference Figure 23 It can be based on a foldable device 2300 that can fold inward and outward (e.g., Figure 1 The folding state of the electronic device 2300 (101) determines whether beamforming is applied. For example, when the electronic device 2300 is folded inward or outward from the unfolded state 2300a to the folded state 2300b or 2300c, the first microphone 2310 and the second microphone 2320 can overlap each other. For example, when the first microphone 2310 and the second microphone 2320 overlap each other, the audio management manager (e.g., Figure 15 The audio management manager (1542) is used to bypass beamforming processing.

[0249] Figure 24 This is a view illustrating a flexible display including multiple microphones in an electronic device according to an embodiment of the present disclosure.

[0250] Reference Figure 24 When in a wrist-worn electronic device 2400 (e.g., Figure 1 When the first microphone 2410 and the second microphone 2420 are positioned close to each other in the electronic device 101, the audio management manager ( Figure 15 The audio management manager (1542) can control the speech beamforming function that bypasses the configuration.

[0251] Figure 25A , Figure 25B , Figure 25C , Figure 25D and Figure 25E This is a view illustrating a flexible display in an electronic device including multiple microphones according to various embodiments of the present disclosure.

[0252] Reference Figure 25A , Figure 25B , Figure 25C , Figure 25D and Figure 25EWhen slid to change the folded state of the electronic device 2500 (e.g., a rollable electronic device) (e.g., Figure 1 The electronic device 101 is curled up and if the first microphone 2510 and the second microphone 2520 are positioned close to each other, the audio management manager can be controlled. Figure 15 The audio management manager (1542) can be used to bypass the configured beamforming function.

[0253] Figure 26A , Figure 26B , Figure 26C , Figure 26D and Figure 26E This is a view illustrating a flexible display in an electronic device including multiple microphones according to various embodiments of the present disclosure.

[0254] Reference Figure 26A , Figure 26B , Figure 26C , Figure 26D and Figure 26E When the first microphone 2610 and the second microphone 2620 are positioned close to each other, or the third microphone 2630 and the fourth microphone 2640 are positioned close to each other, in the electronic device 2600 which can be folded inward and outward through three operations, the audio management manager can be controlled. Figure 15 The audio management manager (1542) can be used to bypass the configured beamforming function.

[0255] Reference Figure 26A , Figure 26B , Figure 26C , Figure 26D and Figure 26E The housing of the electronic device 2600 may include a first housing structure 2601, a second housing structure 2602, and a third housing structure 2603. Housing structures 2601, 2602, and 2603 can be rotated relative to each other to form a foldable electronic device. (See reference...) Figure 26A The electronic device 2600 can be folded inward to an inward-folded state 2600a, or folded outward to an outward-folded state 2600b. (See reference...) Figure 26B , Figure 26C and Figure 26D When the electronic device 2600 is partially unfolded, the first microphone 2610 and the second microphone 2620 can be spaced apart from each other by a predetermined distance, and the third microphone 2630 and the fourth microphone 2640 can be spaced apart from each other by a predetermined distance. According to various embodiments, when the electronic device 2600 is unfolded from... Figure 26B The unfolded state becomes Figure 26CWhen the device is in the inward folded state 2600a and the first microphone 2610 and the second microphone 2620 are positioned close to each other or the third microphone 2630 and the fourth microphone 2640 are close to each other, the electronic device 2600 can control the audio management manager (e.g., Figure 15 The audio management manager (1524) can be used to bypass the configured beamforming function.

[0256] Reference Figure 26E The electronic device 2600 can be switched to a fully folded state 2600c or a fully unfolded state 2600d. When the electronic device 2600 is in the fully unfolded state 2600d, the first microphone 2610 and the second microphone 2620 can be separated from each other by a predetermined distance, and the third microphone 2630 and the fourth microphone 2640 can be separated from each other by a predetermined distance.

[0257] Figure 27A , Figure 27B , Figure 27C , Figure 27D , Figure 27E and Figure 27F This is a view illustrating a flexible display in an electronic device including multiple microphones according to various embodiments of the present disclosure.

[0258] Reference Figure 27A , Figure 27B , Figure 27C , Figure 27D , Figure 27E and Figure 27F When the first microphone 2710 and the second microphone 2720 are in an electronic device 2700 that can be folded inward at both ends (e.g., Figure 1 When the electronic devices 101 are positioned close to each other, the audio management manager can be controlled. Figure 15 The audio management manager (1542) can be used to bypass the configured beamforming function.

[0259] Reference Figure 27A , Figure 27B , Figure 27C , Figure 27D , Figure 27E and Figure 27F The housing of the electronic device 2700 may include a first housing structure 2701, a second housing structure 2702, and a third housing structure 2703. Housing structures 2701, 2702, and 2703 can be rotated relative to each other to form a foldable electronic device. (See reference...) Figure 27A and Figure 27B The electronic device 2700 can be fully unfolded, or it can be folded inward by folding the first housing structure 2710 and the third housing structure 2703 onto the second housing structure 2702.

[0260] According to various embodiments, refer to Figure 27C and Figure 27D When the electronic device folds inward, the first microphone 2710 and the second microphone 2720 are positioned close to each other, and the electronic device 2700 can control the audio management manager. Figure 15 The audio management manager (1542) can be used to bypass the configured beamforming function.

[0261] According to various embodiments, refer to Figure 27E and Figure 27F The electronic device 2700 can be fully deployed. When the electronic device 2700 is fully deployed, the first microphone 2710 and the second microphone 2720 can be separated from each other by a predetermined distance.

[0262] Figure 28A , Figure 28B , Figure 28C and Figure 28D This is a view illustrating a flexible display in an electronic device including multiple microphones according to various embodiments of the present disclosure.

[0263] Reference Figure 28A , Figure 28B , Figure 28C and Figure 28D When the first microphone 2810 and the second microphone 2820 are positioned close to each other in an electronic device 2800 that can fold inward and outward in four operations, the audio management manager can be controlled. Figure 15 The audio management manager (1542) can be used to bypass the configured beamforming function.

[0264] Reference Figure 28A , Figure 28B , Figure 28C and Figure 28D The housing of the electronic device 2800 may include a first housing structure 2801, a second housing structure 2802, a third housing structure 2803, and a fourth housing structure 2804. Housing structures 2802, 2803, and 2804 can be rotated relative to each other to form a foldable electronic device. (See reference...) Figure 28A and Figure 28B The electronic device 2800 can be folded by completely folding the first housing structure 2801 into the fourth housing structure 2804.

[0265] Reference Figure 28A and Figure 28B When the electronic device 2800 is folded, the first microphone 2810 and the second microphone 2820 are positioned close to each other, and the electronic device 2800 can control the audio management manager. Figure 15 The audio management manager (1542) can be used to bypass the configured beamforming function.

[0266] Reference Figure 28C The electronic device 2800 can be fully deployed. When the electronic device 2800 is fully deployed, the first microphone 2810 and the second microphone 2820 can be separated from each other by a predetermined distance. (Refer to...) Figure 28D The electronic device 2800 can maintain the folding angle at a predetermined level. When the electronic device 2800 maintains the folding angle at the predetermined level, the first microphone 2810 and the second microphone 2820 can be separated from each other by a predetermined distance, and the recording function configuration can be adjusted based on the predetermined distance.

[0267] Figures 29A to 29K These are views illustrating various examples of electronic devices comprising at least two or more housing structures and flexible displays according to various embodiments of the present disclosure. According to various embodiments, the electronic device (e.g., Figure 1 The electronic device 101 may include a flexible display and two or more housing structures that are rotatably connected to each other.

[0268] According to various embodiments, the flexible display can be mounted on two or more housings and can be bent according to the rotational state of the housing structure.

[0269] According to various embodiments, the electronic device can be formed in various types, based on two or more housing structures, a flexible display included in the electronic device, and the rotational state of the housing structures.

[0270] Reference Figures 29A to 29K This can include types that define two regions in an electronic device (e.g., a flexible display) (half-fold), types that define three regions in an electronic device (e.g., a triple-fold, Z-fold, single-door fold), types that form four regions in an electronic device (e.g., a flexible display) (e.g., double parallel reverse fold, double parallel fold, double-door fold, roll-up fold, belt stacking, half-fold then half-fold), and types that form more than four regions (e.g., half-fold then triple-fold). The electronic device can include a rotatably connected housing structure and a flexible display, wherein the housing structure can rotate in a corresponding shape.

[0271] The electronic devices and operating methods according to various embodiments of this disclosure can be used not only in electronic devices including two housing structures, but also in applications such as... Figures 29A to 29K The electronic device shown includes three or more housing structures and a flexible display.

[0272] The electronic device according to various embodiments may include at least one microphone in each of the two housing structures, and as... Figures 29A to 29KAs shown, the distance between the microphones within the housing structure can be changed when the housing structure is folded into an unfolded or folded state. According to various embodiments, the recording function configuration can be adjusted by taking into account the distance between the microphones within the housing structure.

[0273] An electronic device according to any one of the various embodiments includes: a first housing structure including a first microphone; a second housing structure including a second microphone and foldably coupled to the first housing structure; a sensor module disposed in the first housing structure and / or the second housing structure; and a processor disposed in the first housing structure and / or the second housing structure and operatively connected to the first microphone, the second microphone, and the sensor module. The processor may be configured to: receive a folding event related to the first housing structure and the second housing structure via the sensor module when executing a specific recording mode; identify folding state information in response to receiving the folding event; identify a recording function configuration related to the first microphone and the second microphone based on the folding state information and the specific recording mode; and perform recording by applying the identified recording function configuration.

[0274] According to various embodiments, a particular recording mode may include at least one of an interview mode, a regular mode, a voice memo mode, or a text mode configured to record voice for a conversation partner.

[0275] According to various embodiments, the folding event may include an event that occurs corresponding to a change in the folding angle between the first housing structure and the second housing structure, and the distance between the first microphone and the second microphone is changed by changing the folding angle.

[0276] According to various embodiments, the folding state information may include the unfolded state of the electronic device, the folded state of the electronic device, and the state in which the folding angle between the first housing structure and the second housing structure is within a predetermined angle range.

[0277] According to various embodiments, the recording function configuration may include at least one of beamforming function configuration, stereo function configuration, and mono function configuration.

[0278] According to various embodiments, when a specific recording mode is an interview mode and the folding state information changes from an unfolded state to a folded state, the processor can control the recording function configuration to change from voice beamforming function to voice beamforming unapplied function.

[0279] According to various embodiments, the electronic device may also include a display device, and the processor is further configured to control a screen for guiding a change in the folding state to be displayed on the display device when a specific recording mode and folding state information meet predetermined conditions.

[0280] According to various embodiments, the processor can also display a screen via a display device to guide the change of the folded state to the unfolded state when the specific recording mode is an interview mode and the folding state information corresponds to the folded state.

[0281] A recording method for an electronic device is provided. The electronic device includes a first housing structure and a second housing structure, wherein the first housing structure includes a first microphone, the second housing structure includes a second microphone, and the second housing structure is foldably connected to the first housing structure. The recording method of the electronic device according to any embodiment of various embodiments includes: receiving a folding event related to the first housing structure and the second housing structure via a sensor module when executing a specific recording mode; identifying folding state information in response to receiving the folding event; identifying a recording function configuration related to the first microphone and the second microphone based on the folding state information and the specific recording mode; and performing recording by applying the identified recording function configuration.

[0282] According to various embodiments, a particular recording mode may include at least one of an interview mode, a regular mode, a voice memo mode, or a text mode configured to record voice for a conversation partner.

[0283] According to various embodiments, the folding event may include an event that occurs corresponding to a change in the folding angle between the first housing structure and the second housing structure, and the distance between the first microphone and the second microphone is changed by changing the folding angle.

[0284] According to various embodiments, the folding state information may include the unfolded state of the electronic device, the folded state of the electronic device, and the state in which the folding angle between the first housing structure and the second housing structure is within a predetermined angle range.

[0285] According to various embodiments, the recording function configuration may include at least one of beamforming function configuration, stereo function configuration, and mono function configuration.

[0286] According to various embodiments, the recording method of the electronic device may further include: when the specific recording mode is an interview mode and the folding state information changes from an unfolded state to a folded state, controlling the recording function configuration to change from a voice beamforming function to a voice beamforming unapplied function.

[0287] According to various embodiments, the recording method of this electronic device can control a screen used to guide the change of the folding state to be displayed on a display device when a specific recording mode and folding state information meet predetermined conditions.

[0288] According to various embodiments, the recording method of the electronic device may further include displaying a screen via a display device to guide the change of the folded state to the unfolded state when the specific recording mode is an interview mode and the folding state information corresponds to the folded state.

[0289] An electronic device according to any one of the various embodiments includes: a first housing structure including a first microphone; a second housing structure including a second microphone, and the second housing structure being foldably coupled to the first housing structure; a sensor module disposed in the first housing structure and / or the second housing structure; and a processor disposed in the first housing structure and / or the second housing structure and operatively connected to the first microphone, the second microphone, and the sensor module. The processor may be configured to: perform a recording operation by applying speech beamforming when a first recording mode is executed in an unfolded state of the electronic device; receive a folding event related to the first housing structure and the second housing structure via the sensor module; identify folding state information in response to receiving the folding event; and perform a recording operation without applying speech beamforming when the electronic device is identified to be in a folded state based on the folding state information.

[0290] According to various embodiments, the first recording mode may include an interview mode for recording the voice of the other party in a conversation.

[0291] According to various embodiments, the folding event may include an event that occurs corresponding to a change in the folding angle between the first housing structure and the second housing structure, and the distance between the first microphone and the second microphone is changed by changing the folding angle.

[0292] According to various embodiments, the folding state information includes the unfolded state of the electronic device, the folded state of the electronic device, and the state in which the folding angle between the first housing structure and the second housing structure is within a predetermined angle range.

[0293] According to various embodiments, the electronic device may also include a display device, and the processor may: when the folding state information meets predetermined conditions in the first recording mode, control the display device to display a screen used to guide the change of the folding state.

[0294] The electronic device according to various embodiments can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to those described above.

[0295] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to terms may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one or all possible combinations of the items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish the respective component from another component and do not limit the component in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “connected to another element (e.g., a second element)”, it means that the element can be directly (e.g., wiredly) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0296] As used herein, the term "module" can include a unit implemented in hardware, software, or firmware, and is used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module can be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to an embodiment, a module can be implemented in the form of an application-specific integrated circuit (ASIC).

[0297] The various embodiments described herein can be implemented as software (e.g., a program) comprising one or more instructions stored in a storage medium (e.g., internal or external memory) that can be read by a machine (e.g., a host device or task execution device). For example, a machine's processor (e.g., a host device or task execution device) can invoke at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" means only that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.

[0298] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or via an app store (e.g., the Play Store). TM The computer program product may be published online (e.g., downloaded or uploaded), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If published online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be temporarily stored in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

[0299] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions prior to integration. According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

[0300] Although this disclosure has been shown and described with reference to various embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made without departing from the spirit and scope of this disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, the electronic device comprising: A first housing structure, the first housing structure including a first microphone; A second housing structure, the second housing structure including a second microphone and foldably coupled to the first housing structure; The sensor module is disposed in at least one of the first housing structure or the second housing structure; A memory, wherein the memory stores instructions; Display device; as well as At least one processor is disposed in at least one of the first housing structure or the second housing structure and is operatively connected to the first microphone, the second microphone, the sensor module and the memory; Wherein, when the instruction is executed by the at least one processor, the electronic device: When a specific recording mode is executed, the sensor module receives folding events related to the first housing structure and the second housing structure. In response to receiving the folding event, the folding state information is identified. Based on the folding state information and the specific recording mode, identify the recording function configuration related to the first microphone and the second microphone, and Recording is performed by applying the recording function configuration identified by the application. The specific recording mode includes an interview mode configured to record voice from a conversation partner, and the recording function configuration includes a beamforming function configuration. When the instruction is executed by the at least one processor, the electronic device, when the specific recording mode is the interview mode and the folding state information changes from the unfolded state to the folded state, controls the beamforming function configuration to change from beamforming function to beamforming unapplied function, and controls the display device to display a screen to guide the change of the folded state to the unfolded state.

2. The electronic device according to claim 1, wherein, The specific recording mode also includes at least one of the following: regular mode, voice memo mode, or text mode.

3. The electronic device according to claim 1, wherein, The folding event includes an event that occurs corresponding to a change in the folding angle between the first housing structure and the second housing structure, and the distance between the first microphone and the second microphone changes due to the change in the folding angle.

4. The electronic device according to claim 1, wherein, The folding state information includes the unfolded state of the electronic device, the folded state of the electronic device, and the state where the folding angle between the first housing structure and the second housing structure is within a predetermined angle range.

5. The electronic device according to claim 1, wherein, The recording function configuration also includes at least one of stereo function configuration or mono function configuration.

6. A recording method for an electronic device, the electronic device comprising a first housing structure, a second housing structure, and a display device, wherein, The first housing structure includes a first microphone, and the second housing structure includes a second microphone and is foldably connected to the first housing structure. The recording method includes: When a specific recording mode is executed, folding events related to the first and second housing structures are received via the sensor module. In response to receiving the folding event, the folding state information is identified. Based on the folding state information and the specific recording mode, identify the recording function configuration related to the first microphone and the second microphone, and Recording is performed by applying the recording function configuration identified by the application. The specific recording modes include an interview mode configured to record voice messages directed at the other party in a conversation, and the recording function configuration includes a beamforming function configuration. The recording method further includes: when the specific recording mode is the interview mode and the folding state information changes from the unfolded state to the folded state, configuring the beamforming function from beamforming function to beamforming not applied function, and displaying a screen through the display device to guide the change of the folded state to the unfolded state.

7. The recording method according to claim 6, wherein, The specific recording mode also includes at least one of the following: regular mode, voice memo mode, or text mode.

8. The recording method according to claim 6, wherein, The folding event includes an event that occurs corresponding to a change in the folding angle between the first housing structure and the second housing structure, and the distance between the first microphone and the second microphone changes due to the change in the folding angle.

9. The recording method according to claim 6, wherein, The folding state information includes the unfolded state of the electronic device, the folded state of the electronic device, and the state where the folding angle between the first housing structure and the second housing structure is within a predetermined angle range.

10. The recording method according to claim 6, wherein, The recording function configuration also includes at least one of stereo function configuration or mono function configuration.

11. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor of an electronic device, cause the electronic device to perform the recording method according to any one of claims 6-10.

Images