Electronic device including an expandable display

Abstract

An electronic device according to various embodiments of the disclosure can include a motor, a microphone, an expandable and / or contractible display, and a processor, wherein the processor: when a call is received, identifies whether the display is in an expanded state; identifies whether the display has been configured to be contracted when the display is in the expanded state; drives the motor to contract the display; and when the display has been configured to be contracted, applies a first filter to a sound received via the microphone; and when the display is contracted, applies a second filter different from the first filter to the sound received via the microphone.

Description

Technical Field

[0001] Various embodiments of this disclosure relate to electronic devices including scalable displays. Background Technology

[0002] With technological advancements, the use of displays in various forms of electronic devices is increasing across diverse industries, including automotive, construction, and information technology (IT). Not only are the forms of electronic devices becoming more varied, but the forms of displays themselves are also becoming more diverse. Devices encompassing various forms of displays can provide users with new experiences by displaying content in a variety of ways. In particular, as the availability of portable electronic devices becomes more diversified, the forms of displays used to show content are also becoming more diverse.

[0003] Electronic devices, including displays denoted by the term "display of things (DoT)," are expected to become more widespread in everyday life in the future. Summary of the Invention

[0004] Technical issues

[0005] Electronic devices, including those for expandable displays, can change the display's state from expanded to retracted or from retracted to expanded. The display's state can be changed by user force, and the electronic devices can also use motors to directly alter the display's state.

[0006] When an electronic device uses a microphone while simultaneously using a motor to change the state of a display, the sound generated by the motor's operation can be introduced into the microphone.

[0007] Technical solution

[0008] According to one aspect of this disclosure, an electronic device may include a motor, a microphone, an expandable and / or shrinkable display, and a processor, wherein, upon receiving a call, the processor identifies whether the display is in an expanded state; when the display is in an expanded state, the processor identifies whether the display has been configured to shrink; when the display is configured to shrink, the motor drives the motor to shrink the display and applies a first filter to the sound received via the microphone; and when the display is shrunk, a second filter different from the first filter is applied to the sound received via the microphone.

[0009] According to another aspect of this disclosure, an electronic device may include a motor, a microphone, an expandable and / or scalable display, and a processor, wherein the processor identifies whether a request to change the state of the display is received when executing an application including using sound received via the microphone, drives the motor to change the state of the display when a request to change the state of the display is identified, applies a first filter to the sound received via the microphone, and applies a second filter, different from the first filter, to the sound received via the microphone when the change of the display state is completed.

[0010] According to another aspect of this disclosure, a method of operating an electronic device may include: when a call is received, identifying whether a display is in an extended state; when the display is in an extended state, identifying whether the display has been configured to be scaled down; when the display has been configured to be scaled down, driving a motor to scale down the display; applying a first filter to sound received via a microphone; and when the display is scaled down, applying a second filter, different from the first filter, to sound received via a microphone.

[0011] According to another aspect of this disclosure, a method of operating an electronic device may include: while executing an application that includes the use of sound received via a microphone, identifying whether a request to change the state of a display is received; when the request to change the state of the display is identified, driving a motor to change the state of the display; applying a first filter to the sound received via the microphone; and when the change of the display state is completed, applying a second filter, different from the first filter, to the sound received via the microphone.

[0012] Beneficial technical effects

[0013] According to various embodiments of the present invention, even when the electronic device uses a motor to change the state of the display while using the microphone of the electronic device, the noise caused by the operation of the motor can be reduced. Attached Figure Description

[0014] Figure 1 This is a block diagram illustrating an electronic device in a network environment according to various embodiments.

[0015] Figure 2 This is a simplified structural diagram showing an electronic device including a scalable display.

[0016] Figure 3 An example of changing the state of a zoomable display is shown.

[0017] Figure 4 An example of changing the state of a scalable display is shown.

[0018] Figure 5An example of a signal received via a microphone when the display state of an electronic device changes is shown.

[0019] Figure 6 An example of a signal received when the display state of the other party's electronic device changes is shown.

[0020] Figure 7 This is an example of a flowchart illustrating an electronic device according to various embodiments.

[0021] Figure 8 This is another example illustrating a flowchart of an electronic device according to various embodiments.

[0022] Figure 9 Examples of signals received via the microphone of an electronic device when the display state changes according to various embodiments are shown.

[0023] Figure 10 Examples of signals received by a counterpart electronic device when the display state of an electronic device changes according to various embodiments are shown. Detailed Implementation

[0024] Figure 1 This is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. (Refer to...) Figure 1 In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with at least one of electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input module 150, sound output module 155, display module 160, audio module 170, sensor module 176, interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module (SIM) 196, or antenna module 197. In some embodiments, at least one of the above components (e.g., connection terminal 178) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components described above (e.g., sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (e.g., display module 160).

[0025] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, processor 120 may store commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132, process the commands or data stored in volatile memory 132, and store the result data in non-volatile memory 134. According to an embodiment, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) or an auxiliary processor 123 (e.g., graphics processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor central processor, or communication processor (CP)) that is operationally independent of or combined with the main processor 121. For example, when electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or may be implemented as part of the main processor 121.

[0026] When the main processor 121 is inactive (e.g., in sleep mode), the auxiliary processor 123 (rather than the main processor 121) can control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., running an application), the auxiliary processor 123 can work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123. According to embodiments, the auxiliary processor 123 (e.g., a neural processing unit) may include hardware architecture dedicated to artificial intelligence model processing. Artificial intelligence models can be generated through machine learning. For example, such learning can be performed via electronic device 101 where artificial intelligence is performed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple layers of artificial neural networks. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q-network, or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include software structures in addition to hardware structures.

[0027] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134. Non-volatile memory 134 may include at least one internal memory 136 and external memory 138.

[0028] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.

[0029] The input module 150 can receive commands or data from outside the electronic device 101 (e.g., a user) that will be used by other components of the electronic device 101 (e.g., processor 120). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (e.g., buttons), or digital pen (e.g., stylus).

[0030] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. According to an embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0031] Display module 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, display module 160 may include a touch sensor adapted to detect touch or a pressure sensor adapted to measure the intensity of the force caused by touch.

[0032] The audio module 170 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input module 150, or output sound via the sound output module 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0033] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0034] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic devices (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.

[0035] Connection end 178 may include a connector, through which electronic device 101 can be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0036] The tactile module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through his touch or kinesthesia. According to embodiments, the tactile module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0037] Camera module 180 can capture still or moving images. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0038] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0039] Battery 189 can power at least one component of electronic device 101. According to an embodiment, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.

[0040] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, 5G network, next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 192 can identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0041] Wireless communication module 192 can support 5G networks following 4G networks and next-generation communication technologies (such as new radio (NR) access technologies). NR access technologies can support enhanced mobile broadband (eMBB), massive machine-type communication (mMTC), or ultra-reliable low-latency communication (URLLC). Wireless communication module 192 can support high-frequency bands (e.g., millimeter-wave bands) to achieve, for example, high data transmission rates. Wireless communication module 192 can support various technologies used to ensure performance in high-frequency bands, such as, for example, beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 192 can support various requirements specified in electronic device 101, external electronic devices (e.g., electronic device 104), or network systems (e.g., second network 199). According to an embodiment, the wireless communication module 192 may support peak data rates (e.g., 20 Gbps or greater) for implementing eMBB, lost coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip) for implementing URLLC.

[0042] Antenna module 197 can transmit or receive signals or power to or from the exterior of electronic device 101 (e.g., external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, antenna module 197 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 197.

[0043] According to various embodiments, antenna module 197 may form a millimeter-wave antenna module. According to embodiments, the millimeter-wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and multiple antennas (e.g., an array antenna), wherein the RFIC is disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and is capable of supporting a specified high-frequency band (e.g., a millimeter-wave band), and the multiple antennas are disposed on or adjacent to a second surface (e.g., a top surface or a side surface) of the printed circuit board and are capable of transmitting or receiving signals in the specified high-frequency band.

[0044] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).

[0045] According to an embodiment, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to a second network 199. Each of electronic device 102 or electronic device 104 can be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some operations that would be performed on electronic device 101 can be performed on one or more of external electronic devices 102, external electronic devices 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, with or without further processing of the result. For this purpose, technologies such as cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing may be used. Electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and / or neural networks. According to embodiments, external electronic device 104 or server 108 may be included in a second network 199. Electronic device 101 may be applied to intelligent services based on 5G communication technology or IoT-related technologies (e.g., smart homes, smart cities, smart cars, or healthcare).

[0046] Figure 2 This is a simplified structural diagram showing an electronic device including a scalable display.

[0047] According to various embodiments, electronic device 200 (e.g., Figure 1The electronic device 200 (101) may include a display 210, a motor 220, a rail 230, a microphone 240, a roller 250, and an instrument stand 260. According to various embodiments, the electronic device 200 may also include other components or some components may be omitted. According to various embodiments, the electronic device 200 may include multiple identical components. For example, multiple microphones 240 may be included in the electronic device, and their types may be the same or different.

[0048] Figure 2 (a) shows a display 210 (e.g., Figure 1 The display module 160 in the middle is in a shrunk state. Figure 2 (b) shows the electronic device's display 210 in an expanded state. The display 210 can be expanded or reduced by the user's force. Furthermore, the electronic device 200 can expand or reduce the display 210 by driving the motor 220.

[0049] According to various embodiments, the display 210 included in the electronic device 200 is an expandable / reducible display and may be a rollable display. The display 210 can expand when the motor 220 included in the electronic device 200 pushes the display 210 using the track 230. Conversely, the display 210 can shrink when the motor 220 pulls the display 210 using the track 230. The expandable or reduceable display 210 may be supported by an instrument stand 260. When the display 210 shrinks, the reduced portion of the display 210 can be rolled onto and accommodated on a roller 250. According to various embodiments, the expandable / reducible display 210 can be understood as having a display area that is expandable / reducible. For example, when the motor 220 included in the electronic device 200 pushes the display 210 using the track 230, the display area of ​​the display 210 can be expanded. When the motor 220 pulls the display 210 using the track 230, the display area can be reduced.

[0050] According to various embodiments, sound generated by driving the motor 220 can be produced when the display 210 is expanded or reduced by driving the motor 220. The sound generated by driving the motor 220 can be received via microphone 240. The frequency of the sound generated by driving the motor 220 can be primarily distributed within a specific frequency band. The sound generated by driving the motor 220 can be noise. For example, when a user uses the electronic device 200 to talk to another party, the sound generated by driving the motor 220 can be received via microphone 240 and transmitted to the other party. When the volume of the sound generated by driving the motor 220 is greater than the volume of the user's voice, the other party may not be able to hear what the user is saying. As another example, when a user is using the electronic device 200 to record video, the sound generated by driving the motor 220 can be received and recorded via microphone 240. This may not be a problem when the volume of the sound generated by driving the motor 220 is less than ambient noise (e.g., birdsong or wind noise). However, when its volume is greater than ambient noise, the ambient noise may be masked by the sound generated by driving the motor 220.

[0051] Meanwhile, the electronic device 200 that can shrink or expand the display state can be called a rollable electronic device or a sliding electronic device.

[0052] Figure 3 An example of a scenario in which the state of the zoomable display is changed is shown.

[0053] See Figure 3 Users can access electronic devices 300 (e.g., Figure 1 The electronic device 301 receives calls when its display is expanded or reduced. When the display is expanded, the user can manually reduce the display to hold the electronic device 300 with one hand. Alternatively, the user can configure the display to reduce its size when certain conditions are met. For example, the user can configure the display to reduce its size when a call is received while the display is expanded (e.g., when the telephone rings or vibrates). As another example, the display can be configured to reduce its size when the user receives a telephone call while the display is expanded (e.g., when the user presses the call button). The electronic device 300 can drive a motor to reduce the size of the display.

[0054] According to various embodiments, the sound generated by the motor driven by the electronic device 300 to reduce the size of the display may be transmitted to another party via the microphone 310. There is no problem when the sound generated by the motor is lower than the user's voice. However, when the sound generated by the motor is higher than the user's voice, the other party may hear both the motor's sound and the user's voice. Due to the sound generated by the motor, the other party may not be able to hear the user's voice correctly.

[0055] According to various embodiments, electronic device 300 may need to drive a motor for several seconds to shrink the display. For example, the time required for electronic device 300 to drive the motor may increase as the size of the display increases and the motor's revolutions per minute (rpm) decreases. When the time required for electronic device 300 to drive the motor is long, the sound generated by the motor may be transmitted to another party via microphone 310.

[0056] According to various embodiments, the motor can be varied according to the size and specifications of the display and the size of the electronic device, and therefore the volume of the sound driven by the motor can be varied according to the type of motor. When the sound of the motor driven by the electronic device 300 is loud, the sound produced by the motor may be transmitted to another party through the microphone 310.

[0057] According to various embodiments, the frequency of the sound driven by the motor can vary depending on the type of motor, the pulse width modulation (PWM) of the signal driving the motor, and / or a combination of components configured with the motor (e.g., gears). According to various embodiments, the PWM of the signal driving the motor can be adjusted such that the frequency of the sound driven by the motor does not overlap with the frequency of human speech. When the PWM of the signal driving the motor is adjusted, the speed of the motor can be adjusted.

[0058] According to various embodiments, the electronic device 300 can identify the size of the display and shrink the display only when the size of the display is greater than a threshold.

[0059] Figure 4 An example of a scenario in which the state of the zoomable display is changed is shown.

[0060] See Figure 4 Users may want to include electronic devices 400 (e.g., Figure 1 The electronic device 400 extends the display while recording video in a minimized state. For example, a user might want to expand and view the video being recorded. As another example, a user might want to extend the display while recording video to perform other tasks. The user can configure a hardware key 420 (or a software key) to extend the display. When the user presses the hardware key 420, the electronic device 400 uses a motor to extend the display.

[0061] According to various embodiments, sound generated by a motor driven by electronic device 400 to extend the display can be recorded along with video via microphone 410. There may be no problem when the sound generated by the motor is lower than the sound recorded with the video (e.g., ambient sound). However, when the sound generated by the motor is higher than the sound to be recorded with the video, the sound generated by the motor may be recorded along with the video.

[0062] According to various embodiments, the electronic device 400 may need to drive a motor for several seconds to expand the display. For example, the time required for the electronic device 400 to drive the motor may increase as the display size increases and the motor's revolutions per minute (rpm) decreases. When the electronic device 400 drives the motor for a long time, the sound produced by the motor may be recorded.

[0063] According to various embodiments, the motor can be varied according to the size and specifications of the display and the size of the electronic device, and therefore the volume of the sound produced by the motor can be varied according to the type of motor. When the sound of the motor driven by the electronic device 400 is loud, the sound produced by the motor may be recorded.

[0064] According to various embodiments, the frequency of the sound driven by the motor can vary depending on the type of motor, the pulse width modulation (PWM) of the signal driving the motor, and / or a combination of components configured with the motor (e.g., gears). According to various embodiments, the PWM of the signal driving the motor can be adjusted such that the frequency of the sound driven by the motor does not overlap with the frequency of human speech. When the PWM of the signal driving the motor is adjusted, the speed of the motor can be adjusted.

[0065] although Figure 4 An example of an extended display is shown, which can also be applied to situations where the display is shrunk.

[0066] Figure 5 An example of a signal received via a microphone when the display state of an electronic device changes is shown.

[0067] Figure 5 (a) shows the volume of the sound based on the motor's drive. See also Figure 5 (a) It can be confirmed that a certain level or higher sound is generated while the motor is being driven.

[0068] Figure 5 (b) shows the amplitude of each frequency obtained by converting the sound generated by the motor drive into frequencies. The frequencies of the sound generated by the motor drive can be mainly distributed in a specific frequency band. See also Figure 5 (b) In operation 510, it can be confirmed that the frequency of the sound driven by the motor is concentrated at 3100Hz.

[0069] Figure 5 (c) shows the energy at each frequency as it varies over time by converting the sound from the motor's drive into frequency. See also Figure 5 (c) In operation 520, it can be confirmed that the sound energy driven by the motor is concentrated at a frequency of 3100Hz.

[0070] exist Figure 5In (b) and 5(c), the frequency of the sound driven by the motor is 3100Hz. However, the frequency of the sound driven by the motor can vary depending on the type of motor, the PWM of the signal driving the motor, and / or the combination of components (e.g., gears) configured with the motor. According to various embodiments, the PWM of the signal driving the motor can be adjusted so that the frequency of the sound driven by the motor does not overlap with the frequency of human speech. When the PWM of the signal driving the motor is adjusted, the speed of the motor can be adjusted.

[0071] As for the sound of the motor drive, it can be seen from... Figure 5 As seen in (a), 5(b) and 5(c), energy (e.g., the volume of sound) is concentrated at a constant level in a specific frequency band regardless of time.

[0072] Figure 6 An example of a signal received at the same time as the display status of the other party's electronic device changes is shown.

[0073] Figure 6 (a) Shows the volume of the sound produced by the motor driven by the other party's electronic device. See also Figure 6 (a) It can be confirmed that a certain level or higher of sound is produced when the motor of the other party's electronic device is running. Although the sound produced when the motor of the other party's electronic device is running is less than the sound that the user can directly hear, the sound may be heard as noise.

[0074] Figure 6 (b) Shows the amplitude of each frequency obtained by converting sound to frequencies according to the motor drive of the other party's electronic device. See also Figure 6 (b) In operation 610, it can be confirmed that the frequency of the sound driven by the motor of the other party's electronic device is concentrated in such a range as... Figure 5 (b) shows 3100Hz.

[0075] exist Figure 6 In (b), the frequency of the sound driven by the motor is 3100Hz, but the frequency of the sound driven by the motor can be changed according to the combination of the type of motor, the PWM of the signal driving the motor and / or the components (e.g., gears) configured with the motor.

[0076] Figure 6 (c) shows the energy at each frequency that varies over time by converting the sound driven by the motor of the corresponding electronic device into a frequency. See also Figure 6 (c) In operation 620, it can be confirmed that the energy of the sound driven by the motor of the corresponding electronic device is also concentrated at a frequency of 3100Hz. For example... Figure 6 (c) The other party's electronic device may filter and transmit signals only in a specific frequency band (e.g., the audible band).

[0077] like Figure 5 Like (a), 5(b) and 5(c), from Figure 6 In (a), 6(b) and 6(c), it can be confirmed that the energy (e.g., the volume of the sound) of the motor driven by the other party's electronic device is concentrated in a specific frequency band with a constant volume, independent of time.

[0078] Figure 7 This is an example illustrating a flowchart of an electronic device according to various embodiments. According to various embodiments, this example could be an example of an electronic device receiving a telephone call.

[0079] In operation 710, the electronic device can receive telephone calls (e.g., voice calls or video calls).

[0080] According to various embodiments, when a video call is received, the electronic device may not perform operations 720 to 750. According to various embodiments, the user can configure whether to perform operations 720 to 750 based on the call type. For example, the user can configure to perform operations 720 to 750 regardless of whether the call is a voice call or a video call. As another example, the user can configure to perform operations 720 to 750 only in the case of a voice call.

[0081] In operation 720, the electronic device can identify whether the display is in an extended state. According to various embodiments, the electronic device is a rollable or slidable electronic device, and the display can be expanded or reduced. According to various embodiments, the electronic device can change the state of the display by driving a motor.

[0082] According to various embodiments, when the display is not in an extended state, the electronic device can perform operation 760.

[0083] In operation 730, when the display is in an extended state, the electronic device can identify whether the display is configured to shrink upon receiving a call. This configuration can be performed by the user or during the manufacture of the electronic device.

[0084] According to various embodiments, the electronic device can recognize whether a request to shrink the display exists. For example, when the user does not configure the display to shrink but the display needs to be shrunk, the user can request to shrink the display using software keys, hardware keys, or / and configured gestures.

[0085] In operation 740, when the display is configured to zoom out upon receiving a telephone call, the electronics can drive a motor to zoom out the display and apply a first filter to the sound received via the microphone. According to various embodiments, the first filter may be a filter for removing frequencies of the sound based on the drive of the motor.

[0086] According to various embodiments of the present invention, an electronic device can identify whether the frequency of the sound driven by the motor overlaps with the frequency of human speech, and adjust the PWM of the signal driving the motor so that the frequency of the sound driven by the motor does not overlap with the frequency of human speech.

[0087] According to various embodiments, when a user presses a specific button (e.g., the "call" button), operation 740 can be performed.

[0088] In operation 750, the electronic device can identify whether the display has been reduced in size.

[0089] According to various embodiments, the electronic device can continue to perform operation 740 while the display has not yet been scaled down. The electronic device can apply a first filter to the sound received via the microphone while the display is being scaled down.

[0090] In operation 760, when the display is zoomed out, the electronic device can apply a second filter to the sound received via the microphone. According to various embodiments, the second filter may be a filter configured to receive human speech.

[0091] In the preceding text, the state of the display is referred to simply as an expanded state or a shrunken state. However, depending on the configuration, when the size (e.g., width, length) of the display exposed to the user is greater than a first threshold, it can be configured to be in an expanded state, and when the size of the display is smaller than a second threshold, it can be configured to be in a shrunken state. According to various embodiments, the first threshold may be greater than the second threshold. According to various embodiments, the first and second thresholds may also be configured by the user and / or manufacturer of the electronic device. The user can configure the first and second thresholds based on the size of their hand and the purpose of using the phone. For example, when the user's hand is large, the first and second thresholds can be configured to be large. As another example, when the user frequently receives calls and receives calls for extended periods, the first and second thresholds can be configured to be small.

[0092] Figure 8 This is another example illustrating a flowchart of an electronic device according to various embodiments. According to various embodiments, another example could be an application that performs functions including using sound received via a microphone in the electronic device.

[0093] In operation 810, the electronic device can execute an application. According to various embodiments, the electronic device can be used by a user to execute the application. The application may include the ability to use sound received via a microphone. One example could be a video recording application capable of recording both sound and video received via a microphone.

[0094] In operation 820, the electronic device can identify whether a request to change the state of the display has been made. The electronic device can identify whether a request to change the state of the display has been made while an application is being executed. According to various embodiments, the request to change the state of the display may be generated by software keys, hardware keys, or / and configured gestures.

[0095] According to various embodiments, when there is no request to change the state of the display, the electronic device may perform operation 850.

[0096] In operation 830, when a request to change the state of the display is received, the electronic device can change the state of the display by driving a motor. According to various embodiments, the request to change the state of the display may be a request to expand or shrink the display.

[0097] According to various embodiments, the electronic device may apply a first filter to sound received via a microphone. The first filter may be a filter used to remove frequencies of sound based on the driving frequency of a motor.

[0098] According to various embodiments, the electronic device can identify whether the frequency of the sound driven by the motor overlaps with the frequency of a sound configured to suit the application (e.g., birdsong, music, or conversation), and adjust the PWM of the signal driving the motor so that the frequency of the sound driven by the motor does not overlap with the frequency of the sound configured to suit the application.

[0099] In operation 840, the electronic device can identify whether the change in the display status has been completed.

[0100] According to various embodiments, the electronic device may continue to perform operation 830 while the change of the display state is not completed.

[0101] In operation 850, when the change of display state is complete, the electronic device can apply a second filter to the sound received via the microphone. According to various embodiments, the second filter can be a filter configured to suit the use of the application.

[0102] In operation 860, the electronic device can identify whether the application has been terminated. According to various embodiments, if the application has not been terminated, the electronic device can repeat operation 820.

[0103] The changes in the state of the display have been briefly described above, but the state of the display can be determined by configuration. For example, when the size (e.g., width and length) of the display exposed to the user is greater than a first threshold, it can be configured to an expanded state, and when its size is less than a second threshold, it can be configured to a shrunk state. According to various embodiments, the first threshold may be greater than the second threshold. According to various embodiments, the first and second thresholds may also be configured by the user and / or manufacturer of the electronic device.

[0104] According to various embodiments, even when the display is expanded, changes in the display's state can be divided into multiple states, and even when it is shrunk, changes in the display's state can be divided into multiple states. The display's states can be configured according to the degree of exposure the display provides to the user (e.g., expanded 1, expanded 2, expanded 3, shrunk 1, shrunk 2, and shrunk 3). According to various embodiments, the user can configure the number of display states differently depending on the display's size, and can even configure the display's states differently according to the intended use (e.g., the display's size).

[0105] Figure 9 Examples of signals received via the microphone of an electronic device when the display state changes according to various embodiments are shown.

[0106] Figure 9 (a) shows the amplitude of the signal received via the microphone of the electronic device when the electronic device drives the motor to change the state of the display. See also Figure 10 (a) It can be confirmed that, in addition to the sound of the motor driving, the signal received via the microphone is also received along with the user's voice.

[0107] Figure 9 (b) shows the results of analyzing the frequency components of the signal received via the microphone of the electronic device while driving the motor. Based on Figure 5 (b) and Figure 9 (b) In operation 910, it can be confirmed that the voice signal includes a 3100Hz signal, which is based on the frequency of the sound of the motor drive.

[0108] Figure 9 (c) illustrates the energy at each frequency that varies over time by converting signals received via a microphone from an electronic device into frequencies while driving the motor. Based on Figure 5 (c) and Figure 9 (c) In operation 920, it can be confirmed that the energy of the 3100Hz signal is also included along with the energy of the voice signal, which is the frequency of the sound driven by the motor.

[0109] In Figures 9(b) and 9(c), the frequency of the sound driven by the motor is 3100 Hz. However, the frequency of the sound driven by the motor can vary depending on the type of motor, the PWM of the signal driving the motor, and / or the combination of components configured with the motor (e.g., gears). According to various embodiments, the PWM of the signal driving the motor can be adjusted so that the frequency of the sound driven by the motor does not overlap with the frequency of human speech. When the PWM of the signal driving the motor is adjusted, the speed of the motor can be adjusted.

[0110] Figure 10 Examples of signals received by a counterpart electronic device when the display state of an electronic device changes according to various embodiments are shown.

[0111] Figure 10 (a) shows the amplitude of the signal sent from one electronic device to another when a motor used to change the state of a display is driven. See also Figure 10 (a) It can be confirmed that when the motor is driving and only the user's voice is being transmitted, the sound of the motor driving is filtered out from the signal received by the other party's electronic device.

[0112] Figure 10 (b) shows the results of analyzing the frequency components of the signal transmitted from the electronic device to the other electronic device while the motor is driven. See also Figure 10 (b) In operation 1010, it can be seen that the 3100Hz signal has been filtered out. 3100Hz is the frequency of the sound of the motor drive.

[0113] Figure 10 (c) shows the energy at each frequency as a function of time, obtained by converting signals transmitted from electronic devices to corresponding electronic devices into frequencies when the motor is driven. See also Figure 10 (c) In operation 1020, it can be confirmed that the signal with a frequency of 3100Hz has been filtered out, and it can also be confirmed that the energy of the signal transmitted from the electronic device to the other electronic device during the driving of the motor has also been filtered out at a frequency of 3100Hz.

[0114] from Figure 10 (a), 10(b) and 10(c) confirm that when the electronic device filters and sends a specific frequency band of sound according to the motor drive, the other electronic device does not receive the sound driven by the motor and receives the user's voice.

[0115] In Figures 10(b) and 10(c), the frequency of the sound driven by the motor is 3100Hz, but this can vary depending on the type of motor, the PWM of the signal driving the motor, and / or the combination of components configured with the motor (e.g., gears). According to various embodiments, the PWM of the signal driving the motor can be adjusted so that the frequency of the sound driven by the motor does not overlap with the frequency of human speech. When the PWM of the signal driving the motor is adjusted, the speed of the motor can be adjusted.

[0116] Electronic devices according to various embodiments of the present disclosure may include a motor, a microphone, an expandable and / or shrinkable display, and a processor, wherein when a call is received, the processor identifies whether the display is in an expanded state; when the display is in an expanded state, the processor identifies whether the display has been configured to shrink; when the display is configured to shrink, the motor is driven to shrink the display and a first filter is applied to the sound received via the microphone; and when the display is shrunk, a second filter different from the first filter is applied to the sound received via the microphone.

[0117] The first filter of the electronic device according to various embodiments of the present disclosure may be a filter for removing the frequency of the sound according to the drive of the motor, and the second filter may be a filter configured to receive human speech.

[0118] The processor of the electronic device according to various embodiments of the present disclosure can identify whether the frequency of the sound driven by the motor overlaps with the frequency of human speech, and adjust the PWM of the signal driving the motor so that the frequency of the sound driven by the motor does not overlap with the frequency of human speech.

[0119] In electronic devices according to various embodiments of the present disclosure, an expanded state may be a state in which the size of the display is greater than a first threshold, and a shrunken state may be a state in which the size of the display is less than a second threshold.

[0120] Electronic devices according to various embodiments of the present disclosure may include a motor, a microphone, an expandable and / or shrinkable display, and a processor, wherein the processor identifies whether a request to change the state of the display is received when performing an application including using sound received via the microphone; drives the motor to change the state of the display when a request to change the state of the display is identified; applies a first filter to the sound received via the microphone; and applies a second filter, different from the first filter, to the sound received via the microphone when the change of the display state is complete.

[0121] The first filter of the electronic device according to various embodiments of the present disclosure may be a filter for removing the frequency of the sound driven by the motor, and the second filter may be a filter configured to suit the use of the application.

[0122] The processor of the electronic device according to various embodiments of the present disclosure can identify whether the frequency of the sound driven by the motor overlaps with the frequency of the sound configured to be suitable for use in the application, and adjust the PWM of the signal driving the motor so that the frequency of the sound driven by the motor does not overlap with the frequency of the sound configured to be suitable for use in the application.

[0123] In electronic devices according to various embodiments of the present disclosure, a request to change the state of the display can be generated by a software key, a hardware key, or a configured gesture.

[0124] The processor of the electronic device according to various embodiments of the present disclosure can identify whether an application has been terminated, and if the application has not been terminated, further identify whether a request to change the state of the display has been received. When it is identified that a request to change the state of the display has been received, the processor drives a motor to change the state of the display, applies a first filter to the sound received via a microphone, and applies a second filter to the sound received via a microphone when the change of the display state is completed.

[0125] In electronic devices according to various embodiments of the present disclosure, a request to change the state of the display may be a request to adjust the size of the display.

[0126] A method of operating an electronic device according to various embodiments of the present disclosure may include: when a call is received, identifying whether a display is in an extended state; when the display is in an extended state, identifying whether the display has been configured to be scaled down; when the display has been configured to be scaled down, driving a motor to scale down the display; applying a first filter to sound received via a microphone; and when the display is scaled down, applying a second filter, different from the first filter, to sound received via a microphone.

[0127] In a method of operating an electronic device according to various embodiments of the present invention, the first filter may be a filter for removing the frequency of the sound according to the drive of the motor, and the second filter may be a filter configured to receive human speech.

[0128] The method of operating an electronic device according to various embodiments of the present disclosure may further include identifying whether the frequency of a sound driven by a motor overlaps with the frequency of human speech, and adjusting the PWM of the signal driving the motor such that the frequency of the sound driven by the motor does not overlap with the frequency of human speech.

[0129] In a method of operating an electronic device according to various embodiments of the present invention, an expanded state may be a state in which the size of the display is greater than a first threshold, and a shrunken state may be a state in which the size of the display is less than a second threshold.

[0130] A method of operating an electronic device according to various embodiments of the present invention may include: while performing an application including using sound received via a microphone, identifying whether a request to change the state of a display is received; when a request to change the state of a display is identified, driving a motor to change the state of the display; applying a first filter to the sound received via the microphone; and when the change of the display state is completed, applying a second filter, different from the first filter, to the sound received via the microphone.

[0131] In a method of operating an electronic device according to various embodiments of the present invention, a first filter of the electronic device may be a filter for removing the frequency of the sound driven by the motor, and a second filter may be a filter configured to suit the application.

[0132] The method of operating an electronic device according to various embodiments of the present disclosure may further include: identifying whether the frequency of a sound driven by a motor overlaps with the frequency of a sound configured to be suitable for use in an application, and adjusting the PWM of the signal driving the motor such that the frequency of the sound driven by the motor does not overlap with the frequency of the sound configured to be suitable for use in an application.

[0133] In methods of operating electronic devices according to various embodiments of the present invention, requests to change the state of the display can be generated via software keys, hardware keys, or configured gestures.

[0134] The method of operating an electronic device according to various embodiments of the present disclosure may further include: identifying whether an application has been terminated; if the application has not been terminated, identifying again whether a request to change the state of a display has been received; when it is identified that a request to change the state of a display has been received, driving a motor to change the state of the display; applying a first filter to sound received via a microphone; and applying a second filter to sound received via a microphone when the change of the display state is completed.

[0135] In the method of operating an electronic device according to various embodiments of the present invention, the request for changing the state of the display may be a request for adjusting the size of the display.

[0136] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents or substitutions to the respective embodiments.

[0137] In the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the singular forms of nouns corresponding to terms may include one or more things unless the relevant context explicitly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “at least one of A, B or C” may include any one or all possible combinations of the items listed together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish one component from another and do not limit the components in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “attached to another element (e.g., a second element)”, it means that the first element can be directly (e.g., wiredly) connected to the second element, wirelessly connected to the second element, or connected to the second element via a third element.

[0138] As used in connection with various embodiments of this disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to embodiments, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0139] The various embodiments set forth herein can be implemented as software (e.g., program 140) containing one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, under the control of a processor, the processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" means only that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.

[0140] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an app store (e.g., the Play Store™), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If distributed online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be stored at least temporarily in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

[0141] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions before integration. According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

Claims

1. An electronic device comprising: Electric motor; microphone; Scalable and / or resizable displays; and processor, The processor is configured as follows: Upon receiving a call, it is determined whether the display is in an extended state; When the display is in an extended state, identify whether the display has been configured to be scaled down; With the display already configured to be scaled down, the motor is driven to scale down the display, and a first filter is applied to receive sound via the microphone; and When the display is reduced in size, a second filter, different from the first filter, is applied to the sound received via the microphone.

2. The electronic device according to claim 1, wherein, The first filter is configured to remove frequencies of sound generated by the driving of the motor, and The second filter is configured to receive human speech.

3. The electronic device according to claim 1, wherein, The processor is configured to: Identify whether the frequency of the sound driven by the motor overlaps with the frequency of human speech; and The pulse width modulation (PWM) of the signal driving the motor is adjusted so that the frequency of the sound driven by the motor does not overlap with the frequency of the human speech.

4. The electronic device according to claim 1, wherein, The extended state is when the size of the display is greater than a first threshold, and The shrinkage state refers to the state where the size of the display is smaller than the second threshold.

5. An electronic device comprising: Electric motor; microphone; Scalable and / or resizable displays; and processor, The processor is configured as follows: Identify whether a request to change the state of the display is received when an application is performing functions that include using sound received via a microphone; If a request to change the state of the display is received, the motor is driven to change the state of the display; The first filter is applied to the sound received via the microphone; and Once the change in the state of the display is complete, a second filter, different from the first filter, is applied to the sound received via the microphone.

6. The electronic device according to claim 5, wherein, The first filter is used to remove the frequency of the sound generated by the motor's drive, and The second filter is a filter configured to be used in the application.

7. The electronic device according to claim 5, wherein, The processor is configured to: Identify whether the frequency of the sound driven by the motor overlaps with the frequency of a sound configured to be suitable for use in the application; and The PWM of the signal driving the motor is adjusted so that the frequency of the sound driven by the motor does not overlap with the frequency of the sound configured to be used in the application.

8. The electronic device according to claim 5, wherein, Requests to change the state of the display are generated via software keys, hardware keys, or configured gestures.

9. The electronic device according to claim 5, wherein, The processor is configured to: Identify whether the application has been terminated; If the application is not terminated, it is checked again whether a request to change the state of the display has been received; Upon recognizing that a request to change the state of the display has been received, the motor is driven to change the state of the display; Apply the first filter to the sound received via the microphone; and When the change of the state of the display is completed, the second filter is applied to the sound received via the microphone.

10. The electronic device according to claim 5, wherein, The request to change the state of the display is a request to adjust the size of the display.

11. A method of operating an electronic device, the method comprising: Upon receiving a call, identify whether the display is in extended mode; When the display is in an extended state, identify whether the display has been configured to be scaled down; When the display has been configured to shrink, drive the motor to shrink the display; The first filter is applied to the sound received via the microphone; and When the display is reduced in size, a second filter, different from the first filter, is applied to the sound received via the microphone.

12. The method according to claim 11, wherein, The first filter of the electronic device is a filter used to remove the frequency of the sound driven by the motor, and The second filter is configured to receive human speech.

13. The method of claim 11, further comprising: Identify whether the frequency of the sound driven by the motor overlaps with the frequency of human speech; and The PWM of the signal driving the motor is adjusted so that the frequency of the sound driven by the motor does not overlap with the frequency of human speech.

14. The method according to claim 11, wherein, The extended state is when the size of the display is greater than a first threshold, and The shrinkage state refers to the state where the size of the display is smaller than the second threshold.

15. A method of operating an electronic device, the method comprising: Identify whether a request to change the state of the display is received when an application is performing functions that include using sound received via a microphone; If a request to change the state of the display is received, the motor is driven to change the state of the display; The first filter is applied to the sound received via the microphone; and When the change of the state of the display is completed, a second filter, different from the first filter, is applied to the sound received via the microphone.

Images