Method for displaying translation screen and electronic device performing same

Abstract

A method performed by an electronic device may comprise the operations of: receiving a sound signal; identifying the language of the sound signal; in a first translation mode, displaying a translation screen in a first area while a first sound signal in a first language is being received, the translation screen being in a second language different from a first language for content expressed by the first sound signal; displaying a translation screen in a second area while a second sound signal is being received, the translation screen being in the first language for content expressed by the second sound signal; while in the first translation mode, switching to a second translation mode on the basis of the second sound signal being received for at least a predetermined length of time; in the second translation mode, displaying a translation screen in at least a portion of the first area and the second area while the second sound signal is being received, the translation screen being in the first language for content expressed by the second sound signal; and while in the second translation mode, switching to the first translation mode in response to receiving the first sound signal.

Description

Method for displaying a translation screen and an electronic device for performing the same

[0001] Hereinafter, a technology for displaying a translation screen based on an acoustic signal is disclosed.

[0002] Electronic devices can provide a variety of services based on acoustic signal recognition. For example, portable electronic devices such as smartphones and tablets can transcribe acoustic signals or translate them into various languages.

[0003] When providing translation based on an acoustic signal, the acoustic signal is first converted into text through speech-to-text (STT), and then the transcribed text can be translated. Direct speech-to-translation allows the acoustic signal to be directly translated into another language without a transcription step. Electronic devices can also translate audio signals from a single speaker, or even two or more speakers, into different languages ​​in real time based on speech recognition.

[0004] According to one embodiment, an electronic device may include a housing including a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing. The electronic device may include a first display including a first area and a second area, wherein at least a portion of the first area corresponds to the first housing and at least a portion of the second area corresponds to the second housing. The electronic device may include a second display included in a surface of the first housing or the second housing opposite the first display. The electronic device may include at least one processor including processing circuitry. The electronic device may include a memory including one or more storage media storing instructions. When the instructions are individually or collectively executed by the at least one processor, the electronic device may cause the electronic device to: receive an acoustic signal. When the instructions are individually or collectively executed by the at least one processor, the electronic device may cause the electronic device to: identify a language of the acoustic signal. When the above commands are individually or collectively executed by the at least one processor, the electronic device may be caused to: in a first translation mode, while a first audio signal in a first language is received, display a translation screen in a second language different from the first language for the content indicated by the first audio signal in the first area. When the above commands are individually or collectively executed by the at least one processor, the electronic device may be caused to: in the first translation mode, while a second audio signal in the second language is received, display a translation screen in the first language for the content indicated by the second audio signal in the second area.When the above commands are individually or collectively executed by the at least one processor, the electronic device may: while in the first translation mode, switch to a second translation mode based on a duration during which the second acoustic signal is received satisfying a predetermined criterion. When the above commands are individually or collectively executed by the at least one processor, the electronic device may: while in the second translation mode, while the second acoustic signal is received, display a translation screen in the first language for the content indicated by the second acoustic signal in at least a portion of the second area. When the above commands are individually or collectively executed by the at least one processor, the electronic device may: while in the second translation mode, switch to the first translation mode in response to receiving the first acoustic signal.

[0005] According to one embodiment, an electronic device may include a housing including a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing. The electronic device may include a first display including a first area and a second area, wherein at least a portion of the first area corresponds to the first housing and at least a portion of the second area corresponds to the second housing. The electronic device may include a second display included in a surface of the first housing or the second housing opposite the first display. The electronic device may include at least one processor including processing circuitry. The electronic device may include a memory including one or more storage media storing instructions. When the instructions are individually or collectively executed by the at least one processor, the electronic device may cause the electronic device to: receive an acoustic signal. When the instructions are individually or collectively executed by the at least one processor, the electronic device may cause the electronic device to: identify a language of the acoustic signal. When the above commands are individually or collectively executed by the at least one processor, the electronic device may be caused to: in a first translation mode, while a first audio signal in a first language is received, display a translation screen in a second language different from the first language for the content indicated by the first audio signal in the first area. When the above commands are individually or collectively executed by the at least one processor, the electronic device may be caused to: in the first translation mode, while a second audio signal in the second language is received, display a translation screen in the first language for the content indicated by the second audio signal in the second area.When the above commands are individually or collectively executed by the at least one processor, the electronic device may be caused to: detect, in the first translation mode, that the first display is in a partially folded state such that an angle between the first housing and the second housing corresponds to a first angle range defined; When the above commands are individually or collectively executed by the at least one processor, the electronic device may be caused to: activate the second display in response to receiving the second acoustic signal in an opposite direction to the first acoustic signal while the first display remains in a partially folded state in the first translation mode; When the above commands are individually or collectively executed by the at least one processor, the electronic device may be caused to: further display, on the second display, a translation screen in the second language for the content indicated by the first acoustic signal while the first acoustic signal is being received. When the above commands are individually or collectively executed by the at least one processor, the electronic device may further display a translation screen in the first language for the content indicated by the second acoustic signal on the second display while the second acoustic signal is being received.

[0006] In one embodiment, a method performed by an electronic device may include a housing including a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing. The electronic device may include a first display including a first area and a second area, wherein at least a portion of the first area corresponds to the first housing and at least a portion of the second area corresponds to the second housing. The electronic device may include a second display included in a surface of the first housing or the second housing opposite the first display. The method performed by the electronic device may include an operation of receiving an acoustic signal. The method performed by the electronic device may include an operation of identifying a language of the acoustic signal. The method performed by the electronic device may include an operation of displaying, in a first translation mode, a translation screen in a second language different from the first language for content indicated by the first acoustic signal in the first area while a first acoustic signal in a first language is received. The method performed by the electronic device may include, in the first translation mode, an operation of displaying a translation screen in the first language for the content indicated by the second acoustic signal in the second area while a second acoustic signal in the second language is received. The method performed by the electronic device may include, in the first translation mode, an operation of switching to a second translation mode based on a duration during which the second acoustic signal is received satisfying a predetermined criterion. The method performed by the electronic device may include, in the second translation mode, an operation of displaying a translation screen in the first language for the content indicated by the second acoustic signal in at least a portion of the first area and the second area while the second acoustic signal is received.The method performed by the electronic device may include, in response to receiving the first acoustic signal while in the second translation mode, switching to the first translation mode.

[0007] According to one embodiment, a non-transitory computer-readable recording medium can store one or more programs including commands for executing an operation method performed by the electronic device described above.

[0008] In one embodiment, a method performed by an electronic device may include a housing including a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing. The electronic device may include a first display including a first area and a second area, wherein at least a portion of the first area corresponds to the first housing and at least a portion of the second area corresponds to the second housing. The electronic device may include a second display included in a surface of the first housing or the second housing opposite the first display. The method performed by the electronic device may include an operation of receiving an acoustic signal. The method performed by the electronic device may include an operation of identifying a language of the acoustic signal. The method performed by the electronic device may include an operation of displaying, in a first translation mode, a translation screen in a second language different from the first language for content indicated by the first acoustic signal in the first area while a first acoustic signal in a first language is received. The method performed by the electronic device may include, in the first translation mode, an operation of displaying a translation screen in the first language for the content indicated by the second acoustic signal in the second area while a second acoustic signal in the second language is received. The method performed by the electronic device may include, in the first translation mode, an operation of detecting that the first display is in a partially folded state such that an angle between the first housing and the second housing corresponds to a first angle range. The method performed by the electronic device may include, in the first translation mode, an operation of activating the second display in response to receiving the second acoustic signal in an opposite direction to the first acoustic signal while the first display remains in the partially folded state.The method performed by the electronic device may further include an operation of displaying a translation screen in the second language for the content indicated by the first acoustic signal on the second display while the first acoustic signal is received. The method performed by the electronic device may further include an operation of displaying a translation screen in the first language for the content indicated by the second acoustic signal on the second display while the second acoustic signal is received.

[0009] According to one embodiment, a non-transitory computer-readable recording medium can store one or more programs including commands for executing an operation method performed by the electronic device described above.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0011] FIG. 2A is a perspective view of a front side of an electronic device according to one embodiment.

[0012] FIG. 2b is a perspective view of the rear of the electronic device according to one embodiment.

[0013] FIG. 3 is an exploded perspective view of a portion of the electronic device of FIGS. 2A and 2B including a hinge device, according to one embodiment.

[0014] FIG. 4A is a perspective view of the front of an electronic device according to one embodiment.

[0015] FIG. 4b is a plan view of the rear side of the electronic device according to one embodiment.

[0016] FIG. 5 is an exploded perspective view of a portion of the electronic device of FIGS. 4A and 4B including a hinge device, according to one embodiment.

[0017] Figure 6 is a flowchart of a display method according to one embodiment.

[0018] Figure 7 is a drawing explaining a display method according to an example.

[0019] Figure 8 is a flowchart of a method for displaying operating elements according to one embodiment.

[0020] FIG. 9a, FIG. 9b, and FIG. 9c are drawings each illustrating a method of displaying an operation element according to an example.

[0021] FIG. 10 is a flowchart of a display method using a sub-display according to one embodiment.

[0022] FIG. 11 and FIG. 12 are drawings each illustrating a display method using a sub-display according to an example.

[0023] Figure 13 is a flowchart of a display method according to one embodiment.

[0024] Figure 14 is a drawing explaining a display method according to an example.

[0025] FIGS. 15 and 16 are flowcharts of a display method when using an external electronic device, respectively, according to one embodiment.

[0026] FIG. 17 is a flowchart of a method for transmitting a translation sound signal when using an external electronic device, according to one embodiment.

[0027] Fig. 18 is a drawing explaining a display method using a sub-display according to an example.

[0028] Figure 19 is a drawing explaining a display method according to an example.

[0029] Figure 20 is a flowchart of a method for activating a sub-display according to an example.

[0030] FIG. 21 is a drawing illustrating a method of activating a sub-display according to an example.

[0031] Figure 22 is a flowchart of a method for switching between translation modes according to an example.

[0032] Figure 23 is a diagram illustrating switching between translation modes according to an example.

[0033] FIG. 24 and FIG. 25 are drawings each illustrating a display method using a sub-display according to an example.

[0034] Hereinafter, an embodiment of the present document may be described with reference to the attached drawings.

[0035] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0036] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0037] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0038] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0039] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0040] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0041] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0042] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0043] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0044] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0045] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0046] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0047] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0048] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0049] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0050] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0051] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0052] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0053] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0054] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0055] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0056] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0057] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0058] FIG. 2A is a perspective view of a front side of an electronic device according to one embodiment. FIG. 2B is a perspective view of a rear side of an electronic device according to one embodiment.

[0059] Referring to FIGS. 2A and 2B, an electronic device (200) (e.g., the electronic device (101) of FIG. 1) may include a first housing (210) (e.g., a first housing structure) including a first side member (213) (e.g., a side bezel) and a second housing (220) (e.g., a second housing structure) including a second side member (223) (e.g., a side bezel) that are foldably coupled to each other with respect to a folding axis (F) through at least one hinge device (240, 240-1) (e.g., a hinge module or a hinge structure). For example, the first housing (210) and the second housing (220) may be configured as a foldable housing (e.g., a housing structure). For example, the electronic device (200) may include a first display (230) (e.g., a flexible display, a foldable display, or a main display) arranged to be supported by a first housing (210) and a second housing (220). For example, the first housing (210) may include a first side (211) and a second side (212) facing in an opposite direction (e.g., a -z-axis direction) of the first side (211). For example, the second housing (220) may include a third side (221) and a fourth side (222) facing in an opposite direction (e.g., a -z-axis direction) of the third side (221). For example, the first housing (210) may include a first rear cover (214) coupled with a first side member (213). For example, the second housing (220) may include a second rear cover (224) coupled with a second side member (223). For example, when the electronic device (200) is in a fully unfolded first state (e.g., an unfolded state or an unfolded state), the first side (211) and the third side (221) may be operated so that they face substantially the same direction (e.g., the z-axis direction).For example, when the electronic device (200) is in a fully folded second state (e.g., a folded state or a collapsed state), the first side (211) and the third side (221) may be operated so that they face each other or face in opposite directions. For example, the electronic device (200) may also be operated so as to maintain a third state (e.g., an intermediate state) between the first state and the second state.

[0060] According to one embodiment, the electronic device (200) may include a receiver (201), at least one sensor module (204) (e.g., an ambient light sensor), and / or at least one first camera module (205) (e.g., a UDC, under display camera) disposed on a first side (211) of the first housing (210). For example, the electronic device (200) may include at least one key (206) disposed on a first side member (213). For example, the electronic device (200) may include a second display (231) (e.g., a sub-display), at least one second camera module (208), and / or a flash (209) disposed on a second side (212) of the first housing (210) (e.g., a first rear cover (214)). For example, the second display (231) may be disposed to be visible from the outside through at least a portion of the first rear cover (214). For example, the electronic device (200) may include a speaker (202), a microphone (203), or a connector port (207) arranged on the second side member (223). At least some of the aforementioned components may be arranged in the first housing (210) and / or the second housing (220).

[0061] According to one embodiment, the first display (230) (e.g., a flexible display) may include a first region (230a) (e.g., a first planar portion) corresponding to at least a portion of the first surface (211), a second region (230b) (e.g., a second planar portion) corresponding to at least a portion of the third surface (221), and a third region (230c) (e.g., a flexible portion) connecting the first region (230a) and the second region (230b) and allowing the electronic device (200) to be deformed in a second state (e.g., a folded state) and / or a third state (e.g., an intermediate state). For example, the third region (230c) may be positioned at a position that at least partially overlaps at least one hinge device (240, 240-1) when the first display (230) is viewed from above (e.g., in the z-axis direction). For example, the first display (230) may be arranged so that it is not visible from the outside in the second state by having the first side (211) and the third side (221) face each other (e.g., inward-fold type). For example, the first display (230) may be arranged so that it is visible from the outside in the second state by having the first side (211) and the third side (221) face each other in opposite directions (e.g., outward-fold type).

[0062] FIG. 3 is an exploded perspective view of a portion of the electronic device of FIGS. 2A and 2B including a hinge device, according to one embodiment.

[0063] Referring to FIG. 3, the electronic device (200) may include at least one hinge device (240, 240-1) (e.g., a hinge module or a hinge structure) connecting the first housing (210) and the second housing (220) under the first display (230) (e.g., in the -z-axis direction). For example, the at least one hinge device (240, 240-1) may include a first hinge device (240) and a second hinge device (240-1) spaced apart from the first hinge device (240) along a direction parallel to the folding axis (F) (e.g., in the ±y-axis direction). For example, at least one hinge device (240, 240-1) may be supported by a first support member (2131) extending from the first side member (213) to the first space (2101) of the first housing (210) and a second support member (2231) extending from the second side member (223) to the second space (2201) of the second housing (220). For example, at least one hinge device (240, 240-1) may be arranged between the first housing (210) and the second housing (220) so as to be invisible from the outside through a hinge housing (250) (e.g., a hinge cover).

[0064] According to one embodiment, the first hinge device (240) may include a first rotation member (241) (e.g., a first arm or a first rotator) disposed on a first support member (2131) of the first housing (210), a second rotation member (242) (e.g., a second arm or a second rotator) disposed on a second support member (2231) of the second housing (220), and a gear assembly (243) connected to the first rotation member (241) and the second rotation member (242) such that the first housing (210) and the second housing (220) rotate symmetrically with respect to each other. For example, the gear assembly (243) may include a plurality of gears (e.g., spur gears and / or worm gears) gear-coupled with respect to one another. For example, the gear assembly (243) may include a cam coupling structure for urging the first housing (210) and the second housing (220) in a direction in which they are to transition from a first state (e.g., an unfolded state or an unfolded state) to a second state (e.g., a folded state or a folded state) or in a direction in which they are to transition from the second state to the first state, based on a predetermined angle, and for providing a free stop at various folding angles. For example, the second hinge device (240-1) may be substantially symmetrical with respect to the first hinge device (240), or may have a configuration that is substantially the same.

[0065] According to one embodiment, the electronic device (200) may be coupled with at least one hinge device (240, 240-1) and may include at least one detent module (244) for providing a stopping sensation at various angles. For example, at least one hinge device (240, 240-1) and / or the detent module (244) may form substantially the same plane as the first support member (2131) and the second support member (2231) when the electronic device (200) is in the first state. For example, the second hinge device (240-1) may be substantially symmetrical with the first hinge device (240) or may have a substantially identical configuration.

[0066] FIG. 4A is a perspective view of a front side of an electronic device according to one embodiment. FIG. 4B is a plan view of a rear side of an electronic device according to one embodiment.

[0067] Referring to FIGS. 4A and 4B , an electronic device (400) (e.g., the electronic device (101) of FIG. 1 or the electronic device (200) of FIGS. 2A , 2B , and 3 ) may include a first housing (410) (e.g., a first housing structure) including a first side member (413) (e.g., a side bezel) and a second housing (420) (e.g., a second housing structure) including a second side member (423) (e.g., a side bezel) that are foldably coupled to each other with respect to a folding axis (F) through at least one hinge device (440, 440-1) (e.g., a hinge module or a hinge structure). For example, the first housing (410) and the second housing (420) may be configured as a foldable housing (e.g., a housing structure). For example, the electronic device (400) may include a first display (430) (e.g., a flexible display, a foldable display, or a main display) arranged to be supported by a first housing (410) and a second housing (420). For example, the first housing (410) may include a first side (411) and a second side (412) facing in an opposite direction (e.g., a -z-axis direction) of the first side (411). For example, the second housing (420) may include a third side (421) and a fourth side (422) facing in an opposite direction (e.g., a -z-axis direction) of the third side (421). For example, the first housing (410) may include a first rear cover (414) coupled with a first side member (413). For example, the second housing (420) may include a second rear cover (424) coupled with a second side member (423). For example, when the electronic device (400) is in a fully unfolded first state (e.g., an unfolded state or a spread state), the first side (411) and the third side (421) may be operated such that they face substantially the same direction (e.g., the z-axis direction).For example, when the electronic device (400) is in a fully folded second state (e.g., a folded state or a collapsed state), the first side (411) and the third side (421) may be operated so that they face each other or face in opposite directions. For example, the electronic device (400) may also be operated so as to maintain a third state (e.g., an intermediate state) between the first state and the second state.

[0068] According to one embodiment, the electronic device (400) may include a first receiver (401), at least one first sensor module (404) (e.g., an ambient light sensor) and / or at least one first camera module (405) (e.g., a UDC, under display camera) disposed on a first side (411) of the first housing (410). For example, the electronic device (400) may include at least one key (406) disposed on a first side member (413). For example, the electronic device (400) may include at least one second camera module (408) and / or a flash (409) disposed on a second side (412) of the first housing (410) (e.g., a first rear cover (414)). For example, the electronic device (400) may include a second display (431) disposed on a fourth side (422) of a second housing (420), at least one third camera module (425) (e.g., UDC, under display camera), at least one second sensor module (426), and / or a second receiver (427). For example, the second display (431) may be disposed to be visible from the outside through at least a portion of the second rear cover (424). For example, the electronic device (400) may include a speaker (402) disposed on a second side member (423), a microphone (403) disposed on a first side member (413), and / or a connector port (407). At least some of the components described above may be disposed in the first housing (410) and / or the second housing (420).

[0069] According to one embodiment, the first display (430) (e.g., a flexible display) may include a first area (430a) (e.g., a first planar portion) corresponding to at least a portion of the first surface (411), a second area (430b) (e.g., a second planar portion) corresponding to at least a portion of the third surface (421), and a third area (430c) (e.g., a flexible portion) connecting the first area (430a) and the second area (430b) and allowing the electronic device (400) to be deformed in a second state (e.g., a folded state) and / or a third state. For example, the third area (430c) may be positioned to at least partially overlap at least one hinge device (440, 440-1) when the first display (430) is viewed from above (e.g., in the z-axis direction). For example, the first display (430) may be arranged so that it is not visible from the outside in the second state by having the first side (411) and the third side (421) face each other (e.g., inward-fold type). For example, the first display (430) may be arranged so that it is visible from the outside in the second state by having the first side (411) and the third side (421) face each other in opposite directions (e.g., outward-fold type).

[0070] FIG. 5 is an exploded perspective view of a portion of the electronic device of FIGS. 4A and 4B including a hinge device, according to one embodiment.

[0071] Referring to FIG. 5, the electronic device (400) may include at least one hinge device (440, 440-1) (e.g., a hinge module or a hinge structure) connecting the first housing (410) and the second housing (420) under the first display (430) (e.g., in the -z-axis direction). For example, the at least one hinge device (440, 440-1) may include a first hinge device (440) and a second hinge device (440-1) spaced apart from the first hinge device (440) along a direction parallel to the folding axis (F) (e.g., in the ±y-axis direction). For example, at least one hinge device (440, 440-1) may be supported by a first support member (4131) extending from the first side member (413) to the first space (4101) of the first housing (410) and a second support member (4231) extending from the second side member (423) to the second space (4201) of the second housing (420). For example, at least one hinge device (440, 440-1) may be arranged between the first housing (410) and the second housing (420) so as to be invisible from the outside through a hinge housing (450) (e.g., a hinge cover).

[0072] According to one embodiment, the first hinge device (440) may include a first rotation member (441) (e.g., a first arm or a first rotator) disposed on a first support member (4131) of the first housing (410), a second rotation member (442) (e.g., a second arm or a second rotator) disposed on a second support member (4231) of the second housing (420), and a gear assembly (443) connected to the first rotation member (441) and the second rotation member (442) such that the first housing (410) and the second housing (420) rotate symmetrically with respect to each other. For example, the gear assembly (443) may include a plurality of gears (e.g., spur gears and / or worm gears) gear-coupled with respect to one another. For example, the gear assembly (443) may include a cam coupling structure for urging the first housing (410) and the second housing (420) in a direction in which they are to transition from a first state (e.g., an unfolded state or an unfolded state) to a second state (e.g., a folded state or a folded state) or in a direction in which they are to transition from the second state to the first state, based on a predetermined angle, and for providing a free stop at various folding angles. For example, the second hinge device (440-1) may have substantially the same configuration as the first hinge device (440).

[0073] According to one embodiment, the electronic device (400) may include a first hinge plate (461) connected to a first support member (4131) and / or a first rotation member (441). The electronic device (400) may include a second hinge plate (462) connected to a second support member (4231) and / or a second rotation member (442). For example, at least one hinge device (440, 440-1), the first rotation member (441), the second rotation member (442), the first hinge plate (461), and the second hinge plate (462) may form substantially the same plane as the first support member (4131) and the second support member (4231) when the electronic device (400) is in a first state. For example, the second hinge device (440-1) may be substantially symmetrical with the first hinge device (440) or may have a substantially identical configuration.

[0074] Figure 6 is a flowchart of a display method according to one embodiment.

[0075] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0076] According to one embodiment, the operations 610 to 660 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1 , the electronic device (200) of FIGS. 2A, 2B, and 3 , or the electronic device (400) of FIGS. 4A, 4B, and 5 ). The electronic device may include at least some of the components of the electronic device (101) described in FIG. 1 . For example, the electronic device may include at least one processor including a processing circuit (e.g., the processor (120) of FIG. 1 ), a memory including one or more storage media for storing instructions (e.g., the memory (130) of FIG. 1 ), and a communication unit (e.g., the communication module (190) of FIG. 1 ).

[0077] The electronic device may include a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3 or the first display (430) of FIGS. 4A, 4B, and 5) and a second display (e.g., the second display (231) of FIGS. 2A, 2B, and 3 or the second display (431) of FIGS. 4A, 4B, and 5).

[0078] The first display may include a first region (e.g., the first region (230a) of FIGS. 2A and 2B or the first region (430a) of FIGS. 4A and 4B) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B or the second region (430b) of FIGS. 4A and 4B).

[0079] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5). For example, the first housing may include a first surface and a second surface opposite the first surface. The second housing may include a third side and a fourth side opposite the third side. When the electronic device is in a fully unfolded state (e.g., an unfolded state or an unfolded state), the first side and the third side may be operated so that they face substantially the same direction. When the electronic device is in a fully folded state (e.g., a folded state or a collapsed state), the first side and the third side may be operated so that they face each other or face opposite directions.

[0080] The first region may be a region corresponding to a portion of the entire area of ​​the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing.

[0081] According to one embodiment, based on the hinge structure, the first region may correspond to the first housing, and the second region may correspond to the second housing. For example, the first region may correspond to the first side of the first housing, and the second region may correspond to the third side of the second housing. Referring to (a) of FIG. 9A or (b) of FIG. 9B, the first region (701) may be the upper half region of the first display (710) corresponding to the first housing, and the second region (702) may be the lower half region of the first display (710) corresponding to the second housing.

[0082] According to one embodiment, a part of the first region may correspond to the first housing based on the hinge structure, and another part of the first region may correspond to the second housing. A part of the second region may correspond to the first housing based on the hinge structure, and another part of the second region may correspond to the second housing. For example, a part of the first region may correspond to the first side of the first housing, and another part of the first region may correspond to the third side of the second housing. A part of the second region may correspond to the first side of the first housing, and another part of the second region may correspond to the third side of the second housing. Referring to (a) of FIG. 9B, the first region (701) may be the upper half region of the first display (710), and the second region (702) may be the lower half region of the first display (710). Referring to (c) of FIG. 9b, the first region (701) may be a left half region of the first display (710), and the second region (702) may be a right half region of the first display (710).

[0083] The second display (or second display area) may be included (or arranged) on a surface of the first housing or the second housing opposite the first display. For example, the second display may be included (or arranged) on a surface of the first housing (e.g., the second surface) opposite a surface of the first housing (e.g., the first surface) that includes at least a portion of the first area. For example, the second display may be included (or arranged) on a surface of the second housing (e.g., the fourth surface) opposite a surface of the second housing (e.g., the third surface) that includes at least a portion of the second area.

[0084] In operation 610, the electronic device may receive an acoustic signal. The acoustic signal may be a voice (or utterance) of a speaker in any language.

[0085] The electronic device may include one or more microphones (e.g., the input module (150) of FIG. 1, the microphone (203) of FIGS. 2A and 3, or the microphone (403) of FIGS. 4A and 5). The electronic device may include one or more directional microphones. For example, the directional microphones may be respectively disposed in the first housing and the second housing of the electronic device. The electronic device (or the processor of the electronic device) may obtain an acoustic signal from the directional microphones, which is received by the directional microphones.

[0086] In one embodiment, the electronic device may predetermine at least a portion of a set of translation languages. The set of translation languages ​​may include a first language to be the target of bidirectional or unidirectional translation and a second language different from the first language.

[0087] For example, an electronic device may determine at least a portion of a translation language set based on a user input specifying one or more languages. In one embodiment, the electronic device may determine a designated language as a main language of a translation language set based on a user input specifying one language. The 'main language' may indicate a language into which the audio signal being received is to be translated when an audio signal of a different language is received in operation 610. In other words, the main language may indicate a language that a user of the electronic device has designated to receive a translation. For convenience of description, the main language may be referred to as a first language. In operation 620, the electronic device may identify the language of the audio signal received in operation 610. If the identified language is a second language different from the first language, the electronic device may determine the first language and the second language as a translation language set. In one embodiment, the electronic device may determine the designated languages ​​as a translation language set based on a user input specifying two languages ​​(e.g., a first language and a second language).

[0088] For example, an electronic device may determine a pre-stored default language of the electronic device as the main language (or, first language). The 'default language' may represent a language used by the owner (or, user) of the electronic device, which is pre-stored or set to be supported by apps and websites of the electronic device. The default language may be the highest-level language when the owner of the electronic device uses multiple languages ​​(e.g., when multiple languages ​​are included in the keyboard settings). According to one embodiment, the electronic device may determine the default language and the second language of the electronic device as a set of translation languages ​​based on a user input specifying a second language different from the default language of the electronic device. According to one embodiment, in operation 620, the electronic device may identify the language of the acoustic signal received in operation 610. If the identified language is a second language different from the default language of the electronic device, the electronic device may determine the default language and the second language of the electronic device as a set of translation languages.

[0089] According to one embodiment, an electronic device may receive an acoustic signal in advance for speech in a first language of a user of the electronic device (hereinafter, referred to as a first speaker). The electronic device may store the first speaker's spoken language (i.e., the first language) and / or speech characteristics. According to one embodiment, in operation 620, the electronic device may identify the language of the acoustic signal received in operation 610. If the identified language is a second language different from the first speaker's spoken language, the electronic device may determine the first speaker's spoken language and the second language as a translation language set.

[0090] In the present disclosure, a first acoustic signal may be understood as being in a first language, and a second acoustic signal may be understood as being in a second language different from the first language.

[0091] The electronic device can receive the first acoustic signal and the second acoustic signal alternately (one after the other).

[0092] An electronic device may receive a first acoustic signal and a second acoustic signal at least partially simultaneously (or overlappingly). For example, if a first speaker and a second speaker are conversing in a first language and a second language, respectively, the first and second acoustic signals may be received with a partial overlap.

[0093] In operation 630, the electronic device may display a screen on the first display in a first translation mode. The first translation mode may be a bidirectional translation mode, which may indicate a state in which a screen in a first language is displayed on a portion of the first display and a screen in a second language is displayed on another portion of the first display. In the first translation mode, for example, when a first speaker and a second speaker are conversing, a portion of the first display may be assigned to the first language, and another portion of the first display may be assigned to the second language.

[0094] According to one embodiment, in operation 630, a first area of ​​a first display may be assigned to a second language, and a second area may be assigned to a first language. The electronic device may display a screen in the second language for a second speaker through the first area, and display a screen in the first language for a first speaker through the second area.

[0095] According to one embodiment, the electronic device may generate a translation text in another language included in the translation language set based on the received acoustic signal if the language identified in operation 620 is included in a predetermined translation language set. For example, if the language of the acoustic signal in operation 620 is identified as a first language included in the translation language set, the electronic device may generate a translation text in a second language included in the translation language set based on the acoustic signal (i.e., the first acoustic signal). For example, if the language of the acoustic signal in operation 620 is identified as a second language included in the translation language set, the electronic device may generate a translation text in the first language included in the translation language set based on the acoustic signal (i.e., the second acoustic signal).

[0096] According to one embodiment, the electronic device can generate an original language text, i.e., a text in the first language, by converting a first acoustic signal into speech-to-text (STT) while receiving a first acoustic signal in the first language, if the language of the acoustic signal is identified as a first language. The text in the first language generated by converting the first acoustic signal into STT can be referred to as a transcription (or, a transcription text) in the first language. That is, the electronic device can generate the transcription text in the first language by transcribing the first acoustic signal. The electronic device can generate the translated text in the second language by converting (or, translating) the transcription text in the first language into the second language.

[0097] According to one embodiment, the electronic device can generate a translation text in a second language by directly STT translating the first acoustic signal while receiving the first acoustic signal in the first language, if the language of the acoustic signal is identified as the first language.

[0098] In one embodiment, the electronic device can generate a translation text in a second language in real time while the first acoustic signal is received.

[0099] The electronic device can generate a translation text in a first language based on a second acoustic signal when the language of the acoustic signal is identified as the second language, similar to the aforementioned method of generating a translation text in a second language based on a first acoustic signal when the language of the acoustic signal is identified as the first language. Duplicate descriptions are omitted.

[0100] The electronic device may, in a first translation mode, display a second language translation screen for the content indicated by the first audio signal on a first area of ​​the first display while the first audio signal is being received.

[0101] The electronic device may, in the first translation mode, display a first language translation screen for the content indicated by the second acoustic signal in a second area of ​​the first display while the second acoustic signal is being received.

[0102] A translation screen may be a screen composed of translated text in a language other than the original language of the audio signal, generated by converting the audio signal. A second language translation screen may display a screen composed of text translated into the second language. A first language translation screen may display a screen composed of text translated into the first language. For example, a main language translation screen may display a screen composed of text translated into the main language from content represented by an audio signal in a language other than the main language.

[0103] In the first translation mode, the electronic device may further display a first language transcription screen for the content indicated by the first audio signal in the second area of ​​the first display while the first audio signal is being received. The electronic device may simultaneously display the first language transcription screen in the second area while displaying the second language translation screen in the first area.

[0104] In the first translation mode, while receiving a second audio signal, the electronic device may further display a second language transcription screen for the content indicated by the second audio signal in the first area of ​​the first display. The electronic device may simultaneously display the second language transcription screen in the first area while displaying the first language translation screen in the second area.

[0105] The transcription screen may be a screen composed of original text, i.e., a transcription text, generated by converting an audio signal to speech-to-text (STT). The second language transcription screen may represent a screen composed of text transcribed into the second language. The first language transcription screen may represent a screen composed of text transcribed into the first language.

[0106] At operation 640, the electronic device may determine, while in the first translation mode, whether the duration for which the second acoustic signal is received satisfies a defined criterion.

[0107] The established criteria may include a threshold value exceeding a predetermined threshold. The electronic device may determine whether the duration for which the second acoustic signal is received exceeds the predetermined threshold value. The preset threshold value may be set, for example, within a range of 5 to 15 seconds. The preset threshold value may be set by the user or adjusted by analyzing conversation patterns, for example.

[0108] The electronic device may continue to display a screen on the first display in the first translation mode if the duration for which the second acoustic signal is received does not meet the set criteria.

[0109] In operation 650, the electronic device may switch to a second translation mode based on a duration of receiving a second acoustic signal that meets a predetermined criterion while in the first translation mode. The second translation mode may be a one-way translation mode, and may indicate a state in which, when one speaker speaks, a translation screen of the language of another speaker listening to the speech is displayed on the first display. For example, the second translation mode may indicate a state in which, when the second speaker speaks, a translation screen of the second speaker's first language is displayed on the first display. In the second translation mode, the first display (or substantially the entire area of ​​the first display) may be assigned to the language of the speaker listening to the speech.

[0110] While in the first translation mode, the electronic device may switch to the second translation mode based on whether the duration of the second acoustic signal received is greater than a predetermined threshold. For example, if the first speaker and the second speaker are not engaged in two-way communication (or conversation) but rather the second speaker is speaking and the first speaker is listening, the duration of the second acoustic signal received may be greater than the predetermined threshold.

[0111] In one embodiment, in the second translation mode, the first and second areas of the first display may be entirely allocated to the first language. The electronic device may provide a screen in the first language for the first speaker through at least a portion of the first and second areas.

[0112] In the second translation mode, the electronic device may display a first language translation screen for the content indicated by the second acoustic signal on at least a portion of the first area and the second area of ​​the first display while the second acoustic signal is being received.

[0113] At operation 660, the electronic device may determine whether a first acoustic signal is received while in the second translation mode.

[0114] The electronic device may switch to the first translation mode in response to receiving the first acoustic signal while in the second translation mode.

[0115] According to one embodiment, operations 630 and 650 may be performed with respect to any of the first acoustic signal and the second acoustic signal. That is, the electronic device may switch from the first translation mode to the second translation mode based on whether the duration of reception of the first acoustic signal satisfies a predetermined criterion. The electronic device may switch to the first translation mode in response to receiving the second acoustic signal in the second translation mode.

[0116] While the method for displaying audio signals of a first language and a second language has been described, the number of languages ​​to be translated is not limited to two, and may be three or more, depending on the number of languages ​​in the audio signal. Referring to FIG. 19, a method for displaying audio signals of different first, second, and third languages ​​is described.

[0117] Figure 7 is a drawing explaining a display method according to an example.

[0118] FIG. 7 is an example of a screen displayed through a first display (710) (e.g., the first display (230) of FIGS. 2A, 2B, and 3, or the first display (430) of FIGS. 4A, 4B, and 5) of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5).

[0119] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 6. For example, the electronic device may include at least one processor including a processing circuit (e.g., the processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., the memory (130) of FIG. 1), and a communication unit (e.g., the communication module (190) of FIG. 1). The electronic device may include a first display (710) including a first region (701) (e.g., the first region (230a) of FIGS. 2A and 2B or the first region (430a) of FIGS. 4A and 4B) and a second region (702) (e.g., the second region (230b) of FIGS. 2A and 2B or the second region (430b) of FIGS. 4A and 4B).

[0120] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0121] The first region (701) may be a region corresponding to a portion of the entire region of the first display (710), and the second region (702) may be a region corresponding to a portion of the first display (710) that is different from the first region (702). At least a portion of the first region (701) may correspond to the first housing, and at least a portion of the second region (702) may correspond to the second housing. According to one embodiment, the first region (701) may correspond to the first housing, and the second region (702) may correspond to the second housing based on the hinge structure. Referring to FIG. 7, for example, the first region (701) may be an upper region of the first display (710) corresponding to the first housing, and the second region (702) may be a lower region of the first display (710) corresponding to the second housing.

[0122] In one embodiment, the electronic device may predetermine at least a portion of a set of translation languages. The set of translation languages ​​may include a first language to be the target of bidirectional or unidirectional translation and a second language different from the first language.

[0123] For example, an electronic device may determine at least a portion of a set of translation languages ​​based on user input specifying one or more languages. In one embodiment, the electronic device may determine a designated language (e.g., Korean) as a primary language of a set of translation languages ​​based on user input specifying one language. For convenience of description, the primary language may be referred to as a primary language. The electronic device may identify a language of a received acoustic signal. If the identified language is a second language (e.g., Spanish) different from the first language, the electronic device may determine the first language and the second language as a set of translation languages. In one embodiment, the electronic device may determine the designated languages ​​as a set of translation languages ​​based on user input specifying two languages ​​(e.g., the first language and the second language).

[0124] For example, an electronic device may determine a pre-stored default language of the electronic device (e.g., Korean) as the main language (or, first language). In one embodiment, the electronic device may determine the default language and the second language of the electronic device as a set of translation languages ​​based on a user input specifying a second language (e.g., Spanish) different from the default language of the electronic device. In one embodiment, the electronic device may identify the language of a received acoustic signal. If the identified language is a second language (e.g., Spanish) different from the default language of the electronic device, the electronic device may determine the default language and the second language of the electronic device as a set of translation languages.

[0125] According to one embodiment, an electronic device may receive an acoustic signal in advance for speech in a first language (e.g., Korean) of a user of the electronic device (hereinafter, referred to as a first speaker). The electronic device may store the first speaker's spoken language (i.e., the first language) and / or speech characteristics. According to one embodiment, the electronic device may identify the language of the received acoustic signal. If the identified language is a second language (e.g., Spanish) different from the first speaker's spoken language, the electronic device may determine the first speaker's spoken language and the second language as a set of translation languages.

[0126] The electronic device may display a screen on the first display (710) in a first translation mode. The first translation mode may be a bidirectional translation mode, which may indicate a state in which a screen in a first language is displayed on a portion of the first display (710) and a screen in a second language is displayed on another portion of the first display (710).

[0127] Referring to (a) of FIG. 7, in the first translation mode, the electronic device can display a screen of a second language through the first area (701) and display a screen of a first language through the second area (702).

[0128] However, in the first translation mode, examples of displaying screens of the first language and the second language are not limited to the embodiment of FIG. 7. The electronic device may display the screens of the first language and the screens of the second language in any other area, respectively, when the first area (701) and the second area (702) are arranged horizontally (i.e., the folding axis is perpendicular to the ground). For example, the electronic device may determine the direction in which an audio signal is received through a directional microphone (e.g., the input module (150) of FIG. 1, the microphone (203) of FIGS. 2A and 3, or the microphone (403) of FIGS. 4A and 5). The electronic device may display the screen of the language of the audio signal in an area corresponding to (or close to) the determined direction. For example, the electronic device may change the language of the screen displayed in each area based on receiving a user input for changing the language of the audio signal for each area.

[0129] In one embodiment, an electronic device may receive an acoustic signal and identify the language of the received acoustic signal. If the identified language is included in a predetermined set of translation languages, the electronic device may generate a translation text in another language included in the set of translation languages ​​based on the received acoustic signal.

[0130] Referring to FIG. 7, an electronic device may receive a second audio signal in a second language (e.g., Spanish). The electronic device may receive the second audio signal for speech (or utterance) of a second speaker in the second language. The content represented by the second audio signal may represent speech (or speech content) of the second speaker in the second language.

[0131] According to one embodiment, the electronic device can generate a source text, i.e., a text in the second language, by STT converting the second acoustic signal while receiving a second acoustic signal in the second language, if the language of the acoustic signal is identified as the second language. The text in the second language generated by STT converting the second acoustic signal can be referred to as a transcription (or transcription text) in the second language. That is, the electronic device can generate a transcription text in the second language by transcribing the second acoustic signal. The electronic device can generate a translated text in the first language by converting (or translating) the transcription text in the second language into the first language.

[0132] According to one embodiment, the electronic device can generate a translation text in the first language by directly STT translating the second acoustic signal while receiving a second acoustic signal in the second language, if the language of the acoustic signal is identified as the second language.

[0133] Referring to (a) of FIG. 7, in the first translation mode, while the second acoustic signal is being received, the electronic device may display a second language transcription screen for the content indicated by the second acoustic signal on the first area (701) of the first display (710), and may display a first language translation screen for the content indicated by the second acoustic signal on the second area (702). The electronic device may display a second language (e.g., Spanish) transcription screen for the content indicated by the second acoustic signal on at least a portion of the first area (701) (e.g., a screen composed of the second language transcription text "Hola. Bienvenido al Museo de Arte. El museo consta de un total de tres plantas... (omitted)"). While the second acoustic signal is being received, the electronic device may display a screen with a translation in a first language (e.g., Korean) of the content indicated by the second acoustic signal on at least a portion of the second area (702) (e.g., a screen with the translated text in the first language "Hello. Welcome to the museum. The museum consists of three floors in total and... (omitted)").

[0134] While in the first translation mode, the electronic device can determine whether the duration for which the second acoustic signal is received satisfies a predetermined criterion. The predetermined criterion may include being greater than or equal to a predetermined threshold. The predetermined threshold may be set within a range of, for example, 5 to 15 seconds. The electronic device can determine whether the duration for which the second acoustic signal is received satisfies the predetermined threshold.

[0135] While in the first translation mode, the electronic device may switch to the second translation mode based on the duration of the second audio signal received meeting a predetermined criterion. The second translation mode is a one-way translation mode, and when one speaker speaks, the first display (710) may display a translation screen in the language of another speaker listening to the speech.

[0136] For example, if a first speaker and a second speaker do not communicate bidirectionally, but the second speaker speaks and the first speaker listens, the duration for which the second acoustic signal is received may be greater than a predetermined threshold.

[0137] Referring to (b) of FIG. 7, in the second translation mode, the electronic device may display a first language translation screen for the content indicated by the second acoustic signal on at least a portion of the first area (701) and the second area (702) of the first display (710) while the second acoustic signal is being received.

[0138] According to one embodiment, in the second translation mode, the first area (701) and the second area (702) of the first display (710) may be entirely allocated to the first language. The electronic device may provide a screen in the first language for the first speaker through at least a portion of the first area (701) and the second area (702).

[0139] According to one embodiment, the electronic device may display a first language translation screen for the content indicated by the second acoustic signal and a second language transcription text for the content indicated by the second acoustic signal together in at least a portion of the first area (701) and the second area (702).

[0140] In one embodiment, the electronic device may generate a summary of the translation text in the first language for the content indicated by the second audio signal. For example, the electronic device may generate and display a summary of the translation text if the duration of the second audio signal reception satisfies a specified condition (e.g., 1 minute or more). For example, the electronic device may generate and display a summary of the translation text if the capacity (or length) of the translation text in the first language satisfies a specified condition (e.g., 100 KB).

[0141] The electronic device can determine whether a first acoustic signal is received while in the second translation mode.

[0142] The electronic device may switch to the first translation mode in response to receiving the first acoustic signal while in the second translation mode.

[0143] Referring to FIG. 7, the electronic device may display control elements (71, 72, 91, 92, 93) on the first display (710). The control elements (71, 72, 91, 92, 93) may represent at least one interface element (e.g., a button, an icon, an indicator, a menu, a graphic object) associated with translation.

[0144] For example, the operating elements (71, 72) may be drop-down buttons (or icons) that provide options for the languages ​​into which the audio signal is to be translated. In one embodiment, the user can directly specify the first and second languages ​​via the operating elements (71, 72). The electronic device may display the operating elements (71, 72) that change depending on the specified language.

[0145] According to one embodiment, in the first translation mode, the operating elements (91) of the first area (701) may be assigned to the second language, and the operating elements (92) of the second area (702) may be assigned to the first language.

[0146] For example, the operating elements (91, 92, 93) may be buttons that initiate reception of an acoustic signal (or provision of a translation screen) in response to receiving a user input (e.g., selection, touch, tap). In one embodiment, the electronic device may initiate reception of an acoustic signal from the time it receives a user input to the operating elements (91, 92, 93).

[0147] For example, the operating elements (91, 92, 93) may be feedback elements that indicate that an acoustic signal (e.g., a first acoustic signal, a second acoustic signal) is being received through a visual effect. In one embodiment, the electronic device may display a visual effect (e.g., a color change, an animation application) applied to the operating element (91) while the second acoustic signal is being received. In one embodiment, when the electronic device receives a user input for the operating element (91), the electronic device may display a different visual effect from the operating element (92) that indicates that reception of the acoustic signal has been activated.

[0148] Referring to (a) of FIG. 7, according to one embodiment, the electronic device may initiate (or activate) reception of a second acoustic signal based on receiving a user input (e.g., a tap) to an operating element (91) in a first translation mode. The electronic device may display a second language transcription screen for the content indicated by the second acoustic signal in at least a portion of the first area (701). The electronic device may display a first language translation screen for the content indicated by the second acoustic signal in at least a portion of the second area (702).

[0149] According to one embodiment, the electronic device may switch to the second translation mode based on receiving a user input (e.g., double tap) on the operating element (91) in the first translation mode. As shown in (b) of FIG. 7, the electronic device may display a translation screen in the first language for the content indicated by the second acoustic signal in at least a portion of the first area (701) and the second area (702) in the second translation mode.

[0150] According to one embodiment, a user input that initiates reception of an acoustic signal and a user input that triggers a transition from a first translation mode to a second translation mode may be predetermined. For example, a user input that initiates reception of an acoustic signal may be predetermined as a single tap on an operating element (91, 92). For example, a user input that changes the display state of a translation screen from (a) to (b) of FIG. 7 may be predetermined as a double tap on an operating element (91, 92). However, the types of user inputs described above with reference to FIG. 7 are not limited to the present disclosure. The user inputs that trigger each action may be changed by the user.

[0151] According to one embodiment, the electronic device may display operation elements (91, 92) in the first area (701) and the second area (702) in the first translation mode, respectively, while displaying one operation element (93) in the second translation mode. Referring to FIG. 7 (b), the electronic device may display only the operation element (93) associated with the reception of the second acoustic signal of the second speaker in the second area (702). The electronic device may display the operation element (93) by applying a visual effect (e.g., changing color, applying animation) while the second acoustic signal is being received.

[0152] Fig. 8 is a flowchart of a method for displaying operation elements according to one embodiment. Figs. 9a, 9b, and 9c are drawings each explaining a method for displaying operation elements according to one embodiment.

[0153] According to one embodiment, the operations 810 to 840 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5).

[0154] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 7. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device may include a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (710) of FIG. 7) including a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIG. 7)) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIG. 7).

[0155] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0156] The first region may be a region corresponding to a portion of the entire area of ​​the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing.

[0157] The electronic device may display an operating element (e.g., an operating element (71, 72, 91, 92, 93) of FIG. 7) on at least a portion of a first area and at least a portion of a second area of ​​the first display while the first display is maintained in an open state (or a fully unfolded state). The operating element may represent at least one interface element (e.g., a button, an icon, an indicator, a menu, a graphic object) associated with translation.

[0158] For example, the operating element may be a drop-down menu button (or icon) that provides options for the language into which the audio signal is to be translated. For example, the operating element may be a button that initiates reception of an audio signal in response to receiving user input (e.g., a selection, touch, or tap). For example, the operating element may be a feedback element that indicates, through a visual effect, that an audio signal (e.g., a first audio signal, a second audio signal) is being received.

[0159] In operations 810 and 820, the electronic device may determine whether the electronic device is in a partially unfolded intermediate state.

[0160] In operation 810, the electronic device may determine whether the first display is partially folded such that the angle between the first housing and the second housing corresponds to a first angle range. For example, the first angle range may correspond to an obtuse angle. For example, the first angle range may be a range from 60 degrees to 170 degrees. The first angle range is not limited to the examples of the present disclosure.

[0161] In operation 820, the electronic device may determine whether the first display is partially folded such that the angle between the first housing and the second housing corresponds to a predetermined second angular range. For example, the predetermined second angular range may be an angular range corresponding to an acute angle. For example, the second angular range may be a range from 40 degrees to 75 degrees. In the partially folded state of the first display such that the angle between the first housing and the second housing corresponds to the predetermined second angular range, the first side of the first housing may face the third side of the second housing. The second angular range is not limited to the examples of the present disclosure.

[0162] In operation 830, the electronic device can display the operating elements on at least a portion of the first area and at least a portion of the second area of ​​the first display, respectively, when the first display is in an unfolded state (or a fully unfolded state).

[0163] In operation 840, the electronic device can rearrange and display the operating elements in the second area based on detecting that the first display is in a partially folded state such that the angle between the first housing and the second housing corresponds to a first angle range.

[0164] In operation 840, the electronic device can rearrange and display the operating elements in the second area based on detecting that the first display is partially folded such that the angle between the first housing and the second housing corresponds to a second angle range.

[0165] When the electronic device detects that the first display is in an unfolded state (or fully unfolded state), the electronic device can rearrange and display the operating elements on at least a portion of the first area and at least a portion of the second area of ​​the first display, respectively.

[0166] FIGS. 9A, 9B, and 9C are examples of screens displayed through a first display (710) of an electronic device (e.g., the first display (230) of FIGS. 2A, 2B, and 3 or the first display (430) of FIGS. 4A, 4B, and 5), respectively.

[0167] Referring to FIGS. 9A, 9B, and 9C, the electronic device may display operating elements (71, 72, 91, 92, 93, 94) on the first display (710). The operating elements (71, 72, 91, 92, 93, 94) may represent at least one interface element (e.g., a button, an icon, an indicator, a menu, a graphic object) associated with translation.

[0168] Referring to FIGS. 9A and 9B , in the first translation mode, while the first acoustic signal is received, the electronic device may display a second language translation screen (e.g., a screen composed of the second language translation text "Thank you for your help.") of the content indicated by the first acoustic signal (e.g., "Thank you for your help") on the first area (701) of the first display (710). In the first translation mode, while the first acoustic signal is received, the electronic device may display a first language transcription screen (e.g., a screen composed of the first language transcription text "Thank you for your help.") of the content indicated by the first acoustic signal on the second area (702) of the first display (710).

[0169] Referring to (a) of FIG. 9A and (a) and (c) of FIG. 9B, when the first display (710) is in an unfolded state (or a fully unfolded state), the electronic device may display an operation element (71, 91) on at least a part of a first area (701) of the first display (710) and display an operation element (72, 92) on at least a part of a second area (702). For example, the operation element (71, 72) may be a drop-down button (or icon) that provides options for a language into which an acoustic signal is to be translated. For example, the operation element (91, 92) may be a button that initiates reception of an acoustic signal in response to receiving a user's input (e.g., selection, touch, tap).

[0170] Referring to (b) of FIG. 9a and (b) of FIG. 9b, the electronic device can rearrange and display the operation elements (71, 72, 91, 92) in the second area (702) of the first display (710) when the first display (710) is in a partially unfolded intermediate state, i.e., when the first display (710) is in a partially folded state such that the angle between the first housing and the second housing corresponds to a first angle range or a second angle range.

[0171] Referring to FIG. 9C, in the second translation mode, the electronic device may display a first language translation screen for the content indicated by the second acoustic signal on at least a portion of the first area (701) and the second area (702) of the first display (710) while the second acoustic signal is being received. The electronic device may also display a second language transcription text for the content indicated by the second acoustic signal on at least a portion of the first area (701) and the second area (702).

[0172] Referring to (a) of FIG. 9c, when the first display (710) is in an unfolded state, the electronic device may display an operation element (94) on at least a part of a first area (701) of the first display (710) and display an operation element (93) on at least a part of a second area (702). For example, the operation element (93) may be a button that initiates reception of an acoustic signal in response to receiving a user's input (e.g., selection, touch, tap). For example, the operation element (94) may be a drop-down button (or icon) that provides options for a language into which the acoustic signal is to be translated.

[0173] Referring to (b) of FIG. 9c, the electronic device can rearrange and display the operation elements (93, 94) in the second area (702) of the first display (710) when the first display (710) is in a partially unfolded intermediate state, i.e., when the first display (710) is in a partially folded state such that the angle between the first housing and the second housing corresponds to a first angle range or a second angle range.

[0174] Fig. 10 is a flowchart of a display method using a sub-display according to one embodiment. Figs. 11 and 12 are drawings each explaining a display method using a sub-display according to one embodiment.

[0175] According to one embodiment, the operations 1010 to 1070 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5).

[0176] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 9. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device may include a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (710) of FIGS. 7, 9A, 9B, and 9C) that includes a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIGS. 7, 9A, 9B, and 9C) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIGS. 7, 9A, 9B, and 9C).

[0177] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0178] The first region may be a region corresponding to a portion of the entire region of the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing. In one embodiment, the first region may correspond to the first housing, and the second region may correspond to the second housing, based on the hinge structure. For example, the first region may correspond to a first side of the first housing, and the second region may correspond to a third side of the second housing. In one embodiment, a portion of the first region may correspond to the first housing, and another portion of the first region may correspond to the second housing, based on the hinge structure. A portion of the second region may correspond to the first housing, and another portion of the second region may correspond to the second housing, based on the hinge structure. For example, a portion of the first region may correspond to a first side of the first housing, and another portion of the first region may correspond to a third side of the second housing. A part of the second area may correspond to a first surface of the first housing, and another part of the second area may correspond to a third surface of the second housing.

[0179] The electronic device may include a second display (e.g., the second display (231) of FIGS. 2A, 2B, and 3 or the second display (431) of FIGS. 4A, 4B, and 5). The second display may be referred to as a sub-display.

[0180] The second display (or second display area) may be included (or arranged) on a surface of the first housing or the second housing opposite the first display. For example, the second display may be included (or arranged) on a surface of the first housing (e.g., the first surface) that corresponds to at least a portion of the first area and the opposite surface (e.g., the second surface) of the first housing. For example, the second display may be included (or arranged) on a surface of the second housing (e.g., the third surface) that corresponds to at least a portion of the second area and the opposite surface (e.g., the fourth surface) of the second housing.

[0181] In operation 1010, the electronic device can receive an acoustic signal.

[0182] In operation 1020, the electronic device can identify the language of the acoustic signal.

[0183] In one embodiment, the electronic device may predetermine at least a portion of a set of translation languages. The set of translation languages ​​may include a first language to be the target of bidirectional or unidirectional translation and a second language different from the first language.

[0184] For example, an electronic device may determine at least a portion of a translation language set based on a user input specifying one or more languages. In one embodiment, the electronic device may determine a designated language as a main language of a translation language set based on a user input specifying one language. For convenience of description, the main language may be referred to as a first language. In operation 1020, the electronic device may identify a language of an acoustic signal received in operation 1010. If the identified language is a second language different from the first language, the electronic device may determine the first language and the second language as a translation language set. In one embodiment, the electronic device may determine the designated languages ​​as a translation language set based on a user input specifying two languages ​​(e.g., a first language and a second language).

[0185] For example, the electronic device may determine the pre-stored default language of the electronic device as the main language (or, first language). According to one embodiment, the electronic device may determine the default language and the second language of the electronic device as a set of translation languages ​​based on a user input specifying a second language different from the default language of the electronic device. According to one embodiment, in operation 1020, the electronic device may identify the language of the acoustic signal received in operation 1010. If the identified language is a second language different from the default language of the electronic device, the electronic device may determine the default language and the second language of the electronic device as a set of translation languages.

[0186] According to one embodiment, an electronic device may receive an acoustic signal in advance for speech in a first language of a user of the electronic device (hereinafter, referred to as a first speaker). The electronic device may store the first speaker's spoken language (i.e., the first language) and / or speech characteristics. According to one embodiment, in operation 1020, the electronic device may identify the language of the acoustic signal received in operation 1010. If the identified language is a second language different from the first speaker's spoken language, the electronic device may determine the first speaker's spoken language and the second language as a set of translation languages.

[0187] In operation 1030, the electronic device can display a screen on the first display in a first translation mode.

[0188] According to one embodiment, the electronic device may generate a translation text in another language included in the translation language set based on the received acoustic signal if the language identified in operation 1020 is included in a predetermined translation language set. For example, if the language of the acoustic signal in operation 1020 is identified as a first language included in the translation language set, the electronic device may generate a translation text in a second language included in the translation language set based on the acoustic signal (i.e., the first acoustic signal). For example, if the language of the acoustic signal in operation 1020 is identified as a second language included in the translation language set, the electronic device may generate a translation text in the first language included in the translation language set based on the acoustic signal (i.e., the second acoustic signal).

[0189] In the first translation mode, the electronic device may display a second language translation screen for the content indicated by the first audio signal on the first area of ​​the first display while the first audio signal is being received. The electronic device may further display a first language transcription screen for the content indicated by the first audio signal on the second area of ​​the first display while the first audio signal is being received.

[0190] In the first translation mode, the electronic device may display a first language translation screen for the content indicated by the second audio signal in the second area of ​​the first display while the second audio signal is being received. The electronic device may further display a second language transcription screen for the content indicated by the second audio signal in the first area of ​​the first display while the second audio signal is being received.

[0191] In actions 1040 and 1070, the electronic device can determine whether the electronic device is in a partially unfolded intermediate state.

[0192] In operation 1040, the electronic device may determine whether the first display is partially folded such that the angle between the first housing and the second housing corresponds to a first angle range in the first translation mode. For example, the first angle range may correspond to an obtuse angle. For example, the first angle range may be a range from 60 degrees to 170 degrees. The first angle range is not limited to the examples of the present disclosure.

[0193] The electronic device can detect a state in which the first display is partially folded such that an angle between the first housing and the second housing corresponds to a first angle range.

[0194] At operation 1050, the electronic device can determine whether a second acoustic signal is received in an opposite direction to the first acoustic signal while the first display remains in a partially folded state in the first translation mode.

[0195] An electronic device may include one or more microphones (e.g., an input module (150) of FIG. 1, a microphone (203) of FIGS. 2A and 3, or a microphone (403) of FIGS. 4A and 5). The electronic device may include one or more directional microphones. For example, a directional microphone may be disposed in a first housing and a second housing of the electronic device, respectively. The electronic device may obtain a first acoustic signal and a second acoustic signal received by the directional microphone from the directional microphone. The electronic device may determine a direction from which each acoustic signal is received based on the first acoustic signal and the second acoustic signal received through the directional microphone.

[0196] The electronic device may determine that the second acoustic signal is received in an opposite direction to the first acoustic signal when a first acoustic signal of a first speaker is received in a direction toward a front side of the electronic device (e.g., a first side of a first housing, a third side of a second housing) (or a first display) while a second acoustic signal of a second speaker is received in a direction toward a rear side of the electronic device (e.g., a second side of a first housing, a fourth side of a second housing) (or a second display).

[0197] The electronic device may determine that the second acoustic signal is received from an opposite direction of the first acoustic signal when the first acoustic signal of the first speaker is received from a position closer to the first housing than the second housing while the second acoustic signal of the second speaker is received from a position closer to the first housing than the second housing while the folding axis is horizontal to the ground.

[0198] The electronic device can receive a second acoustic signal in an opposite direction to the first acoustic signal while the first display remains partially folded such that an angle between the first housing and the second housing corresponds to a first angle range in the first translation mode.

[0199] The electronic device may activate the second display in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal while the first display remains in a partially folded state in the first translation mode.

[0200] In operation 1060, the electronic device may further display a second language translation screen for the content indicated by the first acoustic signal on the second display while the first acoustic signal is being received. That is, the electronic device may display a second language translation screen for the content indicated by the first acoustic signal on the first area of ​​the first display while the first acoustic signal is being received, display a first language transcription screen for the content indicated by the first acoustic signal on the second area, and display an identical screen to the first area on the second display.

[0201] In operation 1060, the electronic device may further display a second language transcription screen for the content indicated by the second acoustic signal on the second display while the second acoustic signal is being received. That is, the electronic device may display a second language transcription screen for the content indicated by the second acoustic signal on the first area of ​​the first display while the second acoustic signal is being received, display a first language translation screen for the content indicated by the second acoustic signal on the second area, and display an identical screen to the first area on the second display.

[0202] In operation 1070, the electronic device may determine whether the first display is partially folded such that the angle between the first housing and the second housing corresponds to a second angle range. For example, the second angle range may correspond to an acute angle. For example, the second angle range may be a range of 40 to 75 degrees. The second angle range is not limited to the examples of the present disclosure.

[0203] The electronic device can detect a state in which the first display is partially folded such that the angle between the first housing and the second housing corresponds to a second angle range.

[0204] The electronic device can activate the second display based on detecting that the first display is partially folded such that the angle between the first housing and the second housing corresponds to a second angle range in the first translation mode.

[0205] In operation 1060, the electronic device may further display a second language translation screen for the content indicated by the first audio signal on the second display while the first audio signal is received. The electronic device may further display a second language transcription screen for the content indicated by the second audio signal on the second display while the second audio signal is received.

[0206] When the second display is activated, in operation 1060, the first display may be a screen assigned to the first language, and the second display may be a screen assigned to the second language.

[0207] FIGS. 11 and 12 are examples of screens displayed through a first display (710) (e.g., the first display (230) of FIGS. 2A, 2B, and 3 or the first display (430) of FIGS. 4A, 4B, and 5) and a second display (720) (e.g., the second display (231) of FIGS. 2A, 2B, and 3 or the second display (431) of FIGS. 4A, 4B, and 5) of an electronic device, respectively.

[0208] Referring to (a) of FIG. 11, the electronic device can operate in a first translation mode.

[0209] While the first acoustic signal is received, the electronic device may display a second language translation screen (e.g., a screen composed of the second language translation text "Thank you for your help.") of the content indicated by the first acoustic signal (e.g., "Thank you for your help") on the first area (701) of the first display (710). While the first acoustic signal is received, the electronic device may display a first language transcription screen (e.g., a screen composed of the first language transcription text "Thank you for your help.") of the content indicated by the first acoustic signal (e.g., "Thank you for your help") on the second area (702) of the first display (710).

[0210] In FIG. 11(a), the electronic device can detect a state in which the first display (710) is partially folded such that the angle between the first housing and the second housing corresponds to a first angle range determined. For example, the first angle range determined may be an angle range corresponding to an obtuse angle. For example, the first angle range may be a range from 60 degrees to 170 degrees.

[0211] In (b) of FIG. 11, the electronic device can receive a second acoustic signal in the opposite direction of the first acoustic signal while the first display (710) is maintained in a partially folded state such that the angle between the first housing and the second housing corresponds to a first angle range determined in the first translation mode.

[0212] The electronic device may activate the second display in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal while the first display (710) remains in a partially folded state in the first translation mode.

[0213] Referring to (b) of FIG. 11, while the second acoustic signal is being received, the electronic device may display a second language transcription screen (e.g., a screen composed of the second language transcription text "You're welcome.") for the content indicated by the second acoustic signal (e.g., "You're welcome.") on a first area (701) of the first display (710). While the second acoustic signal is being received, the electronic device may display a first language translation screen (e.g., a screen composed of the first language translation text "You're welcome.") for the content indicated by the second acoustic signal on a second area (702) of the first display (710). While the second acoustic signal is being received, the electronic device may display a second language transcription screen (e.g., a screen composed of the second language transcription text "You're welcome.") for the content indicated by the second acoustic signal on at least a portion (e.g., area (703)) of the second display (720).

[0214] In one embodiment, in FIG. 11, the second audio signal being received in the opposite direction of the first audio signal may indicate a situation in which the first speaker and the second speaker are facing each other (or facing each other) with the electronic device between them. When the first speaker and the second speaker are facing each other with the first display (710) partially folded, the second speaker cannot see the first display (710), so the second speaker can be provided with a screen by activating the second display (720). The second display (720) (or area (703)) may be assigned to a second language.

[0215] Referring to (a) of FIG. 12, the electronic device can operate in a first translation mode.

[0216] While the first audio signal is being received, the electronic device may display a second language translation screen of the content indicated by the first audio signal on the first area (701) of the first display (710). While the first audio signal is being received, the electronic device may display a first language transcription screen of the content indicated by the first audio signal on the second area (702) of the first display (710).

[0217] In (b) of FIG. 12, the electronic device can detect a state in which the first display (710) is partially folded so that the angle between the first housing and the second housing corresponds to a second angle range determined in the first translation mode. For example, the second angle range may be an angle range corresponding to an acute angle. For example, the second angle range may be a range from 40 degrees to 75 degrees.

[0218] The electronic device can activate the second display based on detecting that the first display (710) is partially folded such that the angle between the first housing and the second housing corresponds to a second angle range in the first translation mode.

[0219] Referring to (b) of FIG. 12, while the first acoustic signal is received, the electronic device may display a second language translation screen for the content indicated by the first acoustic signal on the first area (701) of the first display (710). While the first acoustic signal is received, the electronic device may display a first language transcription screen for the content indicated by the first acoustic signal on the second area (702) of the first display (710). While the first acoustic signal is received, the electronic device may display a second language translation screen for the content indicated by the first acoustic signal on at least a portion (e.g., area (703)) of the second display (720).

[0220] In one embodiment, in FIG. 12, the angle between the first housing and the second housing is partially folded to correspond to a second angle range (e.g., less than 90 degrees, or in the range of 40 to 75 degrees), which may indicate a situation where the second speaker can no longer see the front of the electronic device (or the first display (710)), i.e., a situation where the first speaker and the second speaker are facing each other. Accordingly, by activating the second display (720), a screen may be provided to the second speaker. The second display (720) (or the area (703)) may be assigned to a second language.

[0221] The electronic device may dim the screen of the first region (701) based on detecting that the first display (710) is partially folded such that the angle between the first housing and the second housing corresponds to a second angle range. Partial folding of less than 90 degrees such that the angle between the first housing and the second housing corresponds to the second angle range may indicate a situation in which the first speaker cannot see or has difficulty seeing the first region (701) of the first display (710) of the electronic device. Therefore, unnecessary power consumption may be reduced by dimming the screen of the first region (701). According to one embodiment, the electronic device may dim the screen of the first region (701) and stop displaying text on a screen (e.g., a translation screen, a transcription screen) displayed on the first region (701).

[0222] Fig. 13 is a flowchart of a display method according to an embodiment. Fig. 14 is a drawing explaining a display method according to an example.

[0223] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0224] According to one embodiment, the operations 1310 to 1360 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5).

[0225] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 12. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device includes a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (430) of FIGS. 7, 9A, 9B, and 5) including a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIGS. 7, 9A, 9B, and 9C, 11, and 12) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIGS. 7, 9A, 9B, and 9C, 11, and 12). 9c, FIG. 11, and FIG. 12 may include the first display (710).

[0226] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0227] The first region may be a region corresponding to a portion of the entire region of the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing. In one embodiment, the first region may correspond to the first housing, and the second region may correspond to the second housing, based on the hinge structure. For example, the first region may correspond to a first side of the first housing, and the second region may correspond to a third side of the second housing. In one embodiment, a portion of the first region may correspond to the first housing, and another portion of the first region may correspond to the second housing, based on the hinge structure. A portion of the second region may correspond to the first housing, and another portion of the second region may correspond to the second housing, based on the hinge structure. For example, a portion of the first region may correspond to a first side of the first housing, and another portion of the first region may correspond to a third side of the second housing. A part of the second area may correspond to a first surface of the first housing, and another part of the second area may correspond to a third surface of the second housing.

[0228] At operation 1310, the electronic device can receive an acoustic signal.

[0229] At operation 1320, the electronic device can identify the language of the acoustic signal.

[0230] According to one embodiment, the electronic device may predetermine at least a portion of a translation language set. The translation language set may include a first language that is the target of bidirectional or unidirectional translation and a second language different from the first language. A description of the method for determining the translation language set, which overlaps with the description provided above with reference to FIGS. 6 and 10, will be omitted.

[0231] At operation 1330, the electronic device can display a screen on the first display in a first translation mode.

[0232] According to one embodiment, the electronic device may generate a translation text in another language included in the translation language set based on the received acoustic signal if the language identified in operation 1320 is included in a predetermined translation language set. For example, if the language of the acoustic signal in operation 1320 is identified as a first language included in the translation language set, the electronic device may generate a translation text in a second language included in the translation language set based on the acoustic signal (i.e., the first acoustic signal). For example, if the language of the acoustic signal in operation 1320 is identified as a second language included in the translation language set, the electronic device may generate a translation text in the first language included in the translation language set based on the acoustic signal (i.e., the second acoustic signal).

[0233] In the first translation mode, the electronic device may display a second language translation screen for the content indicated by the first audio signal on the first area of ​​the first display while the first audio signal is being received. The electronic device may further display a first language transcription screen for the content indicated by the first audio signal on the second area of ​​the first display while the first audio signal is being received.

[0234] In the first translation mode, the electronic device may display a first language translation screen for the content indicated by the second audio signal in the second area of ​​the first display while the second audio signal is being received. The electronic device may further display a second language transcription screen for the content indicated by the second audio signal in the first area of ​​the first display while the second audio signal is being received.

[0235] At operation 1340, the electronic device may determine whether the first display is unfolded (or fully unfolded) in the first translation mode.

[0236] The electronic device can detect that the first display is in an unfolded state.

[0237] At operation 1350, the electronic device can determine whether a second acoustic signal is received in an opposite direction to the first acoustic signal while the first display remains unfolded in the first translation mode.

[0238] An electronic device may include one or more microphones (e.g., an input module (150) of FIG. 1, a microphone (203) of FIGS. 2A and 3, or a microphone (403) of FIGS. 4A and 5). The electronic device may include one or more directional microphones. For example, a directional microphone may be disposed in a first housing and a second housing of the electronic device, respectively. The electronic device may obtain a first acoustic signal and a second acoustic signal received by the directional microphone from the directional microphone. The electronic device may determine a direction from which each acoustic signal is received based on the first acoustic signal and the second acoustic signal received through the directional microphone.

[0239] The electronic device can receive a second acoustic signal in an opposite direction to the first acoustic signal while the first display remains unfolded in the first translation mode.

[0240] In operation 1360, the electronic device may display the screen of the first area in an opposite direction to the screen of the second area in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal while the first display remains in an unfolded state in the first translation mode.

[0241] In operation 1360, the first area and the second area of ​​the first display may be screens allocated to the second language and the first language, respectively.

[0242] FIG. 14 is an example of a screen displayed through a first display (710) of an electronic device (e.g., the first display (230) of FIGS. 2A, 2B, and 3 or the first display (430) of FIGS. 4A, 4B, and 5).

[0243] Referring to (a) of FIG. 14, the electronic device may operate in a first translation mode. While the first acoustic signal is received, the electronic device may display a second language translation screen (e.g., a screen composed of the second language translation text "Thank you for your help.") of the content indicated by the first acoustic signal (e.g., "Thank you for your help.") on a first area (701) of the first display (710). While the first acoustic signal is received, the electronic device may display a first language translation screen (e.g., a screen composed of the first language translation text "You're welcome.") of the content indicated by the first acoustic signal (e.g., "You're welcome.") on a second area (702) of the first display (710).

[0244] The electronic device can determine whether a second acoustic signal is received in an opposite direction to the first acoustic signal while the first display (710) remains unfolded in the first translation mode.

[0245] The electronic device may display the screen of the first region (701) in the opposite direction to the screen of the second region (702) in response to receiving a second acoustic signal in the opposite direction to the first acoustic signal while the first display (710) remains in the unfolded state in the first translation mode.

[0246] In (b) of FIG. 14, while the second acoustic signal is being received, the electronic device may display a second language transcription screen of the content indicated by the second acoustic signal (e.g., a screen composed of the second language transcription text "You're welcome.") on the first area (701) of the first display (710). While the second acoustic signal is being received, the electronic device may display a first language translation screen of the content indicated by the second acoustic signal (e.g., a screen composed of the first language translation text "You're welcome.") on the second area (702) of the first display (710). At this time, the electronic device may display the second language transcription screen on the first area (701) in an opposite direction to the translation screen on the second area (702).

[0247] Thereafter, when the second acoustic signal is continuously received from the opposite direction of the first acoustic signal, the electronic device may display the screen of the first area (701) in the opposite direction to the screen of the second area (702). For example, while the first acoustic signal is being received, the electronic device may display a translation screen of the second language of the content indicated by the first acoustic signal on the first area (701). While the first acoustic signal is being received, the electronic device may display a transcription screen of the first language of the content indicated by the first acoustic signal on the second area (702) of the first display (710). At this time, the electronic device may display the translation screen of the second language on the first area (701) in the opposite direction to the transcription screen of the second area (702).

[0248] In one embodiment, in FIG. 14, the second audio signal is received in an opposite direction to the first audio signal while the first display (710) remains in an unfolded state, which may indicate a situation where the first speaker and the second speaker are facing each other and the second speaker can see the front of the electronic device (or the first display (710)). Accordingly, the screen of the second language (e.g., a transcription screen or a translation screen) in the first area (701) may be rotated and displayed to correspond to the direction of the second speaker, thereby providing the screen to the second speaker.

[0249] Referring to FIG. 14, the electronic device can display an operating element (1) on at least a portion of a first display (710). The operating element (1) can include a first element (11), a second element (12), and a third element (13).

[0250] According to one embodiment, the first element (11) may be an interface element related to the display direction of the screen. When the display directions of the screen of the first area (701) and the screen of the second area (702) are the same, the electronic device may display the first element (11) as in (a) of FIG. 14, and when the screen of the first area (701) is displayed in the opposite direction to the screen of the second area (702), the electronic device may display a changed first element (11) as in (b) of FIG. 14.

[0251] According to one embodiment, the second element (12) may be an interface element related to activation of the second display. The second element (12) is described with reference to FIG. 21.

[0252] In one embodiment, the third element (13) may be an interface element related to a translation history. In response to receiving an input from a user selecting the third element (13), the electronic device may provide a history of a previous translation (conversation or utterance).

[0253] FIGS. 15 and 16 are flowcharts of a display method when using an external electronic device according to one embodiment.

[0254] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0255] According to one embodiment, the operations 1510 to 1560 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1 , the electronic device (200) of FIGS. 2A, 2B, and 3 , or the electronic device (400) of FIGS. 4A, 4B, and 5 ).

[0256] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 12. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device includes a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (430) of FIGS. 7, 9A, 9B, and 5) including a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIGS. 7, 9A, 9B, and 9C, 11, and 12) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIGS. 7, 9A, 9B, and 9C, 11, and 12). 9c, FIG. 11, and FIG. 12 may include the first display (710).

[0257] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0258] The first region may be a region corresponding to a portion of the entire region of the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing. In one embodiment, the first region may correspond to the first housing, and the second region may correspond to the second housing, based on the hinge structure. For example, the first region may correspond to a first side of the first housing, and the second region may correspond to a third side of the second housing. In one embodiment, a portion of the first region may correspond to the first housing, and another portion of the first region may correspond to the second housing, based on the hinge structure. A portion of the second region may correspond to the first housing, and another portion of the second region may correspond to the second housing, based on the hinge structure. For example, a portion of the first region may correspond to a first side of the first housing, and another portion of the first region may correspond to a third side of the second housing. A part of the second area may correspond to a first surface of the first housing, and another part of the second area may correspond to a third surface of the second housing.

[0259] In operation 1510, the electronic device may establish a communication channel with an external electronic device (e.g., the electronic device (102) of FIG. 1).

[0260] The external electronic device may be an audio device (e.g., earphones, earbuds, headphones, headset) that is directly or wirelessly connected to the electronic device. The external electronic device may include an input module (or input circuit), such as a microphone, and an audio output module (or audio output circuit), such as a speaker. The user of the electronic device may wear the external electronic device.

[0261] An electronic device can transmit (or output) an acoustic signal to an external electronic device. The external electronic device can receive an acoustic signal from the electronic device. The external electronic device can output an acoustic signal to a user.

[0262] An external electronic device can receive an acoustic signal through an input module (e.g., a microphone) of the external electronic device. The external electronic device can transmit the acoustic signal to the electronic device. The electronic device can receive the acoustic signal from the external electronic device. The electronic device can display a screen (e.g., a translation screen, a transcription screen) based on the acoustic signal.

[0263] The acoustic signals described above in FIGS. 1 to 14 (e.g., the first acoustic signal, the second acoustic signal) may be direct acoustic signals or indirect acoustic signals. A direct acoustic signal may refer to an acoustic signal that an electronic device directly obtains through an input module (e.g., an input module (150) of FIG. 1) (e.g., a microphone) of the electronic device. An indirect acoustic signal may refer to an acoustic signal that an electronic device indirectly obtains through a microphone of an external electronic device.

[0264] For example, if an electronic device directly acquires the voice (or speech) of a first speaker through an input module of the electronic device, it may acquire a first direct audio signal. If the electronic device indirectly acquires the speech of the first speaker from an external electronic device, it may acquire a first indirect audio signal.

[0265] For example, if an electronic device directly acquires the voice (or speech) of a second speaker through an input module of the electronic device, it may acquire a second direct audio signal. If the electronic device indirectly acquires the speech of a second speaker from an external electronic device, it may acquire a second indirect audio signal.

[0266] In operation 1520, the electronic device may receive a second indirect audio signal of a second language from an external electronic device. The electronic device may identify the language of the received indirect audio signal, as described above with reference to FIG. 6. The electronic device may identify the language of the received indirect audio signal as the second language.

[0267] At operation 1530, the electronic device may generate translation data in a first language for the content indicated by the second indirect acoustic signal.

[0268] The translation data in the first language may represent data (e.g., text, audio) translated into the first language of the content represented by the second indirect acoustic signal (i.e., the speech content of the second speaker in the second language).

[0269] In operation 1540, the electronic device may generate a first language translation audio signal for the content represented by the second indirect audio signal based on the first language translation data.

[0270] The electronic device can generate a first language translation sound signal by converting the first language translation data into speech (text-to-speech) when the first language translation data is text data.

[0271] If the translation data of the first language is audio data, the electronic device may omit operation 1540. That is, the electronic device may generate the translation data of the first language as a translation audio signal of the first language.

[0272] At operation 1550, the electronic device can transmit a translated audio signal in the first language to an external electronic device.

[0273] The external electronic device can receive a translation audio signal in the first language from the electronic device. The external electronic device can output the translation audio signal in the first language to the user.

[0274] In operation 1560, the electronic device may display a translation screen in the first language based on translation data in the first language on at least a portion of the first area and the second area of ​​the first display. For example, the electronic device may display a translation screen in the first language on at least a portion of the first area (701) and the second area (702) of the first display (710), as illustrated in (a) of FIG. 9c.

[0275] The electronic device can display a first language translation screen composed of the first language translation data, if the first language translation data is text data.

[0276] If the translation data of the first language is audio data, the electronic device can transcribe the translation data of the first language into text and then display a translation screen of the first language composed of text of the first language.

[0277] In one embodiment, the electronic device can perform operation 1560 in a second translation mode.

[0278] According to one embodiment, FIG. 16 is a flowchart of a method for providing translation using an indirect acoustic signal or a direct acoustic signal when using an external electronic device.

[0279] In operation 1610, the electronic device may receive a second indirect audio signal of a second language from an external electronic device. The electronic device may identify the language of the received indirect audio signal, as described above with reference to FIG. 6. The electronic device may identify the language of the received indirect audio signal as the second language.

[0280] In operation 1620, the electronic device can receive a second direct acoustic signal of a second language through an input module of the electronic device. The electronic device can identify the language of the received direct acoustic signal as described above with reference to FIG. 6. The electronic device can identify the language of the received direct acoustic signal as the second language. The electronic device can receive sensing information acquired by a sensor circuit (e.g., a sensor module (176) of FIG. 1) of the electronic device (e.g., a proximity sensor, an IR sensor, an illumination sensor).

[0281] The electronic device can receive a second direct acoustic signal while simultaneously receiving a second indirect acoustic signal.

[0282] The sensing information acquired by the sensor circuit may include information about the distance between the electronic device and an external object (e.g., a first speaker, a second speaker, or other objects) or the level of brightness outside the electronic device.

[0283] In operation 1630, the electronic device can determine a target acoustic signal among the second indirect acoustic signal and the second direct acoustic signal based on at least one of the second direct acoustic signal or the sensing information.

[0284] The electronic device may determine the second indirect audio signal as the target audio signal if the sound quality of the second indirect audio signal is better than the sound quality of the second direct audio signal. For example, in a state where the electronic device's sound reception is not smooth (e.g., when the electronic device is in a bag or pocket, or when the microphone is blocked), the sound quality of the second indirect audio signal acquired by the external electronic device worn by the user may be better than the sound quality of the second direct audio signal.

[0285] The electronic device may determine the second direct audio signal as the target audio signal if the sound quality of the second direct audio signal is better than that of the second indirect audio signal. For example, when the electronic device's sound reception is smooth, the sound quality of the second direct audio signal may be better than that of the second indirect audio signal acquired by the external electronic device.

[0286] The electronic device can determine the second indirect acoustic signal or the second direct acoustic signal as the target acoustic signal based on the state of the electronic device determined based on the sensing information.

[0287] For example, if the distance between the electronic device and an external object is closer than a specified degree, or if the brightness outside the electronic device is darker than a specified degree (e.g., if the electronic device is in a bag or pocket), the electronic device may not be able to pick up sound smoothly. When the electronic device is not able to pick up sound smoothly, the electronic device may determine the second indirect acoustic signal as the target acoustic signal.

[0288] The electronic device can comprehensively consider the second direct acoustic signal, the second indirect acoustic signal, and the sensing information to determine a signal with better sound quality and / or a signal received by the device with smooth sound reception among the second indirect acoustic signal and the second direct acoustic signal as the target acoustic signal.

[0289] In operation 1640, if the electronic device determines the second indirect acoustic signal as the target acoustic signal, the electronic device may generate translation data in the first language for the content indicated by the second indirect acoustic signal.

[0290] In operation 1650, if the electronic device determines the second direct acoustic signal as the target acoustic signal, it can generate translation data in the first language for the content indicated by the second direct acoustic signal.

[0291] In operation 1660, the electronic device may display a translation screen of the first language based on the translation data of the first language generated in operation 1640 or operation 1650 on at least a portion of the first area and the second area of ​​the first display.

[0292] In one embodiment, the electronic device can perform operation 1660 in a second translation mode.

[0293] In operation 1670, if the electronic device determines the second indirect audio signal as the target audio signal, the electronic device can generate a first language translation audio signal for the content indicated by the second indirect audio signal based on the first language translation data.

[0294] In operation 1680, if the electronic device determines the second direct audio signal as the target audio signal, the electronic device can generate a first language translation audio signal for the content indicated by the second direct audio signal based on the first language translation data.

[0295] At operation 1690, the electronic device can transmit the first language translation sound signal generated at operation 1670 or operation 1680 to an external electronic device.

[0296] FIG. 17 is a flowchart of a method for transmitting a translation sound signal when using an external electronic device, according to one embodiment.

[0297] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0298] According to one embodiment, the operations 1710 to 1740 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1 , the electronic device (200) of FIGS. 2A, 2B, and 3 , or the electronic device (400) of FIGS. 4A, 4B, and 5 ).

[0299] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 16. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device includes a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (430) of FIGS. 7, 9A, 9B, and 5) including a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIGS. 7, 9A, 9B, and 9C, 11, and 12) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIGS. 7, 9A, 9B, and 9C, 11, and 12). 9c, FIG. 11, and FIG. 12 may include the first display (710).

[0300] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0301] The first region may be a region corresponding to a portion of the entire area of ​​the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing.

[0302] At operation 1710, the electronic device can generate translation data in a first language for content represented by a second acoustic signal in a second language.

[0303] As described with reference to FIG. 16, the electronic device can generate translation data in a first language for content represented by a target audio signal among the second direct audio signal and the second indirect audio signal. The second audio signal in the second language can be the second direct audio signal or the second indirect audio signal.

[0304] At operation 1720, the electronic device can determine an utterance characteristic corresponding to the second acoustic signal based on the second acoustic signal.

[0305] Speech characteristics may include at least one of the speaker's gender, age, speech rate, timbre, tone, or accent.

[0306] The electronic device can determine at least one of the gender, age, speech rate, timbre, tone, or accent of the second speaker corresponding to the second acoustic signal based on the second acoustic signal of the second speaker.

[0307] At operation 1730, the electronic device can generate a first language translation audio signal for the content represented by the second audio signal based on the translation data and speech characteristics of the first language.

[0308] For example, if the second speaker is male, the electronic device may generate a translation audio signal of the first language in a male voice. The electronic device may generate a translation audio signal of the first language with a rate adjusted based on the second speaker's speaking rate. The electronic device may generate a translation audio signal of the first language that reflects the second speaker's timbre, tone, or accent.

[0309] At operation 1740, the electronic device can transmit a translated audio signal in the first language to an external electronic device that has established a communication channel with the electronic device.

[0310] The external electronic device can receive a translation audio signal in the first language from the electronic device. The external electronic device can output the translation audio signal in the first language to the user.

[0311] Fig. 18 is a drawing explaining a display method using a sub-display according to an example.

[0312] FIG. 18 is an example of a screen displayed through a second display (720) (e.g., the second display (231) of FIGS. 2A, 2B, and 3, or the second display (431) of FIGS. 4A, 4B, and 5) of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5). The electronic device may display a screen in a second language (e.g., a transcription screen or a translation screen) on at least a portion (e.g., an area (703)) of the second display (720).

[0313] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 17. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device includes a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (430) of FIGS. 7, 9A, 9B, and 5) including a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIGS. 7, 9A, 9B, and 9C, 11, and 12) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIGS. 7, 9A, 9B, and 9C, 11, and 12). 9c, FIG. 11, and FIG. 12 may include the first display (710).

[0314] The electronic device may include a second display (720). The second display (720) may be referred to as a sub-display.

[0315] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0316] The first region may be a region corresponding to a portion of the entire area of ​​the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing.

[0317] The second display (720) (or second display area) may be included (or arranged) on a surface of the first housing or the second housing that faces the first display. For example, the second display (720) may be included (or arranged) on a surface (e.g., the second surface) of the first housing that faces a surface (e.g., the first surface) of the first housing that includes at least a portion of the first area. For example, the second display (720) may be included (or arranged) on a surface (e.g., the fourth surface) of the second housing that faces a surface (e.g., the third surface) of the second housing that includes at least a portion of the second area.

[0318] FIG. 18 illustrates, for example, displaying a screen in a second language for content indicated by a first acoustic signal on a second display (720), as in FIG. 11 or FIG. 12. A first speaker (e.g., a user of an electronic device) and a second speaker can converse while facing each other with the electronic device between them. For example, while the first acoustic signal is being received, the electronic device can display a screen in a second language for the content indicated by the first acoustic signal on at least a portion of the second display (720). While the second acoustic signal is being received, the electronic device can display a screen in a second language for the content indicated by the second acoustic signal on at least a portion of the second display (720).

[0319] The electronic device can receive sensing information acquired by a sensor circuit (e.g., a proximity sensor, an IR sensor, a light sensor) of the electronic device from a sensor circuit (e.g., a sensor module (176) of FIG. 1).

[0320] The sensing information acquired by the sensor circuit may include information about the distance between the electronic device and an external object (e.g., a first speaker, a second speaker, or other objects) or the level of brightness outside the electronic device.

[0321] The electronic device can display a screen on the second display (720) by adjusting the properties of text in a second language (e.g., transcription text, translation text) based on sensing information. The properties of the text may include various elements such as the size, boldness, color, or layout of the translation text.

[0322] In one embodiment, the electronic device can adjust the size of the text in the second language based on a distance between the electronic device and the second speaker indicated by the sensing information.

[0323] Referring to (a) and (b) of FIG. 18, the electronic device may display the text of the second language relatively small on the second display (720) when the distance between the electronic device and the second speaker indicated by the sensing information is short. The electronic device may display the text of the second language larger on the second display (720) as the distance between the electronic device and the second speaker indicated by the sensing information increases.

[0324] In one embodiment, the electronic device may adjust the boldness of text in the second language based on the distance between the electronic device and the second speaker indicated by the sensing information. For example, the electronic device may display text in the second language on the second display (720) in bold as the distance between the electronic device and the second speaker indicated by the sensing information increases.

[0325] As described with reference to FIG. 17, the electronic device may determine speech characteristics corresponding to the second acoustic signal based on the second acoustic signal. The speech characteristics may include at least one of the speaker's gender, age, speech rate, timbre, tone, or accent.

[0326] The electronic device can determine at least one of the gender, age, speech rate, timbre, tone, or accent of the second speaker corresponding to the second acoustic signal based on the second acoustic signal of the second speaker.

[0327] According to one embodiment, the electronic device may display a screen on the second display (720) by adjusting properties of text in a second language based on speech characteristics corresponding to a second acoustic signal.

[0328] For example, an electronic device may display text in a second language by making it larger and / or bolder if the second speaker is an elderly person.

[0329] In one embodiment, the electronic device may display the text on the screen by adjusting the size of the text so that the text in the second language can be fully included on the second display (720). For example, if the length of the text in the second language satisfies a specified condition (e.g., 40 characters or more), the electronic device may display the text so that the text is fully included on the second display (720) by adjusting the size of the text.

[0330] Figure 19 is a drawing explaining a display method according to an example.

[0331] FIG. 19 is an example of a screen displayed through a first display (710) (e.g., the first display (230) of FIGS. 2A, 2B, and 3 or the first display (430) of FIGS. 4A, 4B, and 5) of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5).

[0332] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 18. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device may include a first display (710) (e.g., the first display (230) of FIGS. 2A, 2B, and 3, or the first display (430) of FIGS. 4A, 4B, and 5) including a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIGS. 7, 9A, 9B, 9C, 11, and 12) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIGS. 7, 9A, 9B, 9C, 11, and 12).

[0333] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0334] The first region (701) may be a region corresponding to a portion of the entire region of the first display (710), and the second region (702) may be a region corresponding to a portion of the first display (710) that is different from the first region (702). At least a portion of the first region (701) may correspond to the first housing, and at least a portion of the second region (702) may correspond to the second housing. According to one embodiment, based on the hinge structure, the first region (701) may correspond to the first housing, and the second region (702) may correspond to the second housing.

[0335] The electronic device may include a second display (e.g., the second display (231) of FIGS. 2A, 2B, and 3 or the second display (431) of FIGS. 4A, 4B, and 5). The second display may be referred to as a sub-display.

[0336] The second display (or second display area) may be included (or arranged) on a surface of the first housing or the second housing opposite the first display. For example, the second display may be included (or arranged) on a surface of the first housing (e.g., the second surface) opposite a surface of the first housing (e.g., the first surface) that includes at least a portion of the first area. For example, the second display may be included (or arranged) on a surface of the second housing (e.g., the fourth surface) opposite a surface of the second housing (e.g., the third surface) that includes at least a portion of the second area.

[0337] The electronic device can receive a first acoustic signal in a first language and a second acoustic signal in a second language. The electronic device can receive a first acoustic signal for speech (or utterance) of a first speaker in a first language and a second acoustic signal for speech of a second speaker in a second language.

[0338] Referring to (a) of FIG. 19, the electronic device may display a screen in a second language (e.g., a screen composed of translated text in the second language or a screen composed of transcription text in the second language) on a first area (701) of the first display (710). The electronic device may display a screen in a first language (e.g., a screen composed of translated text in the first language or a screen composed of transcription text in the first language) on a second area (702) of the first display (710). According to one embodiment, the electronic device may operate in a first translation mode.

[0339] The electronic device can identify the language of the received audio signal while displaying a screen of a second language in the first area (701) and a screen of a first language in the second area (702). The electronic device can identify the language of the received audio signal as a third language other than the first or second language. For example, the electronic device can receive a third audio signal for speech in a third language from a third speaker.

[0340] The electronic device may display a screen of a second language in a first area (701) and a screen of a first language in a second area (702), and in response to receiving a third acoustic signal of a third language, display a screen of the second language in at least a portion of the first area (701), display a screen of the third language in another portion of the first area (702), and display a screen of the first language in at least a portion of the second area (702).

[0341] For example, referring to (b) of FIG. 19, the electronic device may display a screen in a second language on one side of the first area (701). The electronic device may display a screen in a second language on the other side of the first area (701). The electronic device may display a screen in a first language on at least a portion of the second area (702).

[0342] While the first audio signal is being received, the electronic device can display a second language translation screen for the content indicated by the first audio signal on one side of the first area (701), display a third language translation screen for the content indicated by the first audio signal on the other side of the first area (701), and display a first language transcription screen for the content indicated by the first audio signal on the second area (702).

[0343] While the second acoustic signal is being received, the electronic device can display a second language transcription screen for the content indicated by the second acoustic signal on one side of the first area (701), display a third language translation screen for the content indicated by the second acoustic signal on the other side of the first area (701), and display a first language translation screen for the content indicated by the second acoustic signal on the second area (702).

[0344] While the third acoustic signal is being received, the electronic device can display a second language translation screen for the content indicated by the third acoustic signal on one side of the first area (701), display a third language transcription screen for the content indicated by the third acoustic signal on the other side of the first area (701), and display a first language translation screen for the content indicated by the third acoustic signal on the second area (702).

[0345] In (b) of FIG. 19, one side of the first area (701) may be allocated to a second language, the other side of the first area (701) may be allocated to a third language, and the second area (702) may be a screen allocated to the first language.

[0346] The embodiments of displaying a screen of a first language, a second language, or a third language are not limited to the examples shown.

[0347] According to one embodiment, the electronic device can arrange the screen according to the direction in which each acoustic signal is received. The electronic device can determine the direction in which each acoustic signal is received based on the first acoustic signal, the second acoustic signal, and the third acoustic signal received through the directional microphone of the electronic device. The electronic device can display a screen of a second language on one side of the first region (701) corresponding to the direction in which the second acoustic signal is received, and display a screen of a third language on the other side of the first region (701) corresponding to the direction in which the third acoustic signal is received.

[0348] The electronic device may display a screen of a second language in a first area (701) and display a screen of a first language in a second area (702), and in response to receiving a third audio signal of a third language in an opposite direction to the first audio signal (or the second audio signal), activate the second display and display a screen of the third language on at least a portion of the second display.

[0349] According to one embodiment, the electronic device may place translation screens in different languages ​​for the content indicated by the audio signal of the currently speaking speaker in the first area (701) and the second area (702), respectively.

[0350] For example, the electronic device may display a screen in a second language in a first area (701) and a screen in a first language in a second area (702), and in response to receiving a third audio signal in a third language, display a translation screen in the second language for the content indicated by the third audio signal in at least a portion of the first area (701) and display a translation screen in the first language for the content indicated by the third audio signal in at least a portion of the second area (702). That is, the first area (701) and the second area (702) may be assigned to the second language and the first language, respectively, while the third speaker is speaking.

[0351] When a second speaker speaks after a third speaker speaks, the electronic device may, in response to receiving a second acoustic signal in the second language, display a third language translation screen for the content indicated by the second acoustic signal in at least a portion of the first area (701) and display a first language translation screen for the content indicated by the second acoustic signal in at least a portion of the second area (702). That is, the first area (701) and the second area (702) may be assigned to the third language and the first language, respectively, while the second speaker speaks.

[0352] FIG. 20 is a flowchart illustrating a method for activating a sub-display according to an example. FIG. 21 is a diagram illustrating a method for activating a sub-display according to an example.

[0353] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0354] According to one embodiment, the operations 2010 to 2060 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5).

[0355] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 19. For example, the electronic device may include at least one processor including a processing circuit (e.g., processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., memory (130) of FIG. 1), and a communication unit (e.g., communication module (190) of FIG. 1). The electronic device may include a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (710) of FIGS. 7, 9A, 9B, and 9C) that includes a first region (e.g., the first region (230a) of FIGS. 2A and 2B, the first region (430a) of FIGS. 4A and 4B, or the first region (701) of FIGS. 7, 9A, 9B, and 9C) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B, the second region (430b) of FIGS. 4A and 4B, or the second region (702) of FIGS. 7, 9A, 9B, and 9C).

[0356] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5).

[0357] The electronic device may include a second display (e.g., the second display (231) of FIGS. 2A, 2B, and 3 or the second display (431) of FIGS. 4A, 4B, and 5). The second display may be referred to as a sub-display.

[0358] The second display (or second display area) may be included (or arranged) on a surface of the first housing or the second housing opposite the first display. For example, the second display may be included (or arranged) on a surface of the first housing (e.g., the first surface) that corresponds to at least a portion of the first area and the opposite surface (e.g., the second surface) of the first housing. For example, the second display may be included (or arranged) on a surface of the second housing (e.g., the third surface) that corresponds to at least a portion of the second area and the opposite surface (e.g., the fourth surface) of the second housing.

[0359] In operation 2010, the electronic device can receive an acoustic signal.

[0360] In Action 2020, an electronic device can identify the language of an acoustic signal.

[0361] According to one embodiment, the electronic device may predetermine at least a portion of a translation language set. The translation language set may include a first language that is the target of bidirectional or unidirectional translation and a second language different from the first language. A description of the method for determining the translation language set, which overlaps with the description provided above with reference to FIGS. 6 and 10, will be omitted.

[0362] In operation 2030, the electronic device can display a screen on the first display in a first translation mode.

[0363] According to one embodiment, the electronic device may generate a translation text in another language included in the translation language set based on the received acoustic signal if the language identified in operation 2020 is included in a predetermined translation language set. For example, if the language of the acoustic signal in operation 2020 is identified as a first language included in the translation language set, the electronic device may generate a translation text in a second language included in the translation language set based on the acoustic signal (i.e., the first acoustic signal). For example, if the language of the acoustic signal in operation 2020 is identified as a second language included in the translation language set, the electronic device may generate a translation text in the first language included in the translation language set based on the acoustic signal (i.e., the second acoustic signal).

[0364] In the first translation mode, the electronic device may display a second language translation screen for the content indicated by the first audio signal on the first area of ​​the first display while the first audio signal is being received. The electronic device may further display a first language transcription screen for the content indicated by the first audio signal on the second area of ​​the first display while the first audio signal is being received.

[0365] In the first translation mode, the electronic device may display a first language translation screen for the content indicated by the second audio signal in the second area of ​​the first display while the second audio signal is being received. The electronic device may further display a second language transcription screen for the content indicated by the second audio signal in the first area of ​​the first display while the second audio signal is being received.

[0366] In operation 2040, the electronic device may determine whether a first user input has been received. The first user input may be a predetermined input that activates the second display. For example, the first user input may be an input (e.g., a selection, touch, or tap) to an operating element (e.g., the second element (12) of FIG. 21).

[0367] The electronic device can receive a first user input in a first translation mode.

[0368] At operation 2050, the electronic device may activate the second display in response to receiving the first user input.

[0369] The electronic device may further display a second language translation screen for the content indicated by the first audio signal on the second display while the first audio signal is being received. That is, the electronic device may display a second language translation screen for the content indicated by the first audio signal on the first area of ​​the first display while the first audio signal is being received, display a first language transcription screen for the content indicated by the first audio signal on the second area, and display an identical screen to the first area on the second display.

[0370] In operation 2060, the electronic device may further display a second language transcription screen for the content indicated by the second acoustic signal on the second display while the second acoustic signal is being received. That is, the electronic device may display a second language transcription screen for the content indicated by the second acoustic signal on the first area of ​​the first display while the second acoustic signal is being received, display a first language translation screen for the content indicated by the second acoustic signal on the second area, and display an identical screen to the first area on the second display.

[0371] FIG. 21 is an example of a screen displayed through a first display (710) of an electronic device (e.g., the first display (230) of FIGS. 2A, 2B, and 3 or the first display (430) of FIGS. 4A, 4B, and 5) and a second display (720) (e.g., the second display (231) of FIGS. 2A, 2B, and 3 or the second display (431) of FIGS. 4A, 4B, and 5).

[0372] Referring to (a) of FIG. 21, the electronic device can display an operation element (1) on at least a portion of the first display (710). The operation element (1) can include a first element (11), a second element (12), and a third element (13). With reference to FIG. 14, descriptions of the first element (11) and the third element (13) that overlap with the above description are omitted.

[0373] According to one embodiment, the second element (12) may be an interface element related to the activation of the second display (720). When the electronic device receives a user input for the second element (12) while the second display (720) is inactive, the electronic device may activate the second display (720). When the electronic device receives a user input for the second element (12) while the second display (720) is active, the electronic device may deactivate the second display (720).

[0374] In (a) of FIG. 21, the electronic device can receive a user input for the second element (12). In response to receiving the user input for the second element (12), the electronic device can activate the second display (720) in (b) of FIG. 21.

[0375] According to one embodiment, in (b) of FIG. 21, the electronic device may deactivate the second display (720) in response to receiving user input again for the second element (12).

[0376] In response to receiving a user input for the second element (12), the electronic device may display an interface element, such as text, a notification, or a pop-up, on at least a portion of the first display (710) and the second display (720) in FIG. 21 (b). For example, the electronic device may display text such as “What the other person said appears here” in the first area (701). The electronic device may display a pop-up such as “A translation of what I said will appear on the cover screen (or the second display (720) or the sub-display)” in the second area (702). The electronic device may display text such as “Translation of what you will say will show on the other person’s screen” in the second display (720). That is, the electronic device may display instructions regarding what content is displayed on each display and area.

[0377] Fig. 22 is a flowchart of a method for switching between translation modes according to an example. Fig. 23 is a diagram illustrating switching between translation modes according to an example.

[0378] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0379] According to one embodiment, the operations 2210 to 2230 below may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A, 2B, and 3, or the electronic device (400) of FIGS. 4A, 4B, and 5).

[0380] An electronic device may include at least some of the components of the electronic device described in FIGS. 1 to 21. For example, the electronic device may include at least one processor including a processing circuit (e.g., the processor (120) of FIG. 1), a memory including one or more storage media for storing instructions (e.g., the memory (130) of FIG. 1), and a communication unit (e.g., the communication module (190) of FIG. 1). The electronic device may include a first display (e.g., the first display (230) of FIGS. 2A, 2B, and 3, the first display (430) of FIGS. 4A, 4B, and 5, or the first display (710) of FIGS. 7, 9A, 9B, and 9C).

[0381] The first display may include a first region (e.g., the first region (230a) of FIGS. 2A and 2B , the first region (430a) of FIGS. 4A and 4B , or the first region (701) of FIGS. 7 , 9A, 9B , and 9C ) and a second region (e.g., the second region (230b) of FIGS. 2A and 2B , the second region (430b) of FIGS. 4A and 4B , or the second region (702) of FIGS. 7 , 9A, 9B , and 9C ).

[0382] The electronic device may include a housing (e.g., a foldable housing) including a first housing (e.g., a first housing (210) of FIGS. 2A, 2B, and 3 or a first housing (410) of FIGS. 4A, 4B, and 5), a second housing (e.g., a second housing (220) of FIGS. 2A, 2B, and 3 or a second housing (420) of FIGS. 4A, 4B, and 5), and a hinge structure rotatably connected between the first housing and the second housing (e.g., at least one hinge device (240, 240-1) of FIGS. 2A and 3 or at least one hinge device (440, 440-1) of FIGS. 4A and 5). For example, the first housing may include a first surface and a second surface opposite the first surface. The second housing may include a third side and a fourth side opposite the third side. When the electronic device is in a fully unfolded state (e.g., an unfolded state or an unfolded state), the first side and the third side may be operated so that they face substantially the same direction. When the electronic device is in a fully folded state (e.g., a folded state or a collapsed state), the first side and the third side may be operated so that they face each other or face opposite directions.

[0383] The first region may be a region corresponding to a portion of the entire region of the first display, and the second region may be a region corresponding to a portion of the first display that is different from the first region. At least a portion of the first region may correspond to the first housing, and at least a portion of the second region may correspond to the second housing. In one embodiment, the first region may correspond to the first housing, and the second region may correspond to the second housing, based on the hinge structure. For example, the first region may correspond to a first side of the first housing, and the second region may correspond to a third side of the second housing. In one embodiment, a portion of the first region may correspond to the first housing, and another portion of the first region may correspond to the second housing, based on the hinge structure. A portion of the second region may correspond to the first housing, and another portion of the second region may correspond to the second housing, based on the hinge structure. For example, a portion of the first region may correspond to a first side of the first housing, and another portion of the first region may correspond to a third side of the second housing. A part of the second area may correspond to a first surface of the first housing, and another part of the second area may correspond to a third surface of the second housing.

[0384] The electronic device may include a second display (e.g., the second display (231) of FIGS. 2A, 2B, and 3, the second display (431) of FIGS. 4A, 4B, and 5, or the second display (720) of FIGS. 11, 12, 18, and 21). The second display may be referred to as a sub-display.

[0385] The second display (or second display area) may be included (or arranged) on a surface of the first housing or the second housing opposite the first display. For example, the second display may be included (or arranged) on a surface of the first housing (e.g., the second surface) opposite a surface of the first housing (e.g., the first surface) that includes at least a portion of the first area. For example, the second display may be included (or arranged) on a surface of the second housing (e.g., the fourth surface) opposite a surface of the second housing (e.g., the third surface) that includes at least a portion of the second area.

[0386] In operation 2210, the electronic device may operate in a first translation mode. The first translation mode may indicate a state in which a screen in a first language is displayed on a portion of the first display and a screen in a second language is displayed on another portion of the first display. In the first translation mode, when a first speaker and a second speaker are conversing, a portion of the first display may be assigned to the first language, and another portion of the first display may be assigned to the second language.

[0387] In operation 2220, the electronic device may determine whether a second user input has been received. The second user input may be a predetermined input that switches from the first translation mode to the second translation mode. For example, the second user input may be an input (e.g., a selection, touch, or tap) to an interface element (e.g., see FIG. 23).

[0388] The electronic device can receive a second user input in the first translation mode. In response to receiving the second user input in the first translation mode, the electronic device can switch to the second translation mode.

[0389] In operation 2230, the electronic device may operate in a second translation mode. The second translation mode may indicate a state in which, when one speaker speaks, a translation screen in the language of another speaker listening to the speech is displayed on the first display. For example, the second translation mode may indicate a state in which, when the second speaker speaks, a translation screen in the first language of the first speaker is displayed on the first display. In the second translation mode, the first display (or substantially the entire area of ​​the first display) may be provided to the speaker listening to the speech.

[0390] According to one embodiment, the first translation mode is a bidirectional translation mode, which may be named 'conversational mode'.

[0391] According to one embodiment, the second translation mode is a one-way translation mode and may be named 'listening mode'.

[0392] FIG. 23 is an example of a screen displayed through a first display (710) of an electronic device (e.g., the first display (230) of FIGS. 2A, 2B, and 3 or the first display (430) of FIGS. 4A, 4B, and 5).

[0393] Referring to (a) of FIG. 23, the electronic device can display an operation element (1) on at least a portion of the first display (710). The operation element (1) can include a first element (11), a second element (12), and a third element (13). With reference to FIG. 14 and FIG. 21, descriptions of the first element (11), the second element (12), and the third element (13) that overlap with the above descriptions are omitted.

[0394] In (a) of FIG. 23, the electronic device can display a menu button (or icon) on the first display (710). The electronic device can receive user input for the menu button.

[0395] In (b) of FIG. 23, in response to receiving a user input for a menu button, the electronic device may display a list containing options for translation modes. For example, the electronic device may display a list containing a first translation mode (or conversation mode) and a second translation mode (or listening mode). The electronic device may receive a user input selecting the second translation mode.

[0396] The electronic device may display a screen corresponding to the second translation mode on the first display (710) in (c) of FIG. 23 based on receiving a user input for selecting the second translation mode. In the second translation mode, the electronic device may display one operating element (e.g., operating element (93) of FIG. 7) associated with receiving a second acoustic signal from a second speaker. In the second translation mode, the electronic device may display an operating element (e.g., operating element (94) of FIG. 9c) that provides options for the language of the acoustic signal and the language into which the acoustic signal is to be translated.

[0397] FIG. 24 and FIG. 25 are drawings each illustrating a display method using a sub-display according to an example.

[0398] FIGS. 24 and 25 are examples of screens displayed through a first display (2410) (e.g., a flexible display, a foldable display, or a main display) and a second display (2420) (e.g., a sub-display) of an electronic device (e.g., the electronic device (101) of FIG. 1) that may be provided as a foldable type that can be folded or unfolded depending on the usage state. The electronic device may include a first housing, a second housing, a third housing, a first hinge, and a second hinge. The first housing and the second housing may be foldably connected by the first hinge. The second housing and the third housing may be foldably connected by the second hinge.

[0399] Although not shown, when the electronic device is fully unfolded, the side where the first display (2410) is visually exposed to the outside may be referred to as the front side of the electronic device. The side opposite the front side may be referred to as the back side of the electronic device. In this case, the second display (2420) may be visually exposed to the outside on the back side of the electronic device.

[0400] In one embodiment, the first display (2410) may include a first portion (2401) supported by a first housing, a second portion (2402) supported by a second housing, and a third portion (2403) supported by a third housing. In one embodiment, the second display (2420) may include a fourth portion (2404) supported by the second housing. According to one embodiment, the electronic device may display a screen on the first display (2410) in a first translation mode. The first translation mode may indicate a state in which a screen in a first language is displayed on a portion of the first display (2410) and a screen in a second language is displayed on another portion of the first display (2410). In the first translation mode, when a first speaker and a second speaker are conversing, a portion of the first display (2410) may be assigned to the first language, and another portion of the first display (2410) may be assigned to the second language.

[0401] According to one embodiment, the second area (2402) of the first display (2410) may be assigned to a second language, and the third area (2403) may be assigned to a first language. The electronic device may display a screen in the second language for a second speaker through the second area (2402), and display a screen in the first language for a first speaker through the third area (2403).

[0402] In the first translation mode, while the first audio signal is being received, the electronic device can display a second language translation screen for the content indicated by the first audio signal in the second area (2402) of the first display (2410), and display a first language transcription screen for the content indicated by the first audio signal in the third area (2403).

[0403] In the first translation mode, while the second acoustic signal is being received, the electronic device can display a second language transcription screen for the content indicated by the second acoustic signal in the second area (2402) of the first display (2410), and display a first language translation screen for the content indicated by the second acoustic signal in the third area (2403).

[0404] The electronic device can activate the second display (2420) when a specified condition is satisfied.

[0405] For example, in a first translation mode, the electronic device may activate the second display (2420) in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal while the first display (2410) remains in a partially folded state. For example, the electronic device may activate the second display (2420) based on detecting that the first display is at least partially folded such that an angle between the housings (e.g., the first housing and the second housing, or the second housing and the third housing) corresponds to a predetermined angular range. For example, the electronic device may activate the second display (2420) in response to receiving a predetermined input to activate the second display (2420), such as an input to an operating element (e.g., the second element (12) of FIG. 21 ).

[0406] The electronic device may further display a second language translation screen for the content indicated by the first acoustic signal on at least a portion of the second display (2420) (e.g., the fourth area (2404)) while the first acoustic signal is being received. That is, the electronic device may display a second language translation screen for the content indicated by the first acoustic signal on the second area (2402) of the first display (2410), display a first language transcription screen for the content indicated by the first acoustic signal on the third area (2403), and display the same screen as the second area (2402) on the second display (2420) while the first acoustic signal is being received.

[0407] While the second acoustic signal is being received, the electronic device may further display a second language transcription screen for the content indicated by the second acoustic signal on at least a portion of the second display (2420). That is, while the second acoustic signal is being received, the electronic device may display a second language transcription screen for the content indicated by the second acoustic signal on the second area (2402) of the first display (2410), display a first language translation screen for the content indicated by the second acoustic signal on the third area (2403), and display the same screen as the second area (2402) on the second display (2420).

[0408] Referring to FIG. 25, according to one embodiment, the electronic device can display a screen on a first area (2401) of a first display (2410) and a fourth area (2404) of a second display (2420) when the second housing and the third housing are completely folded.

[0409] While the first audio signal is being received, the electronic device may display a first language transcription screen for the content indicated by the first audio signal on the first area (2401) of the first display (2410). While the first audio signal is being received, the electronic device may display a second language translation screen for the content indicated by the first audio signal on the second display (2420).

[0410] While the second acoustic signal is being received, the electronic device may display a first language translation screen for the content indicated by the second acoustic signal on the first area (2401) of the first display (2410). While the second acoustic signal is being received, the electronic device may display a second language transcription screen for the content indicated by the second acoustic signal on the second display (2420).

[0411] According to one embodiment, an electronic device (101, 200, 400) comprises: a housing including a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing; a first display (230, 430, 710) including a first region (230a, 430a, 701) and a second region (230b, 430b, 702), wherein at least a portion of the first region (230a, 430a, 701) corresponds to the first housing and at least a portion of the second region (230b, 430b, 702) corresponds to the second housing; a second display (231, 431, 720) included in a surface of the first housing or the second housing opposite the first display (230, 430, 710); At least one processor (120) comprising processing circuitry;and a memory (130) including one or more storage media storing instructions, wherein when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) causes: to receive an acoustic signal, identify a language of the acoustic signal, and, in a first translation mode, while a first acoustic signal of a first language is received, display a translation screen in a second language different from the first language for the content indicated by the first acoustic signal in a first area (230a, 430a, 701), while a second acoustic signal of the second language is received, display a translation screen in the first language for the content indicated by the second acoustic signal in a second area (230b, 430b, 702), and, while in the first translation mode, switch to a second translation mode based on a defined criterion being satisfied by a duration during which the second acoustic signal is received, and, in the second translation mode, switch to a second translation mode based on a defined criterion being satisfied by the second acoustic signal. While being received, a first language translation screen for the content indicated by the second acoustic signal may be displayed in at least a portion of the first region (230a, 430a, 701) and the second region (230b, 430b, 702), and while in the second translation mode, in response to receiving the first acoustic signal, the first translation mode may be switched.;

[0412] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may be caused to: in a first translation mode, while a first acoustic signal in a first language is received, further display a first language transcription screen for the content indicated by the first acoustic signal in the second area (230b, 430b, 702), and while a second acoustic signal in a second language is received, further display a second language transcription screen for the content indicated by the second acoustic signal in the first area (230a, 430a, 701).

[0413] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) is configured to: detect, in a first translation mode, a partially folded state of the first display (230, 430, 710) such that an angle between the first housing and the second housing corresponds to a first angle range, and, in the first translation mode, while the first display (230, 430, 710) remains in the partially folded state, in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal, activate the second display (231, 431, 720), and, while the first acoustic signal is being received, further display a second language translation screen for the content indicated by the first acoustic signal on the second display (231, 431, 720), and, while the second acoustic signal is being received, display a second language translation screen on the second display (231, 431, 720). It is possible to further display a second language transcription screen for the content represented by the audio signal.

[0414] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may: activate the second display (231, 431, 720) based on detecting that the first display (230, 430, 710) is in a partially folded state such that an angle between the first housing and the second housing corresponds to a defined second angle range in a first translation mode, and further display a second language translation screen for the content indicated by the first acoustic signal on the second display (231, 431, 720) while the first acoustic signal is received, and further display a second language transcription screen for the content indicated by the second acoustic signal on the second display (231, 431, 720) while the second acoustic signal is received.

[0415] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may: detect that the first display (230, 430, 710) is in an open state in a first translation mode, and, while the first display (230, 430, 710) remains in an open state in the first translation mode, in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal, cause the screen of the first region (230a, 430a, 701) to be displayed in an opposite direction to the screen of the second region (230b, 430b, 702).

[0416] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may be caused to: display a control element in at least a portion of a first region (230a, 430a, 701) and at least a portion of a second region (230b, 430b, 702), and rearrange and display the control element in the second region (230b, 430b, 702) based on detecting that the first display (230, 430, 710) is in a partially folded state such that an angle between the first housing and the second housing corresponds to a first angle range or a second angle range.

[0417] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may: establish a communication channel with an external electronic device (102), receive a second indirect audio signal in a second language from the external electronic device (102), generate translation data in a first language for content represented by the second indirect audio signal, generate a translation audio signal in the first language for content represented by the second indirect audio signal based on the translation data in the first language, and transmit the translation audio signal in the first language to the external electronic device (102).

[0418] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) is configured to: receive a second direct acoustic signal of a second language through an input module (150) of the electronic device (101, 200, 400); receive sensing information acquired by a sensor circuit from a sensor circuit of the electronic device (101, 200, 400); determine a target acoustic signal among a second indirect acoustic signal of a second language received from an external electronic device (102) and a second direct acoustic signal based on at least one of the second direct acoustic signal or the sensing information; and, when the second direct acoustic signal is determined as the target acoustic signal, generate translation data in a first language for content indicated by the second direct acoustic signal; generate a translation acoustic signal in the first language for content indicated by the second direct acoustic signal based on the translation data of the first language; and transmit the translation acoustic signal in the first language to the external electronic device (102). You can have it transmitted.

[0419] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may: generate translation data in a first language for content represented by a second acoustic signal in a second language; determine an utterance characteristic corresponding to the second acoustic signal based on the second acoustic signal; generate a translation acoustic signal in the first language for content represented by the second acoustic signal based on the translation data and the utterance characteristic in the first language; and transmit the translation acoustic signal in the first language to an external electronic device (102) that has established a communication channel with the electronic device (101, 200, 400).

[0420] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may: receive sensing information acquired by the sensor circuit from the sensor circuit of the electronic device (101, 200, 400), and display a screen on a second display (231, 431, 720) by adjusting properties of text in a second language based on the sensing information, the screen being a translation screen or a transcription screen.

[0421] According to one embodiment, the instructions, when individually or collectively executed by at least one processor (120), may cause the electronic device (101, 200, 400) to: in a first translation mode, in response to receiving a third acoustic signal in a third language, display a screen in a second language in at least a portion of a first region (230a, 430a, 701), display a screen in a third language in another portion of the first region (230a, 430a, 701), and display a screen in a first language in a second region (230b, 430b, 702).

[0422] In one embodiment, an electronic device (101, 200, 400) comprises: a housing including a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing; a first display (230, 430, 710) including a first region (230a, 430a, 701) and a second region (230b, 430b, 702), wherein at least a portion of the first region (230a, 430a, 701) corresponds to the first housing, and at least a portion of the second region (230b, 430b, 702) corresponds to the second housing; a second display (231, 431, 720) included in a surface of the first housing or the second housing opposite the first display (230, 430, 710); At least one processor (120) comprising processing circuitry;and a memory (130) including one or more storage media storing instructions, wherein when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) is configured to: receive an acoustic signal, identify a language of the acoustic signal, and, in a first translation mode, while a first acoustic signal of a first language is received, display a translation screen in a second language different from the first language for the content indicated by the first acoustic signal in the first area (230a, 430a, 701), while a second acoustic signal of the second language is received, display a transcription screen in the second language for the content indicated by the second acoustic signal in the first area (230a, 430a, 701), and, in the first translation mode, position the first display (230, 430, 701) so that an angle between the first housing and the second housing corresponds to a first angular range defined. 710) is detected to be in a partially folded state, and in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal while the first display (230, 430, 710) is maintained in a partially folded state in the first translation mode, the second display (231, 431, 720) is activated, and while the first acoustic signal is received, a second language translation screen for the content indicated by the first acoustic signal is further displayed on the second display (231, 431, 720), and while the second acoustic signal is received, a first language translation screen for the content indicated by the second acoustic signal is further displayed on the second display (231, 431, 720).

[0423] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may be caused to: in a first translation mode, while a first acoustic signal in a first language is received, further display a first language transcription screen for the content indicated by the first acoustic signal in the second area (230b, 430b, 702), and while a second acoustic signal in a second language is received, further display a second language transcription screen for the content indicated by the second acoustic signal in the first area (230a, 430a, 701).

[0424] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may: activate the second display (231, 431, 720) based on detecting that the first display (230, 430, 710) is in a partially folded state such that an angle between the first housing and the second housing corresponds to a predetermined second angle range in a first translation mode, and further display a second language translation screen for the content indicated by the first acoustic signal on the second display (231, 431, 720) while the first acoustic signal is received, and further display a first language translation screen for the content indicated by the second acoustic signal on the second display (231, 431, 720) while the second acoustic signal is received.

[0425] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) is caused to: display a control element in at least a portion of a first area (230a, 430a, 701) and at least a portion of a second area (230b, 430b, 702), and rearrange and display the control element in the second area (230b, 430b, 702) based on detecting that the first display (230, 430, 710) is in a partially folded state such that an angle between the first housing and the second housing corresponds to a first angle range or a second angle range.

[0426] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101, 200, 400) may: receive sensing information acquired by the sensor circuit from the sensor circuit of the electronic device (101, 200, 400), and display a screen on a second display (231, 431, 720) by adjusting properties of text in a second language based on the sensing information, the screen being a translation screen or a transcription screen.

[0427] In one embodiment, a method performed by an electronic device (101, 200, 400), wherein the electronic device (101, 200, 400) comprises: a housing including a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing; a first display (230, 430, 710) including a first region (230a, 430a, 701) and a second region (230b, 430b, 702), wherein at least a portion of the first region (230a, 430a, 701) corresponds to the first housing, and at least a portion of the second region (230b, 430b, 702) corresponds to the second housing; And a second display (231, 431, 720) included in a surface of the first housing or the second housing facing the first display (230, 430, 710), the operation of receiving an acoustic signal; the operation of identifying a language of the acoustic signal; in a first translation mode, while the first acoustic signal is received, the operation of displaying a translation screen in a second language different from the first language for the content indicated by the first acoustic signal in the first area (230a, 430a, 701); while the second acoustic signal of the second language is received, the operation of displaying a translation screen in the first language for the content indicated by the second acoustic signal in the second area (230b, 430b, 702); while in the first translation mode, the operation of switching to the second translation mode based on the duration of receiving the second acoustic signal meeting a defined criterion; In the second translation mode, while the second acoustic signal is being received, an operation of displaying a translation screen in a first language for the content indicated by the second acoustic signal in at least a portion of the first region (230a, 430a, 701) and the second region (230b, 430b, 702) may be included; and while in the second translation mode, in response to receiving the first acoustic signal, an operation of switching to the first translation mode may be included.

[0428] According to one embodiment, a method performed by an electronic device (101, 200, 400) may further include: displaying a transcription screen in a first language for content indicated by the first acoustic signal in a second area (230b, 430b, 702) while a first acoustic signal in a first language is received; and displaying a transcription screen in a second language for content indicated by the second acoustic signal in the first area (230a, 430a, 701) while a second acoustic signal in a second language is received.

[0429] According to one embodiment, a method performed by an electronic device (101, 200, 400) comprises: in a first translation mode, detecting a partially folded state of a first display (230, 430, 710) such that an angle between a first housing and a second housing corresponds to a first angle range; in the first translation mode, while the partially folded state of the first display (230, 430, 710) is maintained, in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal, activating a second display (231, 431, 720); while the first acoustic signal is being received, further displaying a second language translation screen for the content indicated by the first acoustic signal on the second display (231, 431, 720); And while the second audio signal is being received, the second display (231, 431, 720) may further include an operation of displaying a translation screen in the first language for the content indicated by the second audio signal.

[0430] According to one embodiment, a method performed by an electronic device (101, 200, 400) may further include: an operation of activating a second display (231, 431, 720) based on detecting that the first display (230, 430, 710) is in a partially folded state such that an angle between the first housing and the second housing corresponds to a second angle range in a first translation mode; an operation of further displaying a second language translation screen for the content indicated by the first acoustic signal on the second display (231, 431, 720) while a first acoustic signal is received; and an operation of further displaying a first language translation screen for the content indicated by the second acoustic signal on the second display (231, 431, 720) while a second acoustic signal is received.

[0431] According to one embodiment, a method performed by an electronic device (101, 200, 400) may further include: in a first translation mode, detecting that a first display (230, 430, 710) is in an open state; and in response to receiving a second acoustic signal in an opposite direction to the first acoustic signal in the first translation mode, displaying a screen of a first region (230a, 430a, 701) in an opposite direction to a screen of a second region (230b, 430b, 702).

[0432] According to one embodiment, a method performed by an electronic device (101, 200, 400) may further include: generating translation data in a first language for content represented by a second acoustic signal in a second language; determining an utterance characteristic corresponding to the second acoustic signal based on the second acoustic signal; generating a translation acoustic signal in a first language for content represented by the second acoustic signal based on the translation data and the utterance characteristic of the first language; and transmitting the translation acoustic signal in the first language to an external electronic device (102) that has established a communication channel with the electronic device (101, 200, 400).

[0433] According to one embodiment, a computer-readable recording medium can store a program for executing a method performed by an electronic device (101, 200, 400) in combination with hardware.

[0434] According to one embodiment, a non-transitory computer-readable recording medium stores one or more programs including instructions, which, when individually or collectively executed by at least one processor of an electronic device (101, 200, 400), cause the electronic device (101, 200, 400) to: receive an acoustic signal, identify a language of the acoustic signal, and, in a first translation mode, while a first acoustic signal in a first language is received, display a translation screen in a second language different from the first language for the content indicated by the first acoustic signal in a first area (230a, 430a, 701), while a second acoustic signal in the second language is received, display a translation screen in the first language for the content indicated by the second acoustic signal in a second area (230b, 430b, 702), and, while in the first translation mode, determine a duration for which the second acoustic signal is received based on a defined criterion. Based on the satisfaction, the second translation mode can be switched, and in the second translation mode, while the second acoustic signal is being received, a translation screen in the first language for the content indicated by the second acoustic signal can be displayed in at least a part of the first region (230a, 430a, 701) and the second region (230b, 430b, 702), and while in the second translation mode, in response to receiving the first acoustic signal, the first translation mode can be switched.

[0435] According to one embodiment, a non-transitory computer-readable recording medium stores one or more programs including instructions, which, when individually or collectively executed by at least one processor of an electronic device (101, 200, 400), cause the electronic device (101, 200, 400) to: receive an acoustic signal, identify a language of the acoustic signal, and, in a first translation mode, while a first acoustic signal of a first language is received, display a translation screen in a second language different from the first language for the content indicated by the first acoustic signal in a first area (230a, 430a, 701), while a second acoustic signal of the second language is received, display a transcription screen in a second language for the content indicated by the second acoustic signal in the first area (230a, 430a, 701), and, in the first translation mode, the angle between the first housing and the second housing is a defined first angle. In response to detecting that the first display (230, 430, 710) is in a partially folded state corresponding to the range, and while the first display (230, 430, 710) is maintained in a partially folded state in the first translation mode, in response to receiving a second acoustic signal in the opposite direction of the first acoustic signal, the second display (231, 431, 720) is activated, and while the first acoustic signal is being received, a translation screen in a second language for the content indicated by the first acoustic signal is further displayed on the second display (231, 431, 720), and while the second acoustic signal is being received, a translation screen in a first language for the content indicated by the second acoustic signal is further displayed on the second display (231, 431, 720).

[0436] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and software applications running on the operating system. Furthermore, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0437] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may, independently or collectively, command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave, for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on a computer-readable recording medium.

[0438] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination, and the program commands recorded on the medium may be those specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0439] The hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiment, and vice versa.

[0440] Although the embodiments have been described with limited drawings, those skilled in the art will appreciate that various technical modifications and variations can be applied based on the described embodiments. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0441] Therefore, other implementations, embodiments and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In electronic devices (101, 200, 400), A housing comprising a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing; A first display (230, 430, 710) comprising a first region (230a, 430a, 701) and a second region (230b, 430b, 702), wherein at least a portion of the first region (230a, 430a, 701) corresponds to the first housing, and at least a portion of the second region (230b, 430b, 702) corresponds to the second housing; A second display (231, 431, 720) included in a surface of the first housing or the second housing facing the first display (230, 430, 710); At least one processor (120) comprising processing circuitry; and A memory (130) comprising one or more storage media for storing instructions, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Receive an acoustic signal, Identify the language of the above acoustic signal, In the first translation mode, While a first audio signal of a first language is received, a translation screen in a second language different from the first language is displayed for the content indicated by the first audio signal in the first area (230a, 430a, 701). While the second audio signal of the second language is being received, a translation screen of the first language for the content indicated by the second audio signal is displayed in the second area (230b, 430b, 702), While in the first translation mode, switching to the second translation mode based on the duration of the second sound signal being received meeting a defined criterion, In the above second translation mode, While the second sound signal is being received, a translation screen in the first language for the content indicated by the second sound signal is displayed in at least a part of the first area (230a, 430a, 701) and the second area (230b, 430b, 702), While in the second translation mode, in response to receiving the first acoustic signal, switching to the first translation mode To do, Electronic devices (101, 200, 400).

2. In paragraph 1, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: In the above first translation mode, While the first audio signal of the first language is being received, a transcription screen of the first language for the content indicated by the first audio signal is further displayed in the second area (230b, 430b, 702), While the second audio signal of the second language is being received, a transcription screen of the second language for the content indicated by the second audio signal is further displayed in the first area (230a, 430a, 701). To do, Electronic devices (101, 200, 400).

3. In either of paragraphs 1 and 2, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: In the first translation mode, the first display (230, 430, 710) is detected to be partially folded so that the angle between the first housing and the second housing corresponds to a predetermined first angle range, While the first display (230, 430, 710) is maintained in a partially folded state in the first translation mode, in response to receiving the second acoustic signal in the opposite direction of the first acoustic signal, the second display (231, 431, 720) is activated, While the first sound signal is being received, a second language translation screen for the content indicated by the first sound signal is further displayed on the second display (231, 431, 720). While the second sound signal is being received, a second language transcription screen for the content indicated by the second sound signal is further displayed on the second display (231, 431, 720). To do, Electronic devices (101, 200, 400).

4. In any one of paragraphs 1 to 3, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Based on detecting that the first display (230, 430, 710) is partially folded so that the angle between the first housing and the second housing corresponds to a second angle range in the first translation mode, the second display (231, 431, 720) is activated, While the first sound signal is being received, a second language translation screen for the content indicated by the first sound signal is further displayed on the second display (231, 431, 720). While the second sound signal is being received, a second language transcription screen for the content indicated by the second sound signal is further displayed on the second display (231, 431, 720). To do, Electronic devices (101, 200, 400).

5. In any one of paragraphs 1 to 4, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: In the first translation mode, it is detected that the first display (230, 430, 710) is in an open state, While the first display (230, 430, 710) is maintained in an unfolded state in the first translation mode, in response to receiving the second acoustic signal in the opposite direction of the first acoustic signal, the screen of the first area (230a, 430a, 701) is displayed in the opposite direction to the screen of the second area (230b, 430b, 702). To do, Electronic devices (101, 200, 400).

6. In any one of paragraphs 1 to 5, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Displaying a control element in at least a part of the first area (230a, 430a, 701) and at least a part of the second area (230b, 430b, 702), Based on detecting that the first display (230, 430, 710) is partially folded so that the angle between the first housing and the second housing corresponds to a predetermined first angle range or a predetermined second angle range, The above operating elements are rearranged and displayed in the second area (230b, 430b, 702) To do, Electronic devices (101, 200, 400).

7. In any one of paragraphs 1 to 6, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Establish a communication channel with an external electronic device (102), Receive a second indirect sound signal of the second language from the external electronic device (102), Generate translation data in the first language for the content indicated by the second indirect audio signal, Generating a translation audio signal in the first language for the content indicated by the second indirect audio signal based on the translation data in the first language; Transmitting the translated sound signal of the first language to the external electronic device (102) To do, Electronic devices (101, 200, 400).

8. In any one of paragraphs 1 to 7, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Receive a second direct sound signal of the second language through the input module (150) of the electronic device (101, 200, 400), Receive sensing information obtained by the sensor circuit from the sensor circuit of the electronic device (101, 200, 400), Based on at least one of the second direct acoustic signal or the sensing information, a target acoustic signal is determined among the second indirect acoustic signal of the second language received from an external electronic device (102) and the second direct acoustic signal, When the second direct audio signal is determined as a target audio signal, translation data in the first language for the content indicated by the second direct audio signal is generated, Generating a translation audio signal in the first language for the content indicated by the second direct audio signal based on the translation data in the first language; Transmitting the translated sound signal of the first language to the external electronic device (102) To do, Electronic devices (101, 200, 400).

9. In electronic devices (101, 200, 400), A housing comprising a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing; A first display (230, 430, 710) comprising a first region (230a, 430a, 701) and a second region (230b, 430b, 702), wherein at least a portion of the first region (230a, 430a, 701) corresponds to the first housing, and at least a portion of the second region (230b, 430b, 702) corresponds to the second housing; A second display (231, 431, 720) included in a surface of the first housing or the second housing facing the first display (230, 430, 710); At least one processor (120) comprising processing circuitry; and A memory (130) comprising one or more storage media for storing instructions, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Receive an acoustic signal, Identify the language of the above acoustic signal, In the first translation mode, While a first audio signal of a first language is received, a translation screen in a second language different from the first language is displayed for the content indicated by the first audio signal in the first area (230a, 430a, 701). While the second audio signal of the second language is being received, a transcription screen of the second language for the content indicated by the second audio signal is displayed in the first area (230a, 430a, 701), In the first translation mode, it is detected that the first display (230, 430, 710) is partially folded so that the angle between the first housing and the second housing corresponds to a defined first angle range, While the first display (230, 430, 710) is maintained in a partially folded state in the first translation mode, in response to receiving the second acoustic signal in the opposite direction of the first acoustic signal, the second display (231, 431, 720) is activated, While the first sound signal is being received, a second language translation screen for the content indicated by the first sound signal is further displayed on the second display (231, 431, 720). While the second sound signal is being received, a second language transcription screen for the content indicated by the second sound signal is further displayed on the second display (231, 431, 720). To do, Electronic devices (101, 200, 400).

10. In paragraph 9, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: In the above first translation mode, While the first audio signal of the first language is being received, a transcription screen of the first language for the content indicated by the first audio signal is further displayed in the second area (230b, 430b, 702), While the second audio signal of the second language is being received, a transcription screen of the second language for the content indicated by the second audio signal is further displayed in the first area (230a, 430a, 701). To do, Electronic devices (101, 200, 400).

11. In any one of paragraphs 9 and 10, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Based on detecting that the first display (230, 430, 710) is partially folded so that the angle between the first housing and the second housing corresponds to a second angle range in the first translation mode, the second display (231, 431, 720) is activated, While the first sound signal is being received, a second language translation screen for the content indicated by the first sound signal is further displayed on the second display (231, 431, 720). While the second sound signal is being received, a second language transcription screen for the content indicated by the second sound signal is further displayed on the second display (231, 431, 720). To do, Electronic devices (101, 200, 400).

12. In any one of paragraphs 9 to 11, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Displaying a control element in at least a part of the first area (230a, 430a, 701) and at least a part of the second area (230b, 430b, 702), Based on detecting that the first display (230, 430, 710) is partially folded so that the angle between the first housing and the second housing corresponds to a predetermined first angle range or a predetermined second angle range, Display by rearranging the operating elements in the above second area (230b, 430b, 702) To do, Electronic devices (101, 200, 400).

13. In any one of paragraphs 9 to 12, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101, 200, 400) causes: Receive sensing information obtained by the sensor circuit from the sensor circuit of the electronic device (101, 200, 400), Displaying a screen by adjusting the properties of the text of the second language based on the sensing information on the second display (231, 431, 720) - the screen being the translation screen or the transcription screen - To do, Electronic devices (101, 200, 400).

14. In a method performed by an electronic device (101, 200, 400), The above electronic device (101, 200, 400) A housing comprising a first housing, a second housing, and a hinge structure rotatably connected between the first housing and the second housing; A first display (230, 430, 710) comprising a first region (230a, 430a, 701) and a second region (230b, 430b, 702), wherein at least a portion of the first region (230a, 430a, 701) corresponds to the first housing, and at least a portion of the second region (230b, 430b, 702) corresponds to the second housing; and A second display (231, 431, 720) included in a surface of the first housing or the second housing facing the first display (230, 430, 710), The act of receiving an acoustic signal; An action to identify the language of the above acoustic signal; In the first translation mode, An operation of displaying a translation screen in a second language different from the first language for the content indicated by the first audio signal in the first area (230a, 430a, 701) while a first audio signal of the first language is received; An operation of displaying a translation screen in the first language for the content indicated by the second audio signal in the second area (230b, 430b, 702) while the second audio signal of the second language is being received; While in the first translation mode, an operation of switching to the second translation mode based on the duration of the second acoustic signal being received meeting a defined criterion; In the above second translation mode, An operation of displaying a translation screen in the first language for the content indicated by the second acoustic signal in at least a portion of the first area (230a, 430a, 701) and the second area (230b, 430b, 702) while the second acoustic signal is being received; and An operation of switching to the first translation mode in response to receiving the first acoustic signal while in the second translation mode. including, method.

15. A non-transitory computer-readable recording medium storing one or more programs for executing the method of claim 14 in combination with hardware.

Images