Method for providing service by using multi-foldable structure, and multi-foldable electronic device thereof

Abstract

Various embodiments of the present invention, when instructions stored in a memory (130) are individually and / or collectively executed by a processor, may instruct a multi-foldable electronic device (101) to: identify a folding state of the multi-foldable electronic device while providing an interpretation service; determine a first area of a display to provide the interpretation service to a first user of the multi-foldable electronic device on the display if the multi-foldable electronic device is in a designated folding state; display first translation information translated into a first language of the first user in the first area; and display second translation information translated into a second language of a second user in a second area of the display to provide the interpretation service to the second user talking with the first user. Various embodiments are possible.

Description

Method for providing a service utilizing a multi-foldable structure and the multi-foldable electronic device thereof

[0001] Various embodiments of the present disclosure disclose a method for providing a service utilizing a multi-foldable structure and a multi-foldable electronic device.

[0002] With the development of digital technology, various types of electronic devices such as mobile communication terminals, PDAs (personal digital assistants), electronic notebooks, smartphones, tablet PCs (personal computers), or wearable devices are widely used. To support and enhance the functionality of these electronic devices, the hardware and / or software parts of the devices are continuously being improved.

[0003] For example, electronic devices are being developed to go beyond bendable forms and feature foldable displays, or displays that can be expanded in a slide or rolling format. Electronic devices including such displays can provide convenience of use depending on the state of the display and the orientation of the electronic device.

[0004] For example, electronic devices may have new form factors such as multi-display devices (e.g., dual display devices) or foldable electronic devices. Foldable electronic devices are equipped with a foldable (or bendable) display (e.g., foldable display or flexible display) and can be used by folding or unfolding. For example, in the case of foldable electronic devices, various information can be visually provided through the display (or display area) exposed in the unfolded or folded state.

[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0006] In one embodiment, a method and apparatus may be disclosed for displaying first translation information translated to the first language of a first user in a first area of ​​a display that provides interpretation services to a first user of the multi-foldable electronic device when the device changes to a designated folding state (e.g., U-shaped), and displaying second translation information translated to the second language of a second user in a second area of ​​the display that provides interpretation services to a second user conversing with the first user.

[0007] A multi-foldable electronic device (101) according to one embodiment of the present disclosure comprises a housing including a first housing (315), a second housing (325) and a third housing (335); a first hinge structure (511) disposed between the first housing and the second housing so that the first housing and the second housing fold together; a second hinge structure (513) disposed between the second housing and the third housing so that the second housing and the third housing fold together; a first display area (310) disposed corresponding to the first housing; a display (160) comprising a second display area (320) disposed between the first hinge structure and the second hinge structure and a third display area (330) disposed corresponding to the third housing, a memory (130) for storing instructions; and a processor (120), wherein the instructions are, by the processor, individually and / or When executed individually and / or collectively, the multi-foldable electronic device may identify the folding state of the multi-foldable electronic device while providing interpretation services, and if the multi-foldable electronic device is in a designated folding state, determine a first area of ​​the display to provide the interpretation service to a first user of the multi-foldable electronic device on the display, display first translation information translated into the first language of the first user in the first area, and display second translation information translated into the second language of the second user in a second area of ​​the display to provide the interpretation service to a second user conversing with the first user.

[0008] A method of operation of a multi-foldable electronic device (101) comprising a housing including a first housing (315), a second housing (325), and a third housing (335) according to one embodiment of the present disclosure, a first hinge structure (511) disposed between the first housing and the second housing so that the first housing and the second housing fold together, a second hinge structure (513) disposed between the second housing and the third housing so that the second housing and the third housing fold together, a first display area (310) disposed corresponding to the first housing, a second display area (320) disposed between the first hinge structure and the second hinge structure corresponding to the second housing, and a third display area (330) disposed corresponding to the third housing, wherein, while providing an interpretation service, the operation of identifying the folding state of the multi-foldable electronic device, and when the multi-foldable electronic device is in a designated folding state, the operation of the display The method may include determining a first area of ​​the display to provide the interpretation service to a first user of a multi-foldable electronic device, displaying first translation information translated into the first language of the first user in the first area, and displaying second translation information translated into the second language of the second user in a second area of ​​the display to provide the interpretation service to a second user conversing with the first user.

[0009] According to one embodiment, user convenience can be improved by sharing the display of a multi-foldable electronic device with a counterpart facing the user.

[0010] According to one embodiment, a first area of ​​a display to provide interpretation services to a first user in a multi-foldable electronic device may provide a screen for the first user, and a second area of ​​a display to provide interpretation services to a second user may provide a screen for the second user.

[0011] According to one embodiment, when a multi-foldable electronic device changes to a designated folding state while providing an interpretation service, a first translation information translated into the language of the first user may be displayed in a first area of ​​a display to provide an interpretation service to the first user, and a second translation information translated into the language of the second user may be displayed in a second area of ​​a display to provide an interpretation service to the second user.

[0012] According to one embodiment, while providing interpretation services through a first area and a second area of ​​a display, if a third user is identified, the direction of the display area for the third user is determined based on the location of the third user, and third translation information for the third user can be displayed based on the determined direction.

[0013] FIG. 1 is a block diagram of a multi-foldable electronic device in a network environment according to one embodiment.

[0014] FIG. 2 is a drawing illustrating a display of a multi-foldable electronic device according to one embodiment.

[0015] FIG. 3 is a drawing illustrating an example of a first type of multi-foldable electronic device according to one embodiment.

[0016] FIG. 4 is a drawing illustrating an example of a second type of multi-foldable electronic device according to one embodiment.

[0017] FIG. 5 is a diagram illustrating an example of providing interpretation services in a multi-foldable electronic device according to one embodiment.

[0018] FIG. 6 is a flowchart illustrating the operation method of a multi-foldable electronic device according to one embodiment.

[0019] FIGS. 7a to 7c are drawings illustrating an example of providing an interpretation service in a multi-foldable electronic device according to one embodiment.

[0020] FIGS. 8a and FIGS. 8b are drawings illustrating an example of providing interpretation services in a multi-foldable electronic device according to one embodiment.

[0021] FIG. 9 is a flowchart illustrating a method for providing interpretation services in a multi-foldable electronic device according to one embodiment.

[0022] FIGS. 10a to 10c are drawings illustrating an example of providing an interpretation service in response to a conversation participant in a multi-foldable electronic device according to one embodiment.

[0023] FIG. 11 is a drawing illustrating an example in which a multi-foldable electronic device according to one embodiment provides a presentation service in a designated folding state.

[0024] FIG. 12 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing a game service in a designated folding state.

[0025] FIG. 13 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing a consultation service in a designated folding state.

[0026] FIG. 14 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing video services in a designated folding state.

[0027] FIG. 15 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing a collaborative service in a designated folding state.

[0028] FIG. 16 is a diagram illustrating an example in which a multi-foldable electronic device according to one embodiment provides different services to users in a designated folding state.

[0029] FIG. 1 is a block diagram of a multi-foldable electronic device (101) in a network environment (100) according to various embodiments.

[0030] Referring to FIG. 1, in a network environment (100), a multi-foldable electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the multi-foldable electronic device (101) may communicate with an electronic device (104) through a server (108). According to one embodiment, a multi-foldable electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the multi-foldable electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0031] The processor (120) can, for example, execute software (e.g., program (140)) to control at least one other component (e.g., hardware or software component) of the multi-foldable electronic device (101) connected to the processor (120) and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if a multi-foldable electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a specified function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0032] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the multi-foldable electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the multi-foldable electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0033] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the multi-foldable electronic device (101). The data may include, for example, software (e.g., program (140)) and input data or output data for related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0034] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0035] The input module (150) can receive commands or data to be used for a component (e.g., processor (120)) of the multi-foldable electronic device (101) from outside the multi-foldable electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0036] The sound output module (155) can output a sound signal to the outside of the multi-foldable electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0037] The display module (160) can visually provide information to the outside (e.g., user) of the multi-foldable electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0038] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) that is directly or wirelessly connected to the multi-foldable electronic device (101).

[0039] The sensor module (176) can detect the operating state (e.g., power or temperature) of the multi-foldable electronic device (101) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0040] The interface (177) may support one or more specified protocols that can be used for the multi-foldable electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0041] The connection terminal (178) may include a connector through which the multi-foldable electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0042] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0043] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0044] The power management module (188) can manage the power supplied to the multi-foldable electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0045] The battery (189) can supply power to at least one component of the multi-foldable electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0046] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between a multi-foldable electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate a multi-foldable electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0047] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the multi-foldable electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0048] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0049] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0050] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0051] According to one embodiment, commands or data may be transmitted or received between the multi-foldable electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be a device of the same or different type as the multi-foldable electronic device (101). According to one embodiment, all or part of the operations performed on the multi-foldable electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the multi-foldable electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the multi-foldable electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the multi-foldable electronic device (101). The multi-foldable electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The multi-foldable electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (104) or server (108) may be included within the second network (199). The multi-foldable electronic device (101) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0052] FIG. 2 is a drawing illustrating a display of a multi-foldable electronic device according to one embodiment.

[0053] Referring to FIG. 2, a display (e.g., display module (160) of FIG. 1) of a multi-foldable electronic device (e.g., multi-foldable electronic device (101) of FIG. 1) according to one embodiment may include a display having a fixed shape and / or a deformable display such as a foldable display or a rollable (or slideable) display. The components, their relationships, and their functions illustrated in FIG. 2 are merely illustrative and are not intended to limit the implementations described or claimed herein.

[0054] The display module (160) may include components such as a display panel (210), a display driver integrated circuitry (DDI) (230) (or a display driver circuitry (230)), and / or a touch circuitry (250). These components are merely exemplary. For example, the display module (160) may include other components (e.g., a circuitry for controlling a digitizer and / or a sensor (270)). For example, some components may be omitted from the display module (160).

[0055] The display panel (210) may include a plurality of pixels and a plurality of thin film transistors (TFTs) that control the plurality of pixels. For example, the plurality of TFTs may include p-channel metal-oxide semiconductor (PMOS) transistors and / or n-channel metal-oxide semiconductor (NMOS) transistors. Each of the plurality of pixels may include a set of subpixels (e.g., a subpixel for providing red light, a subpixel for providing blue light, a subpixel for providing green light, and / or a subpixel for providing white light). For example, the plurality of pixels in the display panel (210) may be driven based on a voltage (or current) provided to the TFTs through (or from) a display driving circuit (230).

[0056] A display driving circuit (230) can provide visual information (or a screen) (or one or more images) through a display panel (210) (or through a display area of ​​the display panel (210)) based on image data received from a processor (120) and / or a command for controlling the operation of subcomponents of the display driving circuit (230). The display driving circuit (230) may include subcomponents such as an interface controller (231) (e.g., including an interface control circuit), a timing controller (232) (e.g., including a timing control circuit), a command controller (233) (e.g., including a command control circuit), a GRAM (graphics random access memory) controller (234) (e.g., including a GRAM control circuit), a GRAM (235), a source driver (238), and / or a gate driver (239). The display driving circuit (230) may be configured to receive data (e.g., frame data) from the processor (120) and to control the display panel (210) to display visual information using the data. The display driving circuit (230) may be described as a display peripheral.

[0057] The above sub-components are exemplary. For example, the display driving circuit (230) may further include other sub-components (e.g., a self-drawing engine (or any suitable circuit for self-drawing)). For example, some sub-components (e.g., a GRAM controller (234) and a GRAM (235)) may be omitted from the display driving circuit (230). For example, some sub-components (e.g., a source driver (238), a gate driver (239)) may be placed as components separate from the display driving circuit (230).

[0058] The interface controller (231) may provide image data obtained from the processor (120) (e.g., display controller (215)) to the GRAM (235) and provide commands obtained from the processor (120) to the command controller (233). For example, the interface controller (231) may be used for one or more interfaces (e.g., MIPI (mobile industry processor interface), MDDI (mobile display digital interface), SPI (serial peripheral interface), I2C (inter-integrated circuit), I3C (improved inter-integrated circuit), and / or CDP (compact display port)). In one embodiment, the image data may be stored in the GRAM (235). In one embodiment, storing the image data in the GRAM (235) may be bypassed. If the storage of the above image data is bypassed, the image data may be provided to an image processing circuit (not shown) or a source driver (238) within the display driving circuit (230) via the interface controller (231).

[0059] The timing controller (232) may provide a synchronization signal (or timing signal) to the GRAM controller (234), the source driver (238), and / or the gate driver (239). In one embodiment, the synchronization signal is generated by the timing controller (232), and the synchronization signal generated by the timing controller (232) may be provided from the timing controller (232) to the GRAM controller (234), the source driver (238), the gate driver (239), and / or the touch circuit (250). In one embodiment, the synchronization signal is generated by a synchronization signal generating circuit located outside the display driving circuit (230), and may be provided from the synchronization signal generating circuit to the timing controller (232).

[0060] The synchronization signal provided from the synchronization signal generation circuit may be provided from the timing controller (232) to the GRAM controller (234), the source driver (238), and / or the gate driver (239). For example, the synchronization signal may include a display synchronization signal (e.g., a display vertical synchronization signal and a display horizontal synchronization signal). For example, the display vertical synchronization signal and the display horizontal synchronization signal may be used for reference timing to switch the source driver (238) and the gate driver (239), respectively. For example, the synchronization signal may include a touch synchronization signal (e.g., a touch vertical synchronization signal and a touch horizontal synchronization signal). For example, the touch vertical synchronization signal and the touch horizontal synchronization signal may each be provided to the touch circuit (250). As an example, but not limited to, the frequency of the display synchronization signal may be different from the frequency of the touch synchronization signal.

[0061] The command controller (233) can provide the command to the GRAM controller (234) and / or the timing controller (232).

[0062] The GRAM controller (234) can provide the image data recorded in the GRAM (235) to the source driver (238) by scanning the image data based on the synchronization signal obtained from the timing controller (232) and the command obtained from the command controller (233). In one embodiment, before the image data is provided to the source driver (238), it can be processed based on the command provided to the image processing circuit from the command controller (233) through an image processing circuit (not shown) located between the GRAM (235) and the source driver (238).

[0063] The source driver (238) can provide color through a set of subpixels based on the display vertical synchronization signal and the image data. For example, the source driver (238) can provide a data voltage corresponding to the input image data to a plurality of pixels.

[0064] The gate driver (239) can turn on or turn off the set of subpixels based on the display horizontal synchronization signal and the light emission signal.

[0065] The touch circuit (250) may include a touch command controller (251) and a touch sensor (252).

[0066] A touch sensor controller (251) can control a touch sensor (252) based on a touch synchronization signal (e.g., a touch vertical synchronization signal and / or the touch horizontal synchronization signal) to obtain information about an input on a display panel (210) (e.g., a touch input or a hovering input on the display panel (210)). The touch sensor controller (251) can provide the information obtained based on the touch synchronization signal to a processor (120) or a display driving circuit (230).

[0067] The touch sensor (252) may be positioned in relation to the display panel (210). For example, the touch sensor (252) may be positioned within the display panel (210) or on the display panel (210).

[0068] FIG. 3 is a drawing illustrating an example of a first type of multi-foldable electronic device according to one embodiment.

[0069] Referring to FIG. 3, an example of changing the shape (e.g., folding state) of a display (e.g., display module (160) of FIG. 1) in a multi-foldable electronic device (e.g., multi-foldable electronic device (101) of FIG. 1) according to one embodiment may be shown. The multi-foldable electronic device (101) of FIG. 3 may represent an example of an in-folding type multi-foldable electronic device (e.g., G-type foldable electronic device).

[0070] According to one embodiment, when the multi-foldable electronic device (101) is in a folded state, at least a portion of the second display area (320) and the third display area (330) of the display module (160) are in contact with each other based on a second point (or second folding axis) (e.g., B axis) that is folded (e.g., in-folding), and at least a portion of the first display area (310) of the display module (160) and the third portion (e.g., third housing (335)) of the housing (e.g., cover) are in contact with each other based on a first point (or first folding axis) (e.g., A axis), so that they are in a closed state.

[0071] According to one embodiment, when the multi-foldable electronic device (101) is in an unfolded state (e.g., an unfolded state based on the shape of FIG. 3), all display areas of the display module (160) (e.g., a first display area (310), a second display area (320), a third display area (330)) are provided as one side (or the entire side), so that the display module (160) can be used in a relatively large size. According to one embodiment, when the multi-foldable electronic device (101) is partially unfolded (e.g., an intermediate state), at least one display area of ​​the display module (160) can be provided as an area for displaying visual information (or a screen) (or one or more images). In FIG. 3, the display module (160) of the multi-foldable electronic device (101) may display a folding state corresponding to a partially folded state (e.g., intermediate state) with respect to a folding axis (or hinge axis or hinge structure) (e.g., first folding axis and second folding axis) at an angle less than a certain angle (e.g., about 180 degrees).

[0072] A multi-foldable electronic device (101) may include a housing (350) (or multi-foldable housing) (e.g., a first housing (315), a second housing (325), and a third housing (335)) that fixes a display module (160) including a first display area (310), a second display area (320), and a third display area (330). According to one embodiment, the housing (350) may include a foldable structure (e.g., a hinge structure). When the multi-foldable electronic device (101) is in a folded state, the first part (301) and the third part (305) may face in opposite directions to the second part (303), and the first part (301) and the third part (305) may face in the same direction. When the electronic device (101) is in an unfolded state, the first part (301), the second part (303), and the third part (305) may be formed to face in the same direction.

[0073] According to one embodiment, the multi-foldable electronic device (101) may be an example comprising two folding axes (e.g., a first folding axis and a second folding axis) (e.g., an A-axis and a B-axis). The two folding axes (A-axis and B-axis) may each be an example employed to divide the display module (160) into three parts. The multi-foldable electronic device (101) may be folded, unfolded, or bent along the folding axes (A-axis and B-axis). The first display area (310), the second display area (320), and the third display area (330) of the display module (160) of the multi-foldable electronic device (101) may be a form in which they are folded inward (e.g., an in-folding method) so that they are not exposed to the outside of the electronic device (101). The multi-foldable electronic device (101) may represent an example of a G-type foldable electronic device, and may represent an intermediate state (e.g., partially folded state or partially unfolded state) viewed from the front of the multi-foldable electronic device (101) and a folded state viewed from the back (or bottom) of the multi-foldable electronic device (101).

[0074] In the form of the multi-foldable electronic device (101), the multi-foldable electronic device (101) being completely folded (e.g., in a folded state or in a folded state) may mean that any two parts included in the display module (160) of the multi-foldable electronic device (101) (e.g., a second display area (320) and a third display area (330)) are facing each other (or are facing each other), so that the two parts are completely parallel or nearly parallel, and any part of the display module (160) (e.g., a first display area (310)) and any part included in the housing (350) (e.g., a third housing (335)) are facing each other (or are facing each other), so that the two parts are completely parallel or nearly parallel. For example, the multi-foldable electronic device (101) being completely folded may mean that the two parts of the multi-foldable electronic device (101) do not necessarily have to be in contact, but are positioned in nearly close proximity.

[0075] In the form of a multi-foldable electronic device (101), the multi-foldable electronic device (101) being fully unfolded (e.g., unfolded state or unfolded state) may indicate a state in which the first display area (310), the second display area (320) of the display module (160) of the electronic device (101), and the third display area (330) of the display module (160) are visually exposed to the outside and form a flat plane like a single display module (160), and the area of ​​the display module (160) exposed to the outside is the largest or approaches the largest area.

[0076] The multi-foldable electronic device (101) may have different directions of folding or bending with respect to each folding axis (A-axis, B-axis). This is exemplary, and the multi-foldable electronic device (101) may have the same direction of folding or bending with respect to each folding axis (A-axis, B-axis). According to one embodiment, the multi-foldable electronic device (101) may have the first display area (310) and the second display area (320) of the display module (160) folded facing each other, and the second display area (320) and the third display area (330) folded facing each other. This is not limited thereto, and the multi-foldable electronic device (101) exemplified in FIG. 3 may include a form in which it is folded in an out-folding manner.

[0077] According to one embodiment, depending on the position where two folding axes (A-axis, B-axis) are employed on the multi-foldable electronic device (101), the multi-foldable electronic device (101) may be folded or bent asymmetrically with respect to each folding axis (A-axis, B-axis), and even when the multi-foldable electronic device (101) is completely folded with respect to the folding axis (A-axis, B-axis), each display area (310, 320, 330) of the multi-foldable electronic device (101) separated by the folding axes (A-axis, B-axis) may not completely overlap. According to one embodiment, even when the folding axis (A-axis, B-axis) is provided on the multi-foldable electronic device (101), a display module (160) may be employed on the front and / or rear of the multi-foldable electronic device (101), and the display module (160) may be activated or deactivated.

[0078] According to one embodiment, the multi-foldable electronic device (101) can detect the folding state (or degree of folding) (e.g., folded state, intermediate state, or unfolded state) of the multi-foldable electronic device (101). According to one embodiment, the multi-foldable electronic device (101) can detect the folding state based on a first folding angle based on a folding axis of a first hinge structure (e.g., a first folding axis or an A-axis) and a second folding angle based on a folding axis of a second hinge structure (e.g., a second folding axis or a B-axis). According to one embodiment, the multi-foldable electronic device (101) can detect the folding state and enable or disable at least some display area of ​​the display module (160).

[0079] According to one embodiment, when the multi-foldable electronic device (101) detects a folded state, all display areas of the display module (160) (e.g., a first display area (310), a second display area (320), and a third display area (330)) may be deactivated. According to one embodiment, when the multi-foldable electronic device (101) detects a folded state, the display area used by the multi-foldable electronic device (101) (e.g., a first display area (310)) may be activated, and the display area not used (e.g., a second display area (320) and a third display area (330)) may be deactivated. According to one embodiment, when the multi-foldable electronic device (101) detects an intermediate state, it can activate / deactivate at least one display area (e.g., a first display area (310), a second display area (320) and / or a third display area (330)) of the display module (160) according to the folding state of the electronic device (101).

[0080] FIG. 4 is a drawing illustrating an example of a second type of multi-foldable electronic device according to one embodiment.

[0081] Referring to FIG. 4, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) may represent an example of an in-folding type multi-foldable electronic device (e.g., a C-type foldable electronic device). When the multi-foldable electronic device (101) is in a folded state, at least a portion of the first display area (410) and the second display area (420) of the display module (160) are in contact with each other based on a first point (or first folding axis) (e.g., A-axis) that is folded (e.g., in-folding), and at least a portion of the third display area (430) and the second display area (420) of the display module (160) are in contact with each other based on a second point (or second folding axis) (e.g., B-axis), so that the device is in a closed state.

[0082] When the multi-foldable electronic device (101) is in an unfolded state, all display areas of the display module (160) (e.g., first display area (410), second display area (420), third display area (430)) are provided as one side (or the entire side), allowing the display module (160) to be used in a relatively large size. According to one embodiment, when the multi-foldable electronic device (101) is partially unfolded (e.g., intermediate state), at least one display area of ​​the display module (160) may be provided as an area for displaying visual information (or a screen) (or one or more images). The display module (160) of the multi-foldable electronic device (101) may display a folding state corresponding to a partially folded state (e.g., intermediate state) at an angle less than a certain angle (e.g., about 180 degrees) with respect to a folding axis (or hinge axis or hinge structure) (e.g., first folding axis and second folding axis).

[0083] A multi-foldable electronic device (101) may include a housing (450) (or multi-foldable housing) (e.g., a first housing (415), a second housing (425), and a third housing (435)) that fixes a display module (160) including a first display area (410), a second display area (420), and a third display area (430). According to one embodiment, the housing (450) may include a foldable structure (e.g., a hinge structure). When the multi-foldable electronic device (101) is in a folded state, the first part (401) and the third part (405) may face in opposite directions to the second part (403), and the first part (401) and the third part (405) may face in the same direction. When the multi-foldable electronic device (101) is in an unfolded state, the first part (401), the second part (403), and the third part (405) may be formed to face in the same direction.

[0084] According to one embodiment, an example of a multi-foldable electronic device (101) comprising two folding axes (e.g., a first folding axis and a second folding axis) (e.g., an A-axis and a B-axis) may be shown. The two folding axes (A-axis and B-axis) may each be employed to divide the display module (160) into three parts. The electronic device (101) may be folded, unfolded, or bent along the folding axes (A-axis and B-axis). The first display area (410), the second display area (420), and the third display area (430) of the display module (160) of the multi-foldable electronic device (101) may be folded inward (e.g., in-folding method) so that they are not exposed to the outside of the electronic device (101). In FIG. 4, the multi-foldable electronic device (101) may represent an example of a C-type foldable electronic device, and may represent an intermediate state (e.g., partially folded state or partially unfolded state) viewed from the front of the multi-foldable electronic device (101) and a folded state viewed from the back (or bottom) of the multi-foldable electronic device (101).

[0085] According to one embodiment, in the form of the multi-foldable electronic device (101) illustrated in FIG. 4, the electronic device (101) being completely folded (e.g., in a folded state or in a folded state) may mean that all parts included in the display module (160) of the multi-foldable electronic device (101) (e.g., a first display area (410) and a second display area (420), and a second display area (420) and a third display area (430)) are facing each other (or are facing each other), so that the two parts are completely parallel or nearly parallel. For example, the multi-foldable electronic device (101) being completely folded may mean that the two parts of the multi-foldable electronic device (101) do not necessarily have to be in contact, but are positioned nearly close to each other.

[0086] According to one embodiment, in the form of the multi-foldable electronic device (101) illustrated in FIG. 4, the multi-foldable electronic device (101) being fully unfolded (e.g., unfolded state or unfolded state) may indicate a state in which the first display area (410), the second display area (420) of the display module (160) of the multi-foldable electronic device (101), and the third display area (430) of the display module (160) are visually exposed to the outside and form a flat plane like a single display module (160), and may indicate when the area of ​​the display module (160) exposed to the outside is the largest or approaches the largest area.

[0087] As illustrated in FIG. 4, the multi-foldable electronic device (101) may have different directions of folding or bending with respect to each folding axis (A-axis, B-axis). This is exemplary, and the multi-foldable electronic device (101) may have the same direction of folding or bending with respect to each folding axis (A-axis, B-axis). According to one embodiment, the multi-foldable electronic device (101) may be folded such that the first display area (410) and the second display area (420) of the display module (160) face each other, and the second display area (420) and the third display area (430) face each other. This is not limited to, but if the multi-foldable electronic device (101) exemplified in FIG. 4 is in a form that folds in an out-folding manner, the first display area (410), the second display area (420), and the third display area (430) are exposed to the outside, and the back surface of the first display area (410) (e.g., the first housing (415)) and the back surface of the second display area (420) (e.g., the second housing (425)) are folded facing each other, and the back surface of the second display area (420) (e.g., the second housing (425)) and the back surface of the third display area (430) (e.g., the third housing (435)) are folded facing each other.

[0088] According to one embodiment, depending on the position where two folding axes (A-axis, B-axis) are employed on the multi-foldable electronic device (101), the multi-foldable electronic device (101) may be folded or bent asymmetrically with respect to each folding axis (A-axis, B-axis), and even when the multi-foldable electronic device (101) is completely folded with respect to the folding axis (A-axis, B-axis), each display area (410, 420, 430) of the multi-foldable electronic device (101) separated by the folding axes (A-axis, B-axis) may not completely overlap. According to one embodiment, even when the folding axis (A-axis, B-axis) is provided in the multi-foldable electronic device (101) as exemplified in FIG. 4, a display module (160) may be employed on the front and / or rear of the electronic device (101), and the display module (160) may be activated or deactivated in a similar manner as described in the description section with reference to FIG. 3 above.

[0089] According to one embodiment, a multi-foldable electronic device (101) can detect a change in the shape (e.g., folding or unfolding) of a display module (160) based on various methods.

[0090] According to one embodiment, the multi-foldable electronic device (101) may include a state sensing sensor and / or an angle sensing sensor based on at least one sensor (e.g., sensor module (176) of FIG. 1). According to one embodiment, the multi-foldable electronic device (101) may determine the posture (or operation mode) (e.g., portrait mode or landscape mode) of the multi-foldable electronic device (101) based on first sensor data sensed by the state sensing sensor. According to one embodiment, the multi-foldable electronic device (101) may determine the folding angle (or folding state) of the multi-foldable electronic device (101) based on second sensor data sensed by the angle sensing sensor. In one embodiment, the posture of the multi-foldable electronic device (101) may include a portrait mode or a landscape mode used in an operation mode (e.g., phone mode or tablet mode). In one embodiment, the portrait mode may be a mode in which the multi-foldable electronic device (101) is used in portrait mode in an unfolded state (e.g., fully unfolded state or intermediate state). In one embodiment, the landscape mode may be a mode in which the multi-foldable electronic device (101) is used in landscape mode in an unfolded state (e.g., fully unfolded state or intermediate state). According to one embodiment, the multi-foldable electronic device (101) may be changed from portrait mode to landscape mode or from landscape mode to portrait mode based on a change in the orientation (e.g., rotation) of the multi-foldable electronic device (101).

[0091] According to one embodiment, a multi-foldable electronic device (101) may include a first sensor (e.g., a first angle sensing sensor) that detects a first folding angle of a first folding axis (or a first hinge structure) and a second sensor (e.g., a second angle sensing sensor) that detects a second folding angle of a second folding axis (or a second hinge structure). For example, the multi-foldable electronic device (101) can determine a first folding angle between the first housing (315, 415) and the second housing (325, 425) (or between the first display area (310, 410) and the second display area (320, 420)) based on a first folding axis (e.g., A axis) based on sensor data sensed by the first sensor. For example, the multi-foldable electronic device (101) can determine a second folding angle between the second housing (325, 425) and the third housing (335, 435) (or between the second display area (320, 420) and the third display area (330, 430)) based on a second folding axis (e.g., B axis) based on sensor data sensed by the second sensor.

[0092] According to one embodiment, the state sensing sensor may include at least one of a grip sensor, an inertial sensor, a proximity sensor, an illuminance sensor, a magnetic sensor, a Hall sensor, a gesture sensor, a bending sensor, an infrared sensor, a touch sensor, a pressure sensor, or an infrared camera, or a combination thereof. According to one embodiment, the angle sensing sensor may include at least one of an inertial sensor, a Hall sensor, a magnetic sensor, or a bending sensor, or a combination thereof. According to one embodiment, an angle sensing sensor may be positioned on one side of the electronic device (101) (e.g., a folding axis, a housing end, a bottom of a display module (160) (e.g., under a panel, and / or a bezel of a display module (160)) to measure the folding angle of the multi-foldable electronic device (101). The folding angle may represent the angle formed by two display areas separated by the folding axis of the electronic device (101) with the folding axis. According to one embodiment, the multi-foldable electronic device (101) may measure the folding angle to determine whether the electronic device (101) is in a fully folded state, a fully unfolded state, or an intermediate state in which it is unfolded (or folded) at a certain angle.

[0093] FIG. 5 is a diagram illustrating an example of providing interpretation services in a multi-foldable electronic device according to one embodiment.

[0094] Referring to FIG. 5, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3); a first hinge structure (511) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together; a second hinge structure (513) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together; a first display area (e.g., the first display area (310) of FIG. 3) disposed corresponding to the first housing (315); and a second It may include a display (e.g., a display module (160) of FIG. 1) comprising a second display area (e.g., a second display area (320) of FIG. 3) positioned between a first hinge structure (511) and a second hinge structure (513) corresponding to a housing (325), and a third display area (e.g., a third display area (330) of FIG. 3) positioned corresponding to a third housing (335).

[0095] When a multi-foldable electronic device (101) is placed between a user of the multi-foldable electronic device (101) (e.g., first user (501), main user) and a counterpart (e.g., second user (503)), and the multi-foldable electronic device (101) is in a designated folding state, the multi-foldable electronic device (101) may provide a first screen related to an interpretation service for the first user (501) in the first area (510)) and provide a second screen related to an interpretation service for the second user (503) in the second area (530)). For example, the multi-foldable electronic device (101) may be a foldable electronic device of various forms, such as a G type, a C type, or an e type. According to one embodiment, the multi-foldable electronic device (101) may provide different information displays depending on the state of the display module (e.g., the display module (160) of FIG. 1) of the multi-foldable electronic device (101), such as when the first housing is folded or when the first housing and the third housing are folded together, in the first housing, the second housing, and the third housing.

[0096] A multi-foldable electronic device (101) is described through FIGS. 3 and FIGS. 4. Referring to FIGS. 4, the multi-foldable electronic device (101) may include a housing (450) (or multi-foldable housing) (e.g., a first housing (415), a second housing (425), and a third housing (435)) that fixes a display module (160) comprising a first display area (e.g., the first display area (410) of FIGS. 4), a second display area (e.g., the second display area (420) of FIGS. 4), and a third display area (e.g., the third display area (430) of FIGS. 4). According to one embodiment, the housing (450) may include a foldable structure (e.g., a hinge structure). Hereinafter, the multi-foldable electronic device (101) of FIGS. 3 is described as an example, but the present invention is not limited by this description.

[0097] The above-mentioned folding state may include a state in which it is unfolded beyond an angle specified by the first hinge structure (511) or the second hinge structure (513). When the multi-foldable electronic device (101) is partially unfolded (e.g., intermediate state), at least one display area of ​​the display module (160) may be provided as an area for displaying visual information (or a screen) (or one or more images). When the multi-foldable electronic device (101) is in the designated folding state (e.g., intermediate state, U-shaped structure), the first display area (310) may be directed toward the gaze of the second user (503), and the third display area (330) may be directed toward the gaze of the first user (501). In this case, the third display area (330) may be identified as the first area (510) for providing interpretation services to the first user (501), and the first display area (310) may be identified as the second area (530) for providing interpretation services to the second user (503). The second display area (320) placed between the first display area (310) and the third display area (330) may be divided into two areas, with some parts included in the first area (510) and other parts included in the second area (530). As another example, the second display area (320) may be included in the first area (510) so that the first user (501) can use it (e.g., control menu, home screen display).

[0098] Alternatively, the first display area (310) may be identified as the first area (510) for providing interpretation services to the first user (501), and the third display area (330) may be identified as the second area (530) for providing interpretation services to the second user (503). The first display area (310) may be identified as the first area (510) for providing interpretation services to the first user (501), and the third display area (330) may be identified as the second area (530) for providing interpretation services to the second user (503). The second display area (320) may be divided into two areas, with some parts included in the first area (510) and other parts included in the second area (530).

[0099] While providing interpretation services (e.g., functions, modes, applications), the multi-foldable electronic device (101) may display first translation information translated to the first language (e.g., Korean) of the first user (501) in the first area (510) and second translation information translated to the second language (e.g., English) of the second user (503) in the second area (530). Alternatively, while providing presentation services, the multi-foldable electronic device (101) may display PPT information and explanation information for the first user (501) in the first area (510) and PPT information for the second user (503) in the second area (530). While providing game services, the multi-foldable electronic device (101) may display a first game screen for the first user (501) in the first area (510) and a second game screen for the second user (503) in the second area (530). Accordingly, the multi-foldable electronic device (101) can improve user convenience by sharing the screen of the multi-foldable electronic device (101) with a second user (503) facing the first user (501).

[0100] According to one embodiment, the multi-foldable electronic device (101) can detect a third user participating in the interpretation service while providing interpretation services through a first area (510) and a second area (530), respectively. The multi-foldable electronic device (101) can detect the participation of the third user in the interpretation service based on the input of the first user (501) (e.g., voice input, keypad input, etc.), identify the location of the third user using at least one camera (e.g., camera module (180) of FIG. 1), determine the direction of the display area to be provided to the third user based on the location of the third user, and display third translation information to the third user based on the direction of the determined display area. Alternatively, the multi-foldable electronic device (101) may identify the location of the third user (1005) using a directional microphone. For example, the foldable electronic device (101) may identify the second display area (320) as a third area for the third user. In this case, while providing a third area for the third user, the size of the first area (510) and the second area (530) may be reduced.

[0101] The foldable electronic device (101) may display the third translation information in the third area based on the display direction of the third area (e.g., a 90-degree direction with respect to the first user (501) or a -90-degree direction with respect to the second user (503) (e.g., 270 degrees). According to one embodiment, while the foldable electronic device (101) is displaying the third translation information, it may acquire an image from the at least one camera, and if the third user is not detected in the acquired image for a specified period of time, it may remove the area displaying the third translation information and reset the first area and the second area. When the third area for the third user is removed, the size of the first area (510) and the second area (530) may be increased.

[0102] A multi-foldable electronic device (101) according to one embodiment of the present disclosure comprises a housing including a first housing (315), a second housing (325) and a third housing (335); a first hinge structure (511) disposed between the first housing and the second housing so that the first housing and the second housing fold together; a second hinge structure (513) disposed between the second housing and the third housing so that the second housing and the third housing fold together; a first display area (310) disposed corresponding to the first housing; a display (160) comprising a second display area (320) disposed between the first hinge structure and the second hinge structure and a third display area (330) disposed corresponding to the third housing, a memory (130) for storing instructions; and a processor (120), wherein the instructions are, by the processor, individually and / or When executed individually and / or collectively, the multi-foldable electronic device may identify the folding state of the multi-foldable electronic device while providing interpretation services, and if the multi-foldable electronic device is in a designated folding state, determine a first area of ​​the display to provide the interpretation service to a first user of the multi-foldable electronic device on the display, display first translation information translated into the first language of the first user in the first area, and display second translation information translated into the second language of the second user in a second area of ​​the display to provide the interpretation service to a second user conversing with the first user.

[0103] The above-mentioned designated folding state includes a state unfolded beyond an angle specified by the first hinge structure or the second hinge structure, and when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device may detect user input specifying the first region and the second region when the multi-foldable electronic device changes to the designated folding state, and determine the first region and the second region based on the user input.

[0104] The first area includes at least a portion of the first display area and the second display area, and the second area includes the third display area, and a control menu related to the interpretation service may be displayed in at least a portion of the second display area.

[0105] The above second display area may be divided into a second-1 display area and a second-2 display area, the first area may include the first display area and the second-1 display area, and the second area may include the third display area and the second-2 display area.

[0106] When the above instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device may convert voice input obtained from the first user into first text and display it in the first area, and display a second text translated from the displayed first text in the first area.

[0107] When the above instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device may display the conversation history between users represented in the first language and the first text in the first area, display the second text below the first text in the first area, and maintain the display of the first text and the second text in the first area until the next utterance is input from the first user or the second user.

[0108] When the above instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device may display the conversation history between users represented in the second language and the second text in the second area, display the first text below the second text in the second area, and maintain the display of the first text and the second text in the second area until the next utterance is input from the first user or the second user.

[0109] When the above instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device may detect a third user to participate in the interpretation service while providing interpretation services through the first area and the second area, respectively, identify the location of the third user using at least one camera, determine the orientation of a display area to be provided to the third user based on the location of the third user, and display third translation information to the third user based on the determined orientation of the display area.

[0110] The third area providing the above third translation information may be a second display area positioned between the first folding axis and the second folding axis.

[0111] When the above instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device may acquire an image from the at least one camera while displaying the third translation information, and if the third user is not detected in the acquired image for a specified time, remove the display of the third translation information and reset the first area and the second area.

[0112] FIG. 6 is a flowchart (600) illustrating the operation method of a multi-foldable electronic device according to one embodiment.

[0113] Referring to FIG. 6, in operation 601, a processor (e.g., processor (120) of FIG. 1) of a multi-foldable electronic device (e.g., multi-foldable electronic device (101) of FIG. 1) according to one embodiment can identify the folding state of the multi-foldable electronic device (101) while providing interpretation services. For example, the multi-foldable electronic device (101) may be a foldable electronic device of various forms, such as a G-type, a C-type, or an e-type. According to one embodiment, a multi-foldable electronic device (101) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3); a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together; a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together; and a first display area (e.g., the first display of FIG. 3) disposed corresponding to the first housing (315). It may include a display (e.g., a display module (160) of FIG. 1) comprising a second display area (e.g., a second display area (320) of FIG. 3) positioned between a first hinge structure (511) and a second hinge structure (513) corresponding to a region (310) and a second housing (325), and a third display area (e.g., a third display area (330) of FIG. 3) positioned corresponding to a third housing (335).

[0114] A multi-foldable electronic device (101) is described through FIGS. 3 and FIGS. 4. Referring to FIGS. 4, the multi-foldable electronic device (101) may include a housing (450) (or multi-foldable housing) (e.g., a first housing (415), a second housing (425), and a third housing (435)) that fixes a display module (160) comprising a first display area (e.g., the first display area (410) of FIGS. 4), a second display area (e.g., the second display area (420) of FIGS. 4), and a third display area (e.g., the third display area (430) of FIGS. 4). According to one embodiment, the housing (450) may include a foldable structure (e.g., a hinge structure). Hereinafter, the multi-foldable electronic device (101) of FIGS. 3 is described as an example, but the present invention is not limited by this description.

[0115] The above interpretation service may translate input (e.g., voice input, text input via keypad) obtained from a user of the multi-foldable electronic device (101) (e.g., primary user, first user (e.g., first user (501) in FIG. 5)) and provide it in another language. For example, the above interpretation service may translate and output (or provide) what the first user (501) said in Korean (e.g., first language) as "안녕하세요" into English (e.g., second language) as "Hello." The above interpretation service may translate input obtained from a counterparty (e.g., second user (503) in FIG. 5) and provide it in the language of the first user (501). The above interpretation service may be provided through a function, mode, or application provided by the multi-foldable electronic device (101). The first user (501) may use the above interpretation service when the multi-foldable electronic device (101) is completely folded or completely unfolded. The first user (501) is the second A multi-foldable electronic device (101) can be placed between the user (503) and the second user (503) to have a conversation while facing the user (503).

[0116] In operation 603, the processor (120) may detect that the multi-foldable electronic device (101) is in a designated folding state. The designated folding state may mean an intermediate state in which the multi-foldable electronic device (101) is partially unfolded or partially closed. For example, the designated folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) less than a certain angle (e.g., about 180 degrees) with respect to the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The designated folding state may include a state in which it is unfolded beyond an angle specified by the first hinge structure (511) or the second hinge structure (513).

[0117] In operation 605, the processor (120) can identify a first area of ​​the display module (160) (e.g., the first area (510) of FIG. 5) to provide interpretation services to the first user (501). When the multi-foldable electronic device (101) is placed between the first user (501) and the second user (503) in a designated folding state, the first user (501) may not be able to see the entire display area of ​​the display module (160). That is, the first user (501) may only be able to see a portion of the display area of ​​the display module (160). When the multi-foldable electronic device (101) changes to a designated folding state, the processor (120) may divide the display module (160) into at least two areas. The processor (120) receives user input from the first user (501) specifying the first area (510) and can identify the first area (510) based on the user input. According to one embodiment, the processor (120) can acquire the voice (e.g., speech) of the first user (501) or the second user (503) through a microphone (e.g., input module (150) of FIG. 1) and can identify the first area (510) based on the acquired voice. The voice of the first user (501) may be stored in the memory of the multi-foldable electronic device (101) (e.g., memory (130) of FIG. 1). The processor (120) can identify the voice of the first user (501) by comparing the voice acquired through the microphone with the voice stored in the memory (130) and can identify the first area (510) based on the voice of the first user (501).

[0118] In operation 607, the processor (120) may display first translation information for the first user (501) in the first area (510). The first translation information may include a first text converted from the first user (501)'s voice (e.g., "I'm hungry"), a second text translated from the first text into the second user (503)'s language (e.g., "I'm hungry"), or a third text converted from the second user (503)'s voice (e.g., "Having something together?") into the first user (501)'s language (e.g., "Shall we go eat something?"). Alternatively, the first translation information may include a conversation history between the first user (501) and the second user (503).

[0119] In operation 609, the processor (120) may display second translation information for the second user (503) in a second area (e.g., the second area (530) of FIG. 5) to provide interpretation services to the second user (503). The processor (120) may identify, based on the identification (or designation) of the first area (510), an area opposite to the first area (510) as the second area (530) to provide interpretation services to the second user (503). The second translation information may include a first text converted into text (STT) from the voice of the second user (503) (e.g., "I'm hungry"), a second text translated into the language of the first user (501) (e.g., "I'm hungry"), or a third text converted into text from the voice of the first user (501) (e.g., "Shall we go eat something?") and translated into the language of the second user (503) (e.g., "Having something together?"). Alternatively, the second translation information may include a conversation history between the first user (501) and the second user (503).

[0120] FIGS. 7a to 7c are drawings illustrating an example of providing an interpretation service in a multi-foldable electronic device according to one embodiment.

[0121] Referring to FIG. 7a, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and on the first housing (315 It may include a display (e.g., a display module (160) of FIG. 1) comprising a first display area (e.g., the first display area (310) of FIG. 3) that corresponds to the second housing (325), a second display area (e.g., the second display area (320) of FIG. 3) that corresponds to the first hinge structure (511) and the second hinge structure (513), and a third display area (e.g., the third display area (330) of FIG. 3) that corresponds to the third housing (335).

[0122] The multi-foldable electronic device (101) can divide the display module (160) into at least two regions when the multi-foldable electronic device (101) changes to a designated folding state. The designated folding state may include a state unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513). When the multi-foldable electronic device (101) is in a designated folding state, a portion of the first display area (310) and the second display area (320), such as the first user interface (710), may be identified as a first-1 region (711) to provide interpretation services to the first user (e.g., the first user (501) of FIG. 5). A portion of the second display area (320) included in the first-1 region (711) may be divided into two regions based on the direction of the long side length of the multi-foldable electronic device (101) (e.g., vertical direction). If part of the first display area (310) and the second display area (320) is a first-1 area (711) that provides interpretation services to the first user (501), the other part of the second display area (320) and the third display area (330) may be a second area that provides interpretation services to the second user (e.g., the second user (503) of FIG. 5).

[0123] Alternatively, when the multi-foldable electronic device (101) is in a designated folding state, the first display area (310), such as the second user interface (720), may be identified as a first-second area (721) to provide interpretation services to the first user (501). If the first display area (310) is the first-second area (721) to provide interpretation services to the first user (501), the third display area (330) may be a second area to provide interpretation services to the second user (503). In this case, the second display area (320) may be utilized as an area used by the first user (501). For example, a control menu related to interpretation services may be displayed in the second display area (320).

[0124] Below, an example may be described in which a portion of the first display area (310) and the second display area (320) is used as the first area (711). However, the present invention is not limited by this description.

[0125] Referring to FIG. 7b, the processor of the multi-foldable electronic device (101) (e.g., the processor (120) of FIG. 1) receives the voice (703) of the first user (501) through a microphone and can display the first text converted from the voice (703). The third user interface (730) is displayed in the first area (711) and may include a conversation history (735) between users, the first text (731) converted from the voice (703) and a translation processing object (733). The translation processing object (733) may indicate that the first text (731) is being translated. While displaying the translation processing object (733), the processor (120) can translate the first text (731) into the language of the second user (503). When the translation of the first text (731) is completed, the processor (120) can display the fourth user interface (750).

[0126] According to one embodiment, a microphone icon may be included in a first area (e.g., a screen provided to a first user) or a second area (e.g., a screen provided to a second user). When the microphone icon displayed in the first area is activated, the processor (120) may receive the speech of the first user. Additionally, when the microphone icon displayed in the second area is activated, the processor (120) may indicate that the speech of the second user is being input. When the speech of both the first user and the second user is finished, the microphone icon may be deactivated. While the speech of the first user is being input, STT is input in real time in the first area, and the translated text in the second area may be displayed after the microphone icon is deactivated. Only the language of the first user may be displayed in the first area, and only the language of the second user may be displayed in the second area.

[0127] The fourth user interface (750) is displayed in the first area (711) and may include a conversation history between users, a first text (751), and a second text (753). The processor (120) may display the first text (751) at the top of the first area (711) and display the translated second text (753) below the first text (751). The processor (120) may maintain the display of the first text (751) and the second text (753) until the next utterance is input from the first user (501) or the second user (503). The processor (120) may stop displaying the second text (753) when an utterance is input from the first user (501) or the second user (503). The third user interface (730) and the fourth user interface (750) may be displayed in the first area (711) provided (or displayed) to the first user (501). The conversation history (735) between users in the third user interface (730) and the fourth user interface (750) may be displayed in the language of the first user (501) (e.g., Korean).

[0128] Referring to FIG. 7c, when the processor of the multi-foldable electronic device (101) (e.g., the processor (120) of FIG. 1) receives the voice (703) of the first user (501), it may display a first text that converts the voice (703) into text. A fifth user interface (770) is displayed in a second area that provides interpretation services to the second user (503) and may include a conversation history (775) between users, a first text (771) that converts the voice (703) into text, and a translation processing object (773). The translation processing object (773) may indicate that the first text (771) is being translated. The processor (120) may translate the first text (771) into the language of the second user (503) while displaying the translation processing object (773). The processor (120) can display the sixth user interface (790) when the translation of the first text (771) is completed.

[0129] The sixth user interface (790) is displayed in a second area to provide interpretation services to the second user (503) and may include a conversation history between users, a first text (793), and a second text (791). The processor (120) may display the translated second text (791) at the top of the second area and display the first text (793) before translation below the second text (791). The processor (120) may maintain the display of the first text (793) and the second text (791) until the next utterance is input from the first user (501) or the second user (503). The processor (120) may stop displaying the first text (793) when an utterance is input from the first user (501) or the second user (503). The fifth user interface (770) and the sixth user interface (790) may be displayed in a second area provided (or displayed) to the second user (503). The conversation history (775) between users in the fifth user interface (770) and the sixth user interface (790) may be displayed in the language of the second user (503) (e.g., English).

[0130] FIGS. 8a and FIGS. 8b are drawings illustrating an example of providing interpretation services in a multi-foldable electronic device according to one embodiment.

[0131] Referring to FIG. 8a, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3); a first hinge structure (811) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together; a second hinge structure (813) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together; a first display area (e.g., the first display area (310) of FIG. 3) disposed corresponding to the first housing (315); and a second A display (e.g., a display module (160) of FIG. 1) may be included, comprising a second display area (e.g., a second display area (320) of FIG. 3) positioned between a first hinge structure (511) and a second hinge structure (513) corresponding to a housing (325), and a third display area (e.g., a third display area (330) of FIG. 3) positioned corresponding to a third housing (335). Referring to the first reference numeral (810), the display module (160) may be divided into a first display area (①) (e.g., a first display area (310) of FIG. 3), a second display area (②) (e.g., a second display area (320) of FIG. 3), and a third display area (③) (e.g., a third display area (330) of FIG. 3).

[0132] As shown in the second reference numeral (830), when the multi-foldable electronic device (101) provides interpretation services in an unfolded state, it may provide first conversation history information in the first display area (831), provide second conversation history information in the second display area (833), and provide a control menu related to the interpretation service in the third display area (835). The first conversation history information may be a conversation history in the first language (e.g., Korean) of a user of the multi-foldable electronic device (101) (e.g., the first user (501) in FIG. 5, the primary user). The second conversation history information may be a conversation history in the second language (e.g., English) of a counterpart (e.g., the second user (503) in FIG. 5) conversing with the first user (501).

[0133] Referring to the third reference numeral (850), the processor of the multi-foldable electronic device (101) (e.g., the processor (120) of FIG. 1) may identify a first display area (851) and a part (853) of the second display area as a first area (801) to provide interpretation services to a first user (501), and identify another part (855) of the second display area and a third display area (857) as a second area (803) to provide interpretation services to a second user (503), when the multi-foldable electronic device (101) is in a designated folding state. That is, the processor (120) may divide the second display area into two areas (853, 855), include a part (853) of the second display area in the first area (801), and include another part (855) of the second display area in the second area (803). When the processor (120) provides interpretation services in a state where the multi-foldable electronic device (101) is changed to a designated folding state, it may display first translation information for a first user (501) in a first area (801) and second translation information for a second user (503) in a second area (803).

[0134] Referring to FIG. 8b, the processor (120) may provide a user interface (870) when the multi-foldable electronic device (101) is changed to a designated folding state and provides an interpretation service. The user interface (870) is displayed in a first area for a first user (501) and may include a control menu for the first user (501) to control the interpretation service. The user interface (870) may include conversation history information displayed in the language of the first user (501), an end button (871) for the interpretation service, or a conversation history view object (873).

[0135] FIG. 9 is a flowchart (900) illustrating a method for providing interpretation services in a multi-foldable electronic device according to one embodiment. FIG. 9 can be performed after operation 609 of FIG. 6.

[0136] Referring to FIG. 9, in operation 901, a processor (e.g., processor (120) of FIG. 1) of a multi-foldable electronic device (e.g., multi-foldable electronic device (101) of FIG. 1) according to one embodiment can provide interpretation services through a first area and a second area. For example, a multi-foldable electronic device (101) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and a first display area (e.g., the first display of FIG. 3) disposed corresponding to the first housing (315). It may include a display (e.g., a display module (160) of FIG. 1) comprising a second display area (e.g., a second display area (320) of FIG. 3) positioned between a first hinge structure (511) and a second hinge structure (513) corresponding to a region (310) and a second housing (325), and a third display area (e.g., a third display area (330) of FIG. 3) positioned corresponding to a third housing (335).

[0137] When the multi-foldable electronic device (101) is in a designated folding state, the processor (120) may identify a portion of the first display area (310) and the second display area (320) as a first area to provide interpretation services to a first user (e.g., the first user (501) in FIG. 5), and identify another portion of the second display area (320) and the third display area (330) as a second area to provide interpretation services to a second user (e.g., the second user (503) in FIG. 5). The designated folding state may include a state unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513). The above-mentioned folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) at a certain angle (e.g., about 180 degrees) relative to the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis).

[0138] The processor (120) may display a conversation history between users in the first language of the first user (501), a first text converted from voice input obtained from the first user (501), or a second text translated from the first text in a first area. The processor (120) may display a conversation history between users in the second language of the second user (503), the first text, or the second text in a second area. The processor (120) may maintain the display of the first text and the second text in the first area or the second area until the next utterance is input from the first user (501) or the second user (503).

[0139] In operation 903, the processor (120) can detect a third user participating in the interpretation service. The processor (120) can detect a third user participating in the interpretation service while providing the interpretation service. For example, the processor (120) can detect the participation of the third user in the interpretation service based on the input of the first user (501) (e.g., voice input, keypad input, menu input, etc.). The processor (120) can detect the participation of the third user when a designated utterance such as "3rd speaker participation" or "change to 3-person mode" is obtained from the first user (501). Alternatively, the processor (120) can detect the participation of the third user in the interpretation service by identifying the context of the utterance when an utterance such as "Welcome" or "Let's talk together" is obtained from the first user (501).

[0140] In operation 905, the processor (120) can identify the location of the third user using at least one camera (e.g., the camera module (180) of FIG. 1). The camera may be positioned on the front of the multi-foldable electronic device (101) on which the display module (160) is placed. When the multi-foldable electronic device (101) is in a designated folding state, the processor (120) can identify the location of the third user using the camera positioned on the front of the multi-foldable electronic device (101). The processor (120) may also identify the location of the third user (1005) using a directional microphone. For example, when the third user participates in the interpretation service, the processor (120) may designate the first display area (310) as the first area to provide the interpretation service to the first user (501), designate the third display area (330) as the second area to provide the interpretation service to the second user (503), and designate the second display area (320) as the third area to provide the interpretation service to the third user. While providing the third area for the third user, the size of the first area and the second area may be reduced.

[0141] In operation 907, the processor (120) may determine the direction of the display area to be provided to the third user based on the location of the third user. The second display area (320) is positioned between the first display area (310) and the third display area (330), and the third user may be located at a 90-degree direction from the first user (501) or at -90 degrees (e.g., 270-degree direction) from the first user (501). The processor (120) may determine the display direction of the third area based on the location of the third user.

[0142] In operation 909, the processor (120) may display third translation information to the third user based on the direction of the determined display area. The processor (120) may display a conversation history between users in the third user's third language (e.g., Spanish), a first text converted from voice input obtained from the first user (501), or a second text translated from the first text in the third area.

[0143] According to one embodiment, the processor (120) acquires an image from the at least one camera while displaying the third translation information, and if the third user is not detected in the acquired image for a specified time, the area displaying the third translation information may be removed and the first area and the second area may be reset. When the third area for the third user is removed, the size of the first area and the second area may be increased. The processor (120) may designate a portion of the first display area (310) and the second display area (320) as the first area, and designate another portion of the second display area (320) and the third display area (330) as the second area.

[0144] FIGS. 10a to 10c are drawings illustrating an example of providing an interpretation service in response to a conversation participant in a multi-foldable electronic device according to one embodiment.

[0145] Referring to FIG. 10a, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and a first A display (e.g., a display module (160) of FIG. 1) may be included, comprising a first display area (e.g., the first display area (310) of FIG. 3) positioned corresponding to a housing (315), a second display area (e.g., the second display area (320) of FIG. 3) positioned between a first hinge structure (511) and a second hinge structure (513) corresponding to a second housing (325), and a third display area (e.g., the third display area (330) of FIG. 3) positioned corresponding to a third housing (335).

[0146] When a multi-foldable electronic device (101) is placed between a user of the multi-foldable electronic device (101) (e.g., first user (501), main user) and a counterpart (e.g., second user (503)), and the multi-foldable electronic device (101) is in a designated folding state, a processor (e.g., processor (120) of FIG. 1) may provide a first screen related to an interpretation service for the first user (501) in a first area (1010), provide a second screen related to an interpretation service for the second user (503) in a second area (1020), and provide a third screen related to an interpretation service for the third user (1005) in a third area (1030). The first area (1010) may correspond to the third display area (330), the second area (1020) may correspond to the first display area (310), and the third area (1030) may correspond to the second display area (320). The specified folding state may mean a state in which the multi-foldable electronic device (101) is partially unfolded or partially closed as an intermediate state. For example, the specified folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) less than a certain angle (e.g., about 180 degrees) relative to the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The specified folding state may include a state in which it is unfolded beyond an angle specified by the first hinge structure (511) or the second hinge structure (513).

[0147] Referring to FIG. 10b, the processor (120) can identify the location of a third user (1005) using at least one camera (1051) (e.g., the camera module (180) of FIG. 1). The camera (1051) may be positioned on the front of a multi-foldable electronic device (101) on which a display module (160) is placed. When the multi-foldable electronic device (101) is in a designated folding state, the processor (120) can identify the location of the third user (1005) using the camera (1051) positioned on the front of the multi-foldable electronic device (101). The processor (120) may also identify the location of the third user (1005) using a directional microphone. Based on the location of the third user (1005), the processor (120) can determine the display direction of the third area (1030) to be provided to the third user (1005). The first situation (1050) illustrates an example where the third user (1005) is located in the first direction (1053) (e.g., -90 degrees from the first user (501)). The second situation (1070) illustrates an example where the third user (1005) is located in the second direction (1073) (e.g., 90 degrees from the first user (501)).

[0148] The processor (120) may display third translation information to the third user (1005) based on the display direction of the third area (1030). If the third user (1005) is located in the first direction (1053), the processor (120) may display third translation information in the first direction (1053) of the third area (1030). If the third user (1005) is located in the second direction (1073), the processor (120) may display third translation information in the second direction (1073) of the third area (1030). According to one embodiment, while displaying the third translation information, the processor (120) may acquire an image from the camera (1051) and analyze the acquired image. Based on the analyzed result, if the position of the second user (503) or the third user (1005) is inappropriate (e.g., a position separated from the first user (501), the processor (120) may provide a guidance message to the first user (501) to adjust the position of the second user (503) or the third user (1005).

[0149] Referring to FIG. 10c, when a multi-foldable electronic device (101) provides interpretation services in a designated folding state, the processor (120) may provide a first screen related to interpretation services for a first user (501) in a first area (1091), provide a second screen related to interpretation services for a second user (503) in a second area (1093), provide a third screen related to interpretation services for a third user (1005) in a third area (1095), and provide a fourth screen related to interpretation services for a fourth user (1007) in a fourth area (1097). The first area (1091) corresponds to the third display area (330), the second area (1093) corresponds to the first display area (310), the third area (1095) corresponds to a part of the second display area (320), and the fourth area (1097) may correspond to another part of the second display area (320). The processor (120) may divide the second display area (320) into two areas, designate a part of the second display area (320) as the third area (1095), and designate another part of the second display area (320) as the fourth area (1097).

[0150] FIG. 11 is a drawing illustrating an example in which a multi-foldable electronic device according to one embodiment provides a presentation service in a designated folding state.

[0151] Referring to FIG. 11, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and on the first housing (315 It may include a display (e.g., a display module (160) of FIG. 1) comprising a first display area (e.g., the first display area (310) of FIG. 3) that corresponds to the second housing (325), a second display area (e.g., the second display area (320) of FIG. 3) that corresponds to the first hinge structure (511) and the second hinge structure (513), and a third display area (e.g., the third display area (330) of FIG. 3) that corresponds to the third housing (335).

[0152] The multi-foldable electronic device (101) can provide a presentation service in a designated folding state. The designated folding state may refer to an intermediate state in which the multi-foldable electronic device (101) is partially unfolded or partially closed. For example, the designated folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) less than a certain angle (e.g., about 180 degrees) relative to the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The designated folding state may include a state in which it is unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513).

[0153] While providing a presentation service, the multi-foldable electronic device (101) may display PPT information (1101) and explanatory information (1103) in a first area where the gaze of a first user (501) (e.g., a presenter) is directed, and may display PPT information (1101) in a second area where the gaze of a second user (503) (e.g., a person listening to the presentation) is directed. The first area may include a part of the first display area (310) and the second display area (320). The second area may include another part of the second display area (320) and the third display area (330). The first user interface (1110) is displayed in the first area and may include PPT information (1101) and explanatory information (1103). The second user interface (1130) is displayed in the second area and may include PPT information (1101). The first user interface (1110) provided to the first user (501) and the second user interface (1130) provided to the second user (503) may be different. In a situation where the presenter and the customer (e.g., a person listening to the presentation) face each other with the multi-foldable electronic device (101) in between, the multi-foldable electronic device (101) may provide a screen for the presentation to the presenter's line of sight and provide the full slideshow screen to the customer's line of sight.

[0154] FIG. 12 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing a game service in a designated folding state.

[0155] Referring to FIG. 12, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and on the first housing (315 It may include a display (e.g., a display module (160) of FIG. 1) comprising a first display area (e.g., the first display area (310) of FIG. 3) that corresponds to the second housing (325), a second display area (e.g., the second display area (320) of FIG. 3) that corresponds to the first hinge structure (511) and the second hinge structure (513), and a third display area (e.g., the third display area (330) of FIG. 3) that corresponds to the third housing (335).

[0156] The multi-foldable electronic device (101) can provide game services in a designated folding state. The designated folding state may refer to an intermediate state in which the multi-foldable electronic device (101) is partially unfolded or partially closed. For example, the designated folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) at a certain angle (e.g., about 180 degrees) less than the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The designated folding state may include a state in which it is unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513).

[0157] While providing a game service, the multi-foldable electronic device (101) may display a first screen related to the game service in a first area where the gaze of the first user (501) is directed, and display a second screen related to the game service in a second area where the gaze of the second user (503) is directed. The first area may include a part of the first display area (310) and the second display area (320). The second area may include another part of the second display area (320) and the third display area (330). The first user interface (1210) may be displayed in the first area, and the second user interface (1230) may be displayed in the second area. The first user interface (1210) provided to the first user (501) and the second user interface (1230) provided to the second user (503) may be different. The multi-foldable electronic device (101) may display each play screen according to the viewpoint of each user facing each other to enjoy a multiplayer game.

[0158] FIG. 13 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing a consultation service in a designated folding state.

[0159] Referring to FIG. 13, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and on the first housing (315 It may include a display (e.g., a display module (160) of FIG. 1) comprising a first display area (e.g., the first display area (310) of FIG. 3) that corresponds to the second housing (325), a second display area (e.g., the second display area (320) of FIG. 3) that corresponds to the first hinge structure (511) and the second hinge structure (513), and a third display area (e.g., the third display area (330) of FIG. 3) that corresponds to the third housing (335).

[0160] The multi-foldable electronic device (101) can provide consultation services in a designated folding state. The designated folding state may refer to an intermediate state in which the multi-foldable electronic device (101) is partially unfolded or partially closed. For example, the designated folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) at a certain angle (e.g., about 180 degrees) less than the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The designated folding state may include a state in which it is unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513).

[0161] While providing a counseling service, the multi-foldable electronic device (101) may display a first screen related to a game service in a first area where the gaze of a first user (501) (e.g., counselor) is directed, and display a second screen related to a game service in a second area where the gaze of a second user (503) (e.g., person being counseled) is directed. The first area may include a first display area (310) and a part of a second display area (320). The second area may include another part of the second display area (320) and a third display area (330). A first user interface (1310) may be displayed in the first area, and a second user interface (1330) may be displayed in the second area. The first user interface (1310) provided to the first user (501) and the second user interface (1330) provided to the second user (503) may be different. The multi-foldable electronic device (101) can provide different screens between the counselor and the counselee to ensure that the counseling proceeds smoothly.

[0162] FIG. 14 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing video services in a designated folding state.

[0163] Referring to FIG. 14, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and on the first housing (315 It may include a display (e.g., a display module (160) of FIG. 1) comprising a first display area (e.g., the first display area (310) of FIG. 3) that corresponds to the second housing (325), a second display area (e.g., the second display area (320) of FIG. 3) that corresponds to the first hinge structure (511) and the second hinge structure (513), and a third display area (e.g., the third display area (330) of FIG. 3) that corresponds to the third housing (335).

[0164] The multi-foldable electronic device (101) can provide a video service (or video streaming service) in a designated folding state. The designated folding state may refer to an intermediate state in which the multi-foldable electronic device (101) is partially unfolded or partially closed. For example, the designated folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) at a certain angle (e.g., about 180 degrees) less than the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The designated folding state may include a state in which it is unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513).

[0165] While providing video services, the multi-foldable electronic device (101) may display a first screen related to the video service in a first area for providing interpretation services to a first user (501), display a second screen related to the video service in a second area directed toward the gaze of a second user (503), and display a third screen related to the video service in a third area directed toward the gaze of a third user (1005). The first area may be a first display area (310), the second area may be a third display area (330), and the third area may be a second display area (320). The first user interface (1410) may be displayed in the first area, the second user interface (1430) may be displayed in the second area, and the third user interface (1450) may be displayed in the third area.

[0166] The video service is content that supports Korean (e.g., a first language), and the second user interface (1430) may include a video (1431) and a first subtitle (1433) corresponding to a second language (e.g., English). The third user interface (1450) may include a video (1451) and a second subtitle (1453) corresponding to a third language (e.g., French). The second user interface (1430) provided to the second user (503) and the third user interface (1450) provided to the third user (1005) may be different. To provide the video service, the multi-foldable electronic device (101) may receive a first area, a second area, and a third area from the first user (501), and receive a second language to be provided as subtitles in the second area and a third language to be provided as subtitles in the third area.

[0167] According to one embodiment, users may wear their respective earphones. A multi-foldable electronic device (101) may be connected (e.g., paired) with a first earphone worn by a first user (501), a second earphone worn by a second user (503), and a third earphone worn by a third user (1005). The foldable electronic device (101) may provide the same audio data in relation to content to each earphone. Alternatively, the foldable electronic device (101) may transmit first audio data (e.g., Korean content) in relation to content to the first earphone, transmit second audio data (e.g., English content) in relation to content to the second earphone, and transmit third audio data (e.g., French content) in relation to content to the third earphone.

[0168] FIG. 15 is a drawing illustrating an example of a multi-foldable electronic device according to one embodiment providing a collaborative service in a designated folding state.

[0169] Referring to FIG. 15, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and on the first housing (315 It may include a display (e.g., a display module (160) of FIG. 1) comprising a first display area (e.g., the first display area (310) of FIG. 3) that corresponds to the second housing (325), a second display area (e.g., the second display area (320) of FIG. 3) that corresponds to the first hinge structure (511) and the second hinge structure (513), and a third display area (e.g., the third display area (330) of FIG. 3) that corresponds to the third housing (335).

[0170] The multi-foldable electronic device (101) can provide collaborative services in a designated folding state. The designated folding state may refer to an intermediate state in which the multi-foldable electronic device (101) is partially unfolded or partially closed. For example, the designated folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) less than a certain angle (e.g., about 180 degrees) relative to the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The designated folding state may include a state in which it is unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513).

[0171] While providing collaborative work services, the multi-foldable electronic device (101) may display a first screen related to a video service in a first area that provides interpretation services to the first user (501), display a second screen related to a video service in a second area directed toward the gaze of the second user (503), and display a third screen related to a video service in a third area directed toward the gaze of the third user (1005). The first area may be a first display area (310), the second area may be a third display area (330), and the third area may be a second display area (320). The first user interface (1510) may be displayed in the first area, the second user interface (1530) may be displayed in the second area, and the third user interface (1550) may be displayed in the third area. The multi-foldable electronic device (101) may provide each screen so that users facing each other can share different screens when proceeding with collaborative document work or coding work.

[0172] FIG. 16 is a diagram illustrating an example in which a multi-foldable electronic device according to one embodiment provides different services to users in a designated folding state.

[0173] Referring to FIG. 16, a multi-foldable electronic device according to one embodiment (e.g., the multi-foldable electronic device (101) of FIG. 1) comprises a housing including a first housing (e.g., the first housing (315) of FIG. 3), a second housing (e.g., the second housing (325) of FIG. 3), and a third housing (e.g., the third housing (335) of FIG. 3), a first hinge structure (e.g., the first hinge structure (511) of FIG. 5) disposed between the first housing (315) and the second housing (325) so that the first housing (315) and the second housing (325) fold together, a second hinge structure (e.g., the second hinge structure (513) of FIG. 5) disposed between the second housing (325) and the third housing (335) so that the second housing (325) and the third housing (335) fold together, and on the first housing (315 It may include a display (e.g., a display module (160) of FIG. 1) comprising a first display area (e.g., the first display area (310) of FIG. 3) that corresponds to the second housing (325), a second display area (e.g., the second display area (320) of FIG. 3) that corresponds to the first hinge structure (511) and the second hinge structure (513), and a third display area (e.g., the third display area (330) of FIG. 3) that corresponds to the third housing (335).

[0174] The multi-foldable electronic device (101) can provide different services to users in a designated folding state. The designated folding state may refer to an intermediate state in which the multi-foldable electronic device (101) is partially unfolded or partially closed. For example, the designated folding state may represent a folding state in which the display module (160) is partially folded (e.g., intermediate state, U-shaped structure) less than a certain angle (e.g., about 180 degrees) relative to the first hinge structure (511) or the second hinge structure (513) (e.g., A-axis and B-axis). The designated folding state may include a state in which it is unfolded beyond an angle designated by the first hinge structure (511) or the second hinge structure (513).

[0175] A multi-foldable electronic device (101) may display a first screen related to a game service in a first area that provides interpretation services to a first user (501), display a second screen related to coding work in a second area directed toward the gaze of a second user (503), and display a third screen related to an integrated search page in a third area directed toward the gaze of a third user (1005). The first area may be a first display area (310), the second area may be a third display area (330), and the third area may be a second display area (320). A first user interface (1610) may be displayed in the first area, a second user interface (1630) may be displayed in the second area, and a third user interface (1650) may be displayed in the third area. The multi-foldable electronic device (101) may provide each screen so that multiple people can each view their own content and perform necessary tasks.

[0176] A method of operation of a multi-foldable electronic device (101) comprising a housing including a first housing (315), a second housing (325), and a third housing (335) according to one embodiment of the present disclosure, a first hinge structure (511) disposed between the first housing and the second housing so that the first housing and the second housing fold together, a second hinge structure (513) disposed between the second housing and the third housing so that the second housing and the third housing fold together, a first display area (310) disposed corresponding to the first housing, a second display area (320) disposed between the first hinge structure and the second hinge structure corresponding to the second housing, and a third display area (330) disposed corresponding to the third housing, wherein, while providing an interpretation service, the operation of identifying the folding state of the multi-foldable electronic device, and when the multi-foldable electronic device is in a designated folding state, the operation of the display The method may include determining a first area of ​​the display to provide the interpretation service to a first user of a multi-foldable electronic device, displaying first translation information translated into the first language of the first user in the first area, and displaying second translation information translated into the second language of the second user in a second area of ​​the display to provide the interpretation service to a second user conversing with the first user.

[0177] The above-mentioned designated folding state includes a state in which it is unfolded beyond an angle specified by the first hinge structure or the second hinge structure, and the method may include, when the multi-foldable electronic device changes to the designated folding state, an operation of detecting a user input specifying the first region and the second region, and an operation of determining the first region and the second region based on the user input.

[0178] The first area includes at least a portion of the first display area and the second display area, and the second area includes the third display area, and at least a portion of the second display area may display a control menu related to the interpretation service.

[0179] The above second display area may be divided into a second-1 display area and a second-2 display area, the first area may include the first display area and the second-1 display area, and the second area may include the third display area and the second-2 display area.

[0180] The operation of displaying in the first area may include converting voice input obtained from the first user into first text and displaying it in the first area, and displaying a second text translated from the displayed first text in the first area.

[0181] The operation of displaying in the first area may include the operation of displaying the conversation history between users expressed in the first language and the first text in the first area, the operation of displaying the second text below the first text in the first area, and the operation of maintaining the display of the first text and the second text in the first area until the next utterance is input from the first user or the second user.

[0182] The operation of displaying in the second area may include the operation of displaying the conversation history between users expressed in the second language and the second text in the second area, the operation of displaying the first text below the second text in the second area, and the operation of maintaining the display of the first text and the second text in the second area until the next utterance is input from the first user or the second user.

[0183] The above method may further include, while providing interpretation services through the first area and the second area respectively, detecting a third user to participate in the interpretation service, identifying the location of the third user using at least one camera, determining the direction of a display area to be provided to the third user based on the location of the third user, and displaying third translation information to the third user based on the direction of the determined display area.

[0184] The third area providing the above third translation information may be a second display area positioned between the first folding axis and the second folding axis.

[0185] The above method may further include, while displaying the third translation information, an operation of acquiring an image from the at least one camera, an operation of removing the display of the third translation information if the third user is not detected in the acquired image for a specified time, and an operation of resetting the first area and the second area.

[0186] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0187] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., by wire), wirelessly, or through a third component.

[0188] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0189] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., multi-foldable electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., multi-foldable electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0190] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0191] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0192] The various embodiments of the present invention disclosed in this specification and drawings are provided merely as specific examples to facilitate the explanation of the technical content of the invention and to aid in understanding the invention, and are not intended to limit the scope of the invention. Accordingly, the scope of the present invention should be interpreted to include all modifications or variations derived based on the technical concept of the invention, in addition to the embodiments disclosed herein.

Claims

1. In a multi-foldable electronic device (101), A housing comprising a first housing (315), a second housing (325), and a third housing (335); A first hinge structure (511) disposed between the first housing and the second housing so that the first housing and the second housing are folded together; A second hinge structure (513) positioned between the second housing and the third housing so that the second housing and the third housing are folded together; A display (160) comprising a first display area (310) positioned corresponding to the first housing, a second display area (320) positioned between the first hinge structure and the second hinge structure corresponding to the second housing, and a third display area (330) positioned corresponding to the third housing; Memory (130) for storing instructions; and The multi-foldable electronic device includes a processor (120), and when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, While providing interpretation services, identify the folding state of the multi-foldable electronic device, and When the above multi-foldable electronic device is in a designated folding state, a first area of ​​the display is determined to provide the interpretation service to a first user of the multi-foldable electronic device on the display, and Displaying first translation information translated into the first language of the first user in the first area, and A multi-foldable electronic device that displays second translation information translated into the second language of the second user in a second area of ​​the display to provide the interpretation service to the second user conversing with the first user.

2. In Paragraph 1, The above-mentioned designated folding state includes a state unfolded beyond an angle specified by the first hinge structure or the second hinge structure, and When the above instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, When the above multi-foldable electronic device changes to a designated folding state, it detects user input designating the first region and the second region, and A multi-foldable electronic device that determines the first region and the second region based on the above user input.

3. In Paragraph 1, The first region above includes at least a portion of the first display region and the second display region, and The second area above includes the third display area, and A multi-foldable electronic device that displays a control menu related to the interpretation service in at least a portion of the second display area.

4. In Paragraph 1, The above second display area is divided into a second-1 display area and a second-2 display area, and The first area above includes the first display area and the second-1 display area, and A multi-foldable electronic device wherein the second region includes the third display region and the second-2 display region.

5. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, The voice input obtained from the first user is converted into first text and displayed in the first area, and A multi-foldable electronic device that displays a second text translated from the first text shown above in a first area.

6. In paragraph 5, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, Displaying the conversation history between users expressed in the first language and the first text in the first area, Display the second text below the first text in the first area, and A multi-foldable electronic device that maintains the display of the first text and the second text in the first area until the next utterance is input from the first user or the second user.

7. In paragraph 5, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, Displaying the conversation history between users expressed in the second language and the second text in the second area, and Display the first text below the second text in the second area, and A multi-foldable electronic device that maintains the display of the first text and the second text in the second area until the next utterance is input from the first user or the second user.

8. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, While providing interpretation services through the first area and the second area respectively, detect a third user to participate in the interpretation service, and Identify the location of the third user using at least one camera, and Determining the direction of the display area to be provided to the third user based on the location of the third user, and A multi-foldable electronic device that displays third translation information to the third user based on the direction of the determined display area.

9. In Paragraph 8, A multi-foldable electronic device in which the third region providing the above-mentioned third translation information is a second display region disposed between the first folding axis and the second folding axis.

10. In paragraph 8, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, While displaying the above third translation information, an image is acquired from the above at least one camera, and If the third user is not detected in the acquired image for a specified period of time, the display of the third translation information is removed, and A multi-foldable electronic device that resets the first region and the second region.

11. A method of operation of a multi-foldable electronic device (101) comprising a housing including a first housing (315), a second housing (325) and a third housing (335), a first hinge structure (511) disposed between the first housing and the second housing so that the first housing and the second housing fold together, a second hinge structure (513) disposed between the second housing and the third housing so that the second housing and the third housing fold together, a first display area (310) disposed corresponding to the first housing, a second display area (320) disposed between the first hinge structure and the second hinge structure corresponding to the second housing, and a third display area (330) disposed corresponding to the third housing. An operation to identify the folding state of the multi-foldable electronic device while providing interpretation services; When the above multi-foldable electronic device is in a designated folding state, the operation of determining a first area of ​​the display to provide the interpretation service to a first user of the multi-foldable electronic device on the display; The operation of displaying first translation information translated into the first language of the first user in the first area; and A method comprising the operation of displaying second translation information translated into the second language of the second user in a second area of ​​the display to provide the interpretation service to the second user conversing with the first user.

12. In Paragraph 11, The above-mentioned designated folding state includes a state unfolded beyond an angle specified by the first hinge structure or the second hinge structure, and When the above multi-foldable electronic device changes to a designated folding state, an operation of detecting user input designating the first region and the second region; and A method including an operation to determine the first region and the second region based on the above user input.

13. In Paragraph 11, The first region above includes at least a portion of the first display region and the second display region, and The second area above includes the third display area, and A method in which a control menu related to the interpretation service is displayed in at least a portion of the second display area.

14. In Paragraph 11, The above second display area is divided into a second-1 display area and a second-2 display area, and The first area above includes the first display area and the second-1 display area, and A method in which the second region above includes the third display region and the second-2 display region.

15. In Clause 11, the operation displayed in the first area is, The operation of converting voice input obtained from the first user into first text and displaying it in the first area; and A method comprising the action of displaying a second text translated from the first text shown above in a first area.

Images