Electronic device and control method therefor

Abstract

An electronic device is disclosed. The electronic device comprises: an output unit; a memory for storing one or more instructions; and one or more processors operatively connected to the output unit and the memory, wherein the one or more processors, by executing the one or more instructions, control the output unit so as to output a screen containing a background area and a plurality of display areas when a multi-view mode is executed, and when a first display area is selected from among the plurality of display areas, control the output unit so as to expand the size of the selected first display area and provide an effect whereby the expanded first display area moves in the direction toward the front of the background area.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more particularly, to an electronic device for outputting an image and a method for controlling the same.

[0002] Advances in electronic technology have led to the development and proliferation of various types of electronic devices. In particular, electronic devices used in various settings, such as homes, offices, and public spaces, have been continuously evolving in recent years.

[0003] In particular, beam projectors are being used in a variety of settings, including offices, theaters, homes, and stores, and the market is continuously expanding. The increasing efficiency and power savings of LED light sources have led to a proliferation of diverse form factors for home / portable beam projectors, and the market is growing by 10-15% annually.

[0004] Additionally, with the recent increase in wired and wireless interface capabilities between beam projector devices and external devices, it has become possible to select and output various contents in real time from various locations via Wi-Fi and 5G networks.

[0005] An electronic device according to one or more embodiments includes: an output unit; a memory storing one or more instructions; and one or more processors operatively connected to the output unit and the memory, wherein the one or more processors, by executing the one or more instructions, control the output unit to output a screen including a background area and a plurality of display areas when a multi-view mode is executed, and control the output unit to provide an effect of enlarging the size of the selected first display area and moving the enlarged first display area toward the front of the background area when a first display area among the plurality of display areas is selected.

[0006] According to one or more embodiments, the one or more processors can control the output unit to provide an effect of reducing the size of a second display area that is not selected among the plurality of display areas and moving the reduced second display area toward the rear of the background area by executing the one or more commands.

[0007] According to one or more embodiments, the background area is an area having a sense of space, and the one or more processors can control the output unit to provide an effect in which, by executing the one or more commands, a floor area included in the background area is identified, and the enlarged first display area is moved in a front direction in the identified floor area, and the reduced second display area is moved in a rearward direction in the floor area.

[0008] According to one or more embodiments, the one or more processors may control the output unit to provide an animation effect in which the size of the selected first display area is gradually enlarged and gradually moved forward from the identified floor area, and the size of the unselected second display area is gradually reduced and gradually moved backward from the floor area, by executing the one or more commands.

[0009] According to one or more embodiments, the one or more processors may control the output unit to additionally output an edge area of ​​a background area that is not output when a zoom-out command for the background area is input by executing the one or more commands, thereby zooming out the background area and reducing the size of the plurality of display areas and outputting the zoom-out, and to control the output unit to zoom in on the background area when a zoom-in command for the background area is input so that an edge area of ​​the output background area is not output and to enlarge the size of the plurality of display areas and output the zoom-in.

[0010] According to one or more embodiments, the one or more processors can control the output unit so that, when a rotation command for the background area is input by executing the one or more commands, the output positions of the plurality of display areas are fixed and the background area is output in a rotated form.

[0011] According to one or more embodiments, the one or more processors can control the output unit so that, when a rotation command for the background area is input by executing the one or more commands, the background area is output in a rotated form and the plurality of display areas are output in a rotated form linked to the background area in the rotated form.

[0012] According to one or more embodiments, the present invention further includes a speaker; and the one or more processors can control the speaker to increase the audio volume of content provided in the first display area and output it when the size of the first display area is enlarged and output in a form that moves toward the front of the background area by executing the one or more commands.

[0013] According to one or more embodiments, the device further comprises a speaker; and the one or more processors can control the speaker and at least one external speaker so that, by executing the one or more commands, the size of the first display area is enlarged and output in a form that moves toward the front of the background area, and the audio of the content provided in the first display area is output close to the user, thereby providing a sound field sensation.

[0014] According to one or more embodiments, the output unit may include at least one of a display or an image projection unit.

[0015] A method of controlling an electronic device according to one or more embodiments includes: when a multi-view mode is executed, outputting a screen including a background area and a plurality of display areas; and when a first display area among the plurality of display areas is selected, enlarging the size of the selected first display area and providing an effect of the enlarged first display area moving in a front direction of the background area.

[0016] A non-transitory computer-readable medium storing computer instructions that, when executed by a processor of an electronic device according to one or more embodiments, cause the electronic device to perform an operation, the operation comprising: when a multi-view mode is executed, outputting a screen including a background area and a plurality of display areas; and when a first display area among the plurality of display areas is selected, enlarging the size of the selected first display area and providing an effect in which the enlarged first display area moves in a front direction of the background area.

[0017] The above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0018] FIG. 1 is a drawing for explaining an implementation example of an electronic device according to one or more embodiments.

[0019] FIG. 2A is a block diagram illustrating a configuration of an electronic device according to one or more embodiments.

[0020] FIG. 2b is a drawing for explaining a detailed configuration of an electronic device according to one or more embodiments.

[0021] FIG. 3 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0022] FIG. 4A is a diagram illustrating a method for providing a multi-view mode according to one or more embodiments.

[0023] FIG. 4b is a diagram illustrating a method for providing a multi-view mode according to one or more embodiments.

[0024] FIG. 4c is a diagram illustrating a method for providing a multi-view mode according to one or more embodiments.

[0025] FIG. 5 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0026] FIG. 6 is a drawing for explaining a method for providing a multi-view mode according to one or more embodiments.

[0027] FIG. 7 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0028] FIG. 8 is a drawing for explaining a method for providing a multi-view mode according to one or more embodiments.

[0029] FIG. 9 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0030] The terms used in this specification will be briefly explained, and the present disclosure will be described in detail.

[0031] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions or cases of those skilled in the art, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0032] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0033] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to cases where (1) only A is included, (2) only B is included, or (3) both A and B are included.

[0034] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0035] When it is said that a component (e.g., a first component) is “operatively or communicatively coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0036] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0037] In some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0038] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0039] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of "modules" or "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "module" or "part" that needs to be implemented as specific hardware.

[0040] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0041] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0042] FIG. 1 is a drawing for explaining an implementation example of an electronic device according to one or more embodiments.

[0043] An electronic device (100) according to one embodiment may have a function of projecting an image, i.e., a projector function. In particular, the electronic device (100) may be a projector device that projects an image onto a wall or a projection surface, and the projector device may be an LCD projector or a DLP (digital light processing) projector using a DMD (digital micromirror device).

[0044] In addition, the electronic device (100) may be implemented as a home or industrial display device, a lighting device used in daily life, an audio device including an audio module, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a wearable device, or a home appliance device. However, the electronic device (100) is not limited to the above-described devices, and the electronic device (100) may be implemented as an electronic device (100) having two or more functions of the above-described devices. For example, the electronic device (100) may be used as a display device, a lighting device, or an audio device by turning off the projector function and turning on the lighting function or the speaker function according to the operation of the processor, and may be used as an AI speaker including a microphone or a communication device.

[0045] According to FIG. 1, when a multi-view mode is executed while a general projection screen (10) is provided, a projection screen (20) including a plurality of display areas (21, 22) and a background area (23) can be provided.

[0046] For example, the multi-view mode may be a mode in which multiple content screens are provided simultaneously. For example, in the multi-view mode, in addition to multiple display areas (21, 22) for providing multiple contents, a background area (230) may be provided. For example, the background area may be provided with a preset theme image. The preset themes may include various types of themes, such as a nature theme, a city theme, a countryside theme, and a home space theme.

[0047] For example, when one of multiple display areas (21, 22) is selected in multi-view mode, various UX experiences can be provided to increase the user's concentration on the content provided in the selected display area.

[0048] Accordingly, below, various embodiments for increasing the user's concentration on selected content among multiple contents provided in multi-view mode will be described.

[0049] FIG. 2A is a block diagram illustrating a configuration of an electronic device according to one or more embodiments.

[0050] According to FIG. 2A, the electronic device (100) may include an output unit (110), a memory (120), and one or more processors (130). The electronic device (100) may be implemented as a projector that projects an image onto a wall, a projection surface, or a projection surface, or as various types of devices with an image projection function. However, the electronic device (100) is not limited thereto, and may also be implemented as a display device such as a TV.

[0051] According to FIG. 2a, the electronic device (100) may include an output unit (110), a memory (120), and one or more processors (140).

[0052] The output unit (110) may include at least one of an image projector or a display, depending on the implementation example of the electronic device (100). In one example, when the electronic device (100) is implemented as a projector, the output unit (110) may be implemented as an image projector. In another example, when the electronic device (100) is implemented as a TV, the output unit (110) may be implemented as a display. When the output unit (110) is implemented as a display, the display may be implemented as a display including a self-luminous element or a display including a non-luminous element and a backlight. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. For example, the display may be implemented as a flat display, a curved display, a foldable or / and rollable flexible display, etc.

[0053] For convenience of explanation, the following description assumes that the output unit (110) is implemented as an image projection unit.

[0054] The output unit (110) may perform a function of projecting light to the outside to express an image and outputting the image on a projection surface. Here, the projection surface may be part of the physical space where the image is output or a separate projection surface. The output unit (110) may include various detailed configurations such as a light source of at least one of a lamp, an LED, and a laser, a projection lens, and a reflector.

[0055] The output unit (110) can project an image using one of various projection methods (e.g., CRT (cathode-ray tube) method, LCD (Liquid Crystal Display) method, DLP (Digital Light Processing) method, laser method, etc.). The output unit (110) can include at least one light source.

[0056] The output unit (110) can output images in a 4:3 screen ratio, a 5:4 screen ratio, or a 16:9 wide screen ratio depending on the purpose of the electronic device (100) or the user's settings, and can output images in various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the screen ratio.

[0057] The output unit (110) can perform various functions for adjusting the projection image under the control of the processor (130). For example, the output unit (110) can perform a zoom in / out function, a lens shift function, etc. The zoom in / out function can include a hardware method for adjusting the screen size by moving the lens and a software method for adjusting the screen size by cropping the image, etc. Meanwhile, when the zoom in / out function is performed, it is necessary to adjust the focus of the image. For example, the method for adjusting the focus can include a manual focus method, an electric method, etc.

[0058] The output unit (110) can automatically analyze the surrounding environment and projection environment without user input to provide zoom / keystone / focus functions. Specifically, the output unit (110) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the projection surface, information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0059] The memory (120) can store data required for various embodiments. Depending on the purpose of data storage, the memory (120) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100). For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding the functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100). Meanwhile, in the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD). In addition, in the case of memory that can be attached or detached to the electronic device (100'), it may be implemented as at least one of memory cards (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. It can be implemented in the form of.

[0060] For example, the memory (120) can store various theme images for providing a background area in multi-view mode.

[0061] For example, the memory (120) can store various display area images for providing display areas in multi-view mode. For example, the display area images can include images identical to or similar to actual display product images. For example, the display area images can include various display product images, such as a stand TV image, a wall-mounted TV image, and a kiosk image.

[0062] One or more processors (130) control the overall operation of the electronic device (100). Specifically, one or more processors (130) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (130) may be operatively connected to the display (130) and the memory (120). The processor (130) may be composed of one or more processors.

[0063] One or more processors (130) may perform operations of the electronic device (100) according to various embodiments by executing at least one instruction stored in the memory (120).

[0064] The one or more processors (130) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (130) may control one or any combination of other components of the electronic device, and may perform operations related to communication or data processing. The one or more processors (130) may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in a memory.

[0065] When a method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0066] One or more processors (130) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (130) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure.

[0067] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0068] In the embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. Hereinafter, for the convenience of explanation, one or more processors (130) will be referred to as a processor (130).

[0069] According to one embodiment, when the multi-view mode is executed, the processor (130) can control the output unit (110) to output a screen including a background area and multiple display areas.

[0070] For example, the multi-view mode may be a mode in which multiple content screens are provided simultaneously. For example, in the multi-view mode, in addition to multiple display areas for providing multiple contents, a background area may be provided. For example, the background area may be provided with a preset theme image. The preset themes may include various types of themes, such as a nature theme, a city theme, a countryside theme, and a home space theme. For example, the background area may include an image that provides a sense of space. For example, the background area may be a 2D image but may include an image that provides a sense of space. However, in some cases, the background area may also include a 3D image. Even when the background area is a 3D image, the same / similar embodiments as when it is a 2D image may be applied.

[0071] For example, the display area may include images identical to or similar to actual display product images. For example, the display area may include various display product images, such as images of a stand TV, images of a wall-mounted TV, and images of a kiosk.

[0072] According to one embodiment, when a first display area among a plurality of display areas is selected, the processor (130) can control the output unit (110) to provide an effect of enlarging the size of the selected first display area and moving the enlarged first display area toward the front of the background area.

[0073] According to one embodiment, the processor (130) can control the output unit (110) to reduce the size of a second display area that is not selected among the plurality of display areas and provide an effect in which the reduced second display area moves toward the rear of the background area.

[0074] According to one embodiment, the processor (130) can identify a floor area included in a background area and control the output unit (110) to provide an effect in which an enlarged first display area is moved in a front direction in the identified floor area and a reduced second display area is moved in a rear direction in the floor area.

[0075] According to one embodiment, the processor (130) may control the output unit (110) to provide an animation effect in which the size of the selected first display area is gradually enlarged and gradually moved forward from the identified floor area, and the size of the unselected second display area is gradually reduced and gradually moved backward from the floor area.

[0076] According to one embodiment, when a zoom-out command for a background area is input, the processor (130) can control the output unit (110) to output the background area by additionally outputting the edge area of ​​the background area that is not output and to output the background area by zooming out and reducing the size of a plurality of display areas.

[0077] According to one embodiment, when a zoom-in command for a background area is input, the processor (130) can control the output unit (110) to zoom in and output the background area so that the edge area of ​​the output background area is not output and to enlarge the size of a plurality of display areas and output the zoom-in.

[0078] According to one embodiment, when a rotation command for a background area is input, the processor (130) can control the output unit (110) so that the output positions of the plurality of display areas are fixed and the background area is output in a rotated form.

[0079] According to one embodiment, when a rotation command for a background area is input, the processor (130) can control the output unit (110) so that the background area is output in a rotated form and a plurality of display areas are output in a rotated form linked to the background area in a rotated form.

[0080] FIG. 2b is a drawing for explaining a detailed configuration of an electronic device according to one or more embodiments.

[0081] According to FIG. 2b, the electronic device (100') includes an output unit (110), a memory (120), one or more processors (130), a communication interface (140), a user interface (150), a sensor (160), a camera (170), a speaker (180), and a power supply unit (190). Among the configurations illustrated in FIG. 2b, a detailed description of configurations that overlap with those illustrated in FIG. 2a will be omitted.

[0082] The communication interface (140) includes a circuit and can communicate with an external device (server or user terminal). For example, the processor (130) can receive various data or information from an external device connected via the communication interface (140) and can also transmit various data or information to the external device.

[0083] The communication interface (140) may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and a UWB module (Ultra Wide Band). At this time, the wireless communication module may perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), etc.

[0084] In addition, the communication interface (140) may perform communication according to a communication method such as Ethernet, IEEE 1394, HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), MHL (Mobile High-Definition Link), AES / EBU (Audio Engineering Society / European Broadcasting Union), optical, coaxial, etc., depending on the implementation example of the electronic device (100').

[0085] The user interface (150) may be implemented by devices such as buttons, touch pads, mice, and keyboards, or may be implemented by a touch projection surface, a remote control transmitter / receiver, etc. that can also perform the above-described display function and operation input function. The remote control transmitter / receiver may receive a remote control signal from an external remote control device or transmit a remote control signal through at least one of infrared communication, Bluetooth communication, and Wi-Fi communication.

[0086] The sensor (160) may include various types of sensors such as a distance sensor, a light sensor, an image sensor, a touch sensor, a proximity sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, a pressure sensor, a position sensor, etc.

[0087] The camera (170) can be turned on and take pictures according to a preset event. The camera (170) can convert the captured image into an electrical signal and generate image data based on the converted signal. For example, the subject can be converted into an electrical image signal through a semiconductor optical element (CCD; Charge Coupled Device), and the converted image signal can be amplified and converted into a digital signal and then signal processed.

[0088] According to one embodiment, the processor (130) can identify a user's gesture, gaze, etc. based on a captured image acquired through a camera (170), and can identify whether a user command is input based on the identified gesture, gaze, etc.

[0089] According to one embodiment, the processor (130) may identify the user's location based on the captured image acquired through the camera (170) and provide an effect of rotating the screen in a direction corresponding to the user's location. For example, the screen rotation effect may be provided in the same manner as illustrated in FIG. 8.

[0090] The speaker (180) can output audio signals. In one example, the speaker (180) may include multiple speaker units (or amplifiers) capable of outputting multi-channels. For example, the speaker (180) may include an L channel speaker and an R channel speaker that respectively reproduce the L channel and the R channel.

[0091] According to one embodiment, the processor (130) may control the speaker (180) to increase the audio volume of content provided to the first display area and output it when the size of the first display area is enlarged and output in a form that moves toward the front of the background area.

[0092] According to one embodiment, the processor (130) may control the speaker (180) and at least one external speaker so that when the size of the first display area is enlarged and output in a form that moves toward the front of the background area, the audio of the content provided in the first display area is output close to the user, thereby providing a sound field sensation.

[0093] The power supply unit (190) can receive power from an external source and supply power to various components of the electronic device (100). As an example, the power supply unit (190) can receive power using a connector. For example, the power supply unit (190) can receive power using a 220V DC power cord. However, the present invention is not limited thereto, and the electronic device (100) can receive power using a USB power cord or a wireless charging method.

[0094] The power supply unit (190) can be powered by an internal battery or an external battery. For example, the power supply unit (190) can charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and can be powered by the charged internal battery. For example, the power supply unit (190) can be powered by the external battery when the electronic device (100) is connected to the external battery through various wired communication methods such as a USB power cord, a USB C-Type power cord, a socket home, etc. For example, the power supply unit (190) can be powered directly from the external battery, or can charge the internal battery through the external battery and be powered by the charged internal battery.

[0095] In addition, the electronic device (100') may include a microphone or the like, depending on the implementation example. The microphone is configured to receive user voice or other sounds and convert them into audio data. However, according to another embodiment, the electronic device (100') may receive user voice input via an external device through the communication interface (140).

[0096] FIG. 3 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0097] According to FIG. 3, in operation 310, when the multi-view mode is executed, the electronic device (100) can output a screen including a background area and multiple display areas.

[0098] For example, the multiview mode may be executed (or entered) based on a user command selecting the multiview mode or a preset event. For example, the user command may be received via at least one of a remote control signal, voice input, gesture input, or eye tracking. For example, the preset event may include various events for providing a multiview screen, such as an event in which multiple contents are selected or an event in which additional contents are selected during the playback of a specific content.

[0099] In operation 320, when a first display area among a plurality of display areas is selected (S320:Y), the electronic device (100) can provide an effect of enlarging the size of the selected first display area and moving the enlarged first display area toward the front of the background area in operation 330. In this case,

[0100] In operation 340, the electronic device (100) can reduce the size of a second display area that is not selected among the plurality of display areas and provide an effect in which the reduced second display area moves toward the rear of the background area.

[0101] According to the above-described embodiment, the first display area selected by the user is provided with an effect of coming closer to the user's view, and the second display area and background area not selected by the user are provided with an effect of coming further away from the user's view, thereby improving the user's concentration on the content provided in the first display area.

[0102] Meanwhile, in Fig. 3, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0103] FIGS. 4A, 4B, and 4C are drawings for explaining a method for providing a multi-view mode according to one or more embodiments.

[0104] FIG. 4A is a diagram showing a screen provided in multi-view mode according to one embodiment.

[0105] According to FIG. 4a, when the multi-view mode is executed, the electronic device (100) can provide a screen (410) including multiple display areas (411, 412) and a background area (413).

[0106] For example, the plurality of display areas (411, 412) may be provided based on actual display product images, as shown in FIG. 4A, as areas displaying different content. For example, the first display area (411) may be provided as a stand TV image, and the second display area (412) may be provided as a kiosk image. For example, the plurality of display areas (411, 412) may be provided in a PIP (Picture In Picture) format, but the present invention is not limited thereto.

[0107] For example, the background area (413) may be provided as an image that provides a sense of space. For example, space may be a three-dimensional area as one of the basic design elements, and the sense of space may be a sense that allows one to feel space on a plane. For example, the background area (413) may be a two-dimensional image, but may be provided as an image that provides a three-dimensional sense of space. For example, the background area (413) may be an image that includes a floor area, a wall area, and a ceiling area, but is not limited thereto.

[0108] In one example, the background area (413) may be manually selected based on a user command. In another example, the background area (413) may be automatically selected based on user usage history, user profile, user preference information, content type selected in the display area (411, 412), etc.

[0109] According to one example, the electronic device (100) may provide a plurality of display areas (411, 412) at positions with a preset ratio in the width of the floor area (or floor surface) of the space included in the background area. For example, the electronic device (100) may provide a plurality of display areas (411, 412) at positions of 50% to 70% of the width of the floor area. For example, when the multi-view mode is first executed, the plurality of display areas (411, 412) may be provided side by side at the same position based on the width of the floor area.

[0110] For example, the UI images, sizes, etc. of multiple display areas (411, 412) may be preset. However, they may be changed according to user commands, the context of the electronic device (100), etc. For example, the context of the electronic device (100) may include the current time, weather, selected content, number of users, user location, etc.

[0111] According to one embodiment, when a first display area (411) is selected from among multiple display areas (411, 412), a UX experience for enhancing focus on the first display area (411) may be provided.

[0112] For example, as illustrated in FIG. 4B, after the first display area (411) is selected, an effect may be provided in which the first display area (411) is enlarged and the enlarged first display area (421) moves forward from the bottom area, for example. For example, an effect may be provided in which the size of the first display area (411) is enlarged by about 1.2 to 2 times and then moves closer to the user. For example, the electronic device (100) may gradually enlarge the size of the selected first display area (411) until it becomes 1.2 to 2 times and provide an effect in which the first display area (411) gradually moves closer to the user.

[0113] For example, as illustrated in FIG. 4B, an effect may be provided in which the unselected second display area (412) is reduced and moved backward from the bottom area of ​​the reduced second display area (422). For example, an effect may be provided in which the size of the first display area (411) is reduced by about 0.5 to 0.8 times and then moved away from the user's direction. For example, the electronic device (100) may gradually reduce the size of the selected first display area (411) until it becomes about 0.5 to 0.8 times and provide an effect in which it gradually moves away from the user's direction.

[0114] For example, as shown in FIG. 4b, the background area (423) may be additionally displayed to provide an effect of deepening the sense of space in the front.

[0115] According to one embodiment, when a second display area (421) is selected from among multiple display areas (411, 412), a UX experience for enhancing focus on the second display area (421) may be provided.

[0116] For example, as shown in FIG. 4c, when the second display area (412) is selected, an effect may be provided in which the second display area (412) is enlarged and the enlarged second display area (432) moves in the front direction from the bottom area on the screen (430) provided.

[0117] As an example, as shown in FIG. 4c, an unselected first display area (411) may be reduced and the reduced second display area (431) may be provided with an effect of moving in a rearward direction from the bottom area.

[0118] For example, as shown in FIG. 4c, the background area (433) of the front that is not displayed may be additionally displayed, providing an effect of deepening the sense of space in the front.

[0119] FIG. 5 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0120] According to FIG. 5, in operation 510, when the multi-view mode is executed, the electronic device (100) can output a screen including a background area and multiple display areas.

[0121] In operation 520, when a zoom out command for a background area is input (S520:Y), in operation 530, the electronic device (100) can output an edge area of ​​a background area that is not outputted to zoom out the background area and reduce the size of multiple display areas to output a zoom out.

[0122] In operation 540, when a zoom-in command for a background area is input (S540:Y), in operation 550, the electronic device (100) can output the background area by zooming in so that the edge area of ​​the output background area is not output and enlarge the size of multiple display areas to output the zoom-in.

[0123]

[0124] *Meanwhile, in Fig. 5, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0125] FIG. 6 is a drawing for explaining a method for providing a multi-view mode according to one or more embodiments.

[0126] According to FIG. 6, when the multi-view mode is executed, the electronic device (100) can provide a screen (610) including multiple display areas (611, 612) and a background area (613) as shown on the left.

[0127] For example, when a zoom-out command for a background area is input, the electronic device (100) can scale down the screen and output it. For example, the electronic device (100) can output the background area zoomed out (623) by additionally outputting the edge area of ​​the background area that is not output, as shown in the screen (620) in the upper right, and can zoom out output (621, 622) by reducing the size of multiple display areas. For example, the memory (120) stores the entire image for the background area, and among the entire stored images, an additional image other than the image currently provided on the screen can be additionally output to the edge area of ​​the background area. In this case, the electronic device (100) can output the currently provided image by reducing it according to the scale-down ratio and additionally output a new image to the edge area, while maintaining the size of the entire projection image.

[0128] For example, when a zoom-in command for a background area is input, the electronic device (100) may scale up the screen and output it. For example, the electronic device (100) may zoom in and output (633) the background area so that the edge area of ​​the output background area is not output, as shown in the screen (630) in the lower right, and may enlarge the size of multiple display areas and output (631, 632) the zoom in. For example, the electronic device (100) may enlarge and output the currently output image according to the scale-up ratio, while not outputting the edge area so that the size of the entire projection image is maintained.

[0129] FIG. 7 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0130] According to FIG. 7, in operation 710, when the multi-view mode is executed, the electronic device (100) can output a screen including a background area and multiple display areas.

[0131] In operation 720, when a rotation command for the background area is input (S720:Y), in operation 730, the electronic device (100) can output the screen in a form where the output positions of the plurality of display areas are fixed and the background area is rotated, or the background area is output in a rotated form and the plurality of display areas are rotated and linked to the background area in a rotated form.

[0132] Meanwhile, in Fig. 7, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0133] FIG. 8 is a drawing for explaining a method for providing a multi-view mode according to one or more embodiments.

[0134] According to FIG. 8, when the multi-view mode is executed, the electronic device (100) can provide a screen (810) including multiple display areas (811, 812) and a background area (813) as shown on the left.

[0135] For example, when a rotation command for a background area is input, the electronic device (100) can output the screen (820) in a form where the output positions of multiple display areas (821, 822) are fixed and the background area (823) is rotated, as shown in the screen (820) shown in the upper right.

[0136] In one example, the rotation command may be received via at least one of a remote control signal, a voice input, or a gesture input.

[0137] In another example, rotation of the background area may be performed automatically based on user location recognition, eye tracking, etc. For example, the electronic device (100) may identify the user location or the user's gaze based on at least one of object recognition, object detection, object tracking, or image segmentation. For example, the electronic device (100) may identify the user location or the user's gaze using techniques such as semantic segmentation, which classifies and extracts objects included in a captured image by type as needed, instance segmentation, which recognizes objects by classifying them by object even if they are of the same type, and a bounding box in the shape of a rectangle containing the detected object when detecting an object included in an image.

[0138] For example, when a rotation command for a background area is input, the electronic device (100) may output the background area (833) in a rotated form, as shown in the screen (830) on the lower right side, and output the screen (830) in a rotated form linked to the background area in a rotated form with multiple display areas (831, 832).

[0139] In one example, the rotation angle and / or rotation shape may be determined based on a user command, a user position, a user gaze position, etc. For example, the electronic device (100) may provide a UI for setting a rotation angle, and may rotate the background area and / or the display area based on the rotation angle input through the UI. Alternatively, the electronic device (100) may rotate the background area and / or the display area based on a rotation angle input by a user voice.

[0140] FIG. 9 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0141] According to FIG. 9, in operation 910, when the multi-view mode is executed, the electronic device (100) can output a screen including a background area and multiple display areas.

[0142] In operation 920, when a first display area among a plurality of display areas is selected (S920:Y), in operation 930, the electronic device (100) can provide an effect of enlarging the size of the selected first display area and moving the enlarged first display area toward the front of the background area.

[0143] In operation 940, the electronic device (100) may control the speaker and at least one external speaker to increase the audio volume of the content provided in the first display area or to provide a sound field (or spatial sense) in which the audio of the content provided in the first display area is output close to the user.

[0144] For example, when rendering audio signals to be output to multiple speaker units (including at least one of internal speakers and external speakers), the electronic device (100) may render audio of content provided in the first display area so as to provide a sound field effect in which the audio is output close to the user. Thereafter, the electronic device (100) may transmit a corresponding audio signal to an external speaker device to provide a sound field effect, if necessary.

[0145] Meanwhile, in Fig. 9, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0146] According to the various embodiments described above, in a multi-view screen, not only is the size of the displayed content changed according to the user's content selection, but also the non-selected content is moved away from the user's line of sight along with a theme screen with a sense of space, thereby improving the user's concentration on the content on the selected screen.

[0147] Meanwhile, the methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0148] Additionally, the various embodiments of the present disclosure described above can also be performed through an embedded server provided in an electronic device, or an external server of the electronic device.

[0149] Meanwhile, according to a temporary example of the present disclosure, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call instructions stored from the storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0150] Furthermore, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0151] In addition, each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the corresponding sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the corresponding components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0152] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, Output section; A memory that stores one or more instructions; and comprising one or more processors operatively connected to the output unit and the memory; The one or more processors, by executing the one or more instructions, When the multi-view mode is executed, the output unit is controlled to output a screen including a background area and multiple display areas, An electronic device that controls the output unit to provide an effect in which, when a first display area among the plurality of display areas is selected, the size of the selected first display area is enlarged and the enlarged first display area moves toward the front of the background area.

2. In paragraph 1, The one or more processors, by executing the one or more instructions, An electronic device that controls the output unit to provide an effect of reducing the size of a second display area that is not selected among the plurality of display areas and moving the reduced second display area toward the rear of the background area.

3. In paragraph 2, The above background area is an area that has a sense of space. The one or more processors, by executing the one or more instructions, Identify the floor area included in the above background area, An electronic device that controls the output unit to provide an effect in which the enlarged first display area moves forward from the identified floor area, and the reduced second display area moves backward from the floor area.

4. In paragraph 3, The one or more processors, by executing the one or more instructions, An electronic device that controls the output unit so as to provide an animation effect in which the size of the selected first display area is gradually enlarged and gradually moved toward the front from the identified floor area, and the size of the unselected second display area is gradually reduced and gradually moved toward the rear from the floor area.

5. In paragraph 1, The one or more processors, by executing the one or more instructions, When a zoom out command for the above background area is input, the output unit is controlled to output the background area by additionally outputting the edge area of ​​the background area that is not output and to zoom out the background area and to reduce the size of the plurality of display areas and output the zoom out. An electronic device that controls the output unit to zoom in and output the background area so that the edge area of ​​the output background area is not output and to enlarge and output the size of the plurality of display areas when a zoom-in command for the background area is input.

6. In paragraph 1, The one or more processors, by executing the one or more instructions, An electronic device that controls the output unit so that when a rotation command for the background area is input, the output positions of the plurality of display areas are fixed and the background area is output in a rotated form.

7. In paragraph 1, The one or more processors, by executing the one or more instructions, An electronic device that controls the output unit so that when a rotation command for the background area is input, the background area is output in a rotated form and the plurality of display areas are output in a rotated form linked to the background area in the rotated form.

8. In paragraph 1, Speaker; including more; The one or more processors, by executing the one or more instructions, An electronic device that controls the speaker to increase the audio volume of content provided to the first display area and output it when the size of the first display area is enlarged and output in a form that moves toward the front of the background area.

9. In paragraph 1, Speaker; including more; The one or more processors, by executing the one or more instructions, An electronic device that controls the speaker and at least one external speaker so that when the size of the first display area is enlarged and output in a form moved toward the front of the background area, the audio of the content provided in the first display area is output close to the user, thereby providing a sound field sensation.

10. In paragraph 1, The above output section, An electronic device comprising at least one display or image projection unit.

11. In a method for controlling an electronic device, When the multi-view mode is executed, a step of outputting a screen including a background area and multiple display areas; and A control method comprising: a step of, when a first display area among the plurality of display areas is selected, enlarging the size of the selected first display area and providing an effect of the enlarged first display area moving toward the front of the background area; 12. In paragraph 11, The step of providing the effect of moving toward the front of the above background area is: A control method comprising: a step of reducing the size of a second display area that is not selected among the plurality of display areas and providing an effect in which the reduced second display area moves toward the rear of the background area.

13. In paragraph 12, The above background area is an area that has a sense of space. The step of providing the effect of moving toward the front of the above background area is: a step of identifying a floor area included in the above background area; and A control method comprising: a step of providing an effect in which the enlarged first display area is moved in a front direction from the identified floor area, and the reduced second display area is moved in a rearward direction from the floor area.

14. In paragraph 13, The step of providing the effect of moving toward the front of the above background area is: A control method comprising: a step of providing an animation effect in which the size of the selected first display area is gradually enlarged and gradually moved toward the front from the identified floor area, and the size of the unselected second display area is gradually reduced and gradually moved toward the rear from the floor area.

15. A non-transitory computer-readable medium storing computer instructions that, when executed by a processor of an electronic device, cause the electronic device to perform an operation, The above actions are, When the multi-view mode is executed, a step of outputting a screen including a background area and multiple display areas; and A non-transitory computer-readable medium comprising: a step of, when a first display area among the plurality of display areas is selected, enlarging the size of the selected first display area and providing an effect of the enlarged first display area moving toward the front of the background area;

Images