Method for providing image of 3D space and electronic device therefor

Abstract

A method may be disclosed, the method comprising the steps of: acquiring a camera setting value for fitting a 3D space including an image indicator for controlling a device to a screen of an electronic device; determining a density-independent pixel (DP) value of the image indicator, the DP value corresponding to the size of the image indicator to be displayed on the screen; acquiring a magnification for enlarging or reducing the 3D space on the basis of the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and a DP value of the electronic device; adjusting the camera setting value on the basis of the magnification for enlarging or reducing the 3D space; and displaying, on the screen of the electronic device, an image of the 3D space enlarged or reduced by applying the adjusted camera setting value.

Description

Method for providing an image of a 3D space and an electronic device therefor

[0001] One embodiment of the present disclosure relates to a method for providing an image of a 3D space and an electronic device therefor.

[0002] The Internet of Things (IoT) refers to intelligent services that connect all objects to the Internet, enabling interaction between people and those objects. IoT devices refer to various devices connected to the Internet using IoT technology. For example, IoT devices can include networked home appliances.

[0003] As IoT devices proliferate in the spaces where users live (e.g., homes), technologies that visualize the experiences users have with these devices within their living spaces may become necessary. For example, applying emerging immersive experience technologies, such as hyperconnected and digital twins, to user spaces can provide users with novel experiences with IoT devices within their living spaces.

[0004] A method for an electronic device to provide an image of a 3D space according to one embodiment of the present disclosure may include: obtaining a setting value of a camera for fitting a 3D space including an image indicator for controlling an IoT device to a screen of the electronic device; determining a DP (Density-independent pixel) value of the image indicator corresponding to a size at which the image indicator should be displayed on the screen; obtaining a magnification for enlarging or reducing the 3D space based on the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and the DP value of the electronic device; adjusting a setting value of the camera based on the magnification for enlarging or reducing the 3D space; and displaying an image of the 3D space that has been enlarged or reduced on the screen of the electronic device by applying the adjusted setting value of the camera.

[0005] An electronic device providing an image of a 3D space according to one embodiment of the present disclosure may include a memory storing one or more instructions; and at least one processor. The at least one processor may obtain a setting value of a camera for fitting a 3D space including an image indicator for controlling an IoT device to a screen of the electronic device by executing the one or more instructions. The at least one processor may determine a DP value of the image indicator corresponding to a size at which the image indicator should be displayed on the screen. The at least one processor may obtain a magnification for enlarging or reducing the 3D space based on the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and the DP value of the electronic device. The at least one processor may adjust a setting value of a camera based on the magnification for enlarging or reducing the 3D space. The at least one processor may display an image of the 3D space that has been enlarged or reduced on the screen of the electronic device by applying the adjusted setting value of the camera.

[0006] A computer-readable recording medium according to one embodiment of the present disclosure may store a program for executing a method on a computer, the method including: obtaining a setting value of a camera for fitting a 3D space including an image indicator for controlling an IoT device to a screen of an electronic device; determining a DP (Density-independent pixel) value of an image indicator corresponding to a size at which the image indicator should be displayed on the screen; obtaining a magnification for enlarging or reducing the 3D space based on the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and the DP value of the electronic device; adjusting a setting value of a camera based on the magnification for enlarging or reducing the 3D space; and applying the adjusted setting value of the camera to display an image of the 3D space that has been enlarged or reduced on the screen of the electronic device.

[0007] FIG. 1 is a drawing for explaining a system for providing an image of a 3D space according to one embodiment of the present disclosure.

[0008] FIG. 2 is a drawing for explaining an operation of an electronic device according to one embodiment of the present disclosure to display an image of a 3D space by fitting the 3D space to a screen.

[0009] FIG. 3 is a flowchart illustrating a method for an electronic device according to one embodiment of the present disclosure to provide an image of a 3D space based on a DP value.

[0010] FIG. 4 is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to determine a screen display size of a representative electronic device and an image indicator.

[0011] FIG. 5 is a drawing for explaining an operation of obtaining a magnification for enlarging or reducing a 3D space according to one embodiment of the present disclosure.

[0012] FIG. 6 is a flowchart illustrating a method for an electronic device to select a representative indicator according to an embodiment of the present disclosure.

[0013] FIG. 7 is a diagram for explaining an operation of an electronic device selecting a representative indicator according to one embodiment of the present disclosure.

[0014] FIG. 8 is a flowchart illustrating a method for an electronic device according to one embodiment of the present disclosure to provide an image of a 3D space based on an inch value.

[0015] FIG. 9 is a diagram for explaining an operation for determining a magnification ratio in each of various electronic devices according to one embodiment of the present disclosure.

[0016] FIG. 10 is a drawing for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide images of 3D spaces of different sizes.

[0017] FIG. 11A is a diagram for explaining an operation of providing an image of 3D space in electronic devices with different display sizes according to one embodiment of the present disclosure.

[0018] FIG. 11b is a drawing for explaining an operation of providing an image of a 3D space in an electronic device (1000) including a foldable display according to one embodiment of the present disclosure.

[0019] FIG. 12 is a flowchart illustrating a method for an electronic device according to one embodiment of the present disclosure to reduce or enlarge the size ratio of an image indicator in 3D space.

[0020] FIG. 13 is a drawing for explaining an operation of an electronic device according to one embodiment of the present disclosure to enlarge the size ratio of an image indicator in 3D space.

[0021] FIG. 14 is a drawing for explaining an operation of an electronic device according to one embodiment of the present disclosure to reduce the size ratio of an image indicator in 3D space.

[0022] FIG. 15 is a flowchart illustrating a method for an electronic device according to one embodiment of the present disclosure to display a UI component (User Interface component) for controlling an IoT device.

[0023] FIG. 16A is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to display an image of a 3D space.

[0024] FIG. 16b is a diagram for explaining an operation of an electronic device displaying a UI component for controlling an IoT device according to an embodiment of the present disclosure.

[0025] FIG. 16c is a diagram for explaining an operation of an electronic device according to one embodiment of the present disclosure to provide status information of an IoT device.

[0026] FIG. 17 is a block diagram illustrating the function of an electronic device according to one embodiment of the present disclosure.

[0027] The terms used in this disclosure will be briefly explained, and one embodiment of the present disclosure will be specifically described.

[0028] The terms used in this disclosure are selected from widely used, current terms, taking into account the functions of one embodiment of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments of the disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the disclosure.

[0029] In this disclosure, the expression “at least one of a, b or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “all of a, b and c”, or variations thereof.

[0030] Throughout this disclosure, when a part is said to "include" a certain component, this does not mean that other components are excluded, but rather that other components may be included, unless otherwise specifically stated. Furthermore, terms such as "part," "module," etc., used in this disclosure refer to a unit that processes at least one function or operation, and "part" and "module" may be implemented as hardware or software, or as a combination of hardware and software.

[0031] It should be understood that the blocks and combinations of flowcharts in each flowchart can be executed by one or more computer programs containing computer-executable instructions. The one or more computer programs may be stored entirely in a single memory, or may be stored in separate portions across multiple different memories.

[0032] Unless the context clearly dictates otherwise, singular forms (e.g., "a," "an," and "the") are to be understood to include plural referents. Thus, for example, the description "a component surface" may also include reference to one or more of such surfaces.

[0033] All functions or operations described in this document may be performed by a single processor or a combination of processors. A single processor or a combination of processors is a circuitry that performs processing, and may include circuitry such as an Application Processor (AP), a Communication Processor (CP), a Graphical Processing Unit (GPU), a Neural Processing Unit (NPU), a Microprocessor Unit (MPU), a System on Chip (SoC), or an Integrated Chip (IC).

[0034] Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, one embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly describe one embodiment of the present disclosure, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.

[0035] FIG. 1 is a drawing for explaining a system for providing an image (100) of a 3D space according to one embodiment of the present disclosure.

[0036] As illustrated in FIG. 1, a system for providing an image (100) of a 3D space may include, but is not limited to, an electronic device (1000), a server (2000), and an IoT device (3000). However, not all of the components illustrated in FIG. 1 are essential components. A system for providing an image (100) of a 3D space may be implemented with more components than those illustrated in FIG. 1, or may be implemented with fewer components. For example, a system for providing an image (100) of a 3D space may be implemented with an electronic device (1000) and an IoT device (3000). In addition, a system for providing an image (100) of a 3D space may be implemented by further including an edge computing device or a smart hub (smart dongle) in addition to the electronic device (1000), the server (2000), and the IoT device (3000). The smart hub can connect IoT devices (3000) that support Zigbee, Z-Wave, Thread, and Matter communications to a server (2000). Each configuration will be examined below.

[0037] The IoT device (3000) may include, but is not limited to, a communication interface capable of communicating with an electronic device (1000) or a server (2000), a user interface for receiving user input or outputting information to a user, at least one processor for controlling the operation of the IoT device (3000), and at least one memory in which a program for controlling the operation of the IoT device (3000) is stored.

[0038] The IoT device (3000) may be at least one of various types of home appliances. For example, the IoT device (3000) may include, but is not limited to, at least one of a refrigerator, a dishwasher, an electric range, an electric oven, an air conditioner, a clothes manager, a washing machine, a dryer, and a microwave oven. The IoT device (3000) may include various types of home appliances, such as a robot cleaner, a vacuum cleaner, and a television. In addition, the home appliances mentioned above are merely examples, and in addition to the home appliances mentioned above, a device that is connected to an electronic device (1000) or a server (2000) and can perform the operations described below may be included in the IoT device (3000) according to an embodiment of the present disclosure.

[0039] According to one embodiment of the present disclosure, the IoT device (3000) may be connected to the electronic device (1000) or the server (2000) through an access point (AP), or may be directly connected to the electronic device (1000) or the server (2000) without going through the access point (AP). The access point (AP) may connect the IoT device (3000) or the electronic device (1000) to a wide area network (WAN) to which the server (2000) is connected. The IoT device (3000) or the electronic device (1000) may be connected to the server (2000) through the wide area network (WAN). The access point (AP) can communicate with an IoT device (3000) or electronic device (1000) using wireless communication such as Wi-Fi (IEEE 802.11), Bluetooth (IEEE 802.15.1), or Zigbee (IEEE 802.15.4), and can connect to a wide area network (WAN) using wired communication, but is not limited thereto.

[0040] The IoT device (3000) can be connected to the electronic device (1000) or the server (2000) via a long-range wireless network or a short-range wireless network. For example, the IoT device (3000) can be connected to the electronic device (1000) via a short-range wireless network (e.g., Wi-Fi Direct). In addition, the IoT device (3000) can be connected to the electronic device (1000) or the server (2000) via a wide area network (WAN) using a long-range wireless network (e.g., a cellular communication module). In addition, the IoT device (3000) can access the wide area network (WAN) using wired communication and be connected to the electronic device (1000) or the server (2000) via the wide area network (WAN).

[0041] If the IoT device (3000) can connect to a wide area network (WAN) using wired communication, it may also function as an access relay. Accordingly, the IoT device (3000) can connect other IoT devices to the wide area network (WAN) to which the server (2000) is connected. In addition, other IoT devices can connect the IoT device (3000) to the wide area network (WAN) to which the server (2000) is connected.

[0042] An IoT device (3000) can transmit information about its operation or status to another IoT device, an electronic device (1000), or a server (2000) via a network. For example, the IoT device (3000) can transmit information about its operation or status to the electronic device (1000) or the server (2000) when a request is received from the server (2000), when a specific event occurs in the IoT device (3000), or periodically or in real time. When information about its operation or status is received from the IoT device (3000), the server (2000) can update the information about the operation or status of the IoT device (3000) that has been stored therein, and transmit the updated information about the operation and status of the IoT device (3000) to the electronic device (1000) via a network. Here, updating information can include various operations that change existing information, such as an operation of adding new information to existing information or an operation of replacing existing information with new information.

[0043] The IoT device (3000) can obtain various information from other IoT devices, electronic devices (1000), or servers (2000), and provide the obtained information to a user. For example, the IoT device (3000) can obtain information related to the function of the IoT device (3000) (e.g., recipes, laundry instructions, etc.) and various environmental information (e.g., weather, temperature, humidity, etc.) from the server (2000), and output the obtained information through a user interface.

[0044] The IoT device (3000) can operate according to a control command received from another IoT device, an electronic device (1000), or a server (2000). For example, if the IoT device (3000) has obtained prior approval from a user to operate according to a control command from the server (2000) even without user input, the IoT device (3000) can operate according to a control command received from the server (2000). Here, the control command received from the server (2000) may include, but is not limited to, a control command input by the user through the electronic device (1000) or a control command based on preset conditions.

[0045] The server (2000) may include a communication interface capable of communicating with another server, an electronic device (1000), or an IoT device (3000), at least one processor capable of processing data received from another server, an electronic device (1000), or an IoT device (3000), and at least one memory capable of storing a program for processing data or processed data. The server (2000) may be implemented as various computing devices such as a workstation, a cloud, a data drive, or a data station. The server (2000) may be implemented as one or more servers that are physically or logically separated based on function, detailed configuration of function, or data, and may transmit and receive data and process the transmitted and received data through communication between each server.

[0046] The server (2000) can perform functions such as managing user accounts, registering IoT devices (3000) by linking them to user accounts, and managing or controlling registered IoT devices (3000). For example, a user can access the server (2000) through an electronic device (1000) and create a user account. The user account can be identified by an ID and password set by the user. The server (2000) can register the IoT device (3000) to the user account according to a set procedure. For example, the server (2000) can link identification information (e.g., serial number or MAC address) of the IoT device (3000) to the user account to register, manage, and control the IoT device (3000).

[0047] The server (2000) may determine a control command using technologies such as artificial intelligence. For example, the server (2000) may receive information regarding the operation or status of an IoT device (3000) or information regarding the user of an electronic device (1000), process the information using technologies such as artificial intelligence, and transmit the processing result or control command to the IoT device (3000) or the electronic device (1000) based on the processing result.

[0048] The electronic device (1000) may be at least one of various devices owned by the user. That is, the user may own various types of electronic devices (1000) with different resolutions, display sizes, etc. The electronic device (1000) may be carried by the user or placed in the user's home or office.

[0049] The electronic device (1000) may include, but is not limited to, for example, a portable telephone, a smart phone, a laptop computer, a tablet PC, a wall pad, an e-book terminal, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, a digital camera, etc. The electronic device (1000) may be a device that can be worn by a user (wearable device). The wearable device may include, but is not limited to, at least one of an accessory type device (e.g., a watch, a ring, an wrist band, an ankle band, a necklace, glasses, a contact lens), a head-mounted device (HMD), a fabric or clothing-integrated device (e.g., electronic clothing), a body-attached device (e.g., a skin pad), or a bio-implantable device (e.g., an implantable circuit). The electronic device (1000) may be a home appliance including a display. For example, the electronic device (1000) may include, but is not limited to, a TV, a refrigerator, etc.

[0050] The electronic device (1000) may include, but is not limited to, a communication interface capable of communicating with an IoT device (3000) or a server (2000), a user interface for receiving user input or outputting information to a user, at least one processor for controlling the operation of the electronic device (1000), and at least one memory for storing a program for controlling the operation of the electronic device (1000).

[0051] The memory of the electronic device (1000) may store a program for controlling the IoT device (3000), i.e., an application. The application may be sold installed in the electronic device (1000) or downloaded and installed from an external server.

[0052] A user can access a server (2000) by executing an application installed on an electronic device (1000), create a user account, and register an IoT device (3000) by communicating with the server (2000) based on the logged-in user account.

[0053] For example, when the IoT device (3000) is operated so that the IoT device (3000) can be connected to the server (2000) according to the procedure guided by the application installed on the electronic device (1000), the IoT device (3000) can be registered in the user account by registering the identification information (e.g., serial number or MAC address) of the IoT device (3000) in the corresponding user account on the server (2000).

[0054] An electronic device (1000) according to one embodiment of the present disclosure may be a user terminal that provides a user with an image (100) of a 3D space. The 3D space may be a space set by a user of the electronic device (1000). For example, the 3D space may be a space where the user resides (e.g., a home, an office, etc.), but is not limited thereto. The 3D space may also be expressed as a 3D map.

[0055] According to one embodiment of the present disclosure, a user can define a 3D space according to a procedure guided by an application installed on an electronic device (1000) (e.g., an application for managing home appliances). For example, the user can define a 3D space based on a floor plan corresponding to a building (e.g., an apartment) in which the user currently resides. The user can also define a 3D space based on a map generated by a robot vacuum cleaner. The user can also design or configure the 3D space directly. The 3D space may be a single space or may include multiple distinct spaces. The 3D space may include furniture or home appliances. When the user defines a 3D space through an application installed on the electronic device (1000), information about the 3D space defined by the user can be transmitted to a server (2000), and the server (2000) can store information about the 3D space defined by the user.

[0056] A user can control an IoT device (3000) using an application installed on an electronic device (1000). For example, when a user logs into a user account using an application installed on an electronic device (1000), an IoT device (3000) registered to the user account appears, and when a control command for the IoT device (3000) is input, the control command can be transmitted to the IoT device (3000) via the server (20000).

[0057] Meanwhile, as illustrated in FIG. 1, when a user executes an application installed in an electronic device (1000) and requests an image (100) of a 3D space, the electronic device (1000) can receive information about the 3D space from a server (2000) and display the image (100) of the 3D space on a screen (display). At this time, the image (100) of the 3D space can include an image indicator (10) corresponding to an object constituting the 3D space (e.g., a sofa, a desk, etc.) and an IoT device (3000) registered in the server (2000). The user can input a control command for the IoT device (3000) through the image indicator (10) included in the image (100) of the 3D space.

[0058] The image indicator (10) may be a UI component created to enable a user to interact with an electronic device (1000) or a server (2000). The image indicator (10) may be expressed as a visual element, a visual component, an icon, a control button, a control item, or a control object. The image indicator (10) may include a thumbnail image or an icon image of a corresponding IoT device (3000). In FIG. 1, the image indicator (10) is illustrated as having a circular shape, but is not limited thereto. The image indicator (10) may have various shapes, such as an oval, a polygon (e.g., a square, a triangle, a hexagon, etc.), a water drop shape, or a star shape.

[0059] According to one embodiment of the present disclosure, the electronic device (1000) can display an image (100) of a 3D space by fitting the 3D space (map) to the screen (display) of the electronic device (1000). For example, the electronic device (1000) can appropriately adjust the ratio of the bounds of the 3D space (map) to the bounds of the view port of the camera in order to fit the 3D space (map) to the screen. In this case, the electronic device (1000) can show the entire 3D space (map) to the user at once, so that the user can easily grasp the entire space. On the other hand, since the image of the 3D space is displayed by fitting the screen based on the size of the 3D space regardless of the actual size of the 3D space (e.g., a house) or the display size or resolution of the electronic device (1000), the size of the image indicator (10) (e.g., an icon) included in the image (1000) of the 3D space may vary depending on the situation. For example, the larger the size of the actual space in which the user resides, the smaller the image indicator (10) may appear, and the smaller the display of the electronic device (1000) currently being used by the user, the smaller the image (100) of the 3D space and the image indicator (10) may appear. In addition, the size of the image indicator (10) may be changed and displayed depending on the display resolution of the electronic device (1000) currently being used by the user.

[0060] Accordingly, if the user's actual living space is very large or the display size of the current electronic device (1000) used by the user is small, the image indicator (10) to be operated or checked for status appears too small, so when the user tries to check or control the status of a specific IoT device (3000), he or she has the inconvenience of having to enlarge the image (100) of the 3D space.

[0061] Additionally, if there are multiple electronic devices (1000) available to the user (e.g., TV, mobile, tablet, wallpad, etc.), the display sizes and resolutions of each electronic device (1000) may be different. Accordingly, when the image (100) of 3D space is displayed for the first time on each electronic device (1000), the user may see image indicators (10) of different sizes.

[0062] Referring to FIG. 2, for example, the display size of the first electronic device (1000-1) may be smaller than the display size of the second electronic device (1000-2). In this case, when the first electronic device (1000-1) and the second electronic device (1000-2) each display an image of the same 3D space by fitting the 3D space to the screen, image indicators included in the image of the 3D space displayed on the first electronic device (1000-1) may be smaller than image indicators included in the image of the 3D space displayed on the second electronic device (1000-2).

[0063] Therefore, according to one embodiment of the present disclosure, rather than manipulating the camera setting values ​​based on the 3D space, each electronic device (1000) can adjust the camera setting values ​​based on the size of the image indicator (10) to be displayed on the screen so that the image indicator (10) of the same size can be displayed on each electronic device (1000). Here, the camera may be a virtual camera for rendering the 3D space. Just as a user can see a part of the world through a camera in the real world, a user can see a part of the 3D space through the virtual camera. Objects in the 3D space are projected onto the 2D plane of the virtual camera, and a scene of this projected 2D plane appears on the display (screen) of the electronic device (1000). Hereinafter, the camera may be expressed as a 3D camera.

[0064] Hereinafter, with reference to FIG. 3, a method for an electronic device (1000) to provide an image of a 3D space by adjusting the setting values ​​of a camera so that a user can experience an image indicator (10) of the same size on multiple devices will be described in detail.

[0065] FIG. 3 is a flowchart illustrating a method for an electronic device (1000) according to one embodiment of the present disclosure to provide an image of a 3D space based on a DP value.

[0066] Referring to FIG. 3, a method for an electronic device (1000) to provide an image of a 3D space may include steps S310 to S350. In one embodiment of the present disclosure, steps S310 to S350 may be executed by at least one processor included in the electronic device (1000). The method for an electronic device (1000) to provide an image of a 3D space is not limited to that illustrated in FIG. 3, and in one or more embodiments, steps not illustrated in FIG. 3 may be further included, or some steps may be omitted.

[0067] Steps S310 to S350 may be performed when the electronic device (1000) first enters a 3D space or when reconstructing a 3D space (e.g., changing a 3D space, editing a 3D space, changing a floor, etc.).

[0068] In step S310, the electronic device (1000) according to one embodiment of the present disclosure can obtain a setting value of a camera for fitting a 3D space including an image indicator for controlling an IoT device (3000) to the screen of the electronic device (1000).

[0069] According to one embodiment of the present disclosure, the camera's setting value may include, but is not limited to, at least one of the distance between the camera and an object in 3D space or the camera's field of view. The object in 3D space may include, but is not limited to, a floor, a bed, a desk, etc.

[0070] According to one embodiment of the present disclosure, the electronic device (1000) can appropriately adjust the ratio of the bounds of the 3D space (map) and the bounds of the view port of the camera in order to fit the 3D space (map) to the screen. In addition, the electronic device (1000) can obtain the first distance between the camera and the object or the first angle of view of the camera at the time point when the ratio of the bounds of the 3D space (map) and the bounds of the view port of the camera is appropriately adjusted, as the setting value of the camera. The larger the display size of the electronic device (1000), the shorter the first distance between the camera and the object, and the smaller the display size of the electronic device (1000), the longer the first distance between the camera and the object. For example, referring to FIG. 2, when the 3D space is the same, the first distance between the camera and the object in the first electronic device (1000-1) can be longer than the first distance between the camera and the object in the second electronic device (1000-2).

[0071] In step S320, the electronic device (1000) according to one embodiment of the present disclosure can determine a DP (Density-independent pixel) value of the image indicator corresponding to the size at which the image indicator should be displayed on the screen.

[0072] A density-independent pixel (DP or DIP) is a virtual pixel unit in user interface design that allows the size and arrangement of screen elements to be specified independently of the device's physical display resolution. It can be based on a display resolution of 160 DPI (Dots per inch). For example, on a 240 DP display, 1 DP represents 1.5 pixels. Using DP values ​​allows for consistent user interface design for devices with varying resolutions and sizes, regardless of their respective resolutions.

[0073] According to one embodiment of the present disclosure, the electronic device (1000) may determine a specific ratio value of the DP value of a representative electronic device among at least one electronic device capable of providing an image of a 3D space as the DP value of an image indicator (e.g., an icon). At least one electronic device may include the electronic device (1000).

[0074] According to one embodiment of the present disclosure, the electronic device (1000) can obtain the DP value of each of at least one electronic device capable of providing an image of a 3D space. For example, the electronic device (1000) can obtain DP values ​​from other electronic devices. The electronic device (1000) can directly receive the DP values ​​of other electronic devices using D2D communication from other electronic devices, or can obtain the DP values ​​of other electronic devices through an edge computing device or a smart hub.

[0075] The electronic device (1000) may also obtain usage frequency information of other electronic devices. For example, the electronic device (1000) may obtain information on the number of times other electronic devices execute a specific application and display an image in a 3D space including an image indicator.

[0076] According to one embodiment of the present disclosure, the electronic device (1000) may select a representative electronic device from among at least one electronic device. For example, the electronic device (1000) may select a representative electronic device based on usage frequency information of each of the at least one electronic device. That is, the electronic device (1000) may select an electronic device that has displayed an image of a 3D space including an image indicator the greatest number of times as the representative electronic device. Alternatively, the electronic device (1000) may select an electronic device separately designated by the user as the representative electronic device. For example, the electronic device (1000) may select a smartphone designated by the user as the representative electronic device.

[0077] According to one embodiment of the present disclosure, the electronic device (1000) may determine a specific percentage value (e.g., 10%) of the DP value of the representative electronic device as the DP value of the image indicator. For example, if the DP value of the representative electronic device is 200DP, the DP value of the image indicator may be determined as 20DP (=200*1 / 10). The specific percentage value (e.g., 10%) of the DP value of the representative electronic device may be preset and may be changed by the user. For example, 1 / 10 of the DP value of the representative electronic device may be determined as the default DP value of the image indicator, but if the user wants to view the image indicator on the screen in a larger size, 1 / 10 may be changed to 1 / 7.

[0078] Let us look a little further into the operation of the electronic device (1000) to determine the DP value of the image indicator with reference to FIG. 4.

[0079] FIG. 4 is a diagram illustrating an operation of an electronic device (1000) according to one embodiment of the present disclosure to determine the screen display size of a representative electronic device and an image indicator. In FIG. 4, an example will be described in which, in addition to the electronic device (1000) currently being used by a user, the user further owns a first electronic device (1000-1), a second electronic device (1000-2), a third electronic device (1000-3), and a fourth electronic device (1000-4).

[0080] Referring to FIG. 4, the electronic device (1000) may receive (401) a first DP value or a first inch value of the first electronic device (1000-1) from the first electronic device (1000-1), receive (402) a second DP value or a second inch value of the second electronic device (1000-2) from the second electronic device (1000-2), receive (403) a third DP value or a third inch value of the first electronic device (1000-1) from the third electronic device (1000-3), and receive (401) a fourth DP value or a fourth inch value of the fourth electronic device (1000-4) from the fourth electronic device (1000-4).

[0081] And the electronic device (1000) can obtain the usage count information of the first electronic device (1000-1), the usage count information of the second electronic device (1000-2), the usage count information of the third electronic device (1000-3), and the usage count information of the fourth electronic device (1000-4). The electronic device (1000) can receive the usage count information directly from each electronic device, or can receive it from an edge computing device, a smart hub, or a server (2000).

[0082] The electronic device (1000) may select the first electronic device (1000-1) as the representative electronic device if, as a result of comparing the usage frequency information of each electronic device, the first electronic device (1000) has the highest usage frequency. In this case, the first DP value of the first electronic device (1000-1) may be 720 DP, and the first inch value may be 8 inches.

[0083] The electronic device (1000) can determine the screen display size (DP value or inch value) of the image indicator using the DP value (or inch value) of the representative electronic device. For example, the electronic device (1000) can determine 72DP (or 0.8 inches), which is a predetermined ratio (1 / 10) of the DP value (or inch value) of the first electronic device (1000-1), which is the representative electronic device, as the screen display size of the image indicator.

[0084] According to one embodiment of the present disclosure, each of the first electronic device (1000-1), the second electronic device (1000-2), the third electronic device (1000-3), and the fourth electronic device (100-4) may determine the screen display size (DP value or inch value) of the image indicator using the DP value (or inch value) of the representative electronic device. For example, each of the first electronic device (1000-1), the second electronic device (1000-2), the third electronic device (1000-3), and the fourth electronic device (100-4) may select the first electronic device (1000-1) with the highest number of uses as the representative electronic device, and determine 72DP (or 0.8 inches), which is a predetermined ratio (1 / 10) of the DP value (or inch value) of the first electronic device (1000-1), as the screen display size of the image indicator. Therefore, the image indicator should be displayed in a size of 72DP (or 0.8 inches) on all electronic devices owned by the user (1000, 1000-1, 1000-2, 1000-3, 1000-4).

[0085] Meanwhile, although not shown in FIG. 4, according to one embodiment of the present disclosure, when the electronic device (1000) determines the screen display size of the image indicator to be 72DP (or 0.8 inches), which is a predetermined ratio (1 / 10) of the DP value (or inch value) of the first electronic device (1000-1), which is a representative electronic device, the electronic device (1000) may transmit information that the screen display size of the image indicator is 72DP (or 0.8 inches) to the first electronic device (1000-1), the second electronic device (1000-2), the third electronic device (1000-3), and the fourth electronic device (1000-4).

[0086] Returning to FIG. 3 again, in step S330, the electronic device (1000) according to one embodiment of the present disclosure can obtain a magnification for enlarging or reducing the 3D space based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device (1000).

[0087] For example, the electronic device (1000) can calculate a magnification for enlarging or reducing a 3D space as in Equation 1.

[0088] <Formula 1>

[0089]

[0090] That is, the magnification for enlarging or reducing the 3D space may be a value obtained by dividing the DP value of the image indicator obtained in step S320 by the product of the DP value of the electronic device (1000) and the size ratio of the image indicator in the 3D space.

[0091] Here, the size ratio of the image indicator in 3D space can be defined as in Equation 2. That is, the size ratio of the image indicator in 3D space can be a value obtained by dividing the size of the image indicator by the size of the 3D space. The size of the image indicator can be defined as a virtual unit value in 3D space.

[0092] <Formula 2>

[0093]

[0094]

[0095] Meanwhile, the size of the 3D space may be a value obtained by multiplying the distance between the camera and the object by Tan (angle of view) among the camera setting values ​​obtained in step S310, and then multiplying the value by 2. The size of the 3D space may be one of the vertical length, horizontal length, or diagonal length of the bounding box defining the 3D space, but is not limited thereto.

[0096] Therefore, if Equation 1 is rearranged to obtain a magnification for enlarging or reducing 3D space, it can be as Equation 3. According to Equation 3, the magnification for enlarging or reducing 3D space can increase as the DP value of the electronic device (1000) decreases or the size of the 3D space (distance between the camera and the object * Tan (FoV) * 2) increases.

[0097] <Formula 3>

[0098]

[0099] According to one embodiment of the present disclosure, the electronic device (1000) can obtain size information of an image indicator from a server (2000) to apply to Equation 3. The electronic device (1000) can determine the size of a 3D space based on the distance between the camera and the object among the camera setting values ​​obtained in step S310. In addition, the electronic device (1000) can determine the size ratio of the image indicator in the 3D space based on the size of the 3D space and the size information of the image indicator obtained from the server (2000). With reference to FIG. 5, a specific example of an operation of the electronic device (1000) to determine the size ratio of the image indicator in the 3D space will be described.

[0100] Referring to FIG. 5, when the 3D space is aligned with the screen of the electronic device (1000), the size of the 3D space may be 20 units (= d*Tan(FoV)*2), and the size of the image indicator on the 3D space acquired from the server (2000) may be 1 unit. Accordingly, the size ratio of the image indicator on the 3D space may be 1 / 20.

[0101] Finally, the electronic device (1000) can determine a magnification for enlarging or reducing the 3D space by dividing the DP value of the image indicator (e.g., 72 DP) determined in step S320 by the product of the size ratio of the image indicator in the 3D space (e.g., 1 / 20) and the DP value of the electronic device (1000) (e.g., 360 DP).

[0102] For example, if the DP value of the electronic device (1000) is 360DP, the product of the DP value of the electronic device (1000) and the size ratio of the image indicator in the 3D space may be 18DP. That is, based on the current camera setting value, the image indicator may be displayed on the screen of the electronic device (1000) as 18DP. However, if the DP value of the image indicator calculated in step S320 is 72DP, the image indicator should be displayed in the size of 72DP. Therefore, if 72DP is divided by 18DP, the image in the 3D space should be enlarged by 4 times.

[0103] Returning to FIG. 3 again, in step S340, the electronic device (1000) according to one embodiment of the present disclosure can adjust the camera setting values ​​obtained in step S310 based on the magnification for enlarging or reducing the 3D space.

[0104] According to one embodiment of the present disclosure, based on a magnification for enlarging or reducing the 3D space, at least one of the distance between the camera and the object in the 3D space or the angle of view of the camera can be adjusted. For example, if it is determined that the 3D space must be enlarged by four times in order for the image indicator to be displayed in a size corresponding to the DP value of the image indicator determined in step S320, the electronic device (1000) can adjust the camera distance so that the distance between the camera and the object in the 3D space is reduced to one-quarter. Alternatively, the electronic device (1000) can move the camera closer to the object so that the distance between the camera and the object is reduced to one-fifth, and increase the angle of view of the camera so that the 3D space is enlarged by four times. Alternatively, the electronic device (1000) can also adjust the angle of view of the camera so that the 3D space is enlarged by four times. According to one embodiment of the present disclosure, the electronic device (1000) can adjust the focal length of the camera to adjust the angle of view of the camera. For example, the electronic device (1000) can adjust the angle of view to be narrow by increasing the focal length, or can adjust the angle of view to be wide by decreasing the focal length.

[0105] Meanwhile, the electronic device (1000) may apply a distortion correction algorithm because distortion may occur in the image of the 3D space when adjusting the angle of view of the camera.

[0106] According to one embodiment of the present disclosure, the electronic device (1000) may maintain the camera setting value in the current state when the magnification for enlarging or reducing the 3D space obtained in step S330 is 1.

[0107] In step S350, the electronic device (1000) according to one embodiment of the present disclosure can display an image of an enlarged or reduced 3D space on the screen of the electronic device (1000) by applying the setting value of the adjusted camera.

[0108] According to one embodiment of the present disclosure, when the electronic device (1000) applies the setting value of the adjusted camera, the size of the image indicator included in the image of the 3D space displayed on the screen of the electronic device (1000) may have the DP value determined in S320. That is, according to one embodiment of the present disclosure, the electronic device (1000) may adjust the setting value of the camera so that an image indicator of the same size is displayed on all devices owned by the user.

[0109] Meanwhile, when the sizes of multiple image indicators corresponding to multiple IoT devices in 3D space are different, the electronic device (1000) can select a representative indicator to determine the size ratio of the image indicators in 3D space, and use the size of the representative indicator to determine the size ratio of the image indicators in 3D space. With reference to FIG. 6, an operation of the electronic device (1000) selecting a representative indicator will be described.

[0110] FIG. 6 is a flowchart illustrating a method for an electronic device (1000) to select a representative indicator according to one embodiment of the present disclosure.

[0111] In step S610, the electronic device (1000) according to one embodiment of the present disclosure may obtain 3D space information from the server (2000). For example, the electronic device (1000) may obtain size information of a plurality of image indicators corresponding to a plurality of IoT devices from the server (2000). In addition, the electronic device (1000) may obtain control count information of a plurality of IoT devices from the server (2000). The control count information of a plurality of IoT devices may be information regarding the number of times each IoT device is controlled by a user.

[0112] In step S620, the electronic device (1000) according to one embodiment of the present disclosure can determine whether the sizes of the plurality of image indicators are different based on size information of the plurality of image indicators obtained from the server (2000).

[0113] For example, if the sizes of the first image indicator, the second image indicator, and the third image indicator are 2 units, the sizes of the fourth image indicator and the fifth image indicator are 1.5 units, and the sizes of the sixth image indicator and the seventh image indicator are 1 unit, the electronic device (1000) can determine that the sizes of the plurality of image indicators are different. On the other hand, if the sizes of the first image indicator to the seventh image indicator are all 1 unit, the electronic device (1000) can determine that the sizes of the plurality of image indicators are not different.

[0114] In step S630, the electronic device (1000) according to one embodiment of the present disclosure can determine the size ratio of the image indicators in the 3D space by using the sizes of the image indicators and the sizes of the 3D space, if the sizes of the plurality of image indicators are all the same (No in S620).

[0115] Referring to 710 of FIG. 7, for example, if the size of all image indicators included in the 3D space is 1 unit and the size of the 3D space is 20 units, the electronic device (1000) can determine the size ratio of the image indicators in the 3D space to be 1 / 20.

[0116] In step S640, the electronic device (1000) according to one embodiment of the present disclosure may select a representative indicator from among the plurality of image indicators if the sizes of the plurality of image indicators are different (Yes in S620). In step S650, the electronic device (1000) according to one embodiment of the present disclosure may determine a size ratio of the image indicators in 3D space based on the sizes of the representative indicators.

[0117] According to one embodiment of the present disclosure, the electronic device (1000) may select a first image indicator corresponding to a first IoT device among the plurality of IoT devices as a representative indicator based on information on the number of control times of the plurality of IoT devices. For example, referring to 720 of FIG. 7, if a user controls a lighting device the most among the plurality of IoT devices, the electronic device (1000) may select a first image indicator (700) corresponding to the lighting device among the plurality of IoT devices as a representative indicator. The first image indicator (700) may include a UI component for displaying the status of the lighting device or controlling the operation of the lighting device. If the size of the first image indicator (700) is 2 units and the size of the 3D space is 20 units, the electronic device (1000) may determine a size ratio of the image indicator in the 3D space to be 1 / 10.

[0118] According to one embodiment of the present disclosure, the electronic device (1000) may select a first image indicator corresponding to a first IoT device designated by a user as a representative indicator. For example, the user may designate an image indicator of a robot vacuum cleaner as the representative indicator. If the size of the image indicator of the robot vacuum cleaner is 1 unit and the size of the 3D space is 20 units, the electronic device (1000) may determine the size ratio of the image indicator in the 3D space to be 1 / 20.

[0119] According to one embodiment of the present disclosure, the size ratio of image indicators in 3D space may be determined using the average size of image indicators corresponding to multiple IoT devices. For example, if the average size of image indicators is 1.5 units and the size of 3D space is 20 units, the electronic device (1000) may determine the size ratio of image indicators in 3D space as 1.5 / 20.

[0120] According to one embodiment of the present disclosure, when the size ratio of an image indicator in a 3D space is determined, the electronic device (1000) can determine a magnification for enlarging or reducing the 3D space using the above equation 1. For example, when the size of the representative indicator is 2uint, the size of the 3D space is 20 units, the DP value of the image indicator is 72DP, and the DP value of the electronic device (1000) is 360DP, the magnification ratio can be 2.

[0121]

[0122]

[0123] Accordingly, the electronic device (1000) can adjust the distance between the camera and the object or the angle of view of the camera to double the 3D space.

[0124] Meanwhile, according to one embodiment of the present disclosure, the electronic device (1000) may determine a magnification for enlarging or reducing a 3D space using an inch value instead of a DP value. A method for the electronic device (1000) to adjust the camera setting value based on the inch value of the image indicator and the inch value of the electronic device (1000) will be described in detail with reference to FIG. 8.

[0125] FIG. 8 is a flowchart illustrating a method for an electronic device (1000) according to one embodiment of the present disclosure to provide an image of a 3D space based on an inch value.

[0126] Referring to FIG. 8, a method for an electronic device (1000) to provide an image of a 3D space may include steps S810 to S850. In one embodiment of the present disclosure, steps S310 to S350 may be executed by at least one processor included in the electronic device (1000). The method for an electronic device (1000) to provide an image of a 3D space is not limited to that illustrated in FIG. 3, and in one or more embodiments, steps not illustrated in FIG. 8 may be further included, or some steps may be omitted.

[0127] In step S810, the electronic device (1000) according to one embodiment of the present disclosure can obtain a setting value of a camera for fitting a 3D space including an image indicator for controlling an IoT device (3000) to the screen of the electronic device (1000).

[0128] According to one embodiment of the present disclosure, the electronic device (1000) can appropriately adjust the ratio of the bounds of the 3D space (map) and the bounds of the view port of the camera in order to fit the 3D space (map) to the screen. In addition, the electronic device (1000) can obtain the first distance between the camera and the object or the first angle of view of the camera as the setting value of the camera at a time point when the ratio of the bounds of the 3D space (map) and the bounds of the view port of the camera is appropriately adjusted.

[0129] Step S810 corresponds to step S310 of FIG. 3, so redundant description will be omitted.

[0130] In step S820, the electronic device (1000) according to one embodiment of the present disclosure may determine an inch value of the image indicator corresponding to the size at which the image indicator should be displayed on the screen.

[0131] According to one embodiment of the present disclosure, the electronic device (1000) may determine a specific ratio value of an inch value of a representative electronic device among at least one electronic device capable of providing an image of a 3D space as an inch value of an image indicator (e.g., an icon). At least one electronic device may include the electronic device (1000).

[0132] According to one embodiment of the present disclosure, the electronic device (1000) can obtain the inch value of each of at least one electronic device capable of providing an image of a 3D space. For example, the electronic device (1000) can obtain the inch values ​​of displays from other electronic devices. The electronic device (1000) can directly receive the inch values ​​of other electronic devices using D2D communication from other electronic devices, or can obtain the inch values ​​of other electronic devices through an edge computing device or a smart hub.

[0133] The electronic device (1000) may also obtain usage frequency information of other electronic devices. For example, the electronic device (1000) may obtain information on the number of times other electronic devices execute a specific application and display an image in a 3D space including an image indicator.

[0134] According to one embodiment of the present disclosure, the electronic device (1000) may select a representative electronic device from among at least one electronic device. For example, the electronic device (1000) may select a representative electronic device based on usage frequency information of each of the at least one electronic device. That is, the electronic device (1000) may select an electronic device that has displayed an image of a 3D space including an image indicator the greatest number of times as the representative electronic device. Alternatively, the electronic device (1000) may select an electronic device separately designated by the user as the representative electronic device. For example, the electronic device (1000) may select a smartphone designated by the user as the representative electronic device.

[0135] According to one embodiment of the present disclosure, the electronic device (1000) may determine a specific percentage value (e.g., 10%) of the inch value of the representative electronic device as the inch value of the image indicator. For example, referring to FIG. 4, if the inch value of the representative electronic device is 8 inches, the inch value of the image indicator may be determined as 0.8 inches (=8*1 / 10). Here, the specific percentage value (e.g., 10%) may be preset and may also be changed by the user. For example, 1 / 10 of the inch value of the representative electronic device may be determined as the default inch value of the image indicator, but if the user wants to view the image indicator larger on the screen, 1 / 10 may be changed to 1 / 5.

[0136] In step S830, the electronic device (1000) according to one embodiment of the present disclosure can obtain a magnification for enlarging or reducing the 3D space based on the inch value of the image indicator, the size ratio of the image indicator in the 3D space, and the inch value of the electronic device (1000).

[0137] For example, the electronic device (1000) can calculate a magnification for enlarging or reducing 3D space as follows.

[0138] <Formula 4>

[0139]

[0140] That is, the magnification for enlarging or reducing the 3D space may be a value obtained by dividing the inch value of the image indicator obtained in step S820 by the product of the inch value of the electronic device (1000) and the size ratio of the image indicator in the 3D space.

[0141] Here, the size ratio of the image indicator in 3D space can be defined as in Equation 5. That is, the size ratio of the image indicator in 3D space can be a value obtained by dividing the size of the image indicator by the size of the 3D space. The size of the image indicator can be defined as a virtual unit value in 3D space.

[0142] <Formula 5>

[0143]

[0144]

[0145] Meanwhile, the size of the 3D space may be a value obtained by multiplying the distance between the camera and the object by Tan (angle of view) among the camera setting values ​​obtained in step S810, and then multiplying it again by 2. The size of the 3D space may be one of the vertical length, horizontal length, or diagonal length of the bounding box defining the 3D space, but is not limited thereto.

[0146] Therefore, if the equation for obtaining the magnification for enlarging or reducing the 3D space is rearranged, it can be as in equation 6. According to equation 6, the magnification for enlarging or reducing the 3D space can increase as the inch value of the electronic device (1000) decreases or the size of the 3D space (distance between the camera and the object * Tan (FoV) * 2) increases.

[0147] <Formula 6>

[0148]

[0149] According to one embodiment of the present disclosure, the electronic device (1000) can obtain size information of an image indicator from a server (2000) to apply to Equation 6. The electronic device (1000) can determine the size of a 3D space based on the distance between the camera and the object among the camera setting values ​​obtained in step S810. In addition, the electronic device (1000) can determine a size ratio of an image indicator in a 3D space based on the size of the 3D space and the size information of the image indicator obtained from the server (2000).

[0150] For example, referring to FIG. 5, when the 3D space is aligned with the screen of the electronic device (1000), the size of the 3D space may be 20 units (= d*Tan(FoV)*2), and the size of the image indicator on the 3D space acquired from the server (2000) may be 1 unit. Accordingly, the size ratio of the image indicator on the 3D space may be 1 / 20.

[0151] Finally, the electronic device (1000) can determine a magnification for enlarging or reducing the 3D space by dividing the inch value (e.g., 0.8) of the image indicator determined in step S820 by the product of the size ratio (e.g., 1 / 20) of the image indicator in the 3D space and the inch value (e.g., 8) of the electronic device (1000).

[0152] For example, if the inch value of the electronic device (1000) is 4 inches, the product of the inch value of the electronic device (1000) (e.g., 4 inches) and the size ratio of the image indicator in the 3D space (e.g., 1 / 20) may be 0.2 inches. That is, based on the current setting value of the camera, the image indicator may be displayed on the screen of the electronic device (1000) at 0.2 inches. However, if the inch value of the image indicator calculated in step S820 is 0.8 inches, the image indicator should be displayed at a size of 0.8 inches. Therefore, if 0.8 is divided by 0.2, the image in the 3D space should be enlarged by 4 times.

[0153] In step S840, the electronic device (1000) according to one embodiment of the present disclosure can adjust the setting values ​​of the camera obtained in step S810 based on the magnification for enlarging or reducing the 3D space.

[0154] According to one embodiment of the present disclosure, the electronic device (1000) can adjust at least one of the distance between the camera and an object in the 3D space or the angle of view of the camera based on a magnification for enlarging or reducing the 3D space. For example, the electronic device (1000) can change the first distance between the camera and the object to a second distance among the camera setting values ​​acquired in step S810, or change the first angle of view of the camera to a second angle of view.

[0155] Meanwhile, according to one embodiment of the present disclosure, the electronic device (1000) may maintain the camera setting value in the current state when the magnification for enlarging or reducing the 3D space acquired in step S330 is 1.

[0156] Step S840 corresponds to step S340 of FIG. 3, so a detailed description thereof will be omitted.

[0157] In step S850, the electronic device (1000) according to one embodiment of the present disclosure can display an image of an enlarged or reduced 3D space on the screen of the electronic device (1000) by applying the setting value of the adjusted camera.

[0158] According to one embodiment of the present disclosure, when the electronic device (1000) applies the setting value of the adjusted camera, the size of the image indicator included in the image of the 3D space displayed on the screen of the electronic device (1000) may have the inch value determined in S820. That is, according to one embodiment of the present disclosure, the electronic device (1000) may adjust the setting value of the camera so that an image indicator of the same size is displayed on all devices owned by the user. Hereinafter, with reference to FIG. 9, an operation of determining a magnification ratio so that an image indicator of the same size is displayed on all devices owned by the user will be described.

[0159] FIG. 9 is a diagram for explaining an operation for determining a magnification ratio in each of various electronic devices according to an embodiment of the present disclosure. In FIG. 9, a case in which the size of an image indicator to be displayed on a screen is 72 DP and 0.8 inches will be described as an example. In addition, FIG. 9 will explain a case in which the DP value of a representative electronic device is 720 DP, the inch value of the representative electronic device is 8 inches, the size of a representative space is 10 units (e.g., 30 pyeong), and the size of the image indicator in a 3D space is 1 unit as an example.

[0160] Referring to Table 900, if the DP value of the electronic device (1000) currently used by the user is 720DP, the inch value is 8 inches, and the size of the 3D space is 10 units, the magnification ratio may be 1. That is, the electronic device (1000) may show the user an image indicator of 72 DP and 0.8 inches in size even while maintaining the current setting value of the camera. On the other hand, if the DP value of the electronic device (1000) currently used by the user is 720DP, the inch value is 8 inches, and the size of the 3D space is 20 units, the magnification ratio may be 2. That is, the 3D space must be magnified by 2 times so that the size of the image indicator shown to the user can be 72 DP and 0.8 inches. Accordingly, the electronic device (1000) may reduce the distance between the camera and the object by half so that the 3D space including the image indicator can be displayed magnified by 2 times. Meanwhile, if the DP value of the electronic device (1000) currently used by the user is 720DP, the inch value is 8 inches, and the size of the 3D space is 30 units, the magnification ratio may be 3 times. That is, the 3D space must be magnified 3 times so that the size of the image indicator shown to the user can be 72 DP and 0.8 inches. Accordingly, the electronic device (1000) can reduce the distance between the camera and the object to 1 / 3 so that the 3D space including the image indicator can be displayed magnified 3 times. In conclusion, according to one embodiment of the present disclosure, the electronic device (1000) can determine a higher magnification ratio as the size of the 3D space increases.

[0161] If the DP value of the electronic device (1000) currently used by the user is 360DP, the inch value is 4 inches, and the size of the 3D space is 10 units, the magnification ratio may be 2 times. If the DP value of the electronic device (1000) currently used by the user is 360DP, the inch value is 4 inches, and the size of the 3D space is 20 units, the magnification ratio may be 4 times. That is, if the DP value of the electronic device (1000) is reduced from 720DP to 360DP, the magnification ratio may be determined to be larger when the size of the 3D space is the same. In conclusion, the electronic device (1000) may determine the magnification ratio to be higher as the display size of the electronic device (1000) becomes smaller, even if the size of the 3D space is the same.

[0162] Meanwhile, the magnification ratio calculated based on the DP value may be different from the magnification ratio calculated based on the inch value. For example, if the DP value of the electronic device (1000) is 1440 DP, the DP value of the electronic device (1000) is 8 inches, and the size of the 3D space is 10 units, the magnification ratio calculated based on the DP value may be 1 / 2, and if the magnification ratio is calculated based on the inch value, it may be 1. In this case, the electronic device (1000) may apply the magnification ratio calculated based on the DP value or the magnification ratio calculated based on the inch value, depending on a preset policy.

[0163] Hereinafter, with reference to FIGS. 10 to 11b, an example in which an electronic device (1000) provides an image of a 3D space will be examined.

[0164] FIG. 10 is a drawing for explaining an operation of an electronic device (1000) according to one embodiment of the present disclosure to provide images of 3D spaces of different sizes.

[0165] Referring to FIG. 10, the electronic device (1000) can display an image (1001) of a first 3D space and an image (1002) of a second 3D space. At this time, the second 3D space may be larger than the first 3D space. For example, the first 3D space may be a 30-pyeong apartment space, and the second 3D space may be a 50-pyeong apartment space.

[0166] The electronic device (1000) can display the second 3D space in a larger scale than the first 3D space so that the screen display sizes of the first image indicators included in the image (1001) of the first 3D space and the second indicators included in the image (1002) of the second 3D space are the same. In other words, the electronic device (1000) can adjust the camera setting value so that the sizes of the image indicators shown to the user are the same even if the actual spaces are different.

[0167] Therefore, according to one embodiment of the present disclosure, a user can experience a consistent user interface because the size of the image indicator for controlling the IoT device (3000) is the same even if the 3D space changes.

[0168] FIG. 11A is a diagram for explaining an operation of providing an image of 3D space in electronic devices with different display sizes according to one embodiment of the present disclosure.

[0169] Referring to FIG. 11A, a first electronic device (1000-1) and a second electronic device (1000-2) can display images of the same 3D space. At this time, the first electronic device (1000-1) and the second electronic device (1000-2) may have different display sizes and resolutions. Therefore, when fitting the 3D space to the screen, the sizes of the image indicators displayed on the first electronic device (1000-1) and the second electronic device (1000-2) may be different, and thus, the first electronic device (1000-1) and the second electronic device (1000-2) can each adjust the setting values ​​of the camera to display image indicators of the same size. For example, since the display size of the second electronic device (1000-2) is smaller than that of the first electronic device (1000-1), the second electronic device (1000-2) can display a 3D space in a more enlarged manner than that of the first electronic device (1000-1). In this case, the sizes of the image indicators included in the image (1101) of the 3D space provided by the first electronic device (1000-1) and the sizes of the image indicators included in the image (1102) of the 3D space provided by the second electronic device (1000-2) may be the same.

[0170] Accordingly, according to one embodiment of the present disclosure, since a user can check an image indicator of the same size on any electronic device (1000), the user can operate the image indicator in a familiar manner on any electronic device (1000) without having to additionally adjust the size of the image indicator.

[0171] FIG. 11b is a drawing for explaining an operation of providing an image of a 3D space in an electronic device (1000) including a foldable display according to one embodiment of the present disclosure.

[0172] Referring to 1103 of FIG. 11b, when the electronic device (1000) is folded in half, the DP value of the electronic device (1000) may be 720 DP. On the other hand, referring to 1104 of FIG. 11b, when the electronic device (1000) is fully unfolded, the DP value of the electronic device (1000) may be 1440 DP (= 720 DP * 2).

[0173] Accordingly, the electronic device (1000) can adjust the camera setting value by determining the enlargement or reduction ratio of the 3D space based on 720 DP when it is folded in half, and can adjust the camera setting value by determining the enlargement or reduction ratio of the 3D space based on 1440 DP when it is fully unfolded.

[0174] According to one embodiment of the present disclosure, even if the electronic device (1000) is folded in half and then fully unfolded or fully unfolded and then folded in half while an image of a 3D space is displayed, the size of an indicator included in the image of a 3D space can be maintained the same.

[0175] FIG. 12 is a flowchart illustrating a method for reducing or enlarging the size ratio of an image indicator in 3D space by an electronic device (1000) according to one embodiment of the present disclosure.

[0176] In step S1210, the electronic device (1000) according to one embodiment of the present disclosure can adjust the setting value of the camera to display an image of a 3D space on the screen. For example, the electronic device (1000) can determine a DP value (or inch value) of the image indicator corresponding to the size at which the image indicator should be displayed on the screen. The electronic device (1000) can determine a magnification for enlarging or reducing the 3D space based on the DP value (or inch value) of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value (or inch value) of the electronic device (1000). The electronic device (1000) can adjust the setting value of the camera in the 3D space according to the determined magnification to display an image of the 3D space on the screen. In this case, the electronic device (1000) can display an image indicator of a preset size.

[0177] Step S1210 corresponds to step S350 of FIG. 3 or step S850 of FIG. 8, so a detailed description thereof will be omitted.

[0178] In step S1220, the electronic device (1000) according to one embodiment of the present disclosure may receive a user input for enlarging or reducing an image of a 3D space displayed on the screen.

[0179] For example, a user may perform an input to zoom in on an image of a 3D space to examine a portion of the 3D space in detail. Alternatively, a user may perform an input to zoom out on a 3D space to examine the entire 3D space at once.

[0180] According to one embodiment of the present disclosure, a user input for enlarging or reducing an image in 3D space may include, but is not limited to, a predefined touch input, a predefined motion input, or a voice input.

[0181] In step S1230, the electronic device (1000) according to one embodiment of the present disclosure can enlarge or reduce an image of a 3D space displayed on a screen based on a user input.

[0182] For example, the electronic device (1000) may adjust the camera settings (distance between the camera and an object, angle of view, etc.), the camera position, etc. in the 3D space to enlarge the image in the 3D space based on a user input for enlarging the image in the 3D space. At this time, the size of the image indicator included in the image in the 3D space may also increase.

[0183] On the other hand, the electronic device (1000) can adjust the camera settings (distance between the camera and the object, angle of view, etc.), the position of the camera, etc. in the 3D space to reduce the image of the 3D space based on a user input for reducing the image of the 3D space. At this time, the size of the image indicator included in the image of the 3D space can also be reduced.

[0184] That is, when the electronic device (1000) enlarges or reduces an image of a 3D space displayed on the screen according to a user input, the size of the image indicator may deviate from a preset size (e.g., a preset DP value or a preset inch value).

[0185] In step S1240, the electronic device (1000) according to one embodiment of the present disclosure can reduce or enlarge the size ratio of the image indicator in 3D space based on the DP value (or inch value) of the predetermined image indicator.

[0186] For example, when the size of the image indicator increases as the image in the 3D space is enlarged, the electronic device (1000) can reduce the size ratio of the image indicator in the 3D space based on the DP value (or inch value) of the image indicator determined in step S320 (or step S820). That is, the electronic device (1000) can reduce the size of the image indicator to be smaller by only the predetermined DP value (or predetermined inch value) while maintaining the 3D space in an enlarged state.

[0187] With reference to FIGS. 13 and 14, let us take a closer look at the operation of the electronic device (1000) to reduce or enlarge the size ratio of the image indicator in 3D space.

[0188] FIG. 13 is a diagram illustrating an operation of an electronic device (1000) according to one embodiment of the present disclosure to enlarge the size ratio of an image indicator in 3D space. In FIG. 13, an example will be described in which the size of an image indicator to be displayed on the screen is 72DP.

[0189] Referring to screen 1310 of FIG. 13, the electronic device (1000) can display an image of a 3D space on the screen by adjusting the camera setting value so that the size of the image indicators displayed on the screen becomes 72DP. At this time, the user can perform an input (1301) to enlarge the image of the 3D space in order to view the state of the living room and kitchen in detail. For example, the user can perform a pinch-out gesture on the image of the 3D space, but is not limited thereto. The pinch-out gesture is a gesture that enlarges the screen using two fingers.

[0190] Referring to screen 1320 of FIG. 13, when the electronic device (1000) detects a pinch-out gesture, the electronic device (1000) can enlarge and display an image in 3D space. At this time, the size of image indicators included in the image in 3D space can also be enlarged. For example, when the image in 3D space is enlarged by two times, the size of the image indicators can also be enlarged by two times to 144DP.

[0191] Referring to screen 1330 of FIG. 13, when the size of the image indicators exceeds a predetermined size (e.g., 72 DP), the electronic device (1000) can reduce the size of only the image indicators to 72 DP while keeping the 3D space enlarged. That is, the electronic device (1000) can reduce the size ratio of the image indicators in the 3D space by half. For example, the size ratio of the image indicators in screen 1310 is 1 / 20 (= ) may be, but the size ratio of the image indicators on the 1330 screen is 1 / 40 (= ) may be.

[0192] Therefore, according to one embodiment of the present disclosure, the electronic device (1000) can adjust the size of image indicators (e.g., icons) to remain constant even when an image in 3D space is enlarged.

[0193] FIG. 14 is a diagram illustrating an operation of an electronic device (1000) according to one embodiment of the present disclosure to reduce the size ratio of an image indicator in 3D space. In FIG. 14, an example will be described in which the size of an image indicator to be displayed on a screen is 72 DP.

[0194] Referring to screen 1410 of FIG. 14, the electronic device (1000) can display an image of a 3D space on the screen by adjusting the camera setting value so that the size of the image indicators displayed on the screen becomes 72 DP. At this time, the user can perform an input (1401) to reduce the image of the 3D space in order to view the 3D space as a whole. For example, the user can perform a pinch-in gesture on the image of the 3D space, but is not limited thereto. The pinch-in gesture is a gesture that reduces the screen using two fingers.

[0195] Referring to screen 1420 of FIG. 14, when the electronic device (1000) detects a pinch-in gesture, the electronic device (1000) may display a reduced size image of a 3D space. At this time, the sizes of image indicators included in the image of the 3D space may also be reduced. For example, when the image of the 3D space is reduced to half, the sizes of the image indicators may also be reduced to half, resulting in 36 DP.

[0196] Referring to screen 1430 of FIG. 14, when the size of the image indicators exceeds a predetermined size (e.g., 72 DP), the electronic device (1000) can keep the 3D space reduced and enlarge only the size of the image indicators to 72 DP. That is, the electronic device (1000) can double the size ratio of the image indicators in the 3D space. For example, the size ratio of the image indicators in screen 1410 is 1 / 20 (= ) may be, but the size ratio of the image indicators on the 1330 screen is 1 / 10(= ) may be.

[0197] Therefore, according to one embodiment of the present disclosure, the electronic device (1000) can adjust the size of image indicators (e.g., icons) to remain constant even if the image in 3D space is reduced.

[0198] FIG. 15 is a flowchart illustrating a method for an electronic device (1000) according to one embodiment of the present disclosure to display a UI component (User Interface component) for controlling an IoT device (3000).

[0199] In step S1510, the electronic device (1000) according to one embodiment of the present disclosure may adjust the setting value of the camera to display an image of a 3D space on the screen. For example, the electronic device (1000) may determine a DP value (or inch value) of the image indicator corresponding to the size at which the image indicator should be displayed on the screen. The electronic device (1000) may determine a magnification for enlarging or reducing the 3D space based on the DP value (or inch value) of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value (or inch value) of the electronic device (1000). The electronic device (1000) may adjust the setting value of the camera in the 3D space according to the determined magnification to display an image of the 3D space on the screen. In this case, the electronic device (1000) may display an image indicator of a preset size.

[0200] Step S1510 corresponds to step S350 of FIG. 3 or step S850 of FIG. 8, so a detailed description thereof will be omitted.

[0201] In step S1520, an electronic device (1000) according to an embodiment of the present disclosure may receive an input for selecting an image indicator included in an image of a 3D space. The input for selecting an image indicator may include, but is not limited to, a touch input, a motion input, or a voice input.

[0202] For example, the electronic device (1000) may receive a user input of touching a first image indicator corresponding to a first IoT device among a plurality of image indicators included in an image of a 3D space.

[0203] In step S1530, the electronic device (1000) according to one embodiment of the present disclosure may display a UI component for controlling an IoT device (3000) corresponding to the selected image indicator.

[0204] For example, when a first image indicator corresponding to a first IoT device is selected, the electronic device (1000) may display a first UI component (e.g., a power button, a start button, a stop button, etc.) for controlling the first IoT device near the first image indicator. In this case, the user can conveniently control the first IoT device using the first UI component.

[0205] Below, the operation of the electronic device (1000) displaying a UI component for controlling the IoT device (3000) will be examined in more detail with reference to FIGS. 16a to 16c.

[0206] FIG. 16A is a diagram for explaining an operation of an electronic device (1000) according to an embodiment of the present disclosure to display an image of a 3D space. FIG. 16B is a diagram for explaining an operation of an electronic device (1000) according to an embodiment of the present disclosure to display a UI component for controlling an IoT device (3000). FIG. 16C is a diagram for explaining an operation of an electronic device (1000) according to an embodiment of the present disclosure to provide status information of an IoT device (3000).

[0207] Referring to 1610 of FIG. 16A, the electronic device (1000) may execute an application for managing IoT devices (3000). At this time, the application execution window may display a list of IoT devices (e.g., washing machines, kimchi refrigerators, robot vacuum cleaners, air purifiers, etc.) registered with the server (2000) under a user account. Additionally, the application execution window may display an item (1601) for requesting an image of 3D space (e.g., map view).

[0208] When a user touches an item (1601), the electronic device (1000) can construct and provide an image of a 3D space.

[0209] Referring to 1620 of FIG. 16A, the electronic device (1000) may display an image of a 3D space corresponding to a user's home that the user has pre-registered with the server (2000). At this time, the image of the 3D space may include image indicators (e.g., icons) corresponding to IoT devices (e.g., a washing machine, a dryer, an air purifier, a robot vacuum cleaner, a lighting device, a refrigerator, an oven, etc.) placed in the user's home. The electronic device (1000) may determine a size (e.g., 72 DP) at which the image indicators should be displayed on the screen, and adjust a setting value of the camera (e.g., the distance between the camera and the object or the angle of view of the camera) so that the image indicators are displayed at the determined size (e.g., 72 DP).

[0210] Referring to 1630 of FIG. 16B, the electronic device (1000) may receive a user input for selecting a first image indicator (1602) corresponding to an air purifier among image indicators corresponding to IoT devices. In response to the user input for selecting the first image indicator (1602), the electronic device (1000) may display a first UI component (1603) for controlling the air purifier near the first image indicator (1602). The first UI component (1603) may include a status of the air purifier (e.g., off) and a power button. When the user touches the power button included in the first UI component (1603), the electronic device (1000) may transmit an operation command to the air purifier through the server (2000).

[0211] Referring to 1640 of FIG. 16B, the electronic device (1000) may receive a user input for selecting a second image indicator (1604) corresponding to the robot cleaner. In response to the user input for selecting the second image indicator (1604), the electronic device (1000) may display a second UI component (1605) for controlling the robot cleaner near the second image indicator (1604). The second UI component (1605) may include a status of the robot cleaner (e.g., charging complete) and a start button. When the user touches the start button included in the second UI component (1605), the electronic device (1000) may transmit a cleaning start command to the robot cleaner through the server (2000).

[0212] Therefore, according to one embodiment of the present disclosure, a user can control the operation of IoT devices by using image indicators displayed in a certain size on the screen of the electronic device (1000).

[0213] Referring to 1650 of FIG. 16c, the electronic device (1000) may receive an input for selecting a second UI component (1605) for controlling the robot vacuum cleaner. For example, the electronic device (1000) may receive an input for touching an area of ​​the second UI component (1605) where a start button is not displayed.

[0214] Referring to 1660 of FIG. 16c, the electronic device (1000) may display a page providing detailed information about the robot cleaner in response to a user input selecting the second UI component (1605). For example, the electronic device (1000) may display a page including the robot cleaner's mode (e.g., extreme cleaning), suction strength (e.g., normal), cleaning report, dustbin emptying, map management, etc.

[0215] Accordingly, according to one embodiment of the present disclosure, a user can easily access a page providing detailed information about IoT devices by using image indicators displayed in a certain size on the screen of the electronic device (1000).

[0216] FIG. 17 is a block diagram illustrating the function of an electronic device (1000) according to one embodiment of the present disclosure.

[0217] As illustrated in FIG. 17, an electronic device (1000) according to an embodiment of the present disclosure may include an output unit (1100), a sensor unit (1200), a processor (1300), a communication interface (1400), an A / V input unit (1500), a user input unit (1600), and a memory (1700). However, not all of the components illustrated in FIG. 17 are essential components. The electronic device (1000) may be implemented with more components than the illustrated components, or may be implemented with fewer components. For example, the electronic device (1000) may be implemented with a memory (1700) and a processor (1300).

[0218] Below, we will look at the above components in turn.

[0219] The output unit (1100) is for outputting an audio signal, a video signal, or a vibration signal, and may include a display unit (1111), an audio output unit (1112), a vibration motor (1113), etc.

[0220] The audio output unit (1112) outputs audio data received from the communication interface (1400) or stored in the memory (1700). In addition, the audio output unit (1112) outputs audio signals related to functions performed in the electronic device (1000) (e.g., call signal reception sound, message reception sound, notification sound). The audio output unit (1112) may include a speaker, a buzzer, or the like.

[0221] The vibration motor (1113) can output a vibration signal. For example, the vibration motor (1113) can output a vibration signal corresponding to the output of audio data or video data (e.g., a call signal reception sound, a message reception sound, etc.). In addition, the vibration motor (1113) can also output a vibration signal when a touch is input to the touch screen.

[0222] The output unit (1100) can output an image of a 3D space. At this time, the image of the 3D space can include an image indicator displayed on the screen in a predetermined size. The image indicator can be a UI element for controlling the IoT device (3000). For example, the image indicator can be an icon image, but is not limited thereto.

[0223] The sensor unit (1200) may include at least one of a magnetic sensor (1211), an acceleration sensor (1212), a tilt sensor (1213), an infrared sensor (1214), a gyroscope sensor (1215), a position sensor (e.g., GPS) (1216), a temperature and humidity sensor (1217), a proximity sensor (1218), and a light sensor (1219), but is not limited thereto. Since the function of each sensor can be intuitively inferred by a person skilled in the art from its name, a detailed description thereof will be omitted.

[0224] The processor (1300) typically controls the overall operation of the electronic device (1000). For example, the processor (1300) can control the output unit (1100), the sensor unit (1200), the communication interface (1400), the A / V input unit (1500), the user input unit (1600), the memory (1700), etc., by executing programs stored in the memory (1700).

[0225] The processor (1300) may be composed of one or more processors. The one or more processors included in the processor (1300) may be circuitry such as a System on Chip (SoC), an Integrated Circuit (IC), etc. The one or more processors included in the processor (1300) may be a general-purpose processor such as a Central Processing Unit (CPU), a Micro Processor Unit (MPU), an Application Processor (AP), a Digital Signal Processor (DSP), a graphics-only processor such as a Graphics Processing Unit (GPU), a Vision Processing Unit (VPU), an artificial intelligence-only processor such as a Neural Processing Unit (NPU), or a communication-only processor such as a Communication Processor (CP). When the one or more processors included in the processor (1300) are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model. The processor (1300) may be implemented as a single core processor or as a multicore processor.

[0226] The processor (1300) can write data to the memory (1700), read data stored in the memory (1700), and in particular, process data according to predefined operation rules or artificial intelligence models by executing a program or at least one instruction stored in the memory (1700).

[0227] The communication interface (1400) may include one or more components that enable communication between the electronic device (1000) and the IoT device (3000) or between the electronic device (1000) and the server (2000). For example, the communication interface (1400) may include a short-range communication unit (1411), a mobile communication unit (1412), and a broadcast receiving unit (1413).

[0228] The short-range wireless communication unit (221) may include, but is not limited to, a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a near field communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared (IrDA, infrared Data Association) communication unit, a WFD (Wi-Fi Direct) communication unit, a UWB (ultra wideband) communication unit, an Ant+ communication unit, etc.

[0229] The mobile communication unit (1412) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signals may include various types of data, such as voice call signals, video call signals, or text / multimedia message transmission and reception.

[0230] The broadcast receiver (1413) receives broadcast signals and / or broadcast-related information from an external source via a broadcast channel. The broadcast channel may include a satellite channel or a terrestrial channel. Depending on the implementation example, the electronic device (1000) may not include the broadcast receiver (1413).

[0231] The A / V (Audio / Video) input unit (1500) is for inputting audio signals or video signals, and may include a camera (1511), a microphone (1512), etc. The camera (1511) can obtain image frames such as still images or moving images through an image sensor in a video call mode or a shooting mode. The images captured through the image sensor can be processed through a processor (1300) or a separate image processing unit (not shown). The image frames processed by the camera (1511) can be stored in a memory (1700) or transmitted to the outside through a communication interface (1400). According to one embodiment of the present disclosure, the camera (1511) may include at least one of a telephoto camera, a wide-angle camera, and a general camera, but is not limited thereto.

[0232] The microphone (1512) receives external audio signals and processes them into electrical voice data. For example, the microphone (1512) can receive audio signals from an external device or a speaker. The microphone (1512) can utilize various noise removal algorithms to remove noise generated during the process of receiving external audio signals.

[0233] The user input unit (1600) refers to a means for a user to input data for controlling the electronic device (1000). For example, the user input unit (1600) may include, but is not limited to, a key pad, a dome switch, a touch pad (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, a jog switch, etc.

[0234] The memory (1700) may store a program for processing and controlling the processor (1300), and may also store input / output data (e.g., voice data, photo images, memo data, user's biometric information, etc.).

[0235] The memory (1700) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0236] The memory (1700) may not exist separately and may be configured to be included in the processor (1300). The memory (1700) may be configured as volatile memory, non-volatile memory, or a combination of volatile memory and non-volatile memory. The memory (1700) may store a program or at least one instruction for performing operations according to an embodiment of the present disclosure. The memory (1700) may also provide stored data to the processor (1300) upon request from the processor (1300).

[0237] One embodiment of the present disclosure relates to an electronic device (1000) that specifies a size of an image indicator (e.g., an icon) to be displayed to a user having multiple devices, and adjusts a setting value of a camera in a 3D space to display the image indicator (e.g., an icon) in the same size on all devices according to the specified size.

[0238] A method for providing an image of a 3D space by an electronic device (1000) according to one embodiment of the present disclosure may include: obtaining a setting value of a camera for fitting a 3D space including an image indicator for controlling an IoT device (3000) to a screen of the electronic device (1000); determining a DP (Density-independent pixel) value of an image indicator corresponding to a size at which the image indicator should be displayed on the screen; obtaining a magnification for enlarging or reducing the 3D space based on the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and the DP value of the electronic device (1000); adjusting a setting value of a camera based on the magnification for enlarging or reducing the 3D space; and displaying an image of the 3D space that has been enlarged or reduced on the screen of the electronic device (1000) by applying the adjusted setting value of the camera.

[0239] According to one embodiment of the present disclosure, when a user first enters a space (map) or changes a space (map), a consistent experience can be provided in which the status of IoT devices can be identified and device operation can be performed through image indicators (e.g., icons) of the same size on multiple devices. In addition, since the space (map) is automatically enlarged and entered around the image indicator (e.g., icons), the space can be displayed in an enlarged state without a separate enlargement operation experience even on an electronic device (1000) with a small display. On the other hand, on an electronic device (1000) with a large display, the user can identify the status of IoT devices and operate the devices while viewing the entire map. Therefore, according to one embodiment of the present disclosure, by providing a function for processing camera adjustments in 3D space according to the characteristics of multiple electronic devices to users who own multiple devices, a consistent experience and a more efficient and convenient IoT device (3000) operation experience can be provided to the user.

[0240] The step of determining the DP value of the image indicator according to one embodiment of the present disclosure may include the steps of: obtaining the DP value of each of at least one electronic device capable of providing an image of a 3D space; selecting a representative electronic device from among the at least one electronic device; and determining a specific ratio value of the DP value of the representative electronic device as the DP value of the image indicator.

[0241] The step of selecting a representative electronic device according to one embodiment of the present disclosure may include the step of selecting the representative electronic device based on usage count information of each of at least one electronic device.

[0242] The step of selecting a representative electronic device according to one embodiment of the present disclosure may include a step of selecting an electronic device separately designated by the user as the representative electronic device.

[0243] The step of obtaining a magnification for enlarging or reducing a 3D space according to one embodiment of the present disclosure may include the steps of: obtaining size information of an image indicator in the 3D space from a server; determining a size of the 3D space based on a distance between a camera and an object among setting values ​​of the camera; and determining a size ratio of the image indicator in the 3D space based on the size of the 3D space and the size information of the image indicator.

[0244] A step of determining a size ratio of an image indicator on a 3D space according to one embodiment of the present disclosure may include a step of obtaining size information of a plurality of image indicators corresponding to a plurality of IoT devices on a 3D space from a server (S610); a step of selecting a first image indicator corresponding to a first IoT device from among the plurality of IoT devices as a representative indicator when the sizes of the plurality of image indicators are different (S640); and a step of determining a size ratio of the first image indicator on the 3D space based on the size information of the first image indicator selected as the representative indicator and the size of the 3D space.

[0245] The step of selecting a first image indicator corresponding to a first IoT device as a representative indicator according to one embodiment of the present disclosure may include a step of selecting a first image indicator corresponding to the first IoT device as a representative indicator among a plurality of IoT devices based on control count information of the plurality of IoT devices.

[0246] The step of selecting a first image indicator corresponding to a first IoT device as a representative indicator according to one embodiment of the present disclosure may include a step of selecting a first image indicator corresponding to a first IoT device designated by a user as the representative indicator.

[0247] The step of adjusting the setting values ​​of the camera according to one embodiment of the present disclosure may include the step of adjusting at least one of the distance between the camera and the object in 3D space or the angle of view of the camera.

[0248] The magnification for enlarging or reducing a 3D space according to one embodiment of the present disclosure may increase as the DP value of the electronic device decreases or the size of the 3D space increases.

[0249] A method according to one embodiment of the present disclosure may include: determining an inch value of an image indicator corresponding to a size at which the image indicator should be displayed on a screen; and obtaining a magnification for enlarging or reducing a 3D space based on the inch value of the image indicator, a size ratio of the image indicator in a 3D space, and the inch value of the electronic device (1000).

[0250] A method according to one embodiment of the present disclosure may include: receiving a user input for enlarging or reducing an image of a 3D space displayed on a screen; displaying the image of the 3D space by enlarging or reducing it in response to the user input; and reducing or enlarging a size ratio of the image indicator in the 3D space based on a DP value of the image indicator.

[0251] An electronic device (1000) providing an image of a 3D space according to one embodiment of the present disclosure may include a memory (1700) storing one or more instructions; and at least one processor (1300). The at least one processor (1000) may obtain a setting value of a camera for fitting a 3D space including an image indicator for controlling an IoT device (3000) to a screen of the electronic device (1000) by executing one or more instructions. The at least one processor (1000) may determine a DP value of the image indicator corresponding to a size at which the image indicator should be displayed on the screen. The at least one processor (1000) may obtain a magnification for enlarging or reducing the 3D space based on the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and the DP value of the electronic device (1000). At least one processor (1000) can adjust the camera settings based on a magnification for enlarging or reducing a 3D space. At least one processor (1000) can display an image of the enlarged or reduced 3D space on the screen of the electronic device (1000) by applying the adjusted camera settings.

[0252] According to one embodiment of the present disclosure, at least one processor may obtain a DP value of each of at least one electronic device capable of providing an image of a 3D space by executing one or more instructions. At least one processor may select a representative electronic device from among the at least one electronic device. At least one processor may determine a specific ratio value of the DP value of the representative electronic device as the DP value of the image indicator.

[0253] At least one processor according to one embodiment of the present disclosure may select a representative electronic device from among at least one electronic device based on usage count information of each of the at least one electronic device by executing one or more instructions.

[0254] According to one embodiment of the present disclosure, at least one processor may obtain size information of an image indicator in a 3D space from a server via a communication interface by executing one or more instructions. The at least one processor may determine the size of the 3D space based on a distance from a camera to an object included in the 3D space among the camera's setting values. The at least one processor may determine a size ratio of the image indicator in the 3D space based on the size of the 3D space and the size information of the image indicator.

[0255] According to one embodiment of the present disclosure, at least one processor may obtain size information of a plurality of image indicators corresponding to a plurality of IoT devices in a 3D space from a server by executing one or more instructions. If the sizes of the plurality of image indicators are different, the at least one processor may select a first image indicator corresponding to a first IoT device from among the plurality of IoT devices as a representative indicator. The at least one processor may determine a size ratio of the first image indicator in the 3D space based on the size information of the first image indicator selected as the representative indicator and the size of the 3D space.

[0256] At least one processor according to one embodiment of the present disclosure can adjust at least one of a distance from a camera to an object included in a 3D space or an angle of view of the camera based on a magnification for enlarging or reducing the 3D space by executing one or more instructions.

[0257] At least one processor according to one embodiment of the present disclosure can determine an inch value of an image indicator corresponding to a size at which the image indicator should be displayed on a screen by executing one or more instructions. At least one processor can obtain a magnification for enlarging or reducing the 3D space based on the inch value of the image indicator, a size ratio of the image indicator in 3D space, and the inch value of the electronic device (1000).

[0258] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0259] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM) or a Universal Serial Bus (USB) flash drive), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

Claims

1. A method for an electronic device (1000) to provide an image of a 3D space, Step (S310) of obtaining the setting values ​​of a camera for fitting a 3D space including an image indicator for controlling an IoT device to the screen of the electronic device; A step (S320) of determining a DP (Density-independent pixel) value of the image indicator corresponding to the size at which the image indicator should be displayed on the screen; A step (S330) of obtaining a magnification for enlarging or reducing the 3D space based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device; A step (S340) of adjusting the setting value of the camera based on the magnification for enlarging or reducing the above 3D space; and A method comprising a step (S350) of displaying an image of an enlarged or reduced 3D space on a screen of the electronic device by applying the setting values ​​of the adjusted camera.

2. In the first paragraph, the step of determining the DP value of the image indicator is: A step of obtaining a DP value of each of at least one electronic device capable of providing an image of the above 3D space; a step of selecting a representative electronic device from among at least one of the above electronic devices; and A method comprising the step of determining a specific ratio value of a DP value of the representative electronic device as a DP value of the image indicator.

3. In the second paragraph, the step of selecting the representative electronic device is as follows: A method comprising the step of selecting the representative electronic device based on usage frequency information of each of the at least one electronic device.

4. In the second paragraph, the step of selecting the representative electronic device is as follows: A method comprising the step of selecting an electronic device separately designated by a user as the representative electronic device.

5. In any one of paragraphs 1 to 4, the step of obtaining a magnification for enlarging or reducing the 3D space comprises: A step of obtaining size information of the image indicator in the above 3D space from a server; A step of determining the size of the 3D space based on the distance between the camera and the object among the setting values ​​of the camera; and A method comprising the step of determining a size ratio of the image indicator on the 3D space based on information about the size of the 3D space and the size of the image indicator.

6. In the fifth paragraph, the step of determining the size ratio of the image indicator in the 3D space is, A step (S610) of obtaining size information of a plurality of image indicators corresponding to a plurality of IoT devices in the above 3D space from the server; When the sizes of the plurality of image indicators are different, a step (S640) of selecting a first image indicator corresponding to a first IoT device among the plurality of IoT devices as a representative indicator; and A method comprising a step (S650) of determining a size ratio of the first image indicator in the 3D space based on size information of the first image indicator selected as the representative indicator and the size of the 3D space.

7. In the 6th paragraph, the step of selecting the first image indicator corresponding to the first IoT device as a representative indicator is: A method comprising the step of selecting the first image indicator corresponding to the first IoT device among the plurality of IoT devices as a representative indicator based on control count information of the plurality of IoT devices.

8. In the 6th paragraph, the step of selecting the first image indicator corresponding to the first IoT device as a representative indicator is: A method comprising the step of selecting the first image indicator corresponding to the first IoT device designated by the user as a representative indicator.

9. In any one of paragraphs 1 to 8, the step of adjusting the setting value of the camera is: A method comprising the step of adjusting at least one of the distance between the camera and the object or the angle of view of the camera in the 3D space.

10. In any one of paragraphs 1 to 9, the magnification for enlarging or reducing the 3D space is: A method wherein the DP value of the electronic device decreases or increases as the size of the 3D space increases.

11. In any one of clauses 1 to 10, the method, Step (S820) of determining an inch value of an image indicator corresponding to the size at which the image indicator should be displayed on the screen; and A method further comprising a step (S830) of obtaining a magnification for enlarging or reducing the 3D space based on the inch value of the image indicator, the size ratio of the image indicator in the 3D space, and the inch value of the electronic device.

12. In any one of paragraphs 1 to 11, the method comprises: A step (S1220) of receiving a user input for enlarging or reducing the image of the 3D space displayed on the screen; In response to the user input, a step (S1230) of displaying an image of the 3D space by enlarging or reducing it; and A method further comprising a step (S1240) of reducing or enlarging a size ratio of the image indicator in the 3D space based on the DP value of the image indicator. In an electronic device (1000) providing an image of 13.3D space, A memory (1700) storing one or more instructions; and comprising at least one processor (1300), The above at least one processor (1000) executes the one or more instructions, Obtaining the setting values ​​of the camera for fitting the 3D space including the image indicator for controlling the IoT device (3000) to the screen of the electronic device (1000), Determine the DP value of the image indicator corresponding to the size at which the image indicator should be displayed on the screen, Based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device (1000), a magnification for enlarging or reducing the 3D space is obtained, Based on the magnification for enlarging or reducing the above 3D space, the setting values ​​of the camera are adjusted, An electronic device (1000) that displays an image of a 3D space enlarged or reduced by applying the setting values ​​of the above-mentioned adjusted camera on the screen of the electronic device (1000).

14. In the 13th paragraph, the at least one processor executes the one or more instructions, Obtaining the DP value of each of at least one electronic device capable of providing an image of the above 3D space, Select a representative electronic device from at least one of the above electronic devices, An electronic device that determines a specific ratio value of the DP value of the representative electronic device as the DP value of the image indicator.

15. A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 1 to 12 on a computer.

Images