Method for providing image of 3D space and electronic device

Abstract

A method may be disclosed that includes the steps of: acquiring a camera setting value for adapting a 3D space to a screen of an electronic device, where the 3D space includes an image indicator for controlling the device; determining a density independent pixel (DP) value of the image indicator, where the DP value corresponds to a size at which the image indicator is to be displayed on the screen; acquiring a magnification for magnifying or reducing the 3D space based on the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and a DP value of the electronic device; adjusting a camera setting value based on a magnification for magnifying or reducing the 3D space; and displaying, on a screen of the electronic device, an image of the 3D space that is enlarged or reduced by applying the adjusted camera setting value.

Description

Technical Field

[0001] Embodiments of this disclosure relate to a method and electronic device for providing images in 3D space. Background Technology

[0002] The Internet of Things (IoT) refers to intelligent services that connect all objects via the internet and enable interaction between people and objects. IoT devices refer to various devices connected to the internet using IoT technology. For example, IoT devices can include home appliances connected to the network.

[0003] As the number of IoT devices in users' living spaces (e.g., homes) increases, a technology may be needed to visualize the user experience of IoT devices in those spaces. For example, when emerging fields of immersive experiences (such as hyperconnected / digital twins) are applied to users' living spaces, new user experiences of utilizing IoT devices within those spaces can be provided. Summary of the Invention

[0004] Technical solution According to embodiments of this disclosure, a method for providing an image of 3D space performed by an electronic device may include: obtaining camera settings for adapting the 3D space to a screen of the electronic device, wherein the 3D space includes an image indicator for controlling an IoT device; determining a density-independent pixel (DP) value of the image indicator, wherein the DP value corresponds to the size of the image indicator to be displayed on the screen; obtaining a magnification factor for scaling up or down the 3D space based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device; adjusting the camera settings based on the magnification factor for scaling up or down the 3D space; and displaying an image of the 3D space that has been scaled up or down by applying the adjusted camera settings on the screen of the electronic device.

[0005] According to embodiments of this disclosure, an electronic device for providing an image of 3D space may include: a memory storing one or more instructions; and at least one processor. The at least one processor can execute the one or more instructions to obtain camera settings for adapting the 3D space to a screen of the electronic device, wherein the 3D space includes an image indicator for controlling an IoT device. The at least one processor can determine a DP value for the image indicator, wherein the DP value corresponds to the size of the image indicator to be displayed on the screen. The at least one processor can obtain a magnification ratio for enlarging or reducing the 3D space based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device. The at least one processor can adjust the camera settings based on the magnification ratio for enlarging or reducing the 3D space. The at least one processor can display an image of the 3D space, enlarged or reduced by applying the adjusted camera settings, on the screen of the electronic device.

[0006] According to embodiments of this disclosure, a computer-readable recording medium may store a program for performing a method on a computer, the method comprising: obtaining camera settings for adapting a 3D space to a screen of an electronic device, wherein the 3D space includes an image indicator for controlling an IoT device; determining a density-independent pixel (DP) value of the image indicator, wherein the DP value corresponds to a size at which the image indicator will be displayed on the screen; obtaining a magnification factor for enlarging or reducing the 3D space based on the DP value of the image indicator, a size ratio of the image indicator in the 3D space, and a DP value of the electronic device; adjusting the camera settings based on the magnification factor for enlarging or reducing the 3D space; and displaying an image of the 3D space enlarged or reduced by applying the adjusted camera settings on the screen of the electronic device. Attached Figure Description

[0007] Figure 1 This is a diagram illustrating a system for providing images in 3D space according to an embodiment of the present disclosure.

[0008] Figure 2 This is a diagram illustrating the operation performed by an electronic device according to an embodiment of the present disclosure to display an image of 3D space by adapting 3D space to a screen.

[0009] Figure 3 This is a flowchart illustrating a method performed by an electronic device to provide an image in 3D space based on DP values, according to an embodiment of the present disclosure.

[0010] Figure 4This is a diagram illustrating the operation performed by an electronic device, according to an embodiment of the present disclosure, of determining the screen display size and image indicators of a representative electronic device.

[0011] Figure 5 This is a diagram illustrating the operation of obtaining a magnification for enlarging or reducing a 3D space according to an embodiment of the present disclosure.

[0012] Figure 6 This is a flowchart illustrating a method for selecting a representative indicator performed by an electronic device according to an embodiment of the present disclosure.

[0013] Figure 7 This is a diagram illustrating the operation of selecting a representative indicator performed by an electronic device according to an embodiment of the present disclosure.

[0014] Figure 8 This is a flowchart illustrating a method performed by an electronic device to provide an image in 3D space based on inch values, according to an embodiment of the present disclosure.

[0015] Figure 9 This is a diagram illustrating the operation of determining the magnification ratio in each of various electronic devices according to embodiments of the present disclosure.

[0016] Figure 10 This is a diagram illustrating the operation performed by an electronic device according to an embodiment of the present disclosure to provide images of different sizes in 3D space.

[0017] Figure 11a This is a diagram illustrating the operation of providing images in 3D space in electronic devices with different display sizes according to embodiments of the present disclosure.

[0018] Figure 11b This is a diagram illustrating the operation of providing 3D spatial images in an electronic device 1000 including a foldable display according to an embodiment of the present disclosure.

[0019] Figure 12 This is a flowchart illustrating a method performed by an electronic device to reduce or enlarge the size ratio of an image indicator in 3D space according to an embodiment of the present disclosure.

[0020] Figure 13 This is a diagram illustrating the operation of an electronic device performing a magnified image indicator in 3D space according to an embodiment of the present disclosure.

[0021] Figure 14 This is a diagram illustrating the operation of reducing the size ratio of an image indicator in 3D space performed by an electronic device according to an embodiment of the present disclosure.

[0022] Figure 15This is a flowchart illustrating a method performed by an electronic device to display a user interface (UI) component for controlling an IoT device, according to an embodiment of the present disclosure.

[0023] Figure 16a This is a diagram illustrating the operation of displaying an image in 3D space performed by an electronic device according to an embodiment of the present disclosure.

[0024] Figure 16b This is a diagram illustrating the operation of a UI component for controlling an IoT device, performed by an electronic device according to an embodiment of the present disclosure.

[0025] Figure 16c This is a diagram illustrating operations performed by an electronic device to provide status information of an IoT device according to embodiments of the present disclosure.

[0026] Figure 17 This is a block diagram illustrating the function of an electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0027] The terminology used in this disclosure will be briefly described, and embodiments of this disclosure will be described in detail.

[0028] The terms used in this disclosure are selected from commonly used terms in light of their function in the embodiments thereof, but these terms may vary depending on the intent of those skilled in the art, precedents, or the emergence of new technologies. Furthermore, in certain cases, terms of arbitrary choice by the applicant may be used, and in such cases, their meanings will be described in detail in the description of the corresponding embodiments of this disclosure. Therefore, the terms used in this disclosure should be defined based on their meanings and the overall content of this disclosure, rather than simply on their names.

[0029] In this disclosure, the expression "at least one of a, b or c" may refer to "a", "b", "c", "a and b", "a and c", "b and c", "all of a, b and c" or variations thereof.

[0030] Throughout this disclosure, when a part is described as "comprising" a component, it should be understood that other components are not excluded and may be further included unless otherwise stated. Furthermore, terms such as "...unit" and "module" as used in this disclosure refer to a unit that performs at least one function or operation, and "...unit" or "module" may be implemented in hardware, software, or a combination of hardware and software.

[0031] It should be understood that the boxes and combinations of flowcharts in each flowchart can be executed by one or more computer programs that include computer-executable instructions. One or more computer programs may be stored entirely in a single memory, or they may be partitioned and stored in multiple different memories.

[0032] It should be understood that, unless the context clearly indicates otherwise, the singular form also includes the plural form. Thus, for example, the term "component surface" may also include one or more such surfaces.

[0033] Any function or operation described herein may be performed by a single processor or a combination of processors. A single processor or a combination of processors may include circuitry that performs processing, such as an application processor (AP), a communication processor (CP), a graphics processing unit (GPU), a neural processing unit (NPU), a microprocessor unit (MPU), a system-on-a-chip (SoC), or an integrated chip (IC).

[0034] In the following, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings to enable those skilled in the art to easily implement the disclosure. However, embodiments of the present disclosure can be implemented in many different forms and are not limited to the embodiments described herein. Furthermore, in the accompanying drawings, parts irrelevant to the description have been omitted for clarity of the embodiments of the present disclosure, and throughout the disclosure, the same elements are represented by the same reference numerals.

[0035] Figure 1 This is a diagram illustrating a system for providing an image 100 in 3D space according to an embodiment of the present disclosure.

[0036] like Figure 1 As shown, the system for providing the 3D spatial image 100 may include, but is not limited to, electronic device 1000, server 2000, and IoT device 3000. However, it is not... Figure 1 All components described herein are necessary components. A system for providing 100 images in 3D space is available in more than [number missing]. Figure 1 The components shown can be implemented with more or fewer components. For example, a system for providing a 3D spatial image 100 can be implemented using an electronic device 1000 and an IoT device 3000. Furthermore, in addition to the electronic device 1000, server 2000, and IoT device 3000, the system for providing a 3D spatial image 100 can also be implemented by including an edge computing device or a smart hub (smart dongle). The smart hub can connect the IoT device 3000, which supports Zigbee, Z-Wave, Thread, and Matter communication, to the server 2000. Each component will be described in detail below.

[0037] The IoT device 3000 may include, but is not limited to, a communication interface capable of communicating with the electronic device 1000 or the server 2000, a user interface for receiving user input or outputting information to the user, at least one processor for controlling the operation of the IoT device 3000, and at least one memory for storing a program for controlling the operation of the IoT device 3000.

[0038] The IoT device 3000 can be at least one of various types of household appliances. For example, the IoT device 3000 may include at least one of a refrigerator, dishwasher, electric stove, electric oven, air conditioner, clothes manager, washing machine, dryer, or microwave oven, but is not limited thereto. The IoT device 3000 may include various types of household appliances, such as robotic vacuum cleaners, vacuum cleaners, and televisions. Furthermore, the above-mentioned household appliances are merely examples. In addition to the above-mentioned household appliances, according to embodiments of this disclosure, devices connected to the electronic device 1000 or the server 2000 and capable of performing the operations described below may be included in the IoT device 3000.

[0039] According to embodiments of this disclosure, IoT device 3000 can connect to electronic device 1000 or server 2000 via an access point (AP), or it can connect directly to electronic device 1000 or server 2000 without going through the AP. The AP can connect IoT device 3000 or electronic device 1000 to a wide area network (WAN) to which server 2000 is connected. IoT device 3000 or electronic device 1000 can connect to server 2000 via the WAN. The AP can communicate with IoT device 3000 or electronic device 1000 using wireless communication (such as Wi-Fi (IEEE 802.11), Bluetooth (IEEE 802.15.1), or Zigbee (IEEE 802.15.4)), and can connect to the WAN using wired communication, but is not limited thereto.

[0040] The IoT device 3000 can connect to the electronic device 1000 or the server 2000 via either a long-range or short-range wireless network. For example, the IoT device 3000 can connect to the electronic device 1000 via a short-range wireless network (e.g., Wi-Fi Direct). Alternatively, the IoT device 3000 can connect to the electronic device 1000 or the server 2000 via a WAN using a long-range wireless network (e.g., a cellular communication module). Furthermore, the IoT device 3000 can connect to the WAN using wired communication and can then connect to the electronic device 1000 or the server 2000 via the WAN.

[0041] When IoT device 3000 can connect to the WAN via wired communication, it can also act as a connection repeater. Therefore, IoT device 3000 can connect another IoT device to the WAN to which server 2000 is connected. Furthermore, the other IoT device can connect IoT device 3000 to the WAN to which server 2000 is connected.

[0042] IoT device 3000 can send information about its operation or status to other IoT devices, electronic device 1000, or server 2000 via a network. For example, IoT device 3000 can periodically or in real-time send information about its operation or status to electronic device 1000 or server 2000 when it receives a request from server 2000 or when a specific event occurs in IoT device 3000. When receiving information about the operation or status of IoT device 3000 from server 2000, server 2000 can update the information about the operation or status of IoT device 3000 stored in server 2000 and send the updated information about the operation or status of IoT device 3000 to electronic device 1000 via the network. Here, updating information may include various operations that change existing information (such as adding new information to existing information or replacing existing information with new information).

[0043] The IoT device 3000 can obtain various information from other IoT devices, electronic device 1000, or server 2000, and can provide the obtained information to the user. For example, the IoT device 3000 can obtain information related to the functions of the IoT device 3000 (e.g., recipes, washing instructions, etc.) and various environmental information (e.g., weather, temperature, humidity, etc.) from server 2000, and can output the obtained information through the user interface.

[0044] The IoT device 3000 can operate according to control commands received from other IoT devices, electronic device 1000, or server 2000. For example, when the IoT device 3000 obtains prior approval from the user so that it can operate according to control commands from server 2000 even without user input, the IoT device 3000 can operate according to control commands received from server 2000. Here, the control commands received from server 2000 may include, but are not limited to, control commands input by the user through electronic device 1000 or control commands based on preset conditions.

[0045] Server 2000 may include a communication interface capable of communicating with another server, electronic device 1000, or IoT device 3000; at least one processor capable of processing data received from another server, electronic device 1000, or IoT device 3000; and at least one memory capable of storing programs for processing the data or processed data. Server 2000 may be implemented as various computing devices (such as workstations, clouds, data drives, and data stations). Server 2000 may be implemented as one or more servers based on functions, detailed configurations of functions, or physical or logical separation of data, and may send and receive data and process the sent and received data through communication between servers.

[0046] Server 2000 can perform functions such as managing user accounts, registering IoT devices 3000 by linking them to user accounts, and managing or controlling already registered IoT devices 3000. For example, a user can access server 2000 via electronic device 1000 and can create a user account. User accounts can be identified by an ID and password set by the user. Server 2000 can register IoT devices 3000 to user accounts according to a set procedure. For example, server 2000 can register, manage, and control IoT devices 3000 by linking their identification information (e.g., serial number or MAC address) to user accounts.

[0047] Server 2000 can determine control commands by using technologies such as artificial intelligence. For example, server 2000 can receive information about the operation or status of IoT device 3000 or information about the user of electronic device 1000, process the information by using technologies such as artificial intelligence, and send the processing results or control commands to IoT device 3000 or electronic device 1000 based on the processing results.

[0048] The electronic device 1000 can be at least one of various devices owned by the user. That is, the user can own various types of electronic devices 1000 with different resolutions, display sizes, etc. The electronic device 1000 can be carried by the user or can be placed in the user's home or office.

[0049] Electronic device 1000 may include, but is not limited to, portable telephones, smartphones, laptop computers, tablet PCs, wall-mounted tablets, e-book terminals, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigators, MP3 players, digital cameras, etc. Electronic device 1000 may be a wearable device that can be worn by a user. Wearable devices may include at least one of the following: accessory devices (e.g., watches, rings, wristbands, ankle straps, necklaces, glasses, or contact lenses), head-mounted devices (HMDs), fabric or clothing integrated devices (e.g., electronic clothing), body attachment devices (e.g., skin pads), or bio-implantable devices (e.g., implantable circuitry), but are not limited to. Electronic device 1000 may be a household appliance including a display. For example, electronic device 1000 may include televisions, refrigerators, etc., but is not limited to.

[0050] The electronic device 1000 may include, but is not limited to, a communication interface capable of communicating with the IoT device 3000 or the server 2000, a user interface for receiving user input or outputting information to the user, at least one processor for controlling the operation of the electronic device 1000, and at least one memory for storing a program for controlling the operation of the electronic device 1000.

[0051] The program (i.e., application) used to control the IoT device 3000 can be stored in the memory of the electronic device 1000. The application can be sold as if it were installed on the electronic device 1000, or it can be installed on the electronic device 1000 after being downloaded from an external server.

[0052] By executing the application installed on the electronic device 1000, the user can access the server 2000 to create a user account, and can perform communication with the server 2000 based on the logged-in user account to register the IoT device 3000.

[0053] For example, when IoT device 3000 is operated such that it can connect to server 2000 according to a process guided by an application installed on electronic device 1000, server 2000 can register the identification information of IoT device 3000 (e.g., serial number or MAC address) to a user account, thereby registering IoT device 3000 to the user account.

[0054] The electronic device 1000 according to embodiments of this disclosure may be a user terminal that provides a user with an image 100 of 3D space. The 3D space may be a space set by the user of the electronic device 1000. For example, the 3D space may be the user's living space (e.g., home, office, etc.), but is not limited thereto. The 3D space may also be represented as a 3D map.

[0055] According to embodiments of this disclosure, a user can define a 3D space according to a process guided by an application installed on electronic device 1000 (e.g., an application for managing home appliances). For example, a user can define a 3D space based on a floor plan corresponding to a building (e.g., an apartment) where the user currently resides. A user can also define a 3D space based on a map generated by a robotic vacuum cleaner. A user can also directly design or configure a 3D space. A 3D space can be a single space or can include multiple spaces that are different from each other. A 3D space can also include furniture or home appliances. When a user defines a 3D space through an application installed on electronic device 1000, information about the user-defined 3D space can be sent to server 2000, and information about the user-defined 3D space can be stored in server 2000.

[0056] Users can control IoT device 3000 using an application installed on electronic device 1000. For example, when a user logs into their user account using an application installed on electronic device 1000, IoT device 3000 registered to the user account can appear, and when a control command for IoT device 3000 is entered, the control command can be sent to IoT device 3000 via server 2000.

[0057] In addition, such as Figure 1 As shown, when a user executes an application installed on electronic device 1000 and requests an image 100 in 3D space, electronic device 1000 can receive 3D space information from server 2000 and display the image 100 in 3D space on a screen (display). In this case, the image 100 in 3D space may include objects constituting the 3D space (e.g., sofa, table, etc.) and image indicators 10 corresponding to IoT devices 3000 registered with server 2000. The user can input control commands to IoT device 3000 through the image indicators 10 included in the image 100 in 3D space.

[0058] Image indicator 10 can be a UI component created to enable users to interact with electronic device 1000 or server 2000. Image indicator 10 can also be represented as a visual element, visual component, icon, control button, control item, or control object. Image indicator 10 may include a thumbnail image or icon image of its corresponding IoT device 3000. Figure 1 In the example shown, the image indicator 10 is circular, but it is not limited to this. The image indicator 10 can be various shapes, such as ellipse, polygon (e.g., square, triangle, hexagon, etc.), teardrop shape, and star shape.

[0059] According to embodiments of this disclosure, electronic device 1000 can display an image 100 of a 3D space by adapting a 3D space (map) to the screen (display) of electronic device 1000. For example, to adapt the 3D space (map) to the screen, electronic device 1000 can appropriately adjust the ratio of the boundaries of the 3D space (map) to the boundaries of the camera's viewport. In this case, electronic device 1000 can display the entire 3D space (map) to the user at once, and therefore, the user can easily grasp the entire space. Conversely, because the image of the 3D space is displayed to adapt to the screen based on the size of the 3D space, the size of the image indicator 10 (e.g., an icon) included in the image 100 of the 3D space can vary depending on the circumstances, regardless of the actual size of the 3D space (e.g., a home) or the display size or resolution of electronic device 100. For example, as the actual size of the user's living space increases, the image indicator 100 of the 3D space may appear smaller, and as the size of the display of the electronic device 100 currently used by the user decreases, the image 100 of the 3D space and the image indicator 10 may appear even smaller. Furthermore, the size of the image indicator 10 can be displayed in a variable manner depending on the display resolution of the electronic device 1000 currently being used by the user.

[0060] Therefore, when the user's actual living space is very large or the display size of the electronic device 1000 that the user is currently using is small, the image indicator 10 used for operation or status checks may appear too small, making it inconvenient for the user to have to zoom in on the 3D spatial image 100 when trying to check or control the status of the IoT device 3000.

[0061] Furthermore, when multiple electronic devices 1000 available to the user are present (e.g., TV, mobile device, tablet computer, wall-mounted tablet computer, etc.), the electronic devices 1000 can have different display sizes and resolutions. Therefore, when the 3D spatial image 100 is initially displayed on each of the electronic devices 1000, the user can view image indicators 10 of different sizes.

[0062] Reference Figure 2 For example, the display size of the first electronic device 1000-1 may be smaller than the display size of the second electronic device 1000-2. In this case, when the first electronic device 1000-1 and the second electronic device 1000-2 each display images of the same 3D space by adapting the 3D space to the screen, the image indicator included in the 3D space image displayed on the first electronic device 1000-1 may be smaller than the image indicator included in the 3D space image displayed on the second electronic device 1000-2.

[0063] Therefore, according to embodiments of the present invention, in order for each electronic device 1000 in the electronic device 1000 to display an image indicator 10 of the same size, the electronic device 1000 in the electronic device 1000 may adjust the camera settings based on the size of the image indicator 10 to be displayed on the screen, rather than operating the camera settings based on 3D space. Here, the camera may be a virtual camera used to render 3D space. Just as a user can view a part of the real world through a camera, a user can view a part of 3D space through a virtual camera. Objects in 3D space are projected onto the 2D plane of the virtual camera, and the scene of the projected 2D plane appears on the display (screen) of the electronic device 1000. Hereinafter, the camera may also be referred to as a 3D camera.

[0064] In the following text, reference will be made to Figure 3 The method of providing a 3D spatial image by adjusting camera settings, performed by electronic device 1000, is described in detail, so that users can experience the same size image indicator 10 across multiple devices.

[0065] Figure 3 This is a flowchart illustrating a method performed by an electronic device 1000 to provide an image in 3D space based on DP values, according to an embodiment of the present disclosure.

[0066] Reference Figure 3 The method for providing a 3D spatial image, executed by the electronic device 1000, may include operations S310 to S350. In embodiments of this disclosure, operations S310 to S350 may be executed by at least one processor included in the electronic device 1000. The method for providing a 3D spatial image, executed by the electronic device 1000, is not limited to... Figure 3 The method shown, and in one or more embodiments, may further include Figure 3 Operations not shown in the diagram may be omitted.

[0067] When the electronic device 1000 initially enters the 3D space or when the 3D space is reconfigured (e.g., changing the 3D space, editing the 3D space, changing the floor, etc.), operations S310 to S350 can be performed.

[0068] During operation S310, the electronic device 1000 according to an embodiment of the present disclosure can obtain camera settings for adapting a 3D space, including an image indicator for controlling the IoT device 3000, to the screen of the electronic device 1000.

[0069] According to embodiments of this disclosure, camera settings may include, but are not limited to, at least one of the distance between the camera and an object in 3D space or the camera's field of view. Objects in 3D space may include, but are not limited to, a floor, a bed, a table, etc.

[0070] According to embodiments of this disclosure, in order to adapt a 3D space (map) to the screen, the electronic device 1000 can appropriately adjust the ratio of the boundary of the 3D space (map) to the boundary of the camera's viewport. Furthermore, the electronic device 1000 can obtain a first distance between the camera and an object, or a first field of view of the camera, as a camera setting value at the point in time when appropriately adjusting the ratio of the boundary of the 3D space (map) to the boundary of the camera's viewport. As the display size of the electronic device 1000 increases, the first distance between the camera and the object can decrease; conversely, as the display size of the electronic device 1000 decreases, the first distance between the camera and the object can increase. For example, referring to… Figure 2 For the same 3D space, the first distance between the camera and the object in the first electronic device 1000-1 can be greater than the first distance between the camera and the object in the second electronic device 1000-2.

[0071] In operation S320, the electronic device 1000 according to an embodiment of the present disclosure can determine the density-independent pixel (DP) value of an image indicator corresponding to the size on which the image indicator will be displayed on the screen.

[0072] In the field of user interface design, density-independent pixels (DP or DIP) are virtual pixel units that allow the size and arrangement of screen components to be specified independently, regardless of the device's physical display resolution. A display resolution of 160 dots per inch (DPI) is used as a standard. For example, on a 240 DPI display, 1 DP represents 1.5 pixels. Using DP values ​​allows for consistent user interface design across devices with different resolutions and sizes, regardless of the individual device's resolution.

[0073] According to embodiments of this disclosure, electronic device 1000 may determine a specific ratio value of the DP value of a representative electronic device among at least one electronic device capable of providing an image in 3D space as the DP value of an image indicator (e.g., an icon). At least one electronic device may include electronic device 1000.

[0074] According to embodiments of this disclosure, electronic device 1000 can obtain the DP value of each of at least one electronic device capable of providing an image in 3D space. For example, electronic device 1000 can obtain the DP value from other electronic devices. Electronic device 1000 can receive the DP value of other electronic devices directly from other electronic devices using D2D communication, or it can obtain the DP value of other electronic devices through an edge computing device or a smart hub.

[0075] The electronic device 1000 can also obtain usage count information from other electronic devices. For example, the electronic device 1000 can obtain information about the number of times that other electronic devices have executed a specific application and displayed images in 3D space, including image indicators.

[0076] According to embodiments of this disclosure, electronic device 1000 can select a representative electronic device from at least one electronic device. For example, electronic device 1000 can select a representative electronic device based on usage count information of each of the at least one electronic device. That is, electronic device 1000 can select the electronic device that has displayed images of 3D space including image indicators the most times as the representative electronic device. Optionally, electronic device 1000 can select an electronic device individually specified by a user as the representative electronic device. For example, electronic device 1000 can select a smartphone specified by the user as the representative electronic device.

[0077] According to embodiments of this disclosure, the electronic device 1000 can determine a specific ratio (e.g., 10%) of the DP value of a representative electronic device as the DP value of an image indicator. For example, when the DP value of the representative electronic device is 200 DP, the DP value of the image indicator can be determined to be 20 DP (=200 × 1 / 10). The specific ratio (e.g., 10%) of the DP value of the representative electronic device can be preset and can also be changed by the user. For example, 1 / 10 of the DP value of the representative electronic device can be determined as the default DP value of the image indicator, but when the user expects to view the image indicator at a larger size on the screen, 1 / 10 can be changed to 1 / 7.

[0078] Reference Figure 4 The operation of determining the DP value of the image indicator, performed by the electronic device 1000, is described in more detail.

[0079] Figure 4 This is a diagram illustrating the operation performed by electronic device 1000 to determine the screen display size and image indicator of a representative electronic device according to an embodiment of the present disclosure. Figure 4 Examples are shown where, in addition to the currently used electronic device 1000, the user also owns a first electronic device 1000-1, a second electronic device 1000-2, a third electronic device 1000-3, and a fourth electronic device 1000-4.

[0080] Reference Figure 4Electronic device 1000 can receive a first DP value or a first inch value from first electronic device 1000-1 (401), a second DP value or a second inch value from second electronic device 1000-2 (402), a third DP value or a third inch value from third electronic device 1000-3 (403), and a fourth DP value or a fourth inch value from fourth electronic device 1000-4 (404).

[0081] Furthermore, electronic device 1000 can obtain usage count information from first electronic device 1000-1, second electronic device 1000-2, third electronic device 1000-3, and fourth electronic device 1000-4. Electronic device 1000 can receive usage count information directly from each of the electronic devices, or it can receive usage count information from an edge computing device, a smart hub, or server 2000.

[0082] As a result of comparing multiple usage counts of various electronic devices, when the first electronic device 1000-1 has the maximum number of uses, electronic device 1000 may select the first electronic device 1000-1 as the representative electronic device. In this case, the first DP value of the first electronic device 1000-1 may be 720 DP, and the first inch value of the first electronic device 1000-1 may be 8 inches.

[0083] Electronic device 1000 can determine the screen display size (DP value or inch value) of the image indicator by using the DP value (or inch value) of a representative electronic device. For example, electronic device 1000 can determine 72 DP (or 0.8 inches) as the screen display size of the image indicator, where 72 DP is a preset ratio (1 / 10) of the DP value (or inch value) of the first electronic device 1000-1, which serves as the representative electronic device.

[0084] According to embodiments of this disclosure, each of the first electronic device 1000-1, the second electronic device 1000-2, the third electronic device 1000-3, and the fourth electronic device 1000-4 can determine the screen display size (DP value or inch value) of the image indicator by using the DP value (or inch value) of a representative electronic device. For example, each of the first electronic device 1000-1, the second electronic device 1000-2, the third electronic device 1000-3, and the fourth electronic device 1000-4 can select the first electronic device 1000-1, which has the most usage times, as the representative electronic device, and 72 DP (or 0.8 inches), which is a preset ratio (1 / 10) of the DP value (or inch value) of the first electronic device 1000-1, can be determined as the screen display size of the image indicator. Therefore, the image indicator needs to be displayed on all the electronic devices owned by the user, namely the 1000, 1000-1, 1000-2, 1000-3 and 1000-4, with a size of 72 DP (or 0.8 inches).

[0085] Furthermore, although not in Figure 4 As shown in the illustration, however, according to an embodiment of this disclosure, when the screen display size of the image indicator is determined to be 72 DP (or 0.8 inches) of a preset ratio (1 / 10) of the DP value (or inch value) of the first electronic device 1000-1, which is a representative electronic device, the electronic device 1000 can send information indicating that the screen display size of the image indicator is 72 DP (or 0.8 inches) to the first electronic device 1000-1, the second electronic device 1000-2, the third electronic device 1000-3, and the fourth electronic device 1000-4.

[0086] Return to reference Figure 3 During operation S330, the electronic device 1000 according to an embodiment of the present disclosure can obtain a magnification for scaling up or down the 3D space based on the DP value of the image indicator, the size ratio of the image indicator in 3D space, and the DP value of the electronic device 1000.

[0087] For example, electronic device 1000 can calculate the magnification for enlarging or reducing 3D space as shown in Equation 1.

[0088] Equation 1 Magnification = In other words, the magnification of 3D space can be obtained by dividing the DP value of the image indicator obtained by operation S320 by the product of the DP value of electronic device 1000 and the size ratio of the image indicator in 3D space.

[0089] Here, the size ratio of the image indicator in 3D space can be defined by Equation 2. That is, the size ratio of the image indicator in 3D space can be obtained by dividing the size of the image indicator by the size of the 3D space. The size of the image indicator can be defined as a virtual unit value in 3D space.

[0090] Equation 2

[0091]

[0092] Furthermore, the size of the 3D space can be obtained by multiplying the distance between the camera and the object in the camera settings obtained in operation S310 by Tan(FoV), and then further multiplying the result by 2. The size of the 3D space can be, but is not limited to, one of the vertical length, horizontal length, or diagonal length of the bounding box that defines the 3D space.

[0093] Therefore, Equation 1, used to obtain the magnification for enlarging or reducing 3D space, can be rearranged into Equation 3. According to Equation 3, the magnification for enlarging or reducing 3D space can increase as the DP value of electronic device 1000 decreases or the size of 3D space (distance between camera and object × Tan(FoV) × 2) increases.

[0094] Equation 3

[0095] According to embodiments of this disclosure, electronic device 1000 can obtain size information from server 2000 for use with an image indicator in Equation 3. Electronic device 1000 can determine the size of the 3D space based on the distance between the camera and the object in the camera settings obtained in operation S310. Furthermore, electronic device 1000 can determine the size ratio of the image indicator in the 3D space based on the size of the 3D space and the size information of the image indicator obtained from server 2000. (Refer to...) Figure 5 This section will describe a specific example of the operation performed by the electronic device 1000 to determine the size ratio of an image indicator in 3D space.

[0096] Reference Figure 5 When the 3D space is adapted to the screen of the electronic device 1000, the size of the 3D space can be 20 units (=d×Tan(FoV)×2), and the size of the image indicator in the 3D space obtained from the server 2000 can be 1 unit. Therefore, the size ratio of the image indicator in the 3D space can be 1 / 20.

[0097] Finally, the electronic device 1000 can determine the magnification for scaling up or down the 3D space by dividing the DP value (e.g., 72 DP) of the image indicator determined in operation S320 by multiplying the size ratio of the image indicator in 3D space (e.g., 1 / 20) by the DP value of the electronic device 1000 (e.g., 360 DP).

[0098] For example, when the DP value of electronic device 1000 is 360 DP, the product of the DP value of electronic device 1000 and the size ratio of the image indicator in 3D space can be 18 DP. That is, based on the current camera settings, the image indicator can be displayed on the screen of electronic device 1000 at 18 DP. However, when the DP value of the image indicator calculated in operation S320 is 72 DP, the image indicator is displayed at a size of 72 DP. Therefore, when 72 DP is divided by 18 DP, the image in 3D space will be magnified four times.

[0099] Return to reference Figure 3 During operation S340, the electronic device 1000 according to an embodiment of the present disclosure can adjust the camera settings obtained in operation S310 based on the magnification used to enlarge or reduce the 3D space.

[0100] According to embodiments of this disclosure, at least one of the following can be adjusted: the distance between the camera and an object in 3D space, or the camera's field of view. For example, when it is determined that the 3D space should be magnified four times to allow an image indicator to be displayed at a size corresponding to the DP value of the image indicator determined by operation S320, the electronic device 1000 can adjust the camera distance such that the distance between the camera and the object in 3D space is reduced to 1 / 4. Optionally, the electronic device 1000 can move the camera closer to the object, reducing the distance between the camera and the object to 1 / 5, and can adjust the camera's field of view to increase the field of view, thus magnifying the 3D space four times. Optionally, the electronic device 1000 can adjust the camera's field of view to decrease the field of view, thus magnifying the 3D space four times. According to embodiments of this disclosure, the electronic device 1000 can adjust the camera's focal length to adjust the camera's field of view. For example, the electronic device 1000 can adjust the field of view to be narrower by increasing the focal length, or it can adjust the field of view to be wider by decreasing the focal length.

[0101] Furthermore, distortion may occur in the 3D image when the camera's field of view is adjusted, and therefore, the electronic device 1000 can apply a distortion correction algorithm.

[0102] According to an embodiment of this disclosure, when the magnification obtained in operation S330 for enlarging or reducing the 3D space is 1, the electronic device 1000 can maintain the camera settings in the current state.

[0103] During operation S350, the electronic device 1000 according to an embodiment of the present disclosure can display on the screen of the electronic device 1000 an image of 3D space that has been magnified or reduced by applying adjusted settings of a camera.

[0104] According to embodiments of this disclosure, when the electronic device 1000 applies adjusted camera settings, the size of the image indicator included in the 3D space image displayed on the screen of the electronic device 1000 may have a DP value determined in S320. That is, according to embodiments of this disclosure, the electronic device 1000 can adjust the camera settings such that the same size image indicator is displayed across all devices owned by the user.

[0105] Furthermore, when multiple image indicators corresponding to multiple IoT devices in 3D space have different sizes, the electronic device 1000 can select a representative indicator to determine the size ratio of the image indicator in 3D space, and the size ratio of the image indicator in 3D space can be determined by using the size of the representative indicator. (See reference...) Figure 6 This will describe the operation of selecting the representative indicator performed by the electronic device 1000.

[0106] Figure 6 This is a flowchart illustrating a method for selecting a representative indicator performed by an electronic device 1000 according to an embodiment of the present disclosure.

[0107] During operation S610, the electronic device 1000 according to embodiments of the present disclosure can obtain 3D spatial information from the server 2000. For example, the electronic device 1000 can obtain size information of multiple image indicators corresponding to multiple IoT devices from the server 2000. Furthermore, the electronic device 1000 can obtain control count information of the multiple IoT devices from the server 2000. The control count information of the multiple IoT devices may be information about the number of times each IoT device has been controlled by the user.

[0108] During operation S620, the electronic device 1000 according to an embodiment of the present disclosure can determine whether multiple image indicators have different sizes based on size information of multiple image indicators obtained from the server 2000.

[0109] For example, when the size of the first, second, and third image indicators is 2 units, the size of the fourth and fifth image indicators is 1.5 units, and the size of the sixth and seventh image indicators is 1 unit, the electronic device 1000 can determine that the multiple image indicators have different sizes. Conversely, when all seven image indicators have a size of 1 unit, the electronic device 1000 can determine that the multiple image indicators do not have different sizes.

[0110] In operation S630, when all multiple image indicators have the same size (No in S620), the electronic device 1000 according to an embodiment of the present disclosure can determine the size ratio of the image indicator in the 3D space by using the size of the image indicator and the size of the 3D space.

[0111] Reference Figure 7 For example, when the size of all image indicators included in the 3D space is 1 unit and the size of the 3D space is 20 units, the electronic device 1000 can determine the size ratio of the image indicators in the 3D space as 1 / 20.

[0112] In operation S640, when multiple image indicators have different sizes ("Yes" in S620), the electronic device 1000 according to an embodiment of the present disclosure can select a representative indicator from the multiple image indicators. In operation S650, the electronic device 1000 according to an embodiment of the present disclosure can determine the size ratio of the image indicator in 3D space based on the size of the representative indicator.

[0113] According to embodiments of this disclosure, electronic device 1000 can select a first image indicator corresponding to a first IoT device among the multiple IoT devices as a representative indicator based on control counting information of multiple IoT devices. For example, referring to... Figure 7 720. When a user most frequently controls a lighting device among multiple IoT devices, the electronic device 1000 may select a first image indicator 700 corresponding to the lighting device among the multiple IoT devices as a representative indicator. The first image indicator 700 may include UI components for displaying the status of the lighting device or controlling the operation of the lighting device. When the size of the first image indicator 700 is 2 units and the size in 3D space is 20 units, the electronic device 1000 may determine the size ratio of the image indicator in 3D space to be 1 / 10.

[0114] According to embodiments of this disclosure, the electronic device 1000 can select a first image indicator corresponding to a first IoT device designated by a user as a representative indicator. For example, the user can designate an image indicator of a robotic vacuum cleaner as the representative indicator. When the size of the image indicator of the robotic vacuum cleaner is 1 unit and the size in 3D space is 20 units, the electronic device 1000 can determine the size ratio of the image indicator in 3D space to be 1 / 20.

[0115] According to embodiments of this disclosure, the size ratio of an image indicator in 3D space can be determined by using the average size of the image indicator corresponding to multiple IoT devices. For example, when the average size of the image indicator is 1.5 units and the size of the 3D space is 20 units, the electronic device 1000 can determine the size ratio of the image indicator in 3D space as 1.5 / 20.

[0116] According to embodiments of this disclosure, when the size ratio of the image indicator in 3D space is determined, the electronic device 1000 can determine the magnification for scaling up or down the 3D space using Equation 1 above. For example, when the size of the representative indicator is 2 units, the size of the 3D space is 20 units, the DP value of the image indicator is 72 DP, and the DP value of the electronic device 1000 is 360 DP, the magnification can be 2.

[0117]

[0118]

[0119] Therefore, the electronic device 1000 can adjust the distance between the camera and the object or the field of view of the camera to magnify the 3D space by two times.

[0120] Furthermore, according to embodiments of this disclosure, the electronic device 1000 can determine the magnification for scaling up or down 3D space by using inch values ​​instead of DP values. (See also...) Figure 8 The method for adjusting camera settings based on the inch value of the image indicator and the inch value of the electronic device 1000, performed by the electronic device 1000, is described in detail.

[0121] Figure 8 This is a flowchart illustrating a method performed by an electronic device 1000 to provide an image in 3D space based on inch values, according to an embodiment of the present disclosure.

[0122] Reference Figure 8 The method for providing a 3D spatial image, executed by the electronic device 1000, may include operations S810 to S850. In embodiments of this disclosure, operations S810 to S850 may be executed by at least one processor included in the electronic device 1000. The method for providing a 3D spatial image, executed by the electronic device 1000, is not limited to... Figure 8 The method shown, and in one or more embodiments, may further include Figure 8 Operations not shown in the diagram may be omitted.

[0123] During operation S810, the electronic device 1000 according to an embodiment of the present disclosure can obtain camera settings for adapting a 3D space, including an image indicator for controlling the IoT device 3000, to the screen of the electronic device 1000.

[0124] According to embodiments of this disclosure, in order to adapt a 3D space (map) to the screen, the electronic device 1000 can appropriately adjust the ratio of the boundary of the 3D space (map) to the boundary of the camera's viewport. Furthermore, the electronic device 1000 can obtain a first distance between the camera and an object or a first field of view of the camera as a camera setting value at the point in time when the ratio of the boundary of the 3D space (map) to the boundary of the camera's viewport is appropriately adjusted.

[0125] Operating S810 and Figure 3 Since operation S310 corresponds to this, the redundant description of operation S810 will be omitted.

[0126] During operation S820, the electronic device 1000 according to an embodiment of the present disclosure can determine the inch value of the image indicator corresponding to the size of the image indicator to be displayed on the screen.

[0127] According to embodiments of this disclosure, electronic device 1000 may determine a specific ratio value of the inch value of a representative electronic device among at least one electronic device capable of providing an image in 3D space as the inch value of an image indicator (e.g., an icon). At least one electronic device may include electronic device 1000.

[0128] According to embodiments of this disclosure, electronic device 1000 can obtain the inch value of each of at least one electronic device capable of providing an image in 3D space. For example, electronic device 1000 can obtain the inch value of a display from other electronic devices. Electronic device 1000 can receive the inch value of other electronic devices directly from other electronic devices using D2D communication, or it can obtain the inch value of other electronic devices through an edge computing device or a smart hub.

[0129] The electronic device 1000 can also obtain usage count information from other electronic devices. For example, the electronic device 1000 can obtain information about the number of times that other electronic devices have executed a specific application and displayed images in 3D space, including image indicators.

[0130] According to embodiments of this disclosure, electronic device 1000 can select a representative electronic device from at least one electronic device. For example, electronic device 1000 can select a representative electronic device based on usage count information of each of the at least one electronic device. That is, electronic device 1000 can select the electronic device that has displayed images of 3D space including image indicators the most times as the representative electronic device. Optionally, electronic device 1000 can select an electronic device individually specified by a user as the representative electronic device. For example, electronic device 1000 can select a smartphone specified by the user as the representative electronic device.

[0131] According to embodiments of this disclosure, electronic device 1000 can determine a specific ratio (e.g., 10%) of the inch value of a representative electronic device as the inch value of an image indicator. For example, referring to... Figure 4 When the representative electronic device is 8 inches, the image indicator's size can be set to 0.8 inches (=8 × 1 / 10). Here, a specific ratio value (e.g., 10%) can be preset and can also be changed by the user. For example, 1 / 10 of the representative electronic device's size can be set as the default size for the image indicator, but when the user wants to view the image indicator at a larger size on the screen, 1 / 10 can be changed to 1 / 5.

[0132] During operation S830, the electronic device 1000 according to an embodiment of the present disclosure can obtain a magnification for scaling up or down the 3D space based on the inch value of the image indicator, the size ratio of the image indicator in 3D space, and the inch value of the electronic device 1000.

[0133] For example, electronic device 1000 can calculate the magnification for enlarging or reducing 3D space as follows.

[0134] Equation 4

[0135] In other words, the magnification of 3D space can be obtained by dividing the inch value of the image indicator obtained by operation S820 by the product of the inch value of the electronic device 1000 and the size ratio of the image indicator in 3D space.

[0136] Here, the size ratio of the image indicator in 3D space can be defined by Equation 5. That is, the size ratio of the image indicator in 3D space can be obtained by dividing the size of the image indicator by the size of the 3D space. The size of the image indicator can be defined as a virtual unit value in 3D space.

[0137] Equation 5

[0138]

[0139] Furthermore, the size of the 3D space can be obtained by multiplying the distance between the camera and the object in the camera settings obtained in operation S810 by Tan(FoV), and then further multiplying the result by 2. The size of the 3D space can be, but is not limited to, one of the vertical length, horizontal length, or diagonal length of the bounding box that defines the 3D space.

[0140] Therefore, the equation used to obtain the magnification for enlarging or reducing 3D space can be rearranged into Equation 6. According to Equation 6, the magnification for enlarging or reducing 3D space can increase as the inch value of the electronic device 1000 decreases or the size of the 3D space (distance between camera and object × Tan(FoV) × 2) increases.

[0141] Equation 6

[0142] According to embodiments of this disclosure, electronic device 1000 can obtain size information from server 2000 for use with an image indicator in Equation 6. Electronic device 1000 can determine the size of the 3D space based on the distance between the camera and the object in the camera settings obtained during operation S810. Furthermore, electronic device 1000 can determine the size ratio of the image indicator in the 3D space based on the size of the 3D space and the size information of the image indicator obtained from server 2000.

[0143] For example, refer to Figure 5 When the 3D space is adapted to the screen of the electronic device 1000, the size of the 3D space can be 20 units (=d×Tan(FoV)×2), and the size of the image indicator in the 3D space obtained from the server 2000 can be 1 unit. Therefore, the size ratio of the image indicator in the 3D space can be 1 / 20.

[0144] Finally, the electronic device 1000 can determine the magnification for scaling up or down the 3D space by dividing the inch value (e.g., 0.8) of the image indicator determined in operation S820 by multiplying the size ratio of the image indicator in 3D space (e.g., 1 / 20) by the inch value (e.g., 8) of the electronic device 1000.

[0145] For example, when the size of the electronic device 1000 is 4 inches, the product of the size of the electronic device 1000 (e.g., 4 inches) and the size ratio of the image indicator in 3D space (e.g., 1 / 20) can be 0.2 inches. That is, based on the current camera settings, the image indicator can be displayed at 0.2 inches on the screen of the electronic device 1000. However, when the size of the image indicator calculated in operation S820 is 0.8 inches, the image indicator is displayed at a size of 0.8 inches. Therefore, when 0.8 is divided by 0.2, the image in 3D space is magnified four times.

[0146] During operation S840, the electronic device 1000 according to an embodiment of the present disclosure can adjust the camera settings obtained during operation S810 based on the magnification used to enlarge or reduce the 3D space.

[0147] According to embodiments of this disclosure, the electronic device 1000 can adjust at least one of the distance between the camera and an object in 3D space or the camera's field of view based on the magnification used to enlarge or reduce 3D space. For example, in the camera settings obtained during operation S810, the electronic device 1000 can change a first distance between the camera and the object to a second distance, or it can change the camera's first field of view to a second field of view.

[0148] Furthermore, according to embodiments of this disclosure, when the magnification obtained in operation S830 for enlarging or reducing the 3D space is 1, the electronic device 1000 can maintain the camera settings in the current state.

[0149] Operating S840 and Figure 3 Since operation S340 corresponds to this, the redundant description of operation S840 will be omitted.

[0150] During operation S850, the electronic device 1000 according to an embodiment of the present disclosure can display on the screen of the electronic device 1000 an image of 3D space that has been magnified or reduced by applying adjusted settings of a camera.

[0151] According to embodiments of this disclosure, when the electronic device 1000 applies adjusted camera settings, the size of the image indicator in the 3D space image displayed on the screen of the electronic device 1000 can have an inch value determined in S820. That is, according to embodiments of this disclosure, the electronic device 1000 can adjust the camera settings such that the same size image indicator is displayed across all devices owned by the user. Hereinafter, reference will be made to… Figure 9 This will describe the operation of determining the magnification ratio so that image indicators of the same size are displayed across all devices owned by the user.

[0152] Figure 9This is a diagram illustrating the operation of determining the magnification ratio in each of various electronic devices according to embodiments of the present disclosure. Figure 9 The example shown illustrates that the image indicator will be displayed on the screen at a size of 72 DP and 0.8 inches. Furthermore, Figure 9 The example shown has a representative electronic device with a DP value of 720 DP, a representative electronic device with an inch value of 8 inches, a representative space size of 10 units (e.g., 30 pings), and an image indicator in 3D space with a size of 1 unit.

[0153] Referring to Table 900, when the electronic device 1000 currently used by the user has a DP value of 720 DP and an inch value, and the 3D space has a size of 10 units, the magnification ratio can be 1x. That is, even when maintaining the camera's current settings, the electronic device 1000 can display an image indicator with a size of 72 DP and 0.8 inches to the user. Conversely, when the electronic device 1000 currently used by the user has a DP value of 720 DP and an inch value, and the 3D space has a size of 20 units, the magnification ratio can be 2x. That is, when the 3D space is magnified twice, the size of the image indicator displayed to the user can change to 72 DP and 0.8 inches. Therefore, the electronic device 1000 can halve the distance between the camera and the object, so that the 3D space, including the image indicator, can be displayed as magnified twice. Furthermore, when the electronic device 1000 currently used by the user has a DP value of 720 DP and an inch value, and the 3D space has a size of 30 units, the magnification ratio can be 3x. In other words, when the 3D space is magnified three times, the size of the image indicator displayed to the user can become 72 DP and 0.8 inches. Therefore, the electronic device 1000 can reduce the distance between the camera and the object to one-third, allowing the 3D space, including the image indicator, to be displayed as magnified three times. In summary, according to embodiments of this disclosure, as the size of the 3D space increases, the electronic device 1000 can determine a higher magnification ratio.

[0154] When the electronic device 1000 currently used by the user has a display size (DP) of 360 DP and a screen size of 4 inches, and the 3D space has a size of 10 units, the magnification ratio can be 2x. When the electronic device 1000 currently used by the user has a display size (DP) of 360 DP and a screen size of 4 inches, and the 3D space has a size of 20 units, the magnification ratio can be 4x. That is, when the DP of the electronic device 1000 is reduced from 720 DP to 360 DP, while the size of the 3D space remains unchanged, the magnification ratio can be determined to be greater. In short, even when the size of the 3D space remains unchanged, as the display size of the electronic device 1000 decreases, the magnification ratio of the electronic device 1000 can be determined to be higher.

[0155] Furthermore, the magnification ratio calculated based on the DP value can differ from the magnification ratio calculated based on the inch value. For example, when the DP value of electronic device 1000 is 1440 DP, the inch value of electronic device 1000 is 8 inches, and the size of the 3D space is 10 units, the magnification ratio calculated based on the DP value can be 1 / 2x, while the magnification ratio calculated based on the inch value can be 1x. In this case, according to a preset strategy, electronic device 1000 can apply either the magnification ratio calculated based on the DP value or the magnification ratio calculated based on the inch value.

[0156] In the following text, refer to Figures 10 to 11b This will be an example of an image that describes the 3D space provided by the electronic device 1000.

[0157] Figure 10 This is a diagram illustrating the operation performed by an electronic device 1000 to provide images of different sizes in 3D space according to an embodiment of the present disclosure.

[0158] Reference Figure 10 The electronic device 1000 can display an image 1001 of a first 3D space and an image 1002 of a second 3D space. In this case, the second 3D space may have a larger area than the first 3D space. For example, the first 3D space may be a 30-ping (approximately 13.3 square meters) apartment space, and the second 3D space may be a 50-ping (approximately 13.3 square meters) apartment space.

[0159] The electronic device 1000 can display a second 3D space in a manner that is magnified beyond the first 3D space, such that the first image indicator included in the image 1001 in the first 3D space has the same screen display size as the second indicator included in the image 1002 in the second 3D space. In other words, the electronic device 1000 can adjust the camera settings so that the size of the image indicator displayed to the user remains the same even when the actual space is different.

[0160] Therefore, according to embodiments of this disclosure, users can experience a consistent user interface because the size of the image indicators used to control the IoT device 3000 remains unchanged even when the 3D space changes.

[0161] Figure 11a This is a diagram illustrating the operation of providing images in 3D space in electronic devices with different display sizes according to embodiments of the present disclosure.

[0162] Reference Figure 11aThe first electronic device 1000-1 and the second electronic device 1000-2 can display images in the same 3D space. In this case, the first electronic device 1000-1 and the second electronic device 1000-2 can have different display sizes and resolutions. Therefore, when the 3D space is adapted to the screen, the image indicators displayed on the first electronic device 1000-1 and the second electronic device 1000-2 can have different sizes, and thus, the first electronic device 1000-1 and the second electronic device 1000-2 can each adjust their camera settings to display image indicators of the same size. For example, because the display size of the second electronic device 1000-2 is smaller than the display size of the first electronic device 1000-1, the second electronic device 1000-2 can display the 3D space in a more enlarged manner than the first electronic device 1000-1. In this case, the size of the image indicator included in the image 1101 in the 3D space provided by the first electronic device 1000-1 may be the same as the size of the image indicator included in the image 1102 in the 3D space provided by the second electronic device 1000-2.

[0163] Therefore, according to embodiments of this disclosure, a user can view an image indicator of the same size on any electronic device 1000, and thus, the user can operate the image indicator in a familiar manner on any electronic device 1000 without having to adjust the size of the image indicator.

[0164] Figure 11b This is a diagram illustrating the operation of providing 3D spatial images in an electronic device 1000 including a foldable display according to an embodiment of the present disclosure.

[0165] Reference Figure 11b In 1103, when electronic device 1000 is folded in half, the DP value of electronic device 1000 can be 720DP. Conversely, referring to... Figure 11b 1104, when the electronic device 1000 is fully deployed, the DP value of the electronic device 1000 can be 1440DP (=720 DP×2).

[0166] Therefore, when folded in half, the electronic device 1000 can determine the setting value of the magnification adjustment camera for enlarging or reducing the 3D space based on 720 DP, and when fully unfolded, it can determine the setting value of the magnification adjustment camera for enlarging or reducing the 3D space based on 1440 DP.

[0167] According to embodiments of this disclosure, even when the electronic device 1000 is folded in half and then fully unfolded or fully unfolded and then folded in half, the size of the indicator included in the image in the 3D space can remain the same when the image in the 3D space is displayed.

[0168] Figure 12 This is a flowchart illustrating a method performed by an electronic device 1000 to reduce or enlarge the size ratio of an image indicator in 3D space according to an embodiment of the present disclosure.

[0169] In operation S1210, the electronic device 1000 according to an embodiment of the present disclosure can display an image of 3D space on the screen by adjusting the camera settings. For example, the electronic device 1000 can determine the DP value (or inch value) of an image indicator corresponding to the size of the image indicator to be displayed on the screen. The electronic device 1000 can determine the magnification for enlarging or reducing the 3D space based on the DP value (or inch value) of the image indicator, the size ratio of the image indicator in 3D space, and the DP value (or inch value) of the electronic device 1000. The electronic device 1000 can display an image of 3D space on the screen by adjusting the camera settings in 3D space according to the determined magnification. In this case, the electronic device 1000 can display an image indicator of a preset size.

[0170] Operation S1210 and Figure 3 Operating S350 or Figure 8 Since operation S850 corresponds to this, a detailed description of operation S1210 will be omitted.

[0171] During operation S1220, the electronic device 1000 according to an embodiment of the present disclosure can receive user input for zooming in or out of an image in 3D space displayed on a screen.

[0172] For example, a user can perform input to zoom in on an image in 3D space to view a portion of 3D space in detail. Additionally, a user can perform input to zoom out on 3D space to view the entire 3D space at once.

[0173] According to embodiments of this disclosure, user input for zooming in or out of an image in 3D space may include, but is not limited to, predefined touch input, predefined motion input, or voice input.

[0174] During operation S1230, the electronic device 1000 according to an embodiment of the present disclosure can zoom in or out on an image of 3D space displayed on the screen based on user input.

[0175] For example, based on user input for magnifying the image in 3D space, the electronic device 1000 can adjust camera settings (distance between the camera and the object, field of view, etc.), the camera's position in 3D space, etc., to magnify the image in 3D space. In this case, the size of the image indicator included in the image in 3D space can also be increased.

[0176] Conversely, based on user input for reducing the size of the image in 3D space, the electronic device 1000 can adjust camera settings (distance between the camera and the object, field of view, etc.), the camera's position in 3D space, etc., to reduce the size of the image in 3D space. In this case, the size of the image indicator included in the image in 3D space can also be reduced.

[0177] In other words, when the electronic device 1000 zooms in or out on the 3D space image displayed on the screen according to user input, the size of the image indicator may deviate from the preset size (e.g., preset DP value or preset inch value).

[0178] In operation S1240, the electronic device 1000 according to an embodiment of the present disclosure may reduce or increase the size ratio of the image indicator in 3D space based on a predetermined DP value (or inch value) of the image indicator.

[0179] For example, when the size of the image indicator increases as the image in 3D space is magnified, the electronic device 1000 can reduce the size ratio of the image indicator in 3D space based on the DP value (or inch value) of the image indicator determined in operation S320 (or operation S820). That is, the electronic device 1000 can reduce the size of the image indicator by a predetermined DP value (or predetermined inch value) while keeping the 3D space in a magnified state.

[0180] Reference Figure 13 and Figure 14 The operation of scaling up or down the image indicator in 3D space, performed by the electronic device 1000, will be described in more detail.

[0181] Figure 13 This is a diagram illustrating the operation of an electronic device 1000 performing a magnified image indicator in 3D space according to an embodiment of the present disclosure. Figure 13 This shows an example where the image indicator is to be displayed on the screen at a size of 72 DP.

[0182] Reference Figure 13 On screen 1310, electronic device 1000 can display an image of 3D space by adjusting camera settings, such that the size of the image indicator displayed on the screen becomes 72 DP. In this case, the user can perform input 1301 to zoom in on the image of 3D space to view the state of the living room and kitchen in detail. For example, the user can perform a pinch-and-release gesture on the image of 3D space, but is not limited to this. A pinch-and-release gesture is a gesture that uses two fingers to zoom in on the screen.

[0183] Reference Figure 13On screen 1320, when electronic device 1000 detects a pinch gesture, electronic device 1000 can magnify and display a 3D spatial image. In this case, the size of the image indicator included in the 3D spatial image can also be magnified. For example, when the 3D spatial image is magnified twice, the size of the image indicator can also be magnified twice to become 144DP.

[0184] Reference Figure 13 On screen 1330, when the size of the image indicator exceeds a predetermined size (e.g., 72 DP), the electronic device 1000 can maintain the 3D space in an enlarged state and can reduce the size of the image indicator only to 72 DP. That is, the electronic device 1000 can reduce the size ratio of the image indicator in 3D space by half. For example, the size ratio of the image indicator on screen 1310 can be 1 / 20 (= However, the size ratio of the image indicator on screen 1330 can be 1 / 40 (= ).

[0185] Therefore, according to embodiments of this disclosure, even when the image in 3D space is magnified, the electronic device 1000 can adjust the size of the image indicator (e.g., icon) to remain constant.

[0186] Figure 14 This is a diagram illustrating the operation of reducing the size ratio of an image indicator in 3D space performed by an electronic device 1000 according to an embodiment of the present disclosure. Figure 14 This shows an example where the image indicator is to be displayed on the screen at a size of 72 DP.

[0187] Reference Figure 14 On screen 1410, electronic device 1000 can display an image of 3D space by adjusting camera settings, such that the size of the image indicator displayed on the screen becomes 72 DP. In this case, the user can perform input 1401 to shrink the image of 3D space to view the 3D space as a whole. For example, the user can perform a pinch gesture on the image of 3D space, but is not limited to this. A pinch gesture is a gesture that shrinks the screen using two fingers.

[0188] Reference Figure 14 On screen 1420, when the electronic device 1000 detects a pinch gesture, the electronic device 1000 can shrink and display a 3D spatial image. In this case, the size of the image indicator included in the 3D spatial image can also be reduced. For example, when the 3D spatial image is reduced to 1 / 2, the size of the image indicator can also be reduced to 1 / 2 to become 36DP.

[0189] Reference Figure 14On screen 1430, when the size of the image indicator exceeds a predetermined size (e.g., 72 DP), the electronic device 1000 can maintain the 3D space in a reduced state and can only enlarge the size of the image indicator to 72 DP. That is, the electronic device 1000 can double the size ratio of the image indicator in 3D space. For example, the size ratio of the image indicator on screen 1410 can be 1 / 20 (= However, the size ratio of the image indicator on screen 1430 can be 1 / 10 (= ).

[0190] Therefore, according to embodiments of this disclosure, even when the image in 3D space is reduced in size, the electronic device 1000 can adjust the size of the image indicator (e.g., icon) to remain constant.

[0191] Figure 15 This is a flowchart illustrating a method performed by an electronic device 1000 to display a user interface (UI) component for controlling an IoT device 3000, according to an embodiment of the present disclosure.

[0192] In operation S1510, the electronic device 1000 according to an embodiment of the present disclosure can display an image of 3D space on the screen by adjusting the camera settings. For example, the electronic device 1000 can determine the DP value (or inch value) of an image indicator corresponding to the size of the image indicator to be displayed on the screen. The electronic device 1000 can determine the magnification for enlarging or reducing the 3D space based on the DP value (or inch value) of the image indicator, the size ratio of the image indicator in 3D space, and the DP value (or inch value) of the electronic device 1000. The electronic device 1000 can display an image of 3D space on the screen by adjusting the camera settings in 3D space according to the determined magnification. In this case, the electronic device 1000 can display an image indicator of a preset size.

[0193] Operation S1510 and Figure 3 Operating S350 or Figure 8 Since operation S850 corresponds to this, a detailed description of operation S1510 will be omitted.

[0194] During operation S1520, the electronic device 1000 according to an embodiment of the present disclosure may receive input for selecting an image indicator included in an image in 3D space. The input for selecting the image indicator may include touch input, motion input, or voice input, but is not limited thereto.

[0195] For example, electronic device 1000 may receive user input for touching a first image indicator corresponding to a first IoT device among a plurality of image indicators included in an image in 3D space.

[0196] During operation S1530, the electronic device 1000 according to an embodiment of the present disclosure may display UI components of the corresponding IoT device 3000 for controlling and selecting image indicators.

[0197] For example, when a first image indicator corresponding to the first IoT device is selected, the electronic device 1000 may display a first UI component (e.g., power button, start button, stop button, etc.) for controlling the first IoT device near the first image indicator. In this case, the user can easily control the first IoT device by using the first UI component.

[0198] In the following text, reference will be made to Figures 16a to 16c The operation of the UI components of the display used to control the IoT device 3000, performed by the electronic device 1000, is described in more detail.

[0199] Figure 16a This is a diagram illustrating the operation of displaying an image in 3D space performed by an electronic device 1000 according to an embodiment of the present disclosure. Figure 16b This is a diagram illustrating the operation of a UI component for controlling an IoT device 3000 performed by an electronic device 1000 according to an embodiment of the present disclosure. Figure 16c This is a diagram illustrating the operation performed by electronic device 1000 to provide status information of IoT device 3000 according to an embodiment of the present disclosure.

[0200] Reference Figure 16a 1610, electronic device 1000 can execute an application for managing IoT device 3000. In this case, the application execution window can display a list of IoT devices (e.g., washing machines, refrigerators, robotic vacuum cleaners, air purifiers, etc.) registered to server 2000 under a user account. Additionally, the application execution window can display item 1601 for requesting images of 3D space (e.g., map views).

[0201] When a user touches item 1601, electronic device 1000 can be configured and provide a 3D spatial image.

[0202] Reference Figure 16aAt 1620, electronic device 1000 can display an image of a 3D space corresponding to the home of a user who has been pre-registered by the user to server 2000. In this case, the image of the 3D space may include image indicators (e.g., icons) corresponding to IoT devices (e.g., washing machines, dryers, air purifiers, robotic vacuum cleaners, lighting fixtures, refrigerators, ovens, etc.) placed in the user's home. Electronic device 1000 can determine the size (e.g., 72 DP) of the image indicator to be displayed on the screen and can adjust camera settings (e.g., distance between the camera and the object or the camera's field of view) such that the image indicator is displayed at the determined size (e.g., 72 DP).

[0203] Reference Figure 16b At 1630, electronic device 1000 can receive user input for selecting a first image indicator 1602 corresponding to an air purifier from image indicators corresponding to an IoT device. In response to the user input for selecting the first image indicator 1602, electronic device 1000 can display a first UI component 1603 for controlling the air purifier near the first image indicator 1602. The first UI component 1603 may include the air purifier's status (e.g., off) and a power button. When the user touches the power button included in the first UI component 1603, electronic device 1000 can send an operation command to the air purifier via server 2000.

[0204] Reference Figure 16b At 1640, electronic device 1000 can receive user input for selecting a second image indicator 1604 corresponding to the robotic vacuum cleaner. In response to the user input for selecting the second image indicator 1604, electronic device 1000 can display a second UI component 1605 for controlling the robotic vacuum cleaner near the second image indicator 1604. The second UI component 1605 may include the status of the robotic vacuum cleaner (e.g., charging complete) and a start button. When the user touches the start button included in the second UI component 1605, electronic device 1000 can send a cleaning start command to the robotic vacuum cleaner via server 2000.

[0205] Therefore, according to embodiments of this disclosure, a user can control the operation of an IoT device by using an image indicator displayed at a constant size on the screen of the electronic device 1000.

[0206] Reference Figure 16c At 1650, the electronic device 1000 may receive input for selecting a second UI component 1605 for controlling a robotic vacuum cleaner. For example, the electronic device 1000 may receive input for touching an area of ​​the second UI component 1605 where a start button is not displayed.

[0207] Reference Figure 16c At 1660, in response to user input for selecting the second UI component 1605, electronic device 1000 may display a page providing detailed information about the robotic vacuum cleaner. For example, electronic device 1000 may display a page including the robotic vacuum cleaner's mode (e.g., daily cleaning), suction power (e.g., normal), cleaning report, empty dustbin, map management, etc.

[0208] Therefore, according to embodiments of this disclosure, users can easily access pages providing detailed information about IoT devices by using image indicators displayed at a constant size on the screen of electronic device 1000.

[0209] Figure 17 This is a block diagram illustrating the function of an electronic device 1000 according to an embodiment of the present disclosure.

[0210] like Figure 17 As shown, the electronic device 1000 according to an embodiment of this disclosure may include an output unit 1100, a sensor unit 1200, a processor 1300, a communication interface 1400, an A / V input unit 1500, a user input unit 1600, and a memory 1700. However, not all Figure 17 All components illustrated are necessary components. Electronic device 1000 can be implemented with more components than those shown, or with fewer components. For example, electronic device 1000 can be implemented with memory 1700 and processor 1300.

[0211] The aforementioned components will be described in turn below.

[0212] The output unit 1100 is used to output audio signals, video signals or vibration signals, and may include a display 1111, an audio output unit 1112, a vibration motor 1113, etc.

[0213] Audio output unit 1112 outputs audio data received from communication interface 1400 or stored in memory 1700. Audio output unit 1112 outputs audio signals related to the functions performed by electronic device 1000 (e.g., call signal reception sound, message reception sound, or notification sound). Audio output unit 1112 may include a speaker, buzzer, etc.

[0214] The vibration motor 1113 can output a vibration signal. For example, the vibration motor 1113 can output a vibration signal corresponding to the output of audio data or video data (e.g., call signal reception sound, message reception sound, etc.). In addition, the vibration motor 1113 can output a vibration signal when a touch is input to the touch screen.

[0215] The output unit 1100 can output a 3D spatial image. In this case, the 3D spatial image may include an image indicator displayed on the screen at a preset size. The image indicator may be a UI element used to control the IoT device 3000. For example, the image indicator may be an icon image, but is not limited to this.

[0216] Sensor unit 1200 may include, but is not limited to, at least one of the following: magnetic sensor 1211, accelerometer 1212, tilt sensor 1213, infrared sensor 1214, gyroscope sensor 1215, position sensor (e.g., GPS) 1216, temperature and humidity sensor 1217, proximity sensor 1218, and light sensor 1219. The functions of each sensor can be intuitively inferred by those skilled in the art from their names; therefore, a detailed description of the functions of each sensor will be omitted.

[0217] The processor 1300 typically controls the overall operation of the electronic device 1000. For example, the processor 1300 can control the output unit 1100, sensor unit 1200, communication interface 1400, A / V input unit 1500, user input unit 1600, memory 1700, etc., by executing programs stored in the memory 1700.

[0218] Processor 1300 may include one or more processors. One or more processors included in processor 1300 may include circuitry (such as a system-on-a-chip (SoC) or integrated circuit (IC)). One or more processors included in processor 1300 may be a general-purpose processor (such as a central processing unit (CPU), microprocessor unit (MPU), application processor (AP), or digital signal processor (DSP)), a graphics-specific processor (such as a graphics processing unit (GPU) or vision processing unit (VPU)), an artificial intelligence-specific processor (such as a neural processing unit (NPU)), or a communications-specific processor (such as a communications processor (CP)). When one or more processors included in processor 1300 are artificial intelligence-specific processors, the artificial intelligence-specific processor can be designed with a hardware architecture dedicated to processing a specific artificial intelligence model. Processor 1300 may be implemented as a single-core processor or a multi-core processor.

[0219] The processor 1300 can write data to or read data stored in the memory 1700, and specifically, can process data according to predefined operating rules or artificial intelligence models by executing a program or at least one instruction stored in the memory 1700.

[0220] The communication interface 1400 may include one or more components that enable communication between the electronic device 1000 and the IoT device 3000 or between the electronic device 1000 and the server 2000. For example, the communication interface 1400 may include a short-range wireless communication unit 1411, a mobile communication unit 1412, and a broadcast receiving unit 1413.

[0221] The short-range wireless communication unit 1411 may include, but is not limited to, a Bluetooth communication unit, a Bluetooth Low Energy (BLE) communication unit, a near-field communication unit, a WLAN (WiFi) communication unit, a Zigbee communication unit, an Infrared Data Association (IrDA) communication unit, a Wi-Fi Direct (WFD) communication unit, an ultra-wideband (UWB) communication unit, an Ant+ communication unit, etc.

[0222] Mobile communication unit 1412 transmits wireless signals to at least one of a base station, an external terminal, or a server on the mobile communication network, and receives wireless signals from at least one of the base station, external terminal, or server on the mobile communication network. Here, the wireless signals may include various types of data transmitted / received based on voice call signals, video call signals, or text / multimedia messages.

[0223] The broadcast receiving unit 1413 receives broadcast signals and / or broadcast-related information from the outside via a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. According to an embodiment, the electronic device 1000 may not include the broadcast receiving unit 1413.

[0224] The A / V input unit 1500 is used to input audio or video signals and may include a camera 1511, a microphone 1512, etc. The camera 1511 can acquire image frames, such as still images or moving images, via an image sensor in video call mode or shooting mode. Images captured by the image sensor can be processed by a processor 1300 or a separate image processing unit (not shown). Image frames processed by the camera 1511 can be stored in memory 1700 or sent externally via communication interface 1400. According to embodiments of this disclosure, the camera 1511 may include at least one of a telephoto camera, a wide-angle camera, or a general-purpose camera, but is not limited thereto.

[0225] Microphone 1512 can receive external audio signals and process them into electronic voice data. For example, microphone 1512 can receive audio signals from an external device or speaker. Microphone 1512 can use various noise removal algorithms to remove noise generated during the reception of external audio signals.

[0226] User input unit 1600 refers to a device through which a user inputs data for controlling electronic device 1000. For example, user input unit 1600 may include a keyboard, dome switch, touchpad (contact capacitive type, pressure resistance film type, infrared sensing type, surface acoustic wave conduction type, integrated tension measurement type, piezoelectric effect type, etc.), scroll wheel, scroll wheel switch, etc., but is not limited to these.

[0227] The memory 1700 can store programs for processing and control by the processor 1300, and can also store input / output data (e.g., voice data, photographic images, memo data, user biometric information, etc.).

[0228] The memory 1700 may include at least one type of storage medium selected from flash memory, hard disk memory, multimedia card micro / card memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, or optical disk.

[0229] Memory 1700 may not exist separately and may be included in processor 1300. Memory 1700 may include volatile memory, non-volatile memory, or a combination of volatile memory and non-volatile memory. Memory 1700 may store a program or at least one instruction for performing operations according to embodiments of the present disclosure. Memory 1700 may also provide data stored in memory 1700 to processor 1300 upon request.

[0230] Embodiments of this disclosure relate to an electronic device 1000 that specifies the size of an image indicator (e.g., an icon) to be displayed to a user having multiple devices, and adjusts camera settings in 3D space according to the specified size to display the image indicator (e.g., an icon) at the same size on all devices.

[0231] According to embodiments of this disclosure, a method for providing an image of 3D space performed by an electronic device 1000 may include: obtaining camera settings for adapting the 3D space to a screen of the electronic device 1000, wherein the 3D space includes an image indicator for controlling an IoT device 3000; determining a density-independent pixel (DP) value of the image indicator, wherein the DP value corresponds to the size of the image indicator to be displayed on the screen; obtaining a magnification factor for enlarging or reducing the 3D space based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device 1000; adjusting the camera settings based on the magnification factor for enlarging or reducing the 3D space; and displaying an image of the 3D space enlarged or reduced by applying the adjusted camera settings on the screen of the electronic device 1000.

[0232] According to embodiments of this disclosure, when initially entering or changing a space (map), the user receives a consistent experience: the user can check the status of IoT devices and operate devices across multiple devices using image indicators (e.g., icons) of the same size. Furthermore, because the space (map) automatically zooms in around the image indicators (e.g., icons), even in electronic devices 1000 with small displays, the space can be displayed in a zoomed-in state without a separate zoom-in operation experience. Conversely, in electronic devices 1000 with large displays, the user can view the entire map and check the status of IoT devices and operate them. Therefore, according to embodiments of this disclosure, by providing users with multiple devices with the ability to process camera adjustments in 3D space according to the characteristics of various electronic devices, a consistent experience of operating IoT devices 3000, as well as a more efficient and convenient experience, can be provided to the user.

[0233] According to embodiments of the present disclosure, determining the DP value of an image indicator may include: obtaining the DP value of each of at least one electronic device configured to provide an image in 3D space; selecting a representative electronic device from the at least one electronic device; and determining a specific ratio of the DP value of the representative electronic device as the DP value of the image indicator.

[0234] According to embodiments of this disclosure, selecting a representative electronic device may include: selecting a representative electronic device based on usage count information of each of the at least one electronic device.

[0235] According to embodiments of this disclosure, selecting a representative electronic device may include: selecting an electronic device individually specified by the user as the representative electronic device.

[0236] According to embodiments of this disclosure, obtaining the magnification ratio for scaling up or down 3D space may include: obtaining size information of an image indicator in 3D space from a server; determining the size of 3D space based on the distance between the camera and the object in the camera's settings; and determining the size ratio of the image indicator in 3D space based on the size of 3D space and the size information of the image indicator.

[0237] According to embodiments of this disclosure, determining the size ratio of an image indicator in 3D space may include: obtaining size information of multiple image indicators corresponding to multiple IoT devices in 3D space from a server (S610); when the multiple image indicators have different sizes, selecting a first image indicator corresponding to a first IoT device among the multiple IoT devices as a representative indicator (S640); and determining the size ratio of the first image indicator in 3D space based on the size of the 3D space and the size information of the first image indicator selected as the representative indicator.

[0238] According to embodiments of this disclosure, selecting a first image indicator as a representative indicator may include: selecting a first image indicator corresponding to a first IoT device among the multiple IoT devices as a representative indicator based on control counting information of multiple IoT devices.

[0239] According to embodiments of this disclosure, selecting a first image indicator as a representative indicator may include: selecting a first image indicator corresponding to a first IoT device specified by a user as a representative indicator.

[0240] According to embodiments of this disclosure, adjusting camera settings may include adjusting at least one of the distance between the camera and an object in 3D space or the camera's field of view.

[0241] According to embodiments of this disclosure, the magnification for scaling up or down 3D space can increase as the DP value of the electronic device decreases or the size of the 3D space increases.

[0242] According to embodiments of the present disclosure, the method may include: determining an inch value for an image indicator, wherein the inch value corresponds to the size of the image indicator to be displayed on the screen; and obtaining a magnification ratio for scaling up or down the 3D space based on the inch value of the image indicator, the size ratio of the image indicator in 3D space, and the inch value of the electronic device.

[0243] According to embodiments of this disclosure, the method may include: receiving user input for zooming in or out of an image in 3D space displayed on a screen; zooming in or out of the image in 3D space and displaying the image in response to the user input; and zooming in or out of the size ratio of the image indicator in 3D space based on the DP value of the image indicator.

[0244] According to embodiments of this disclosure, an electronic device 1000 for providing an image of 3D space may include: a memory 1700 storing one or more instructions; and at least one processor 1300. The at least one processor 1300 may execute the one or more instructions to obtain camera settings for adapting the 3D space to the screen of the electronic device 1000, wherein the 3D space includes an image indicator for controlling an IoT device 3000. The at least one processor 1300 may determine a DP value for the image indicator, wherein the DP value corresponds to the size of the image indicator to be displayed on the screen. The at least one processor 1300 may obtain a magnification ratio for enlarging or reducing the 3D space based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device 1000. The at least one processor 1300 may adjust the camera settings based on the magnification ratio for enlarging or reducing the 3D space. The at least one processor 1300 may display an image of the 3D space, enlarged or reduced by applying the adjusted camera settings, on the screen of the electronic device 1000.

[0245] According to embodiments of this disclosure, the at least one processor can execute the one or more instructions to obtain the DP value of each of at least one electronic device configured to provide an image in 3D space. The at least one processor can select a representative electronic device from the at least one electronic device. The at least one processor can determine a specific ratio value of the DP value of the representative electronic device as the DP value of an image indicator.

[0246] According to embodiments of the present disclosure, the at least one processor may execute one or more instructions to select a representative electronic device from the at least one electronic device based on usage count information of each electronic device in the at least one electronic device.

[0247] According to embodiments of this disclosure, the at least one processor can execute the one or more instructions to obtain size information of an image indicator in 3D space from a server via a communication interface. The at least one processor can determine the size of the 3D space based on the distance from the camera to the object included in the 3D space in the camera's settings. The at least one processor can determine the size ratio of the image indicator in the 3D space based on the size of the 3D space and the size information of the image indicator.

[0248] According to embodiments of this disclosure, the at least one processor can execute one or more instructions to obtain size information of multiple image indicators corresponding to multiple IoT devices in 3D space from a server. When the multiple image indicators have different sizes, the at least one processor can select a first image indicator corresponding to a first IoT device among the multiple IoT devices as a representative indicator. The at least one processor can determine the size ratio of the first image indicator in 3D space based on the size of the 3D space and the size information of the first image indicator selected as the representative indicator.

[0249] According to embodiments of this disclosure, the at least one processor may execute the one or more instructions to adjust at least one of the distance from the camera to an object included in the 3D space or the camera's field of view based on a magnification rate used to zoom in or out of the 3D space.

[0250] According to embodiments of this disclosure, the at least one processor can execute one or more instructions to determine the inch value of an image indicator, wherein the inch value corresponds to the size of the image indicator to be displayed on the screen. The at least one processor can obtain a magnification ratio for scaling up or down the 3D space based on the inch value of the image indicator, the size ratio of the image indicator in 3D space, and the inch value of the electronic device 1000.

[0251] Machine-readable storage media may be provided in the form of non-transitory storage media. Here, "non-transitory storage media" refers to a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between cases where data is stored semi-permanently in the storage medium and cases where data is temporarily stored in the storage medium. For example, "non-transitory storage media" may include buffers for temporarily storing data.

[0252] According to embodiments, methods according to various embodiments disclosed herein can be provided by being included in a computer program product. The computer program product can be traded as a commercial product between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM) or a Universal Serial Bus (USB) flash drive), or it can be distributed online (e.g., downloaded or uploaded) through an app store, or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) can be at least temporarily generated or temporarily stored in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

Claims

1. A method for providing an image in 3D space, performed by an electronic device (1000), the method comprising: Obtain camera settings for adapting 3D space to the screen of the electronic device, wherein the 3D space includes an image indicator for controlling the IoT device (S310). Determine the density-independent pixel DP value of the image indicator, wherein the DP value corresponds to the size of the image indicator to be displayed on the screen (S320). Based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device, the magnification ratio for magnifying or reducing the 3D space is obtained (S330). Based on the magnification used to enlarge or reduce the 3D space, the camera settings are adjusted (S340); and The screen of the electronic device displays an image of the 3D space that has been magnified or reduced by applying the adjusted settings of the camera (S350).

2. The method according to claim 1, wherein, Determining the DP value of the image indicator includes: Obtain the DP value of each of at least one electronic device configured to provide an image of the 3D space; Select a representative electronic device from the at least one electronic device; and A specific ratio of the DP value of the representative electronic device is determined as the DP value of the image symbol.

3. The method according to claim 2, wherein, Selecting a representative electronic device includes: selecting the representative electronic device based on usage count information of each of the at least one electronic device.

4. The method according to claim 2, wherein, Selecting a representative electronic device includes selecting an electronic device individually specified by the user as the representative electronic device.

5. The method according to any one of claims 1 to 4, wherein, Obtaining the magnification ratio for scaling up or down the 3D space includes: Obtain the size information of the image indicator in the 3D space from the server; The size of the 3D space is determined based on the distance between the camera and the object in the camera's settings; and Based on the dimensions of the 3D space and the dimensions of the image indicator, the size ratio of the image indicator in the 3D space is determined.

6. The method according to claim 5, wherein, Determining the size ratio of the image indicator in the 3D space includes: Obtain size information of multiple image indicators corresponding to multiple IoT devices in the 3D space from the server (S610). When the plurality of image indicators have different sizes, a first image indicator corresponding to a first IoT device among the plurality of IoT devices is selected as a representative indicator (S640); and Based on the size of the 3D space and the size information of the first image indicator selected as the representative indicator, the size ratio of the first image indicator in the 3D space is determined (S650).

7. The method according to claim 6, wherein, Selecting a first image indicator as the representative indicator includes: based on the control count information of the plurality of IoT devices, selecting a first image indicator corresponding to a first IoT device among the plurality of IoT devices as the representative indicator.

8. The method according to claim 6, wherein, Selecting a first image indicator as the representative indicator includes: selecting a first image indicator corresponding to a first IoT device specified by the user as the representative indicator.

9. The method according to any one of claims 1 to 8, wherein, Adjusting the camera settings includes adjusting at least one of the distance between the camera and an object in the 3D space or the camera's field of view.

10. The method according to any one of claims 1 to 9, wherein, The magnification used to enlarge or reduce the 3D space increases as the DP value of the electronic device decreases or the size of the 3D space increases.

11. The method according to any one of claims 1 to 10, further comprising: Determine the inch value of the image indicator, wherein the inch value corresponds to the size of the image indicator to be displayed on the screen (S820); and Based on the inch value of the image indicator, the size ratio of the image indicator in the 3D space, and the inch value of the electronic device, a magnification ratio for enlarging or reducing the 3D space is obtained (S830).

12. The method according to any one of claims 1 to 11, further comprising: Receive user input for zooming in or out of the image of the 3D space displayed on the screen (S1220). In response to the user input, zoom in or out on the 3D space image and display the image (S1230); and Based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space is reduced or increased (S1240).

13. An electronic device (1000) for providing an image in 3D space, the electronic device (1000) comprising: Memory (1700) stores one or more instructions; as well as At least one processor (1300). The at least one processor (1300) executes the one or more instructions to perform the following operations: Obtain camera settings for adapting the 3D space to the screen of the electronic device (1000), wherein the 3D space includes image indicators for controlling the IoT device (3000). Determine the DP value of the image indicator, wherein the DP value corresponds to the size of the image indicator to be displayed on the screen. Based on the DP value of the image indicator, the size ratio of the image indicator in the 3D space, and the DP value of the electronic device (1000), a magnification ratio for enlarging or reducing the 3D space is obtained. Based on the magnification used to enlarge or reduce the 3D space, the camera settings are adjusted, and The screen of the electronic device (1000) displays an image of the 3D space that has been magnified or reduced by applying the adjusted settings of the camera.

14. The electronic device according to claim 13, wherein, The at least one processor executes the one or more instructions to perform the following operations: Obtain the DP value of each of at least one electronic device configured to provide an image of the 3D space. Select a representative electronic device from the at least one electronic device, and A specific ratio of the DP value of the representative electronic device is determined as the DP value of the image indicator.

15. A computer-readable recording medium having a program recorded thereon for performing the method of any one of claims 1 to 12 on a computer.

Images