Electronic device and operation method thereof

Abstract

An electronic device may be provided, the electronic device comprising a memory storing one or more instructions, and one or more processors executing the one or more instructions stored in the memory, wherein the one or more processors execute the one or more instructions to: identify a plurality of projection surfaces including a first projection surface and a second projection surface on the basis of information obtained with respect to a surrounding space; control to project an image corresponding to first content on the first projection surface on the basis of state information of the electronic device for projecting an image on the first projection surface and image setting information corresponding to the first projection surface; as a projection direction of the electronic device moves from the first projection surface to the second projection surface, change the size of the image corresponding to the first content being outputted on the first projection surface according to the degree of movement in the projection direction and project same; and control to change the size of an image corresponding to second content according to the degree of movement in the projection direction and project same on the second projection surface.

Description

Electronic device and method of operation thereof

[0001] Various embodiments relate to electronic devices and methods of operation thereof. More particularly, the present invention relates to electronic devices for intuitively projecting content onto multiple projection surfaces and methods of operation thereof.

[0002] With the development of electronic and optical technology, various projectors are being used.

[0003] A projector is an electronic device that enlarges images from a display device and projects them onto a screen. It can be used in a variety of ways to create large screens by utilizing indoor and outdoor walls.

[0004] As projectors become more widely used, attempts are being made to seamlessly display images across multiple surfaces within a room. However, changes in projector position, projection distance, or angle result in delays as the projector re-determines the projection surface and recalibrates the content.

[0005] An electronic device according to one embodiment may include a memory storing one or more instructions.

[0006] An electronic device according to one embodiment may include one or more processors that execute one or more instructions stored in the memory.

[0007] One or more processors can be controlled to identify a plurality of projection surfaces, including a first projection surface and a second projection surface, based on information obtained about the surrounding space by executing one or more instructions.

[0008] One or more processors can control the projection of an image corresponding to the first content onto the first projection surface based on status information of an electronic device for projecting an image onto the first projection surface and image setting information corresponding to the first projection surface by executing one or more instructions.

[0009] One or more processors can control, by executing one or more instructions, to project an image corresponding to the first content output on the first projection surface by changing the size thereof according to the degree of movement in the projection direction as the projection direction of the electronic device moves from the first projection surface to the second projection surface, and to project an image corresponding to the second content on the second projection surface by changing the size thereof according to the degree of movement in the projection direction.

[0010] A method of operating an electronic device according to one embodiment may include a step of identifying a plurality of projection surfaces including a first projection surface and a second projection surface based on information acquired about a surrounding space.

[0011] A method of operating an electronic device according to one embodiment may include a step of projecting an image corresponding to first content on the first projection surface based on status information of the electronic device for projecting an image on the first projection surface and image setting information corresponding to the first projection surface.

[0012] An operating method of an electronic device according to one embodiment may include a step of changing the size of an image corresponding to the first content output on the first projection surface and projecting the image according to the degree of movement in the projection direction as the projection direction of the electronic device moves from the first projection surface to the second projection surface, and projecting the image corresponding to the second content on the second projection surface and projecting the image according to the degree of movement in the projection direction.

[0013] A computer-readable recording medium according to one embodiment may be a computer-readable recording medium having recorded thereon a program for implementing a method of operating an electronic device, the method including a step of identifying a plurality of projection surfaces including a first projection surface and a second projection surface based on information acquired about a surrounding space.

[0014] A computer-readable recording medium according to one embodiment may be a computer-readable recording medium having recorded thereon a program for implementing an operating method of an electronic device, the method including a step of projecting an image corresponding to first content on the first projection surface based on status information of the electronic device for projecting an image on the first projection surface and image setting information corresponding to the first projection surface.

[0015] In one embodiment, a computer-readable recording medium may be a computer-readable recording medium having recorded thereon a program for implementing an operating method of an electronic device, the method including the steps of changing the size of an image corresponding to the first content output on the first projection surface and projecting the image according to the degree of movement in the projection direction as the projection direction of the electronic device moves from the first projection surface to the second projection surface, and projecting the image corresponding to the second content on the second projection surface and projecting the image according to the degree of movement in the projection direction.

[0016] FIG. 1 is a diagram illustrating an example of an electronic device projecting content while moving between two projection surfaces according to one embodiment of the present disclosure.

[0017] FIG. 2a is a drawing showing an example of how an electronic device operates according to prior art.

[0018] FIG. 2b is a diagram illustrating an example of an electronic device operating according to one embodiment of the present disclosure.

[0019] FIG. 2c is a diagram illustrating an example of an electronic device operating according to one embodiment of the present disclosure.

[0020] FIG. 3 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.

[0021] FIG. 4 is a diagram illustrating an example of a method by which an electronic device according to one embodiment of the present disclosure obtains and uses information to provide a fixed projection experience.

[0022] FIG. 5 is a diagram illustrating an example of a method for an electronic device to obtain information about a surrounding space according to an embodiment of the present disclosure.

[0023] FIG. 6 is a diagram illustrating an example of a plurality of projection surfaces identified by an electronic device according to one embodiment of the present disclosure.

[0024] FIG. 7 is a diagram illustrating an example in which an electronic device according to one embodiment of the present disclosure identifies recommended content corresponding to multiple projection surfaces.

[0025] FIG. 8 is a diagram illustrating an example of a method by which an electronic device according to one embodiment of the present disclosure determines recommended content corresponding to each projection surface using artificial intelligence.

[0026] FIG. 9 is a diagram showing an example of how an electronic device according to one embodiment of the present disclosure operates.

[0027] FIG. 10 is a drawing showing an example in which an electronic device according to one embodiment of the present disclosure provides a guide for an additional projection surface on which projection is possible.

[0028] FIG. 11 is a diagram showing an example of how an electronic device according to one embodiment of the present disclosure operates.

[0029] FIG. 12 is a diagram illustrating an example of a method for outputting sound and providing user interaction when an electronic device according to one embodiment of the present disclosure moves between multiple projection surfaces.

[0030] FIG. 13 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0031] FIG. 14 is a block diagram for explaining in more detail the configuration of an electronic device according to one embodiment of the present disclosure.

[0032] FIG. 15 is a block diagram conceptually illustrating an electronic device according to one embodiment of the present disclosure.

[0033] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

[0034] The terms used in this disclosure are described as currently common terms, taking into account the functions mentioned herein. However, these terms may mean various other terms depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but rather based on the meanings of the terms and the overall content of this disclosure.

[0035] Additionally, the terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the present disclosure.

[0036] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where it is "directly connected" but also the cases where it is "electrically connected" with another element in between.

[0037] As used herein, particularly in the claims, the terms "above" and "above" and similar referents may refer to both the singular and the plural. Furthermore, unless the order of steps in a method according to the present disclosure is explicitly specified, the steps described may be performed in any appropriate order. The present disclosure is not limited to the order in which the steps are described.

[0038] The appearances of phrases such as “in some embodiments” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.

[0039] Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented by various programming or scripting languages. The functional blocks may be implemented by algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations.

[0040] Additionally, the connecting lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and / or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.

[0041] Additionally, terms such as “part”, “module”, etc. described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.

[0042] Additionally, the term “user” in the specification may mean a person who uses the electronic device to control the function or operation of the electronic device.

[0043] In a specification, "at least one of A or B" or "at least one of A, or B" means that it can include any one of A, B, and A and B. Similarly, "at least one of A, B, or C" or "at least one of A, B, or C" means that it can include any one of A, B, C, A and B, A and C, B and C, or A, B, and C.

[0044] The present disclosure will be described in detail with reference to the attached drawings below.

[0045] FIG. 1 is a diagram illustrating an example of an electronic device projecting content while moving between two projection surfaces according to one embodiment of the present disclosure.

[0046] An electronic device (1000) according to one embodiment of the present disclosure may mean any device capable of projecting an image onto a projection surface outside the electronic device (1000).

[0047] An electronic device (1000) according to one embodiment of the present disclosure can output image light using a light source. The image light output by the light source may be white light. The electronic device (1000) can project the image light output by the light source to the outside using a projection lens. The image light projected to the outside by the electronic device (1000) may refer to an image projected by the electronic device (1000). That is, the electronic device (1000) can project an image using the light source and the projection lens.

[0048] In one embodiment, the electronic device (1000) can project an image using more configurations, and the configuration of the electronic device (1000) is not limited to the light source and the projection lens. Details regarding the configuration of the electronic device (1000) are described in FIGS. 13 to 15.

[0049] The electronic device (1000) can be easily implemented in a device whose main function is image projection, such as a projector, but is not limited thereto.

[0050] In one embodiment, the electronic device (1000) may be implemented in the form of a device that performs image projection as a part of its function while performing other functions. Accordingly, the electronic device (1000) may be implemented in various forms, such as a tablet PC, a smart phone, a digital camera, a camcorder, a laptop computer, a smart TV, a netbook computer, a desktop, an e-book reader, a video phone, a digital broadcasting terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), a navigation device, a wearable device, a smart refrigerator, and other home appliances.

[0051] As shown in (a) of FIG. 1, the electronic device (1000) can point (105) at a first projection surface (101), which is a projection surface within the surrounding space. In the present disclosure, pointing may mean that the electronic device (1000) points at the projection surface to project an image using a light-emitting unit. In one embodiment, the pointing (105) direction may mean a direction pointed by the center of the projected image light. When the electronic device (1000) points (105) at the first projection surface (101), the electronic device (1000) can project first content (103) corresponding to the first projection surface (101) onto the first projection surface (101).

[0052] In the present disclosure, the pointing (105) direction may have the same meaning as the projection direction.

[0053] At this time, the actual projection area C of (a) of FIG. 1 may include the entire first content (103) corresponding to the first projection surface (101) and may not include the second content (104) corresponding to the second projection surface (102).

[0054] An electronic device (1000) according to one embodiment of the present disclosure can move a position of a pointing (105) toward a second projection surface (102) while projecting first content (103) onto a first projection surface (101). In one embodiment, the movement of the pointing (105) position can be achieved by a physical force of a user or by controlling a driving unit included in the electronic device (1000) using a control device.

[0055] An electronic device (1000) according to one embodiment can move the pointing (105) direction without applying physical force to the electronic device (1000) by using a separate control device such as a remote control. The electronic device (1000) can include a driving unit that can automatically move the pointing (105) direction by receiving a user input from a control device.

[0056] An electronic device (1000) according to one embodiment can automatically change the pointing (105) direction when it is determined or identified that movement in the pointing (105) direction is necessary based on context even in the absence of user input.

[0057] For example, if a notification message, such as a text message, needs to be output while watching a projected image, the electronic device (1000) may output the notification message on a different projection surface rather than overlaying it on the currently projected image. In this case, the electronic device (1000) may determine that movement in the pointing direction (105) is necessary.

[0058] In one embodiment, the notification message may be a notification of the start time of a broadcast program that a user has previously scheduled, or a notification of an update of a new episode or new content of an OTT program.

[0059] In (b) of FIG. 1, the pointing direction (105) of the electronic device (1000) still points toward the first projection surface (101), but may point to a position moved from the first projection surface (101) toward the second projection surface (102) compared to (a) of FIG. 1. In this case, the electronic device (1000) can control in real time so that as the position of the pointing (105) moves from the first projection surface (101) toward the second projection surface (102), the ratio of the first content (103) corresponding to the first projection surface (101) among the projection images decreases, and the ratio of the second content (104) corresponding to the second projection surface (102) increases.

[0060] In one embodiment, the electronic device (1000) can move the content projected on the projection area from the first content (103) corresponding to the first projection surface (101) to the second content (104) corresponding to the second projection surface (102) in proportion to the distance the position of the pointing (105) has moved in the direction in which the position of the pointing (105) has moved.

[0061] As a result, in the state (b) of FIG. 1 where the pointing (105) direction of the electronic device (1000) is moving from the first projection surface (101) to the second projection surface (102), the actual projection area D may include both a part of the first content (103) corresponding to the first projection surface (101) and a part of the second content (104) corresponding to the second projection surface (102).

[0062] In (c) of FIG. 1, after the position of the pointing (105) of the electronic device (1000) moves from the first projection surface (101) toward the second projection surface (102), it can point to the second projection surface (102). When the electronic device (1000) points (105) at the second projection surface (102), the electronic device (1000) can project the first content (104) corresponding to the second projection surface (102) onto the second projection surface (102).

[0063] In this case, the actual projection area E may not include the first content (103), but may include the entire second content (104).

[0064] An electronic device (1000) according to an embodiment of the present disclosure may re-recognize the projection surface even when the position of the pointing (105) changes, or may not re-correct the image at once after the change is completed. The electronic device (1000) may detect a change in at least one of the projection position, the projection distance, and the projection angle in real time, and perform correction to output the image according to the preset image setting information for the corresponding projection surface. As a result, the electronic device (1000) according to an embodiment of the present disclosure may intuitively move and project the projection image according to the movement of the pointing (105) position seamlessly without delay or flicker even when the position of the pointing (105) changes. Additionally, the electronic device (1000) according to one embodiment can seamlessly change the projection image from the first content (103) to the second content (104) without delay or flickering as the position of the pointing (105) moves from the first projection surface (101) to the second projection surface (102).

[0065] In one embodiment, the electronic device (1000) can exclude the first content (103) from the projection area by cropping it from the left side as the position of the pointing (105) moves from the first projection surface (101) to the second projection surface (102). In one embodiment, the electronic device (1000) can provide an intuitive projection image according to the movement of the pointing (105) position by gradually including the second content (104) in the projection area from the left corner to the right corner as the position of the pointing (105) moves from the first projection surface (101) to the second projection surface (102).

[0066] In one embodiment, the electronic device (1000) can include the second content (104) in the projection area as the first content (103) is excluded from the projection area as the position of the pointing (105) moves from the first projection surface (101) toward the second projection surface (102).

[0067] An electronic device (1000) according to one embodiment of the present disclosure can provide a consistent projection image that a user can view without interruption or distortion even when the position of the electronic device (1000) is moved by performing correction in real time to output an image according to preset image setting information for a projection surface.

[0068] According to an embodiment of the present disclosure, if there is no preset image setting information for a corresponding projection surface, the electronic device (1000) can derive image setting information most suitable for the corresponding projection surface based on information acquired about the surrounding space, information acquired about the corresponding projection surface, and information about the surrounding environment of the corresponding projection surface, and can perform correction in real time to output an image according to the derived image setting information. The electronic device (1000) can store the derived image setting information as image setting information for the corresponding projection surface. When the electronic device (1000) projects an image on the corresponding projection surface next time, the electronic device (1000) can acquire the stored image setting information and project the image according to the acquired image setting information.

[0069] In addition, the electronic device (1000) according to one embodiment of the present disclosure can predetermine recommended content corresponding to each projection surface, thereby allowing the user to conveniently execute desired content simply by moving the position of the pointing (105) of the electronic device (1000).

[0070] In addition, the electronic device (1000) according to one embodiment of the present disclosure can provide the user with an experience in which only the area illuminated by light changes while the content remains fixed by seamlessly projecting the content corresponding to each projection surface.

[0071] FIG. 2a is a drawing showing an example of how an electronic device operates according to prior art.

[0072] According to the prior art, when the projection angle of an electronic device that projects content on a projection surface as in (a) of FIG. 2a is changed as in (b) of FIG. 2a or the projection surface is changed as in (c) of FIG. 2a, the electronic device may project a distorted image due to the change in the projection angle or projection surface.

[0073] Conventional electronic devices may cause flickering in the projected image by pausing or delaying the projection as in (d) of Fig. 2a to correct the distorted image.

[0074] Conventional electronic devices can project an image identical to the image setting information initially viewed, as in (e) of Fig. 2a, only after recognizing the projection angle or projection surface and recalibrating the image accordingly.

[0075] FIG. 2b and FIG. 2c are diagrams showing an example of how an electronic device operates according to one embodiment of the present disclosure.

[0076] In FIG. 2b, an electronic device (1000) according to an embodiment of the present disclosure can project content at an initial projection angle (x, y, z) as in (a) of FIG. 2b.

[0077] An electronic device (1000) according to one embodiment of the present disclosure can project an image of image setting information such as (a) of FIG. 2B without image distortion even when the projection angle is changed from (x, y, z) to (x', y', z') as in (b) of FIG. 2B.

[0078] In the present disclosure, image setting information may mean settings for at least one of the size, shape, resolution, and brightness of the image.

[0079] The image of the image setting information such as (a) of Fig. 2b may be an image according to conditions preset by the user. The image of the image setting information such as (a) of Fig. 2b may be automatically set by the electronic device (1000). In one embodiment, the electronic device (1000) may automatically obtain image setting information suitable for the projection surface based on information obtained about the surrounding space, information about the projection surface, and information about the surrounding environment of the projection surface.

[0080] In one embodiment, the electronic device (1000) can obtain image setting information suitable for the projection surface by using a neural network trained to receive information about the surrounding space, information about the projection surface, and information about the surrounding environment of the projection surface as input and output image setting information suitable for the projection surface.

[0081] An electronic device (1000) according to one embodiment of the present disclosure can project an image of image setting information such as (a) of FIG. 2b without image distortion even when the projection distance is adjusted as in (c) of FIG. 2b and the projection angle is changed from (x', y', z') to (x'', y'', z'').

[0082] An electronic device (1000) according to one embodiment of the present disclosure identifies change values ​​according to a projection angle and a projection distance in real time, and corrects an image by reflecting the change values, thereby projecting an image under the same conditions without interruption as if the projection angle and the projection distance had not changed.

[0083] Accordingly, the electronic device (1000) according to one embodiment of the present disclosure can seamlessly project an image having the same size, shape, resolution, and brightness to the extent that a user viewing the image projected on a projection surface is unaware of the fact that the electronic device (1000) has moved and the fact that the projection angle and projection distance have changed.

[0084] FIG. 2c is a diagram illustrating an example of an electronic device operating according to one embodiment of the present disclosure.

[0085] The electronic device (1000) according to the embodiment of FIG. 2c can point to projection surface A as in (a) of FIG. 2c to project content at a projection angle (x, y, z) and then change the pointing position to another projection surface, projection surface B.

[0086] For example, the electronic device (1000) may point to projection surface A in the living room in (a) of FIG. 2c and to projection surface B in the room in (b) of FIG. 2c. In this case, not only the projection surface itself may be changed, but also the projection angle and projection distance may be changed.

[0087] An electronic device (1000) according to one embodiment of the present disclosure can identify pre-stored correction information for a projection surface B and project a corrected image onto the projection surface B.

[0088] An electronic device (1000) according to one embodiment of the present disclosure can identify recommended content and image setting information corresponding to a pre-stored projection surface B. The electronic device (1000) can project recommended content corresponding to the projection surface B according to the image setting information corresponding to the projection surface B.

[0089] In the present disclosure, the image setting information may include settings for at least one of the size, shape, resolution, and brightness of the projected image.

[0090] An electronic device (1000) according to one embodiment of the present disclosure can automatically project recommended content corresponding to projection surface B with image setting information corresponding to projection surface B without user intervention as the projection surface changes from A to B.

[0091] In the present disclosure, the recommended content corresponding to the projection surface may be content preset for each projection surface or content executed by a user's selection. That is, the electronic device (1000) according to one embodiment may automatically project preset content on the projection surface pointed at by the electronic device (1000) or execute content selected by the user on the projection surface pointed at.

[0092] An electronic device (1000) according to one embodiment can identify the position, projection angle, etc. of the electronic device (1000) to project an image according to image setting information corresponding to a projection surface B, and correct the image by reflecting the identified position and projection angle.

[0093] FIG. 3 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.

[0094] Referring to FIG. 3, an electronic device (1000) according to one embodiment of the present disclosure can identify a plurality of projection surfaces including a first projection surface and a second projection surface based on information acquired about a surrounding space (S310).

[0095] In the present disclosure, the plurality of projection surfaces may refer to all spaces within the surrounding space that can be used as projection surfaces. For example, the plurality of projection surfaces may include walls, floors, ceilings, doors, etc. within the surrounding space.

[0096] An electronic device (1000) according to one embodiment of the present disclosure can acquire information about a surrounding space using at least one sensor. In one embodiment, the surrounding space may refer to a space independent from the outside, such as a home or a company.

[0097] An electronic device (1000) according to one embodiment of the present disclosure can obtain information about a surrounding space from an external device using at least one sensor. This will be described in detail later.

[0098] An electronic device (1000) according to one embodiment can identify a plurality of projection surfaces that can be used as projection surfaces based on information acquired about the surrounding space.

[0099] An electronic device (1000) according to one embodiment can identify a flat surface having a certain area or more as a projection surface.

[0100] An electronic device (1000) according to one embodiment can identify a flat surface having a certain area or larger and having a space for a user to view an image projected onto the surface as a projection surface.

[0101] An electronic device (1000) according to one embodiment can determine a projection surface by taking into account the user's lifestyle habits.

[0102] An electronic device (1000) according to one embodiment can obtain a plurality of projection surfaces by using a neural network trained to receive information obtained about a surrounding space as input and output projection surfaces.

[0103] FIG. 6 is a diagram illustrating an example of a plurality of projection surfaces identified by an electronic device according to one embodiment of the present disclosure.

[0104] An electronic device (1000) according to one embodiment can identify a wall surface (601, 603, 604), a floor surface (602), and a virtual projection surface (605) as multiple projection surfaces based on information acquired about a surrounding space (600).

[0105] An electronic device (1000) according to one embodiment can store information about a plurality of identified projection surfaces.

[0106] In the embodiment of FIG. 6, the electronic device (1000) can set a virtual projection surface (605) instead of a physical projection surface that actually exists in a location where it is convenient for the user to view an image due to the structure of the surrounding space (600). The virtual projection surface (605) set in this way can be processed as a single projection surface identical to a physical projection surface, such as a wall surface. The user can increase the usability of the electronic device (1000) by setting the virtual projection surface (605) in a location where the user is likely to frequently use the projection surface.

[0107] The electronic device (1000) according to the embodiment of FIG. 3 can project an image corresponding to the first content on the first projection surface based on the status information of the electronic device for projecting an image on the first projection surface and the image setting information corresponding to the first projection surface (S320).

[0108] An electronic device (1000) according to one embodiment can identify recommended content corresponding to each of a plurality of projection surfaces.

[0109] In one embodiment, recommended content may include various types of OTT services, screensaver content including art modes, healthcare applications, IoT device control applications, media content, game content, partial UIs, content linking to external sources, content for derived experiences within content, and shopping content. However, recommended content is not limited to these.

[0110] An electronic device (1000) according to one embodiment may determine recommended content as fixed content.

[0111] An electronic device (1000) according to one embodiment can obtain recommended content corresponding to each of a plurality of projection surfaces by receiving a user input for recommended content received from an external device such as a smart phone.

[0112] An electronic device (1000) according to one embodiment can determine the size of an appropriate projection image, etc. based on information about the surrounding space and additionally acquired obstacle information, and can determine content that matches the size of the determined projection image as recommended content.

[0113] For example, the electronic device (1000) may determine a first OTT service as recommended content corresponding to a wide projection surface of a living room wall, and may determine a second OTT service as recommended content for a wide projection surface of another space.

[0114] In one embodiment, the electronic device (1000) can determine a partial UI or control application as recommended content for a projection surface with a small area.

[0115] In one embodiment, the recommended content corresponding to multiple projection surfaces may be content preset for each projection surface or content executed by a user's selection.

[0116] In one embodiment, the preset content for each projection surface may be content manually set as default for each projection surface by the user. User input for setting recommended content may be obtained in various ways, such as voice input, gesture input, text input, input via a user interface, or input via an external device.

[0117] In one embodiment, the preset content for each projection surface may be content automatically set by considering the size of the projection surface, environmental information around the projection surface, the position of the projection surface, and history information of the content projected on the corresponding projection surface.

[0118] FIG. 7 is a diagram illustrating an example in which an electronic device according to one embodiment of the present disclosure identifies recommended content corresponding to multiple projection surfaces.

[0119] The electronic device (1000) according to the embodiment of FIG. 7 can identify recommended content corresponding to a plurality of projection surfaces (601, 602, 603, 604, 605) identified in the surrounding space (600).

[0120] In one embodiment, the electronic device (1000) can search for previously stored recommended content for each projection surface and identify recommended content corresponding to each projection surface.

[0121] In one embodiment, the electronic device (1000) can identify recommended content corresponding to each projection surface by determining recommended content in real time by considering the size of the projection surface, environmental information around the projection surface, the position of the projection surface, and history information of content projected on the corresponding projection surface. In this case, the electronic device (1000) can use artificial intelligence to identify recommended content, which will be described in detail later.

[0122] The electronic device (1000) according to the embodiment of FIG. 7 can identify an OTT application, such as Netflix or Disney Plus, as recommended content corresponding to the largest and widest projection surface (601) in the surrounding space (600). In the embodiment of FIG. 7, the electronic device (1000) can identify one of exercise contents, such as yoga, Pilates, aerobics, or dance, as recommended content corresponding to the projection surface (602), which is the floor surface. The user can follow the movements while watching the image projected on the floor surface (602).

[0123] In the embodiment of FIG. 7, the electronic device (1000) can identify a video playback application, such as YouTube, as recommended content for the projection surface (603).

[0124] In the embodiment of FIG. 7, the electronic device (1000) can identify IoT control applications, such as smart things, as recommended content for the projection surface (604).

[0125] In the embodiment of FIG. 7, the electronic device (1000) can identify an OTT application, such as Samsung TV Plus, as recommended content for the projection surface (605).

[0126] In the embodiment of FIG. 7, the designation and storage of recommended content corresponding to each projection surface can be performed through an external device (2000). The electronic device (1000) can receive and use recommended content corresponding to each projection surface stored or identified through the external device (2000).

[0127] In one embodiment, the electronic device (1000) can conveniently create, modify, or delete recommended content corresponding to each projection surface through a user interface provided by an external device (2000) connected to the electronic device (1000).

[0128] The electronic device (1000) can automatically execute recommended content corresponding to the projection surface without user intervention when a pointing location is identified on one of the plurality of projection surfaces.

[0129] In one embodiment, the electronic device (1000) can project an image of the recommended content onto the projection surface by independently executing the recommended content corresponding to the projection surface.

[0130] In one embodiment, the electronic device (1000) can project an image of the executed content onto the corresponding projection surface by executing the recommended content through an external device (2000) connected to the electronic device (1000).

[0131] The electronic device (1000) according to the embodiment of FIG. 3 can identify image setting information corresponding to a plurality of projection surfaces.

[0132] The electronic device (1000) can identify image setting information corresponding to each of a plurality of projection surfaces.

[0133] In one embodiment, the electronic device (1000) can identify image setting information corresponding to each of the plurality of projection surfaces by retrieving image setting information corresponding to each of the plurality of projection surfaces that have been previously stored.

[0134] In one embodiment, the electronic device (1000) can identify image setting information corresponding to each of the plurality of projection surfaces by obtaining optimal image setting information for each of the plurality of projection surfaces in real time using information about each of the plurality of projection surfaces. The electronic device (1000) can store the image setting information corresponding to each of the plurality of projection surfaces obtained.

[0135] The image setting information corresponding to each projection surface may include settings for at least one of the image size, image shape, resolution, and brightness that are optimal when viewing an image by projecting it on the corresponding projection surface.

[0136] In one embodiment, the electronic device (1000) may consider at least one of the brightness and size of the space in which the projection surface exists, the size of the projection surface, and the material of the projection surface to determine image setting information corresponding to each projection surface.

[0137] In one embodiment, the image setting information corresponding to each projection surface may be image setting information that is optimal for viewing each projection surface by considering the size of each projection surface, the material of the projection surface, the brightness around the projection surface, the size of the space in which the projection surface can be viewed, etc.

[0138] In one embodiment, the electronic device (1000) can identify the image setting information most recently set by the user for the corresponding projection surface as the image setting information corresponding to the corresponding projection surface.

[0139] In one embodiment, the image setting information corresponding to each projection surface may vary depending on the user's preference.

[0140] In one embodiment, the electronic device (1000) can project an image by correcting it in real time so that the user can always view the image according to the image setting information corresponding to each projection surface.

[0141] The electronic device (1000) according to the embodiment of FIG. 3 can project first content on the first projection surface according to the position of the electronic device pointing to the first projection surface among a plurality of projection surfaces, the projection angle, and the image setting information corresponding to the first projection surface.

[0142] In one embodiment, the electronic device (1000) can automatically correct a projected image according to image setting information corresponding to the projection surface by reflecting changes in the position and projection angle of the electronic device (1000) detected in real time using at least one sensor.

[0143] In the present disclosure, at least one sensor may include at least one of a GPS, an Orientation sensor, an Accelerometer sensor, a Lidar sensor, a ToF sensor, a Gyro sensor, a Gyroscope sensor, an RGB camera, a depth camera, and an IR camera.

[0144] In one embodiment, the electronic device (1000) can identify a projection surface that the electronic device (1000) is pointing at by using information about the surrounding space and position and projection angle information of the electronic device (1000) obtained using at least one sensor.

[0145] The first content may be recommended content corresponding to the first projection surface that the electronic device (1000) is pointing at.

[0146] An electronic device (1000) according to one embodiment of the present disclosure can change the size of an image corresponding to first content output on a first projection surface according to the degree of movement in the projection direction as the projection direction of the electronic device moves from a first projection surface to a second projection surface and can project an image corresponding to second content on a second projection surface by changing the size according to the degree of movement in the projection direction (S330).

[0147] An electronic device (1000) according to one embodiment can project a first content among projected images according to image setting information corresponding to a first projection surface, and can project a second content according to image setting information corresponding to a second projection surface.

[0148] An electronic device (1000) according to one embodiment can control a portion of the first content to be cropped as the pointing position moves from a first projection surface toward a second projection surface, thereby reducing the proportion of the first content in the projection image. In this case, the electronic device (1000) can crop the first content from a left corner to a right corner as the pointing position moves from the first projection surface toward the second projection surface.

[0149] According to one embodiment, the electronic device (1000) can control the projection direction of the electronic device (1000) to move from a first projection surface to a second projection surface so that the ratio of the first content among the entire projection image including the first content and the second content decreases, so that only a portion of the image corresponding to the first content is projected.

[0150] An electronic device (1000) according to one embodiment can control the projection of an image corresponding to the first content to be reduced in size so that the proportion of the first content among the entire projection image including the first content and the second content decreases as the projection direction of the electronic device (1000) moves from the first projection surface to the second projection surface.

[0151] An electronic device (1000) according to one embodiment can control the output ratio of the sound of the first content and the sound of the second content to be changed in proportion to the distance the projection direction of the electronic device (1000) moves from the first projection surface to the second projection surface.

[0152] An electronic device (1000) according to one embodiment can project a part or all of the second content in the direction from the left corner to the right corner of the second content as the position of pointing moves from the first projection surface to the second projection surface.

[0153] An electronic device (1000) according to one embodiment can control the proportion of the first content among the projected images to decrease by reducing the size of the projected image for the first content as the pointing position moves from the first projection surface toward the second projection surface. An electronic device (1000) according to one embodiment can control the proportion of the first content among the entire projected images to decrease by reducing the overall size of the first content while projecting all of the contents of the first content as the pointing position moves from the first projection surface toward the second projection surface.

[0154] An electronic device (1000) according to one embodiment can determine how to control the ratio of the first content in the projection image to decrease when the position of the pointing moves from the first projection surface to the second projection surface according to the relationship between the first content and the second content.

[0155] For example, if the second content is additional information or detailed information about the first content or information related to the first content, the electronic device (1000) can control the projection of all contents of the first content when the pointing position moves from the first projection surface to the second projection surface, but reduces the overall size of the first content so that the proportion of the first content in the entire projection image becomes smaller.

[0156] For example, if the second content is a heterogeneous content unrelated to the first content, the electronic device (1000) can control the proportion of the first content in the projection image to decrease by cropping a portion of the first content as the pointing position moves from the first projection surface toward the second projection surface.

[0157] An electronic device (1000) according to one embodiment may perform function control on an image corresponding to the second content when a user input corresponding to function control is received while an image corresponding to the first content and an image corresponding to the second content are being projected together.

[0158] In one embodiment, the first content projected on the first projection surface may be content selected based on user input, and the second content projected on the second projection surface may be content based on the positional relationship between the first projection surface and the second projection surface. The content based on the positional relationship between the first projection surface and the second projection surface may mean content that is determined to be information related to the first content or separate content unrelated to the first content based on the positional relationship between the first projection surface and the second projection surface.

[0159] In one embodiment, when the positional relationship between the first projection surface and the second projection surface is a vertical relationship, the second content projected onto the second projection surface may be content including information related to the first content.

[0160] In one embodiment, when the positional relationship between the first projection surface and the second projection surface is a left-right relationship, the second content projected on the second projection surface may be separate content unrelated to the first content.

[0161] FIG. 4 is a diagram illustrating an example of a method by which an electronic device according to one embodiment of the present disclosure obtains and uses information to provide a fixed projection experience.

[0162] In one embodiment, the electronic device (1000) may be equipped with a hardware implementation device and a software algorithm that can calculate and apply correction values ​​in real time according to the position of the electronic device (1000), the projection angle of the electronic device (1000), and the projection distance, so as to enable the user to view a projection image of fixed image setting information from the user's perspective with respect to the projection surface as described in FIGS. 2b and 2c.

[0163] In one embodiment, the electronic device (1000) may be equipped with a sensor unit including at least one of a GPS, an orientation sensor, an accelerometer sensor, a Lidar sensor, a ToF sensor, a gravity sensor, a gyro sensor, an RGB camera, a depth camera, and an IR camera as a hardware implementation device.

[0164] In one embodiment, the electronic device (1000) can recognize coordinates and height of the surrounding space using GPS, measure a projection angle using an orientation sensor or an accelerometer sensor, measure a projection distance using a Lidar sensor or a ToF sensor, recognize brightness and obstacles of the surrounding space using a Lidar sensor or an RGB camera, and recognize the surrounding space using an RGB camera or an IR camera.

[0165] In one embodiment, the electronic device (1000) can generate a depth map frame for a space using a hardware implementation device.

[0166] In one embodiment, the electronic device (1000) can model the surrounding space using software algorithms including a viewing direction determination engine, a 3D model linking engine, a current location determination engine, a projectible location determination engine, a content-based content recommendation engine, and the like.

[0167] In one embodiment, the electronic device (1000) can identify in real time the position, projection angle, projection distance, and the projection surface being pointed at of the electronic device (1000) using at least one sensor and various algorithms. The electronic device (1000) can perform correction in real time to project an image according to the image setting information for the projection surface using information such as the position, projection angle, projection distance, and the projection surface being pointed at of the electronic device (1000) among the identified surrounding spaces.

[0168] In one embodiment, the electronic device (1000) can model the surrounding space in 3D using at least one sensor and various algorithms, and identify the location of the electronic device (1000) in the surrounding space.

[0169] In one embodiment, the electronic device (1000) may acquire and utilize additional map data, such as a floor plan of the surrounding space, in addition to information acquired using at least one sensor. In one embodiment, the electronic device (1000) may utilize various drawings already stored, such as an apartment floor plan.

[0170] In one embodiment, the electronic device (1000) can detect obstacles in real time using at least one sensor and various algorithms, thereby reflecting the detected obstacles in the projected image in real time. For example, the electronic device (1000) can correct image distortion caused by obstacles in real time, thereby projecting an image identical to that projected when there is no obstacle.

[0171] In one embodiment, the electronic device (1000) may temporarily adjust the resolution to reduce the size of the image when an obstacle is detected.

[0172] In one embodiment, when an obstacle is detected, the electronic device (1000) may simply project an image onto the obstacle or guide the user to take action against the obstacle.

[0173] FIG. 5 is a diagram illustrating an example of a method by which an electronic device according to one embodiment of the present disclosure obtains information about a surrounding space.

[0174] An electronic device (1000) according to one embodiment can obtain information about the surrounding space from an external device (2000).

[0175] The external device (2000) can be implemented in various forms such as a smart phone, a tablet PC, a digital camera, a camcorder, a laptop computer, a netbook computer, a desktop, an e-book reader, a video phone, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, a wearable device, a smart refrigerator, and other home appliances.

[0176] The external device (2000) can recognize the surrounding space using a sensor unit including at least one of a GPS, an orientation sensor, an accelerometer sensor, a Lidar sensor, a ToF sensor, a gravity sensor, a gyro sensor, an RGB camera, a depth camera, and an IR camera.

[0177] In one embodiment, an external device (2000) can transmit recognized surrounding space information to an electronic device (1000).

[0178] In one embodiment, the external device (2000) can acquire a projectible space, i.e., a plurality of projection surfaces, from the perspective of the electronic device (1000) using the recognized surrounding space information. In one embodiment, the external device (2000) can transmit information about the acquired plurality of projection surfaces to the electronic device (1000).

[0179] In the embodiment of FIG. 5, an external device (2000) can obtain information about the surrounding space or identify a projection surface using a Lidar sensor.

[0180] For example, the external device (2000) can recognize coordinates and height of the surrounding space using GPS, measure the projection angle using an orientation sensor or an accelerometer sensor, measure the distance of the projection surface using a Lidar sensor or a ToF sensor, recognize brightness and obstacles of the surrounding space using a Lidar sensor or an RGB camera, and recognize the surrounding space using an RGB camera or an IR camera.

[0181] FIG. 8 is a diagram illustrating an example of a method by which an electronic device according to one embodiment of the present disclosure determines recommended content corresponding to each projection surface using artificial intelligence.

[0182] An electronic device (1000) according to one embodiment of the present disclosure can obtain recommended content for each projection surface by using a neural network trained to obtain information, projection history, and context for a plurality of projection surfaces as input and output recommended content for each projection surface.

[0183] Artificial intelligence (AI) is a computer system that achieves human-level intelligence. It allows machines to learn and make decisions on their own, and its recognition rate improves with use. AI technology consists of machine learning (deep learning) techniques that utilize algorithms to classify and learn the characteristics of input data, as well as component technologies that leverage machine learning algorithms to mimic the cognitive, judgmental, and other functions of the human brain.

[0184] For example, the element technologies may include at least one of linguistic understanding technology that recognizes human language / characters, visual understanding technology that recognizes objects as if they were human vision, inference / prediction technology that judges information and logically infers and predicts, knowledge representation technology that processes human experience information into knowledge data, and motion control technology that controls autonomous driving of vehicles and movements of robots.

[0185] The artificial intelligence-related function according to the present disclosure may be operated through the processor (110) and memory (120) of FIG. 13. The processor (110) may be composed of one or more processors. In this case, the one or more processors may be a general-purpose processor such as a CPU, an AP, a DSP (Digital Signal Processor), a graphics-only processor such as a GPU, a VPU (Vision Processing Unit), or an artificial intelligence-only processor such as an NPU. The one or more processors (110) control input data to be processed according to predefined operation rules or artificial intelligence models stored in the memory (120). Alternatively, when the one or more processors (110) are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0186] The predefined operation rules or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that the basic artificial intelligence model is learned by a learning algorithm using a plurality of learning data, thereby creating the predefined operation rules or artificial intelligence models set to perform a desired characteristic (or purpose). Such learning may be performed in the electronic device (1000) itself on which the artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and / or system. Examples of the learning algorithm include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

[0187] An AI model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values ​​and performs neural network operations by calculating the results of previous layers and the multiple weights. The multiple weights of the multiple neural network layers can be optimized based on the learning results of the AI ​​model. For example, the multiple weights may be updated during the learning process to reduce or minimize the loss or cost values ​​obtained from the AI ​​model.

[0188] In an embodiment using a deep learning algorithm, the processor (110) may use a pre-trained deep neural network model (810) to determine recommended content for each projection surface using at least one weight obtained.

[0189] The pre-trained deep neural network model (810) may be an artificial intelligence model trained through learning that acquires information on multiple projection surfaces, projection history, and context as inputs and outputs recommended content for each projection surface.

[0190] The deep neural network model may be, for example, a convolutional neural network (CNN). However, the deep neural network model is not limited thereto, and may be a known artificial intelligence model including at least one of a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and a deep Q-network.

[0191] The electronic device (1000) can obtain recommended content for each projection surface by using various machine learning algorithms based on information about multiple projection surfaces, projection history, and context.

[0192] FIG. 9 is a diagram showing an example of how an electronic device according to one embodiment of the present disclosure operates.

[0193] In one embodiment, the electronic device (1000) can project first content on a first projection surface (910), which is a wall surface of a bedroom, and then project second content on a second projection surface (920), which is a ceiling, as the projection angle increases.

[0194] In one embodiment, the first content may be various content such as a TV program, a movie, an OTT service, etc.

[0195] In one embodiment, the second content may be video or music content that aids sleep. In this case, the recommended content corresponding to the second projection surface (920), which is the ceiling, may be the second content.

[0196] In one embodiment, when the electronic device (1000) detects that the pointing position of the electronic device (1000) moves toward the ceiling while projecting the first content, the electronic device can project recommended content corresponding to the second projection surface (920), such as a video or music content that is helpful for sleep.

[0197] FIG. 10 is a drawing showing an example in which an electronic device according to one embodiment of the present disclosure provides a guide for an additional projection surface on which projection is possible.

[0198] In one embodiment, the electronic device (1000) can project first content on the first projection surface (1010) according to image setting information corresponding to the first projection surface (1010) pointed by the electronic device (1000) among the plurality of projection surfaces.

[0199] In one embodiment, the electronic device (1000) can obtain information such as whether there are additional projection surfaces around the first projection surface (1010), in which direction the other projection surfaces exist, and what recommended content corresponds to the other projection surfaces.

[0200] In one embodiment, the electronic device (1000) can detect a second projection surface (1030) as another projection surface around the first projection surface (1010).

[0201] In one embodiment, when there is detailed information to be provided according to the content of the first content, the electronic device (1000) may insert a guide arrow (1020) into the projection image of the first content, thereby informing the user that additional information may be provided when the pointing of the electronic device (1000) is moved in the direction indicated by the guide arrow (1020).

[0202] In this embodiment, the notification display is illustrated as a guide arrow (1020). However, this is merely an example and the notification display is not limited to this. Such notifications may be provided in various ways, such as guide arrows, animation effects, voice guidance, and text notifications.

[0203] In one embodiment, the electronic device (1000) can provide an animation effect, such as a blinking effect, or highlight a guide arrow (1020) inserted into a projection image of the first content.

[0204] In one embodiment, when the position of the pointing is moved in the direction indicated by the guide arrow (1020) and points to the second projection surface (1030), the electronic device (1000) can project detailed information about the first content on the second projection surface (1030) according to the preset image setting information corresponding to the second projection surface (1030).

[0205] For example, if the first content is a soccer match and a goal is detected, the electronic device (1000) can insert a guide arrow (1020) into the projection image to indicate the presence of a detailed information screen. If the pointing position of the electronic device (1000) moves in the direction of the inserted guide arrow (1020), the electronic device (1000) can project detailed information about the goal as the second content on the second projection surface (1030). The detailed information about the goal can include information about the player who scored the goal, information about which goal the player scored, information about the player who assisted the goal, etc.

[0206] FIG. 11 is a diagram showing an example of how an electronic device according to one embodiment of the present disclosure operates.

[0207] In one embodiment, the electronic device (1000) can project a portion of content onto each of two projection surfaces, as shown in (b) of FIG. 1.

[0208] In one embodiment, the electronic device (1000) can project all of the content onto each of two projection surfaces.

[0209] In one embodiment, when the electronic device (1000) is projecting content simultaneously on two projection surfaces, the electronic device (1000) can output sound of each content through speakers adjacent to each of the two projection surfaces.

[0210] For example, when first content (1130) is projected on a first projection surface (1110) and second content (1140) is simultaneously projected on a second projection surface (1120), the electronic device (1000) can output sound for the first content (1130) from a first speaker (1150) located closer to the first projection surface (1110), and output sound for the second content (1140) from a second speaker (1160) located closer to the second projection surface (1120). At this time, the first speaker (1150) can output only sound for the first content (1130), and the second speaker (1160) can output only sound for the second content (1140).

[0211] For example, when first content (1130) is projected on a first projection surface (1110) and second content (1140) is simultaneously projected on a second projection surface (1120), the electronic device (1000) can output sound for the first content (1130) from a first speaker (1150) and output sound for the second content (1140) from a second speaker (1160).

[0212] FIG. 12 is a diagram illustrating an example of a method for outputting sound and providing user interaction when an electronic device according to one embodiment of the present disclosure moves between multiple projection surfaces.

[0213] The situation illustrated in the drawing of Fig. 12 may be a situation in which the position of pointing is moved toward the second projection surface (102) while projecting the first content (A) onto the first projection surface (101) in the same manner as the situation illustrated in Fig. 1.

[0214] When the electronic device (1000) projects the entire first content (A) onto the first projection surface (101) as shown in (a) of FIG. 12, the electronic device (1000) can output the sound of the first content (A) and perform interaction on the first content (A) through a user interface. The user interface may be a separate control device such as a remote control, a touch screen mounted on the electronic device (1000), or the like. In one embodiment, the electronic device (1000) can interact with the user by recognizing voice commands, gesture commands, text commands, etc. Interaction on the content may include adjusting the volume of the sound, changing the channel, and changing other content settings.

[0215] In (b) of FIG. 12, the position of the pointing (105) of the electronic device (1000) still points to the first projection surface (101), but may point to a position moved from the first projection surface (101) toward the second projection surface (102). In this case, the electronic device (1000) may project a portion of the first content (A) and a portion of the second content (B) simultaneously.

[0216] In one embodiment, when the output proportions of the first content (A) and the second content (B) in the projection image are 50% and 40%, respectively, the electronic device (1000) can simultaneously output sounds at a size ratio of 50% and 40%, respectively.

[0217] In one embodiment, when projecting first content (A) and second content (B) simultaneously, the electronic device (1000) may not interact with any content.

[0218] In one embodiment, when projecting first content (A) and second content (B) simultaneously, the electronic device (1000) may be set to interact with the second content (B), which is new content.

[0219] In (c) of FIG. 12, when the pointing position of the electronic device (1000) has finished moving from the first projection surface (101) toward the second projection surface (102), the electronic device (1000) can project the entire second content (B) onto the second projection surface (102). In the case where the electronic device (1000) projects the entire second content (B) onto the second projection surface (102) as in (c) of FIG. 12, the electronic device (1000) can output the sound of the second content (B) and perform interaction on the second content (B) via the user interface.

[0220] FIG. 13 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0221] Referring to FIG. 13, the electronic device (1000) may include a processor (110) and a memory (120).

[0222] The memory (120) can store a program for processing and controlling the processor (110). In addition, the memory (120) can store data input to or output from the electronic device (1000).

[0223] The memory (120) may include at least one of internal memory (not shown) and external memory (not shown).

[0224] The memory (120) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0225] The internal memory may include, for example, at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).

[0226] According to one embodiment, the processor (110) may load commands or data received from non-volatile memory or at least one of other components into volatile memory and process them. In addition, the processor (110) may store data received or generated from other components in non-volatile memory.

[0227] The external memory may include, for example, at least one of CF (Compact Flash), SD (Secure Digital), Micro-SD (Micro Secure Digital), Mini-SD (Mini Secure Digital), xD (extreme Digital), and Memory Stick.

[0228] The memory (120) may store one or more instructions executable by the processor (110).

[0229] In one embodiment, the memory (120) can store various types of information input through an input / output unit (not shown).

[0230] In one embodiment of the present disclosure, the memory (120) may store at least one of instructions, algorithms, data structures, program codes, and application programs that can be read by the processor (110). The instructions, algorithms, data structures, and program codes stored in the memory (120) may be implemented in a programming or scripting language such as, for example, C, C++, Java, or an assembler.

[0231] In one embodiment, the memory (120) may store instructions for controlling a processor in real time to identify a plurality of projection surfaces among the surrounding space based on information acquired about the surrounding space, identify recommended content and image setting information corresponding to the plurality of projection surfaces, project first content on the first projection surface according to a position of an electronic device pointing to a first projection surface among the plurality of projection surfaces, a projection angle, and image setting information corresponding to the first projection surface, and to control the processor so that as the position of the pointing moves from the first projection surface toward the second projection surface, the proportion of the first content among the projected images decreases and the proportion of the second content, which is recommended content corresponding to the second projection surface, increases.

[0232] The processor (110) can execute an OS (Operating System) and various applications stored in the memory (120) when there is a user input or a preset stored condition is satisfied.

[0233] The processor (110) may include a RAM that stores signals or data input from the outside of the electronic device (1000) or is used as a storage area corresponding to various tasks performed in the electronic device (1000), and a ROM that stores a control program for controlling the electronic device (1000).

[0234] The processor (110) may include single cores, dual cores, triple cores, quad cores, and multiples thereof. Furthermore, the processor (110) may include multiple processors. For example, the processor (110) may be implemented as a main processor (not shown) and a subprocessor (not shown) operating in sleep mode.

[0235] Additionally, the processor (110) may include at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and a VPU (Video Processing Unit). Alternatively, according to an embodiment, the processor (110) may be implemented in the form of a SOC (System On Chip) that integrates at least one of a CPU, a GPU, and a VPU.

[0236] The processor (110) can control components of various electronic devices (1000) by executing one or more instructions stored in the memory (120).

[0237] In one embodiment, the processor (110) may identify a plurality of projection surfaces within the surrounding space based on information acquired about the surrounding space. In one embodiment, the processor (110) may identify recommended content and image setting information corresponding to the plurality of projection surfaces. In one embodiment, the processor (110) may project first content on the first projection surface according to the position of an electronic device pointing to a first projection surface among the plurality of projection surfaces, a projection angle, and image setting information corresponding to the first projection surface. In one embodiment, the processor (110) may control in real time so that as the pointing position moves from the first projection surface toward the second projection surface, the proportion of the first content in the projection image decreases and the proportion of the second content, which is recommended content corresponding to the second projection surface, increases.

[0238] In one embodiment, the processor (110) may control the proportion of the first content in the projection image to decrease by cropping a portion of the first content as the position of the pointing moves from the first projection surface to the second projection surface by executing one or more instructions.

[0239] In one embodiment, the processor (110) may control the proportion of the first content among the projection images to decrease by reducing the size of the projection image for the first content as the position of the pointing moves from the first projection surface to the second projection surface by executing one or more instructions.

[0240] In one embodiment, the processor (110) may adjust the output proportion of the sound of the first content and the sound of the second content in proportion to the distance the pointing position moves in the direction of the second projection surface from the first projection surface by executing one or more instructions.

[0241] In one embodiment, the processor (110) may correct a projection image for the first content according to image setting information corresponding to the first projection surface by reflecting a change in the position and projection angle of the electronic device detected in real time using at least one sensor by executing one or more instructions.

[0242] In one embodiment, the processor (110) can identify that a user command, such as adjusting sound volume and changing channels, is for the second content when the projected image includes first content and second content by executing one or more instructions.

[0243] In one embodiment, the processor (110) may transmit a video signal or audio signal transmitted from the electronic device (1000) to an external display so that the signal can be output to the external display.

[0244] FIG. 14 is a block diagram for explaining in more detail the configuration of an electronic device according to one embodiment of the present disclosure.

[0245] Referring to FIG. 14, the electronic device (1000) may include a tuner unit (340), a processor (110), a display (320), a communication unit (350), a sensor unit (130), an input / output unit (370), a video processing unit (380), an audio processing unit (385), an audio output unit (390), a memory (120), a power supply unit (395), a light source unit (365), and a projection lens (366).

[0246] The processor (110) of Fig. 14 corresponds to the processor (110) of Fig. 13, and the memory (120) of Fig. 14 corresponds to the memory (120) of Fig. 13. Therefore, any content that overlaps with the content described above will be omitted.

[0247] According to one embodiment, the communication unit (350) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, a LAN module, an Ethernet module, a wired communication module, etc. In this case, each communication module may be implemented in the form of at least one hardware chip.

[0248] The Wi-Fi module and Bluetooth module perform communication via Wi-Fi and Bluetooth, respectively. When using the Wi-Fi module or Bluetooth module, various connection information such as the SSID and session key are first transmitted and received, and after establishing a communication connection using this, various information can be transmitted and received. The wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0249] According to one embodiment, the communication unit (350) can receive user input from an external device.

[0250] According to one embodiment, the communication unit (350) can communicate with an external device such as a server.

[0251] A communication unit (350) according to one embodiment may include a communication unit that performs wireless communication with a server, etc., such as BT, and a communication unit that connects to an external device, such as through an HDMI port, etc. In this case, the communication unit that performs wireless communication with a server, etc., such as BT, may perform connection with other devices and video / audio data transmission. The communication unit that connects to an external device, such as through an HDMI port, etc., may include not only an input port that receives input, but also an output port, such as DP, HDMI, RGB, DVI, Thunderbolt, etc., for transmitting video or audio signals to an external display unit or speaker.

[0252] A tuner unit (340) according to one embodiment can select and tune only the frequency of a channel to be received by an electronic device (1000) among many radio wave components through amplification, mixing, resonance, etc. of a broadcast signal received wired or wirelessly. The broadcast signal includes audio, video, and additional information (e.g., EPG (Electronic Program Guide)).

[0253] The tuner unit (340) can receive broadcast signals from various sources, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, and Internet broadcasting. The tuner unit (340) can also receive broadcast signals from sources, such as analog broadcasting or digital broadcasting.

[0254] The sensor unit (130) detects sound around the electronic device (1000), image around the electronic device (1000), or interaction with the surroundings of the electronic device (1000), and may include at least one of a microphone (331), a camera (332), and a light receiving unit (333). The sensor unit (130) may detect the state of the electronic device (1000) or the state around the electronic device (1000), and transmit the detected information to the processor (110).

[0255] The microphone (331) receives the user's spoken voice and the voice generated around the electronic device (1000). The microphone (331) can convert the received voice into an electrical signal and output it to the processor (110). The microphone (331) can utilize various noise removal algorithms to remove noise generated in the process of receiving an external acoustic signal.

[0256] The camera (332) can obtain image frames such as still images or moving images. Images captured through the image sensor can be processed through a processor (110) or a separate image processing unit (not shown).

[0257] The image frame processed by the camera (332) can be stored in the memory (120) or transmitted externally through the communication unit (350). Two or more cameras (332) may be provided depending on the configuration of the electronic device (1000).

[0258] The optical receiver (333) receives an optical signal (including a control signal) from an external remote control device (not shown). The optical receiver (333) can receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from the remote control device (not shown). A control signal can be extracted from the received optical signal under the control of the processor (110). For example, the optical receiver (333) can receive a control signal corresponding to a channel up / down button for switching channels from the remote control device (not shown).

[0259] The sensor unit (130) of FIG. 14 is illustrated as including a microphone (331), a camera (332), and a light receiving unit (333), but is not limited thereto, and may include at least one of a magnetic sensor, an acceleration sensor, a temperature / humidity sensor, an infrared sensor, a gyroscope sensor, a position sensor (e.g., GPS), a barometric pressure sensor, a proximity sensor, an RGB sensor, an illuminance sensor, and a Wi-Fi signal receiving unit, but is not limited thereto. Since the function of each sensor can be intuitively inferred from its name by those skilled in the art, a detailed description thereof will be omitted.

[0260] The sensor unit (130) of FIG. 14 is illustrated as being provided in the electronic device (1000) itself, but is not limited thereto, and may be provided in a control device, which is a device that is located independently of the electronic device (1000), such as a remote control, and communicates with the electronic device (1000). When the sensing unit (130) is provided in the control device of the electronic device (1000), the control device can digitize information detected by the sensing unit (130) and transmit it to the electronic device (1000). The control device can communicate with the electronic device (1000) using short-range communication including infrared, Wi-Fi, or Bluetooth.

[0261] For example, the microphone may be provided in the electronic device (1000) itself, but may also be provided in a control device, which is a device that is located independently of the electronic device (1000), such as a remote control, and communicates with the electronic device (1000).

[0262] In one embodiment, if a microphone is provided in the remote control, an analog voice signal can be received through the microphone, digitized by the remote control, and transmitted to an electronic device (1000) such as a TV. In this case, the remote control can communicate with the electronic device (1000) using short-range communication including infrared, Wi-Fi, Bluetooth, or BT.

[0263] In one embodiment, the electronic device (1000) may have multiple communication units (350) capable of various short-range communications including infrared, Wi-Fi, or Bluetooth.

[0264] In one embodiment, the electronic device (1000) may have multiple communication units (350) that communicate with a server and communicate with a remote control, each having different communication units. For example, the communication unit for communicating with the server may be a communication unit that utilizes an Ethernet modem, a Wi-Fi module, etc., while the communication unit for communicating with the remote control may be a communication unit that utilizes a BT module.

[0265] In one embodiment, the electronic device (1000) may have a communication unit (350) that communicates with a server and a communication unit that communicates with a remote control, which are identical. For example, the communication unit that communicates with the server and the communication unit that communicates with the remote control may both be communication units that utilize a Wi-Fi module.

[0266] In one embodiment, a device such as a smartphone with a remote control application installed can perform the same function as the remote control described above. That is, a device with a remote control application installed can control the electronic device (1000) and perform voice recognition functions.

[0267] Devices on which the remote control application can be installed may include any device that can operate by installing an application, such as an AI speaker, in addition to a smartphone.

[0268] In one embodiment, a device having a remote control application installed may be capable of receiving user voice commands.

[0269] In one embodiment, the electronic device (1000) may include a plurality of communication units that can implement the above communication method to transmit and receive data using Wi-Fi, BT, infrared, etc., and control the device on which the remote control or remote control application can be installed.

[0270] The input / output unit (370) receives video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the electronic device (1000) under the control of the processor (110). The input / output unit (370) may include any one of a High-Definition Multimedia Interface (HDMI), a Mobile High-Definition Link (MHL), a Universal Serial Bus (USB), a Display Port (DP), a Thunderbolt, a Video Graphics Array (VGA) port, an RGB port, a D-subminiature (D-SUB), a Digital Visual Interface (DVI), a component jack, and a PC port.

[0271] The video processing unit (380) performs processing on video data received by the electronic device (1000). The video processing unit (380) can perform various image processing operations, such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on the video data.

[0272] The display (320) converts image signals, data signals, OSD signals, control signals, etc. processed by the processor (110) to generate driving signals. The display (320) can be implemented as a PDP, LCD, OLED, flexible display, etc., and can also be implemented as a 3D display. In addition, the display (320) can be configured as a touch screen and used as an input device in addition to an output device.

[0273] The display (320) can output various contents input through a communication unit (not shown) or an input / output unit (370), or output images stored in the memory (120). In addition, the display (320) can output information input by a user through the input / output unit (370) on the screen.

[0274] The display (320) may include a display panel. The display panel may be a liquid crystal display (LCD) panel or a panel including various light-emitting elements such as a light emitting diode (LED), an organic light emitting diode (OLED), or a cold cathode fluorescent lamp (CCFL). In addition, the display panel may include not only a flat display device, but also a curved display device having a curved screen or a flexible display device whose curvature can be adjusted. The display panel may also be a three-dimensional display (3D display) or an electrophoretic display.

[0275] The output resolution of the display panel may include, for example, HD (High Definition), Full HD, Ultra HD, or a resolution sharper than Ultra HD.

[0276] In the embodiment of FIG. 14, the electronic device (1000) is illustrated as including a display, but is not limited thereto. The electronic device (1000) may be configured to be connected to a separate display device including a display via wired or wireless communication, and transmit video / audio signals to the display device.

[0277] In one embodiment, the electronic device (1000) may be implemented in a form that operates by being connected to an external display even if it does not have a built-in display.

[0278] For example, the electronic device (1000) may be implemented in a form that outputs images to a separate external display through a video or audio output port, such as an STB, Apple TV, etc., without a display or with a simple display for notifications, etc.

[0279] In this case, the electronic device (1000) may be equipped with an output port for outputting a video or audio signal to the display. The output port may be of a type capable of simultaneously transmitting video signals and audio signals, such as HDMI, DP, Thunderbolt, etc., or may be of a type in which each port separately transmits video signals and audio signals.

[0280] In one embodiment, the electronic device (1000) can transmit video or audio signals via wired communication or wireless communication.

[0281] The audio processing unit (385) processes audio data. The audio processing unit (385) may perform various processing operations, such as decoding, amplification, and noise filtering, on audio data. Meanwhile, the audio processing unit (385) may be equipped with multiple audio processing modules to process audio corresponding to multiple contents.

[0282] The audio output unit (390) outputs audio included in a broadcast signal received through the tuner unit (340) under the control of the processor (110). The audio output unit (390) can output audio (e.g., voice, sound) input through the communication unit (350) or the input / output unit (370). In addition, the audio output unit (390) can output audio stored in the memory (120) under the control of the processor (110). The audio output unit (390) can include at least one of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface:) output terminal.

[0283] The power supply unit (395) supplies power input from an external power source to components inside the electronic device (1000) under the control of the processor (110). In addition, the power supply unit (395) can supply power output from one or more batteries (not shown) located inside the electronic device (1000) to the internal components under the control of the processor (110).

[0284] The memory (120) can store various data, programs or applications for driving and controlling the electronic device (1000) under the control of the processor (110). The memory (120) can include a broadcast reception module (not shown), a channel control module, a volume control module, a communication control module, a voice recognition module, a motion recognition module, an optical reception module, a display control module, an audio control module, an external input control module, a power control module, a power control module for an external device connected wirelessly (e.g., Bluetooth), a voice database (DB), or a motion database (DB). The modules and database of the memory (120) not shown can be implemented in the form of software to perform a broadcast reception control function, a channel control function, a volume control function, a communication control function, a voice recognition function, a motion recognition function, an optical reception control function, a display control function, an audio control function, an external input control function, a power control function or a power control function for an external device connected wirelessly (e.g., Bluetooth). The processor (110) can perform each function using the software stored in the memory (120).

[0285] The light source unit (365) can output image light. The image light can include white light.

[0286] The projection lens (366) can project image light to the outside. That is, the processor (110) can project an image by projecting image light to the outside using the projection lens (366).

[0287] Although the processor (110) is illustrated as a single element in FIG. 14, it is not limited thereto. In one embodiment, the processor (110) may be composed of one or more processors.

[0288] In one embodiment of the present disclosure, the processor (110) may be configured as a dedicated hardware chip that performs artificial intelligence (AI) learning.

[0289] A 'module' included in the memory (120) means a unit that processes a function or operation performed by the processor (110), and this can be implemented as software such as commands, algorithms, data structures, or program codes.

[0290] Meanwhile, the block diagram of the electronic device (1000) illustrated in FIGS. 13 and 14 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the electronic device (1000) actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0291] FIG. 15 is a block diagram conceptually illustrating an electronic device according to one embodiment of the present disclosure.

[0292] In the embodiment of FIG. 15, the electronic device (1000) may include an image forming optical unit (1510) that modulates light according to an image signal to form an image beam, and a driving projection optical unit (1530) that projects the image beam formed in the image forming optical unit (1510).

[0293] The image beam shown in the drawing refers to a light beam containing an image coming from the image forming optical unit (1510). The image beam passes through the driving projection optical unit (1530) and is expanded to be projected onto a predetermined projection surface, for example, a screen.

[0294] The driving projection optical unit (1530) may include a plurality of projection optical elements and one or more driving optical path changing elements. The projection optical elements may be projection lenses that expand light in a transmissive manner or curved mirrors that expand light in a reflective manner. The optical path changing elements may be mirrors or prisms that reflect light to change its path. In the embodiments below, the driving optical path changing elements will be exemplified as driving mirrors, but are not limited thereto.

[0295] The electronic device (1000) may also include a processor (110) that controls the movement of the driving mirror and, in conjunction therewith, controls the image forming optical unit (1510).

[0296] The electronic device (1000) may further include a camera (1540) for detecting boundary positions between a plurality of surfaces on which images are projected, the position of the electronic device (1000), and the surrounding space. The electronic device (1000) may further control the operation of the driving projection optical unit (1530) in more detail according to the boundary positions detected through the camera (1540), and may control the image forming optical unit (1510) in connection therewith. For example, after the electronic device (1000) detects the boundary positions between a plurality of projection surfaces through the camera (1540), it may control additional movement of the driving mirror or projection lens provided in the driving projection optical unit (1530) to reduce image overlapping that appears near the boundary. Such movement may include parallel translation driving, rotation driving, or tilt driving. Alternatively, image processing for special effects in an area where images overlap may be performed by the image forming optical unit (1510) under the control of the processor (110).

[0297] The electronic device (1000) may also further include a sensor unit (1550) for detecting changes in the position, projection angle, projection distance, and surrounding space of the electronic device (1000).

[0298] The electronic device (1000) may further include a user interface (1560) to control the processor (110) according to a user's input. For example, the electronic device (1000) may allow the user to visually check for image overlapping that appears near the boundaries of multiple surfaces on which images are projected, and may control additional movement of a mirror or projection lens provided in the projection optical unit (1530) according to the user's input to reduce the image overlapping.

[0299] The method of operating the electronic device (1000) according to one embodiment may also be implemented in the form of a computer-readable medium including computer-executable instructions, such as a program module executed by a computer. The computer-readable medium may be any available medium that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. The computer-readable medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program instructions may include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0300] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0301] The foregoing description is for illustrative purposes only, and those skilled in the art will readily appreciate that the invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, components described as single may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

[0302] An electronic device according to one embodiment includes a memory storing one or more instructions and one or more processors executing the one or more instructions stored in the memory, wherein the one or more processors execute the one or more instructions to identify a plurality of projection surfaces within the surrounding space based on information acquired about the surrounding space by executing the one or more instructions, identify recommended content and image setting information corresponding to the plurality of projection surfaces, and project first content on the first projection surface according to a position of an electronic device pointing to a first projection surface among the plurality of projection surfaces, a projection angle, and image setting information corresponding to the first projection surface, and control in real time so that as a position of the pointing moves from the first projection surface toward a second projection surface, a proportion of the first content in the projection image decreases and a proportion of second content, which is recommended content corresponding to the second projection surface, increases.

[0303] Among the above projection images, the first content may be projected according to image setting information corresponding to the first projection surface, and the second content may be projected according to image setting information corresponding to the second projection surface.

[0304] The one or more processors can control the ratio of the first content in the projection image to decrease by cropping a portion of the first content as the position of the pointing moves from the first projection surface to the second projection surface by executing the one or more instructions.

[0305] The one or more processors can control the proportion of the first content in the projection image to decrease by reducing the size of the projection image for the first content as the position of the pointing moves in the direction of the second projection surface from the first projection surface by executing the one or more instructions.

[0306] The one or more processors can adjust the output proportions of the sound of the first content and the sound of the second content in proportion to the distance the position of the pointing has moved in the direction of the second projection surface from the first projection surface by executing the one or more instructions.

[0307] The one or more processors can correct a projection image for the first content according to image setting information corresponding to the first projection surface by reflecting a change in the position and projection angle of the electronic device detected in real time using at least one sensor by executing the one or more instructions.

[0308] The image setting information corresponding to the plurality of projection surfaces is a pre-stored setting or a setting obtained using a neural network trained to receive information about the plurality of projection surfaces and information about the surrounding environment of the plurality of projection surfaces as input and output the image setting information, and may include a setting for at least one of the size, shape, resolution, and brightness of the image.

[0309] The information acquired about the surrounding space may be information acquired using at least one sensor or information acquired from an external device.

[0310] The one or more processors can execute the one or more instructions so that, when the projected image includes the first content and the second content, a user command such as adjusting sound volume and changing channels can be identified as being for the second content.

[0311] The recommended content corresponding to the above plurality of projection surfaces may be content preset for each projection surface or content executed by the user's selection.

[0312] A method of operating an electronic device according to one embodiment may include a step of identifying a plurality of projection surfaces based on information acquired about a surrounding space, a step of identifying recommended content and image setting information corresponding to the plurality of projection surfaces, a step of projecting first content on the first projection surface according to a position of an electronic device pointing to a first projection surface among the plurality of projection surfaces, a projection angle, and image setting information corresponding to the first projection surface, and a step of controlling in real time such that as a position of the pointing moves from the first projection surface toward a second projection surface, a ratio of the first content in the projection image decreases and a ratio of second content, which is recommended content corresponding to the second projection surface, increases.

[0313] Among the above projection images, the first content may be projected according to image setting information corresponding to the first projection surface, and the second content may be projected according to image setting information corresponding to the second projection surface.

[0314] The above controlling step may include a controlling step of cropping a portion of the first content as the position of the pointing moves in the direction of the second projection surface from the first projection surface, thereby reducing the proportion of the first content in the projection image.

[0315] The above controlling step may include a step of controlling the size of the projection image for the first content to be reduced as the position of the pointing moves in the direction of the second projection surface from the first projection surface, thereby reducing the proportion of the first content among the projection image.

[0316] The above controlling step may include a step of adjusting the output proportion of the sound of the first content and the sound of the second content in proportion to the distance the position of the pointing has moved in the direction of the second projection surface from the first projection surface.

[0317] The above controlling step may include a step of identifying, if the projected image includes the first content and the second content, a user command such as adjusting sound volume and changing channels as being for the second content.

[0318] The step of projecting first content on the first projection surface according to the position of the electronic device pointing to the first projection surface among the plurality of projection surfaces, the projection angle, and the image setting information corresponding to the first projection surface may include the step of correcting the projection image for the first content according to the image setting information corresponding to the first projection surface by reflecting a change in the position of the electronic device and the projection angle detected in real time using at least one sensor.

[0319] The image setting information corresponding to the plurality of projection surfaces is a previously stored setting or a setting obtained using a neural network trained to receive information about the plurality of projection surfaces and information about the surrounding environment of the plurality of projection surfaces as input and output the image setting information, and may include a setting for at least one of the size, shape, resolution, and brightness of the image.

[0320] The information acquired about the surrounding space may be information acquired using at least one sensor or information acquired from an external device.

[0321] A computer-readable recording medium having recorded thereon a program for performing the operation method of the above electronic device on a computer may be provided.

Claims

1. Memory (120) for storing one or more instructions; and It includes one or more processors (110) that execute one or more instructions stored in the memory (120), and the one or more processors (110) execute the one or more instructions, Based on the information acquired about the surrounding space, a plurality of projection surfaces including a first projection surface and a second projection surface are identified, Projecting an image corresponding to the first content on the first projection surface based on status information of an electronic device for projecting an image on the first projection surface and image setting information corresponding to the first projection surface, As the projection direction of the electronic device moves from the first projection surface to the second projection surface, the size of the image corresponding to the first content output on the first projection surface is controlled to be projected by changing it according to the degree of movement in the projection direction. An electronic device that controls the projection of an image corresponding to the second content on the second projection surface by changing the size according to the degree of movement in the projection direction.

2. In the first paragraph, the one or more processors (110) execute the one or more instructions, An electronic device that controls the second content to be projected on the second projection surface based on setting information corresponding to the second projection surface.

3. In any one of the first and second paragraphs, the one or more processors (110) execute the one or more instructions, An electronic device that controls the projection direction of the electronic device to move from the first projection surface to the second projection surface so that the ratio of the first content among the entire projection image including the first content and the second content decreases, so that only a portion of the image corresponding to the first content is projected.

4. In any one of the first to third paragraphs, the one or more processors (110) execute the one or more instructions, An electronic device that controls the projection direction of the electronic device to be projected by reducing the size of an image corresponding to the first content so that the proportion of the first content among the entire projection image including the first content and the second content decreases as the projection direction of the electronic device moves from the first projection surface to the second projection surface.

5. In any one of the first to fourth paragraphs, the one or more processors (110) execute the one or more instructions, An electronic device that controls the projection direction of the electronic device so that the output ratio of the sound of the first content and the sound of the second content is changed in proportion to the distance moved from the first projection surface to the second projection surface.

6. In any one of the first to fifth paragraphs, the one or more processors (110) execute the one or more instructions, Obtain image setting information corresponding to the plurality of projection surfaces through a neural network learned based on information about the plurality of projection surfaces and information about the surrounding environment of the plurality of projection surfaces, An electronic device characterized in that the image setting information includes information on at least one of the size, shape, resolution, and brightness of the image.

7. In any one of paragraphs 1 to 6, An electronic device characterized in that the information acquired about the surrounding space is information acquired using at least one sensor or information acquired from an external device.

8. In any one of paragraphs 1 to 7, the one or more processors (110) execute the one or more instructions, An electronic device that, when a user input corresponding to a function control is received while an image corresponding to the first content and an image corresponding to the second content are projected together, performs the function control for the image corresponding to the second content.

9. In any one of paragraphs 1 to 8, the first content projected on the first projection surface is content selected based on user input, An electronic device, characterized in that the second content projected on the second projection surface is content based on the positional relationship between the first projection surface and the second projection surface.

10. An electronic device according to claim 9, wherein the content based on the positional relationship between the first projection surface and the second projection surface is determined as at least one of information related to the first content or content unrelated to the first content, depending on the positional relationship between the first projection surface and the second projection surface.

11. A step (S310) of identifying a plurality of projection surfaces including a first projection surface and a second projection surface based on information acquired about the surrounding space; A step (S320) of projecting an image corresponding to the first content on the first projection surface based on status information of an electronic device for projecting an image on the first projection surface and image setting information corresponding to the first projection surface; and An operating method of an electronic device, comprising a step (S330) of changing the size of an image corresponding to the first content output on the first projection surface and projecting the image according to the degree of movement in the projection direction as the projection direction of the electronic device moves from the first projection surface to the second projection surface, and projecting the image corresponding to the second content on the second projection surface and changing the size according to the degree of movement in the projection direction.

12. In paragraph 11, A method of operating an electronic device, wherein the second content is projected onto the second projection surface based on setting information corresponding to the second projection surface.

13. In any one of paragraphs 11 to 12, the controlling step comprises: An operating method of an electronic device, comprising a step of controlling the projection direction of the electronic device to move from the first projection surface to the second projection surface so that the ratio of the first content among the entire projection image including the first content and the second content decreases so that only a portion of the image corresponding to the first content is projected.

14. In any one of paragraphs 11 to 13, the controlling step comprises: An operating method of an electronic device, comprising a step of controlling the projection of an image corresponding to the first content to be reduced in size so that the proportion of the first content among the entire projection image including the first content and the second content decreases as the projection direction of the electronic device moves from the first projection surface to the second projection surface.

15. A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 11 to 14 on a computer.

Images