Electronic device for maintaining area in which content is displayed on projection surface, and control method thereof

Abstract

An electronic device is disclosed. This electronic device comprises: a projection unit; a driving unit; a memory for storing at least one computer program; and at least one processor communicatively connected to the projection unit, the driving unit, and the memory, wherein the at least one computer program includes computer-executable instructions individually or collectively executed by the at least one processor, to cause the electronic device to: control the projection unit to project first content on a projection surface; identify, if the electronic device moves from a first position to a second position, a projection angle for the projection surface on the basis of the second position; obtain second content obtained by changing the screen shape of the first content, on the basis of the second position and the projection angle; and if the driving unit is controlled such that the electronic device moves from the first position to the second position, control the projection unit to project the second content on the projection surface.

Description

Electronic device for maintaining an area where content is displayed on a projection surface and a control method thereof

[0001] The present disclosure relates to an electronic device and a control method thereof. More specifically, the present disclosure relates to an electronic device that maintains an area where content is displayed on a projection surface, and a control method thereof.

[0002] Advances in electronic technology have led to the development of electronic devices offering a variety of functions. In particular, recent developments have included projectors capable of moving while projecting content.

[0003] However, if the projector moves while projecting content, the size and shape of the content screen change as the projection position changes, which disrupts the user's immersion and requires the user to stop viewing and adjust the content screen.

[0004] The above information is provided solely as background information to aid in understanding the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0005] Aspects of the present disclosure address at least the problems and / or disadvantages mentioned above, and provide at least the advantages described below. Accordingly, one aspect of the present disclosure provides an electronic device and a control method.

[0006] Additional aspects will be partly explained in the following description, partly will be apparent from the description, or may be learned by practice of the embodiments presented.

[0007] According to one embodiment of the present disclosure to achieve the above object, an electronic device is disclosed. The electronic device includes a projection unit, a driving unit, a memory storing one or more computer programs, and one or more processors communicatively connected to the projection unit, the driving unit, and the memory, wherein the one or more computer programs include computer-executable instructions that are individually or collectively executed by the one or more processors, such that the electronic device controls the projection unit to project first content onto a projection surface, and when the electronic device moves from a first position to a second position, identifies a projection angle for the projection surface based on the second position, obtains second content having a changed screen shape of the first content based on the second position and the projection angle, and controls the driving unit so that when the electronic device moves from the first position to the second position, the projection unit can be controlled to project the second content onto the projection surface.

[0008] Additionally, the one or more computer programs may include computer-executable instructions that are individually or collectively executed by the one or more processors, such that the electronic device can identify an edge corresponding to a movement direction of the electronic device among the left edge and the right edge of the projection area on which the first content is projected on the projection surface, and identify the second location based on the identified edge.

[0009] And, further comprising a sensor, wherein the one or more computer programs include computer-executable instructions that are individually or collectively executed by the one or more processors, so that the electronic device can identify a distance from the first location to the projection surface through the sensor, identify a distance from the first location to the identified edge based on a radiation angle of the projection unit, and identify the second location based on the identified distance.

[0010] Additionally, the distance from the second location to the identified edge may be greater than or equal to the distance from the first location to the identified edge.

[0011] And, the projection angle includes an azimuth angle at the second location and an elevation angle at the second location, and the one or more computer programs include computer-executable instructions that are individually or collectively executed by the one or more processors, so that the electronic device can identify the azimuth angle at the second location based on a distance from the first location to the projection surface, a distance from the first location to the second location, and a moving direction of the electronic device, and identify the elevation angle at the second location based on the distance from the first location to the projection surface, the elevation angle at the first location, and the azimuth angle at the second location.

[0012] Additionally, the one or more computer programs may include computer-executable instructions that are individually or collectively executed by the one or more processors, such that the electronic device can scale the second content based on a distance from the first location to the projection surface, a distance from the first location to the second location, a radiation angle of the projection unit, and an azimuth angle at the second location.

[0013] And, the driving unit includes a first driving unit that moves the electronic device and a second driving unit that controls a projection direction of the projection unit, and the one or more computer programs include computer-executable instructions that are individually or collectively executed by the one or more processors, so that the electronic device can control the first driving unit so that the electronic device moves from the first position to the second position, and when the electronic device is located at the second position, control the second driving unit so that the projection unit projects the second content based on the projection angle.

[0014] Additionally, the one or more computer programs may include computer-executable instructions that are individually or collectively executed by the one or more processors, such that the electronic device can identify a plurality of third locations on a path from the first location to the second location, and perform the projection angle identification operation, the screen shape changing operation, and the projection operation at each of the plurality of third locations.

[0015] And, the one or more computer programs may include computer-executable instructions that are individually or collectively executed by the one or more processors, such that the electronic device can identify the electronic device as moving from the first location to the second location based on at least one of a charging state of the electronic device, a temperature of the electronic device, a type of the first content, a number of users around the electronic device, or a location of the users.

[0016] In addition, the projection unit includes a first projection unit and a second projection unit, and the one or more computer programs include computer-executable instructions that are individually or collectively executed by the one or more processors, so that the electronic device can control the first projection unit to project the first content onto the projection surface, and control the second projection unit to project third content onto another projection surface.

[0017] And, the third content includes a control screen for controlling the first content, and the one or more computer programs include computer-executable instructions that are individually or collectively executed by the one or more processors, so that the electronic device can identify the second location so that the control screen is provided in front of the user.

[0018] Additionally, an area corresponding to the first content on the projection surface may overlap an area corresponding to the second content on the projection surface by less than a preset error.

[0019] Meanwhile, according to one embodiment of the present disclosure, a method performed by an electronic device may include a step of projecting first content onto a projection surface by the electronic device, a step of identifying a projection angle for the projection surface based on the second location by the electronic device when the electronic device moves from a first location to a second location, a step of obtaining second content by the electronic device that changes the screen shape of the first content based on the second location and the projection angle, and a step of controlling a driving unit by the electronic device to project the second content onto the projection surface when the electronic device moves from the first location to the second location.

[0020] In addition, the method may further include a step of identifying an edge corresponding to a movement direction of the electronic device among the left edge and the right edge of the projection area on which the first content is projected on the projection surface, and a step of identifying the second location based on the identified edge.

[0021] And, the step of identifying the second position may identify a distance from the first position to the projection surface, identify a distance from the first position to the identified edge based on a radiation angle of a projection unit included in the electronic device, and identify the second position based on the identified distance.

[0022] Additionally, the distance from the second location to the identified edge may be greater than or equal to the distance from the first location to the identified edge.

[0023] And, the projection angle includes an azimuth at the second location and an elevation at the second location, and the step of identifying the projection angle may identify the azimuth at the second location based on a distance from the first location to the projection surface, a distance from the first location to the second location, and a moving direction of the electronic device, and may identify the elevation at the second location based on the distance from the first location to the projection surface, the elevation at the first location, and the azimuth at the second location.

[0024] Additionally, the acquiring step may scale the second content based on a distance from the first location to the projection surface, a distance from the first location to the second location, a radiation angle of the projection unit, and an azimuth at the second location.

[0025] And, the method may further include a step of identifying a plurality of third locations on a path from the first location to the second location, and a step of performing the projection angle identification operation, the screen shape changing operation, and the projection operation at each of the plurality of third locations.

[0026] Additionally, the method may further include a step of identifying the electronic device as being moved from the first location to the second location based on at least one of a charging state of the electronic device, a temperature of the electronic device, a type of the first content, a number of users around the electronic device, or a location of the users.

[0027] And, the step of projecting the first content may control a first projection unit included in the electronic device to project the first content onto the projection surface, and control a second projection unit included in the electronic device to project third content onto another projection surface.

[0028] Additionally, the third content may include a control screen for controlling the first content, and the control method may further include a step of identifying the second location so that the control screen is provided in front of the user.

[0029] And, the area corresponding to the first content on the projection surface can overlap with the area corresponding to the second content on the projection surface by less than a preset error.

[0030] According to another aspect of the present disclosure, there is provided one or more computer-readable storage media storing one or more computer programs comprising computer-executable instructions that, when individually or collectively executed by one or more processors of an electronic device, cause the electronic device to perform an operation. The operation includes: projecting first content onto a projection surface based on movement of the electronic device from a first location to a second location; determining a projection angle with respect to the projection surface based on the second location; changing a screen shape of the first content based on the second location and the projection angle; obtaining second content based on movement of the electronic device from the first location to the second location by controlling a driving unit; and projecting the second content onto the projection surface.

[0031] Other aspects, advantages and salient features of the present disclosure will become apparent to those skilled in the art from the following detailed description of various embodiments of the present disclosure taken in conjunction with the accompanying drawings.

[0032] The above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0033] FIG. 1 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0034] FIG. 2 is a block diagram showing a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0035] FIGS. 3 and 4 are drawings schematically illustrating the operation of an electronic device according to various embodiments of the present disclosure.

[0036] FIG. 5 is a drawing for explaining the structure of an electronic device according to one embodiment of the present disclosure.

[0037] FIG. 6 is a flowchart illustrating the operation of an electronic device according to an embodiment of the present disclosure.

[0038] FIGS. 7, 8, and 9 are drawings illustrating operations for identifying a moving location and projection angle according to various embodiments of the present disclosure.

[0039] FIGS. 10, 11, 12, 13, and 14 are drawings for explaining an operation of changing the screen form of the first content according to various embodiments of the present disclosure.

[0040] FIGS. 15, 16, 17, 18, 19, 20, 21, 22, 23, and 24 are drawings for explaining the cause of movement according to various embodiments of the present disclosure.

[0041] FIG. 25 is a drawing for explaining a case where an obstacle is identified during movement according to one embodiment of the present disclosure.

[0042] FIG. 26 is a flowchart for explaining a method for controlling an electronic device according to an embodiment of the present disclosure.

[0043] The same reference numbers are used for identical components throughout the drawings.

[0044] The following description, with reference to the accompanying drawings, is provided to facilitate a comprehensive understanding of various embodiments of the present disclosure as defined by the claims and their equivalents. While it includes numerous specific details to aid understanding, these are to be considered merely illustrative. Accordingly, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. Furthermore, descriptions of known functions and configurations may be omitted for clarity and brevity.

[0045] The terms and words used in the following description and claims are not to be construed as limited to their bibliographic meanings, but rather have been used by the inventors solely to facilitate a clear and consistent understanding of the present disclosure. Therefore, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustrative purposes only and is not intended to limit the present disclosure as defined by the appended claims and their equivalents.

[0046] The singular forms "a," "an," and "the" should be understood to include plural referents unless the context clearly indicates otherwise. Thus, for example, a reference to "a surface of a part" includes a reference to one or more of those surfaces.

[0047] The purpose of the present disclosure is to provide an electronic device and a control method thereof that maintains the size and shape of a content screen even when projecting content while the electronic device is moving.

[0048] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0049] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0050] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0051] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0052] In this application, terms such as “comprise” or “consist of” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0053] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0054] It should be understood that each block of the flowchart and the combination of flowcharts can be performed by one or more computer programs containing instructions. The entirety of one or more computer programs may be stored in a single memory device, or the one or more computer programs may be divided into different parts stored in different memory devices.

[0055] Any function or operation described in the present disclosure may be processed by a single processor or a combination of processors. A single processor or a combination of processors is a circuit that performs processing and may include an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connection chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio codec chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on a chip (SoC), an IC, and the like.

[0056] FIG. 1 is a block diagram showing the configuration of an electronic device (100) according to one embodiment of the present disclosure.

[0057] The electronic device (100) may be a device that changes the position of the electronic device (100) and projects content. For example, the electronic device (100) may be a projector capable of moving on its own.

[0058] The electronic device (100) may be a device that changes the position of the electronic device (100) and performs image processing on content and projects the image-processed content. For example, the electronic device (100) may be a device that performs image processing on content and projects the image-processed content based on the changed position of the electronic device (100) so that the area on which the content is projected remains constant on the projection surface.

[0059] According to FIG. 1, the electronic device (100) includes a projection unit (110), a driving unit (120), and a processor (130).

[0060] The projection unit (110) can project content onto a projection surface. Specifically, the projection unit (110) can project an image or video including at least one of content received from a source device and pre-stored content onto a projection area using a light source such as a lamp or LED.

[0061] The driving unit (120) may include a first driving unit for moving the electronic device (100) under the control of the processor (130). For example, the driving unit (120) may include wheels, a motor, etc. for moving the electronic device (100). However, the present invention is not limited thereto, and the driving unit (120) may have any configuration as long as it can move the position of the electronic device (100).

[0062] The driving unit (120) may include a second driving unit for controlling the projection direction of the projection unit (110) under the control of the processor (130). For example, the driving unit (120) may include a motor for controlling the projection direction of the projection unit (110). However, the present invention is not limited thereto, and the driving unit (120) may have any configuration as long as it can control the projection direction of the projection unit (110).

[0063] The processor (130) controls the overall operation of the electronic device (100). Specifically, the processor (130) is connected to each component of the electronic device (100) and can control the overall operation of the electronic device (100). For example, the processor (130) is connected to components such as a projection unit (110), a driving unit (120), a sensor (not shown), a communication interface (not shown), etc. and can control the operation of the electronic device (100).

[0064] The one or more processors (130) may include one or more of a CPU, a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), a MIC (Many Integrated Core), an NPU (Neural Processing Unit), a hardware accelerator, or a machine learning accelerator. The one or more processors (130) may control one or any combination of other components of the electronic device (100) and perform operations related to communication or data processing. The one or more processors (130) may execute one or more programs or instructions stored in a memory. For example, the one or more processors (130) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory.

[0065] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0066] One or more processors (130) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (130) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0067] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0068] In embodiments of the present disclosure, one or more processors (130) may refer to a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor. The core may be implemented as a CPU, a GPU, an APU, a MIC, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. However, for convenience of explanation, the operation of the electronic device (100) will be described below using the term "processor (130).

[0069] The processor (130) can control the projection unit (110) to project the first content onto the projection surface.

[0070] The processor (130) may identify the electronic device (100) as moving from a first location to a second location while controlling the projection unit (110) to project the first content onto the projection surface. For example, the processor (130) may identify the electronic device (100) as moving from the first location to the second location based on at least one of a charging state of the electronic device (100), a temperature of the electronic device (100), a type of the first content, the number of users around the electronic device (100), or a location of the users. The second location may be expressed in absolute coordinates, but may also be expressed in relative coordinates with respect to the current location of the electronic device (100).

[0071] The processor (130) can identify an edge corresponding to the movement direction of the electronic device (100) among the left edge and the right edge of the projection area on which the first content is projected on the projection surface, and identify a second location based on the identified edge.

[0072] For example, the electronic device (100) may further include a sensor, and the processor (130) may identify a distance from a first location to a projection surface through the sensor, identify a distance from the first location to an identified edge based on a radiation angle of the projection unit (110), and identify a second location based on the identified distance. For example, the distance from the second location to the identified edge may be greater than or equal to the distance from the first location to the identified edge. Accordingly, a projection area on which content is projected on the projection surface may be maintained. If the distance from the second location to the identified edge is less than the distance from the first location to the identified edge, the projection area by the projection unit (110) may become smaller. In this case, the projection area on which content is projected may become smaller, which may lower the user's sense of immersion.

[0073] When the electronic device (100) moves from a first position to a second position, the processor (130) can identify a projection angle for the projection surface based on the second position. For example, when the electronic device (100) moves to the right based on the projection direction, the projection direction must be changed counterclockwise so that the projection area on which the content is projected can be maintained.

[0074] The processor (130) can acquire second content by changing the screen format of the first content based on the second position and projection angle. For example, when the electronic device (100) moves to the right based on the projection direction, the processor (130) can reduce the first content, but process the left and right portions differently. For example, the processor (130) can acquire second content by changing the screen format of the first content so that the length of the left edge of the first content becomes shorter than the length of the right edge of the second content.

[0075] The projection angle includes an azimuth at a second location and an elevation at the second location, and the processor (130) can identify the azimuth at the second location based on the distance from the first location to the projection surface, the distance from the first location to the second location, and the movement direction of the electronic device, and can identify the elevation at the second location based on the distance from the first location to the projection surface, the elevation at the first location, and the azimuth at the second location. The processor (130) can scale the second content based on the distance from the first location to the projection surface, the distance from the first location to the second location, the radiation angle of the projection unit (110), and the azimuth at the second location.

[0076] The method for identifying the projection angle based on the second position and the method for changing the screen shape of the first content are specifically described through the drawings described below.

[0077] The driving unit (120) includes a first driving unit that moves the electronic device (100) and a second driving unit that controls the projection direction of the projection unit (110). The processor (130) controls the first driving unit so that the electronic device (100) moves from a first position to a second position, and when the electronic device (100) is located at the second position, controls the second driving unit so that the projection unit (110) projects second content based on a projection angle.

[0078] The processor (130) can control the driving unit (120) to control the projection unit (110) to project second content onto the projection surface when the electronic device (100) is moved from the first position to the second position.

[0079] In the above, for the sake of convenience of explanation, only the case where the electronic device (100) moves from the first position to the second position has been described, but such an operation may be a more continuous operation. For example, the processor (130) may identify a plurality of third positions on the path from the first position to the second position, and perform an operation of identifying a projection angle, an operation of changing the screen shape, and a projection operation at each of the plurality of third positions. In other words, a more continuous operation can maintain a user's sense of immersion. In this case, an area corresponding to the first content on the projection surface can overlap an area corresponding to the second content on the projection surface by less than a preset error. In particular, the greater the number of the plurality of third positions, the less the error can be reduced.

[0080] Meanwhile, the projection unit (110) includes a first projection unit (110) and a second projection unit (110), and the processor (130) controls the first projection unit (110) to project first content onto a projection surface, and may also control the second projection unit (110) to project third content onto another projection surface. Here, the third content includes a control screen for controlling the first content, and the processor (130) may identify a second location so that the control screen is provided in front of the user.

[0081] FIG. 2 is a block diagram showing a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0082] According to FIG. 2, the electronic device (100) may include a projection unit (110), a driving unit (120), and a processor (130). The electronic device (100) may further include a sensor (140), a communication interface (150), a user interface (160), a memory (170), a display (180), a microphone (185), a speaker (190, a camera (195). Among the components illustrated in FIG. 2, a detailed description of the overlapping parts with the components illustrated in FIG. 1 will be omitted.

[0083] The sensor (140) is a sensor for identifying the distance from the electronic device (100) to the projection surface, and may be implemented as a ToF sensor. However, the present invention is not limited thereto, and the sensor (140) may be any sensor that can identify the distance from the electronic device (100) to the projection surface. In addition, the processor (130) may also identify the distance from the electronic device (100) to the projection surface through a camera (195) described below.

[0084] The communication interface (150) is a component that performs communication with various types of external devices according to various types of communication methods. For example, the electronic device (100) can perform communication with a content server or a user terminal device through the communication interface (150).

[0085] The communication interface (150) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, etc. Each communication module may be implemented in the form of at least one hardware chip.

[0086] Wi-Fi and Bluetooth modules communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, connection information, such as the SSID and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received. Infrared communication modules use infrared data association (IrDA) technology, which wirelessly transmits data over short distances using infrared light, which lies between visible light and millimeter waves.

[0087] In addition to the above-described communication method, the wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0088] Alternatively, the communication interface (150) may include a wired communication interface such as HDMI, DP, Thunderbolt, USB, RGB, D-SUB, DVI, etc.

[0089] In addition, the communication interface (150) may include at least one of a LAN (Local Area Network) module, an Ethernet module, or a wired communication module that performs communication using a pair cable, a coaxial cable, or an optical fiber cable.

[0090] The user interface (160) may be implemented with buttons, a touch pad, a mouse, a keyboard, etc., or may be implemented with a touch screen that can perform both display and operation input functions. The buttons may be various types of buttons, such as mechanical buttons, touch pads, wheels, etc., formed on any area of ​​the front, side, or back of the main body of the electronic device (100).

[0091] Memory (170) may refer to hardware that stores information such as data in an electrical or magnetic form so that the processor (130) or the like can access it. To this end, the memory (170) may be implemented as at least one piece of hardware from among non-volatile memory, volatile memory, flash memory, hard disk drive (HDD), solid state drive (SSD), RAM, ROM, etc.

[0092] The memory (170) may store at least one instruction required for the operation of the electronic device (100) or the processor (130). Here, the instruction is a unit of code that instructs the operation of the electronic device (100) or the processor (130), and may be written in machine language, which is a language that a computer can understand. Alternatively, the memory (170) may store a plurality of instructions for performing a specific task of the electronic device (100) or the processor (130) as an instruction set.

[0093] The memory (170) may store data in bit or byte units that can represent characters, numbers, images, etc. For example, a projection angle identification module, an image processing module, etc. may be stored in the memory (170).

[0094] The memory (170) is accessed by the processor (130), and reading / writing / modifying / deleting / updating instructions, instruction sets, or data can be performed by the processor (130).

[0095] The display (180) is a configuration that displays content and can be implemented as a variety of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, a PDP (Plasma Display Panel), etc. The display (180) may also include a driving circuit, a backlight unit, etc. that can be implemented as a form such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. Meanwhile, the display (180) may be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, etc.

[0096] The microphone (185) is configured to receive sound and convert it into an audio signal. The microphone (185) is electrically connected to the processor (130) and can receive sound under the control of the processor (130).

[0097] For example, the microphone (185) may be formed as an integrated unit integrated into the upper side, front side, side side, etc. of the electronic device (100). Alternatively, the microphone (185) may be provided in a remote control separate from the electronic device (100). In this case, the remote control may receive sound through the microphone (185) and provide the received sound to the electronic device (100).

[0098] The microphone (185) may include various configurations such as a microphone that collects sound in analog form, an amplifier circuit that amplifies the collected sound, an A / D conversion circuit that samples the amplified sound and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.

[0099] Meanwhile, the microphone (185) may be implemented in the form of a sound sensor, and any method may be used as long as it has a configuration capable of collecting sound.

[0100] The speaker (190) is a component that outputs various audio data processed by the processor (130) as well as various notification sounds and voice messages.

[0101] The camera (195) is configured to capture still images or moving images. The camera (195) can capture still images at a specific point in time, but can also capture still images continuously.

[0102] The camera (195) can capture the front of the electronic device (100) to capture the area where content is projected. The processor (130) can identify whether the area where content is projected is maintained even when the electronic device (100) moves based on the image captured by the camera (195), and if the area where content is projected changes by more than a preset error, the screen format of the content can be re-changed based on the captured image.

[0103] The camera (195) includes a lens, a shutter, an aperture, a solid-state image sensor, an AFE (Analog Front End), and a TG (Timing Generator). The shutter controls the time at which light reflected from a subject enters the camera (195), and the aperture mechanically increases or decreases the size of the opening through which light enters to control the amount of light incident on the lens. When the solid-state image sensor accumulates light reflected from a subject as a photocharge, the image generated by the photocharge is output as an electrical signal. The TG outputs a timing signal for reading out pixel data of the solid-state image sensor, and the AFE samples and digitizes the electrical signal output from the solid-state image sensor.

[0104] As described above, the electronic device (100) can change the projection angle and the screen shape of the content as the electronic device (100) moves, thereby maintaining the area where the content is projected on the projection surface even when the electronic device (100) moves, thereby increasing the user's sense of immersion.

[0105] Hereinafter, the operation of the electronic device (100) will be described in more detail with reference to FIGS. 3 to 25. For convenience of explanation, individual embodiments are described in FIGS. 3 to 25. However, the individual embodiments of FIGS. 3 to 25 may be implemented in any combination.

[0106] FIGS. 3 and 4 are drawings schematically illustrating the operation of an electronic device according to various embodiments of the present disclosure.

[0107] According to FIGS. 3 and 4, the electronic device (100) includes a driving unit (120), and the processor (130) can control the driving unit (120) to move the electronic device (100) as needed. For example, as illustrated in FIG. 3, the processor (130) can project content at position A (310) and then move to position C (330) via position B (320).

[0108] In this case, the processor (130) can control the projection unit (110) to gradually change the screen format of the content and project the content with the changed screen format. For example, at position A (310), the content has a screen format that has not been changed, as in 410-1, and the processor (130) can control the projection unit (110) to project the content on the projection surface, as in 420-1.

[0109] When the electronic device (100) is located at position B (320), the processor (130) can control the projection unit (110) to change the content into a screen format such as 410-2 and project the content onto a projection surface such as 420-2.

[0110] When the electronic device (100) is located at position C (330), the processor (130) can control the projection unit (110) to change the content into a screen format such as 410-3 and project the content onto a projection surface such as 420-3.

[0111] The content may change from a screen format such as 410-1 to a screen format such as 410-3, and in this case, the screen format may change so that each corner of the content points toward the center of the content. In particular, as the electronic device (100) moves to the right, the degree of change in the upper left corner of the content may be greater than the degree of change in the upper right corner of the content.

[0112] The shaded area surrounding the content in 410-1 to 410-3 may be light from an area that does not express the content among the light emitted by the projection unit (110). That is, the entire light emitted by the projection unit (110) in 410-1 to 410-3 is the same, but as the screen shape of the content changes (i.e., from 410-1 to 410-3), the area expressing the content may become smaller.

[0113] On the other hand, as the electronic device (100) moves (i.e., from 420-1 to 420-3), the projection angle decreases, and accordingly, the area corresponding to the entire light emitted by the projection unit (110) on the projection surface may gradually expand. However, as the screen shape of the content is gradually changed as in 410-1 to 410-3, the area corresponding to the content on the projection surface may remain constant. Therefore, the user's sense of immersion may be maintained even when the electronic device (100) moves.

[0114] FIG. 5 is a drawing for explaining the structure of an electronic device (100) according to one embodiment of the present disclosure.

[0115] The electronic device (100) may include a first body and a second body.

[0116] According to FIG. 5, the electronic device (100) may include a first body (510) including a projection unit (110) and a second body (520) formed at the lower portion of the first body (510).

[0117] The first main body (510) may include a projection unit (110) and a second driving unit that controls the projection direction of the projection unit (110), and the second main body (520) may include a first driving unit that moves the electronic device (100). The processor (130) may control the first driving unit so that the electronic device (100) moves from a first position to a second position, and when the electronic device (100) is located at the second position, may control the second driving unit so that the projection unit (110) projects second content based on a projection angle. The second driving unit may be implemented so as to enable at least one of panning and tilting of the projection unit (110).

[0118] FIG. 6 is a flowchart for explaining the operation of an electronic device (100) according to one embodiment of the present disclosure.

[0119] According to FIG. 6, the processor (130) can learn an indoor map through movement (S610). For example, the processor (130) controls the driving unit (120) to move the electronic device (100), and can learn an indoor map during the movement process.

[0120] The processor (130) can identify the initial projection position (S620). For example, when a content projection command is received, the processor (130) can identify the initial projection position based on at least one of the user's position or the projection surface. However, this is not limited thereto, and the processor (130) can also identify the initial projection position based on a user command.

[0121] The processor (130) may determine to move the electronic device (100) while projecting content from the initial projection position (S630). For example, the processor (130) may determine to move the electronic device (100) while projecting content from the initial projection position based on at least one of the charging state of the electronic device (100), the temperature of the electronic device (100), the type of content, the number of users around the electronic device (100), or the location of the users.

[0122] The processor (130) can set destination coordinates corresponding to the location to be moved (S640) and determine whether there is an obstacle on the movement path (S650). For example, the processor (130) can identify an edge corresponding to the movement direction of the electronic device (100) among the left edge and the right edge of the projection area on which content is projected, identify the distance from the initial projection position to the projection surface, identify the distance from the initial projection position to the identified edge based on the radiation angle of the projection unit (110), and identify the location to be moved based on the identified distance. The distance from the location to be moved to the identified edge may be greater than or equal to the distance from the initial projection position to the identified edge.

[0123] The processor (130) can identify an optimal movement path and a projection angle along the path (S660). For example, if there are no obstacles along the movement path to the destination corresponding to the movement location, the processor (130) can identify a straight-line distance as the optimal movement path. If there are obstacles, the processor (130) can identify a short path to the destination while avoiding the obstacles as the optimal movement path. If there are obstacles, the processor (130) can avoid the obstacles by increasing the distance from the electronic device (100) during movement to the identified edge.

[0124] The processor (130) can identify projection angles at preset intervals on an optimal movement path. The preset intervals can be determined based on the computational speed of the electronic device (100), the movement speed of the electronic device (100), etc.

[0125] For example, the processor (130) can identify a first projection angle at a first location based on a first location on an optimal movement path, and can identify a second projection angle at a second location based on a second location on the optimal movement path.

[0126] The projection angle includes an azimuth angle and an elevation angle at each position, and the processor (130) can identify the azimuth angle at each position based on the distance from each position to the projection surface, the distance from the initial projection position to each position, and the direction of movement of the electronic device (100), and can identify the elevation angle at each position based on the distance from the initial projection position to the projection surface, the elevation angle at the initial projection position, and the azimuth angle at each position.

[0127] The processor (130) can calculate a projection screen correction value along the movement path (S670). For example, the processor (130) can scale the content based on the distance from the initial projection position to the projection surface, the distance from the initial projection position to each position, the radiation angle of the projection unit (110), and the azimuth at each position.

[0128] The processor (130) can control the projection unit (110) to move the electronic device (100) and project a screen (S680). As described above, the projection angle and the degree of content scaling at each location may be different.

[0129] The processor (130) can identify whether there is an obstacle during the movement and projection operations of the electronic device (100) (S690). If a new obstacle is found on the optimal movement path, the processor (130) can change the optimal movement path, and if no obstacle is found, the existing operation can be maintained.

[0130] The processor (130) can determine whether the screen is being properly projected (S695). For example, the processor (130) can identify a first area where content is projected onto the projection surface through the camera (195) at the initial projection position, identify a second area where content is projected onto the projection surface during the process of moving and projecting along an optimal movement path, and determine whether the error between the first area and the second area is less than a preset error.

[0131] The processor (130) can maintain the existing operation if the error between the first region and the second region is less than the preset error, and can re-perform the scaling operation of the content if the error between the first region and the second region is greater than the preset error.

[0132] Meanwhile, while the processor (130) described above learns an indoor map, it is not limited thereto. For example, the processor (130) may identify an initial projection position relative to a projection surface, identify destination coordinates relative to the initial projection position or projection surface based on a movement decision, and identify a projection angle based on the destination coordinates, without learning an indoor map.

[0133] FIGS. 7 to 9 are drawings illustrating operations for identifying a moving location and projection angle according to various embodiments of the present disclosure. For convenience of explanation, FIGS. 7 to 9 illustrate that the electronic device (100) moves to a second location (B) while projecting first content from a first location (A).

[0134] According to FIGS. 7 to 9, the processor (130) can control the projection unit (110) to project the first content at the first location (A). In this case, the horizontal axis center of the projection area on which the first content is projected on the projection surface may be Q, and the right edge of the projection area on which the first content is projected may be Q'.

[0135] According to FIGS. 7 to 9, when the processor (130) determines that a positional movement is necessary, the processor (130) can identify an edge corresponding to the movement direction of the electronic device (100) among the left edge and the right edge (Q') of the projection area on which the first content is projected on the projection surface, and can identify a second position (B) based on the identified edge. For example, when the processor (130) determines that a positional movement is necessary, the processor (130) can identify the right edge (Q') as a reference point because the movement direction of the electronic device (100) is to the right among the left edge and the right edge of the projection area on which the first content is projected on the projection surface. In addition, the processor (130) can determine the distance ( ) and identify the radiation angle of the projection unit (110) ) based on the distance from the first position (A) to the right edge (Q') ) can be identified. The processor (130) can identify a second position (B) in which the distance from the second position (B) to the right edge (Q') is greater than or equal to the distance from the first position (A) to the right edge (Q'). For example, the processor (130) can identify a second position (B) in which the distance from the second position (B) to the right edge (Q') is equal to the distance from the first position (A) to the right edge (Q').

[0136] Through this operation, even if the electronic device (100) projects second content with a changed screen shape of the first content at the second location (B), the projection area can be maintained constant. For example, the processor (130) can project the first content (810) at the first location (A), as illustrated on the left side of FIG. 8. As illustrated on the upper right side of FIG. 8, when the projection angle at the second location (B) is identified based on the horizontal axis center (820, Q) of the projection area, the entire area on which light is projected by the projection unit (110) on the projection surface can be changed from 830-1 to 830-2. That is, the area 830-2 may not include the upper right and lower right sides of the projection area on which the first content is projected, as illustrated on the left side of FIG. 8. On the other hand, as shown in the lower right of FIG. 8, when the projection angle at the second position (B) is identified based on the right edge (840, Q'), the entire area on which light is projected by the projection unit (110) on the projection surface can be changed from 850-1 to 850-2. That is, the area of ​​FIG. 850-2 can include the entire projection area on which the first content is projected, as shown on the left side of FIG. 8.

[0137] According to Fig. 7, it has been described that the projection angle is determined based on the right edge (Q'), but it is not limited thereto. For example, the processor (130) may identify an edge corresponding to the movement direction of the electronic device (100) among the left edge and the right edge of the projection area on which the first content is projected on the projection surface, and identify a second position based on a point where a margin is added to the identified edge. For example, the processor (130) may identify a right edge (Q') corresponding to the movement direction of the electronic device (100) among the left edge and the right edge (Q') of the projection area on which the first content is projected on the projection surface, and identify a second position based on a point further to the right of the right edge (Q').

[0138] The processor (130) may also identify a margin based on the movement distance of the electronic device (100). For example, as the movement distance of the electronic device (100) increases, the entire area on which light is projected by the projection unit (110) may become increasingly distorted, and the projection angle may also decrease. Accordingly, the processor (130) may increase the margin added to the identified dpt as the movement distance of the electronic device (100) increases.

[0139] When the second location (B) is determined, the processor (130) can identify the projection angle at the second location (B) based on the second location (B). The projection angle can include an azimuth angle at the second location (B) and an elevation angle at the second location (B).

[0140] First, a method for calculating azimuth is explained through Fig. 7, and a method for calculating elevation is explained through Fig. 9.

[0141] The processor (130) measures the distance from the first position (A) to the projection surface ( ), the distance from the first position (A) to the second position (B) ( ) and the direction of movement of the electronic device (100) ( ) based on the azimuth at the second position (B) ) can be identified. The distance from the first position (A) to the projection surface ( ) is a value obtained through a sensor (140), and is the distance ( ) and the direction of movement of the electronic device (100) ( ) may be the values ​​that are identified and produced at the second location (B).

[0142] For example, the processor (130) calculates the azimuth at the second position (B) through the following mathematical equations: ) can be obtained.

[0143]

[0144]

[0145]

[0146]

[0147] The processor (130) measures the distance from the first position (A) to the projection surface ( ), elevation angle at the first position (A) ( ) and azimuth at the second position (B) ( ) based on the elevation angle at the second position (B) ) can be identified. The distance from the first position (A) to the projection surface ( ) is a value obtained through the sensor (140), and the elevation angle ( ) is a known value through the driving unit (120), and the azimuth at the second position (B) is ) may be a value obtained through Fig. 7.

[0148] For example, the processor (130) calculates the elevation angle (B) at the second position (B) through the following mathematical equations: ) can be identified.

[0149]

[0150]

[0151]

[0152] Through this process, the processor (130) determines the azimuth ( ) and elevation angle ( ) can be identified.

[0153] According to one embodiment, the processor (130) determines the azimuth ( ) and elevation angle ( ) rather than calculating all of the azimuths ( ) may be identified to operate only on the second position (B). That is, the processor (130) may identify the second position (B) so that the elevation angle at the first position (A) and the elevation angle at the second position (B) remain the same.

[0154] FIGS. 10 to 14 are drawings for explaining an operation of changing the screen form of the first content according to various embodiments of the present disclosure.

[0155] For convenience of explanation, in FIGS. 10 to 14, the electronic device (100) is described as moving as described in FIG. 7.

[0156] According to FIG. 10, the upper part of FIG. 10 represents a first entire area where light is projected by the projection unit (110) on the projection surface when the electronic device (100) is at a first position (A), and the lower part of FIG. 10 represents a second entire area where light is projected by the projection unit (110) on the projection surface when the electronic device (100) is at a second position (B), and the lower part of FIG. 10 may have a wider area than the upper part of FIG. 10.

[0157] First, let's explain the horizontal axis. The distance from the center of the horizontal axis of the first entire area to the right edge is , and the distance from the center of the horizontal axis of the second entire area to the right edge is , and the distance from the horizontal axis center of the second entire area to the left edge is and, and Each one is It can be bigger.

[0158] The processor (130) for and The horizontal screen form of the first content can be changed based on each ratio. Referring to FIG. 11, the processor (130) uses the following mathematical formula: for and Each ratio (A, B) can be obtained.

[0159]

[0160]

[0161]

[0162] Referring to Figure 12, the vertical axis is explained. The distance from the center of the vertical axis of the first entire area to the upper edge is , and the distance from the center of the vertical axis of the second entire area to the upper right edge is , and the distance from the center of the vertical axis of the second entire area to the upper left edge is , and the distance from the vertical axis center of the second entire area to the upper edge is It could be.

[0163] The processor (130) for and The vertical screen form of the first content can be changed based on each ratio. For example, referring to FIG. 13, the processor (130) can change the vertical screen form of the first content using the following mathematical formula: for and Each ratio (C, D) can be obtained.

[0164]

[0165]

[0166]

[0167]

[0168]

[0169] The processor (130) can obtain second content by changing the screen form of the first content based on a plurality of ratios (A, B, C, D), as illustrated in FIG. 14.

[0170] However, in FIGS. 10 to 14, it is assumed that only the azimuth changes and the elevation does not. Therefore, if the elevation changes as well as the azimuth, additional operations are required, but the correction operations for the azimuth and the correction operations for the elevation can be distinguished. In addition, the operation for the elevation can be processed in a similar manner to the operation for the azimuth by rotating the coordinates. Therefore, the processor (130) can obtain A', B', C', and D' by performing the same method as in FIGS. 10 to 14 through coordinate rotation.

[0171] The processor (130) can acquire second content by changing the screen shape of the first content based on a plurality of first ratios (A, B, C, D) related to azimuth and a plurality of second ratios (A', B', C', D') related to elevation.

[0172] For example, the processor (130) can perform a change operation through the following mathematical formula.

[0173]

[0174]

[0175]

[0176]

[0177]

[0178]

[0179]

[0180]

[0181]

[0182] In the same manner as described above, the processor (130) can change the screen shape of the first content according to changes in the azimuth and elevation angles, and the projection area where the content is projected on the projection surface can be maintained constant.

[0183] FIGS. 15 to 24 are drawings for explaining the cause of movement according to various embodiments of the present disclosure.

[0184] The processor (130) identifies the charging status of the electronic device (100), and if the electronic device (100) is identified as needing charging, the location of the electronic device (100) can be changed.

[0185] According to FIG. 15, the processor (130) can identify the charging status of the electronic device (100) while projecting content, and control the driving unit (120) to move to the charging dock if the charging status of the battery included in the electronic device (100) is below a preset percentage.

[0186] The processor (130) identifies the temperature of the electronic device (100), and may change the position of the electronic device (100) if the temperature of the electronic device (100) rises above a preset value.

[0187] According to FIG. 16, the processor (130) identifies the temperature of the electronic device (100) while projecting content, and if the temperature of the electronic device (100) is identified as being 60 degrees Celsius or higher, the processor (130) can control the driving unit (120) to move the electronic device (100).

[0188] When the processor (130) moves the electronic device (100) based on the temperature of the electronic device (100), the processor (130) can capture an image by taking a picture of the surroundings of the electronic device (100) through the camera (195) and control the driving unit (120) to move the electronic device (100) to a relatively open position.

[0189] Alternatively, the processor (130) may identify the temperature around the electronic device (100) through a thermal imaging camera and control the driving unit (120) to move the electronic device (100) to a location with a lower temperature when moving the electronic device (100) based on the temperature of the electronic device (100).

[0190] The processor (130) can change the location of the electronic device (100) based on the user's presence around the electronic device (100).

[0191] According to FIG. 17, the processor (130) can identify users around the electronic device (100), identify a projection surface based on the identified users, and control the driving unit (120) to move the electronic device (100) to a position for projecting content onto the identified projection surface. In this case, the processor (130) can identify users through a sensor (140), a communication interface (150), a microphone (185), a camera (195), etc. However, the present invention is not limited thereto, and the processor (130) can identify at least one of the number of users or the positions of the users in any number of ways.

[0192] The processor (130) may also control the driving unit (120) to move the electronic device (100) based on the user's location. For example, the processor (130) may control the driving unit (120) to move closer to the user. Accordingly, the electronic device (100) may provide higher quality sound to the user. Alternatively, the electronic device (100) may also more clearly identify the user's spoken voice.

[0193] The processor (130) may also control the driving unit (120) to move the electronic device (100) based on the user's location when projecting content and providing sound to the user.

[0194] According to FIG. 18, when the processor (130) projects cooking content and provides the user with a cooking method through sound, if the user's position changes according to the cooking stage, the processor (130) may control the driving unit (120) to move the electronic device (100) according to the change in the user's position. That is, the processor (130) may control the driving unit (120) to move the electronic device (100) based on at least one of the type of content being output or the user's position.

[0195] The processor (130) may also control the driving unit (120) to move the electronic device (100) based on the user's context.

[0196] According to FIG. 19, the processor (130) may identify the context of the user based on the operational state of at least one of the communication interface (150) and the camera (195), and if the context of the user is identified as a preset situation, control the driving unit (120) to move the electronic device (100) based on the location of the user. For example, when the processor (130) photographs the user through the camera (195), provides the photographed image to an external server, and at the same time, the image is streamed from the external server and the streamed image is projected, the processor (130) may identify that the current user is in a video conference, and control the driving unit (120) to approach the user more closely in order to provide high-quality image and sound to the other party.

[0197] The processor (130) may also control the driving unit (120) to move the electronic device (100) based on the type of content or sound surrounding the electronic device (100).

[0198] According to FIG. 20, the processor (130) may control the driving unit (120) to come closer to the user when the content requires a user's voice command, but the surroundings of the electronic device (100) are noisy.

[0199] The processor (130) may also control the driving unit (120) to move the electronic device (100) based on at least one of the number of users or the location of the users.

[0200] According to FIG. 21, when a new user is identified around the electronic device (100), the processor (130) can control the driving unit (120) to move the electronic device (100) to a position that can provide optimal sound to both the existing user and the new user.

[0201] The processor (130) may also control the driving unit (120) to move the electronic device (100) if there is a possibility of a failure of the electronic device (100).

[0202] According to FIG. 22, when a collision with a user is expected, the processor (130) can control the driving unit (120) to move the electronic device (100) to a position that can minimize the collision with the user. However, the present invention is not limited thereto, and the processor (130) can also control the driving unit (120) to move the electronic device (100) from a position exposed to direct sunlight to a position not exposed to direct sunlight.

[0203] According to FIG. 23, the processor (130) can project a photo zone or preview, and can also control the driving unit (120) to move the electronic device (100) based on additional user identification, pose change, etc.

[0204] According to FIG. 24, the projection unit (110) includes a first projection unit and a second projection unit, and the processor (130) controls the first projection unit to project first content onto a projection surface, and may control the second projection unit to project third content onto another projection surface. The third content includes a control screen for controlling the first content, and the processor (130) may control the driving unit (120) to move the electronic device (100) to a position where the control screen can be provided in front of the user. That is, the processor (130) may control the driving unit (120) to move the electronic device (100) based on an area where the third content is projected on the other projection surface and the user's position.

[0205] FIG. 25 is a drawing for explaining a case where an obstacle is identified during movement according to one embodiment of the present disclosure.

[0206] According to FIG. 25, when the processor (130) identifies that the electronic device (100) is moving, it can identify a second location and an optimal movement path based on obstacles around the electronic device (100). For example, when the processor (130) identifies that the electronic device (100) is moving, it can identify a second location where there are no obstacles on the movement path.

[0207] The processor (130) may identify a new obstacle while moving from the first location to the second location. Here, the new obstacle may be an obstacle that did not exist before the second location and optimal movement path were determined.

[0208] When a new obstacle is identified during movement, the processor (130) may change the movement path to a path in which the distance from the electronic device (100) to the identified edge increases. If the movement path is changed to a path in which the distance from the electronic device (100) to the identified edge decreases, the entire area on which light is projected by the projection unit (110) on the projection surface may decrease, and the projection area in which content is projected may not be maintained.

[0209] FIG. 26 is a flowchart for explaining a method for controlling an electronic device according to an embodiment of the present disclosure.

[0210] According to FIG. 26, first content is projected onto a projection surface (S2610). Then, when the electronic device moves from a first location to a second location, a projection angle for the projection surface is identified based on the second location (S2620). Then, second content, which has a changed screen shape of the first content, is acquired based on the second location and projection angle (S2630). Then, when the electronic device moves from the first location to the second location, the second content is projected onto the projection surface (S2640).

[0211] In addition, the method may further include a step of identifying an edge corresponding to a movement direction of the electronic device among the left edge and the right edge of the projection area on which the first content is projected on the projection surface, and a step of identifying a second position based on the identified edge.

[0212] And, the step of identifying the second position may identify a distance from the first position to the projection surface, identify a distance from the first position to the identified edge based on a radiation angle of a projection unit included in the electronic device, and identify the second position based on the identified distance.

[0213] Additionally, the distance from the second location to the identified edge may be greater than or equal to the distance from the first location to the identified edge.

[0214] And, the projection angle includes an azimuth at the second position and an elevation angle at the second position, and the step of identifying the projection angle (S2620) identifies the azimuth at the second position based on the distance from the first position to the projection surface, the distance from the first position to the second position, and the movement direction of the electronic device, and identifies the elevation angle at the second position based on the distance from the first position to the projection surface, the elevation angle at the first position, and the azimuth angle at the second position.

[0215] Additionally, the acquiring step (S2630) can scale the second content based on the distance from the first position to the projection surface, the distance from the first position to the second position, the radiation angle of the projection unit, and the azimuth at the second position.

[0216] And, the method may further include a step of identifying a plurality of third positions in a path from the first position to the second position, and a step of performing an operation of identifying a projection angle, an operation of changing a screen shape, and a operation of projecting at each of the plurality of third positions.

[0217] Additionally, the method may further include a step of identifying the electronic device as being moved from a first location to a second location based on at least one of a charging state of the electronic device, a temperature of the electronic device, a type of the first content, a number of users around the electronic device, or a location of the users.

[0218] And, the projecting step can control a first projection unit included in the electronic device to project first content onto a projection surface, and control a second projection unit included in the electronic device to project third content onto another projection surface.

[0219] Additionally, the third content may include a control screen for controlling the first content, and the control method may further include a step of identifying a second location so that the control screen is provided in front of the user.

[0220] And, the area corresponding to the first content on the projection surface can overlap with the area corresponding to the second content on the projection surface by less than a preset error.

[0221] According to various embodiments of the present disclosure as described above, the electronic device can change the projection angle and the screen shape of the content as the electronic device moves, thereby maintaining the area where the content is projected on the projection surface even when the electronic device moves, thereby increasing the user's sense of immersion.

[0222] Meanwhile, according to a temporary example of the present disclosure, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call instructions stored from the storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. 'Non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0223] Furthermore, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0224] Furthermore, according to one embodiment of the present disclosure, the various embodiments described above may be implemented in a computer-readable recording medium or a similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented by the processor itself. In a software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software. Each software may perform one or more functions and operations described herein.

[0225] Meanwhile, computer instructions for performing processing operations of a device according to the various embodiments described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in such a non-transitory computer-readable medium, when executed by a processor of a specific device, cause the specific device to perform processing operations in the device according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that permanently stores data and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of non-transitory computer-readable media may include a CD, DVD, hard disk, Blu-ray disk, USB, memory card, or ROM.

[0226] In addition, each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the corresponding sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the corresponding components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0227] While the present disclosure has been illustrated and described with reference to various embodiments, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.

Claims

1. In electronic devices, Projection section; drive unit; A memory storing one or more computer programs; and comprising one or more processors communicatively connected to the projection unit, the driving unit and the memory; The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, Controlling the projection unit to project the first content onto the projection surface, When the electronic device moves from the first position to the second position, the projection angle for the projection surface is identified based on the second position, Obtain second content that changes the screen shape of the first content based on the second position and the projection angle, An electronic device that controls the projection unit to project the second content onto the projection surface when the electronic device is moved from the first position to the second position by controlling the driving unit.

2. In paragraph 1, The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, Identifying an edge corresponding to the movement direction of the electronic device among the left edge and the right edge of the projection area on which the first content is projected on the projection surface; An electronic device that identifies the second location based on the identified edge.

3. In paragraph 2, sensors; including more; The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, Identifying the distance from the first position to the projection surface through the above sensor, Identifying the distance from the first location to the identified edge based on the radiation angle of the projection unit, An electronic device that identifies the second location based on the identified distance.

4. In paragraph 2, The distance from the second location to the identified edge is, An electronic device having a distance greater than or equal to the distance from the first location to the identified edge.

5. In paragraph 1, The above projection angle is, Including the azimuth at the second location and the elevation at the second location, The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, Identifying the azimuth at the second location based on the distance from the first location to the projection surface, the distance from the first location to the second location, and the direction of movement of the electronic device; An electronic device that identifies an elevation angle at the second location based on a distance from the first location to the projection surface, an elevation angle at the first location, and an azimuth angle at the second location.

6. In paragraph 5, The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, An electronic device that scales the second content based on a distance from the first location to the projection surface, a distance from the first location to the second location, a radiation angle of the projection unit, and an azimuth at the second location.

7. In paragraph 1, The above driving part, a first driving unit for moving the electronic device; and It includes a second driving unit that controls the projection direction of the above projection unit; The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, Controlling the first driving unit so that the electronic device moves from the first position to the second position; An electronic device, wherein when the electronic device is positioned at the second location, the projection unit controls the second driving unit to project the second content based on the projection angle.

8. In paragraph 1, The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, Identifying a plurality of third locations on the path from the first location to the second location, An electronic device that performs the projection angle identification operation, the screen shape changing operation, and the projection operation at each of the plurality of third positions.

9. In paragraph 1, The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, An electronic device that identifies the electronic device as being moved from the first location to the second location based on at least one of a charging state of the electronic device, a temperature of the electronic device, a type of the first content, a number of users around the electronic device, or a location of the users.

10. In paragraph 1, The above projection part, 1st projection section; and Includes a second projection unit; The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, Controlling the first projection unit to project the first content onto the projection surface; An electronic device that controls the second projection unit to project third content onto another projection surface.

11. In paragraph 10, The third content is, Including a control screen for controlling the first content, The one or more computer programs comprise computer-executable instructions that are individually or collectively executed by the one or more processors, wherein the electronic device, An electronic device that identifies the second location so that the control screen is provided in front of the user.

12. In paragraph 1, The area corresponding to the first content on the above projection surface is, An electronic device that overlaps an area corresponding to the second content on the projection surface by less than a preset error.

13. In a method performed by an electronic device, A step of projecting first content onto a projection surface by the above electronic device; When the electronic device moves from a first position to a second position, a step of identifying a projection angle for the projection surface based on the second position by the electronic device; A step of obtaining second content by changing the screen shape of the first content based on the second position and the projection angle by the electronic device; and A control method comprising: a step of controlling a driving unit by the electronic device to move the electronic device from the first position to the second position, thereby projecting the second content onto the projection surface; 14. In paragraph 13, A step of identifying an edge corresponding to the movement direction of the electronic device among the left edge and the right edge of the projection area on which the first content is projected on the projection surface; and A method further comprising: identifying the second location based on the identified edge.

15. In paragraph 14, The step of identifying the second location is: Identify the distance from the first position to the projection surface, Identifying the distance from the first location to the identified edge based on the radiation angle of the projection unit included in the electronic device, A method for identifying the second location based on the identified distance.

Images