Electronic device for maintaining a region of displayed content on a projection surface and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes: a projection unit; a driving unit; a memory for storing at least one computer program; and at least one processor communicatively connected to the projection unit, the driving unit, and the memory, wherein the at least one computer program includes computer-executable instructions, executed individually or collectively by the at least one processor, to cause the electronic device to perform the following operations: controlling the projection unit to project first content onto a projection surface; if the electronic device moves from a first position to a second position, identifying a projection angle of the projection surface based on the second position; obtaining second content by changing the screen shape of the first content based on the second position and the projection angle; and if the driving unit is controlled to move the electronic device from the first position to the second position, controlling the projection unit to project the second content onto the projection surface.

Description

Technical Field

[0001] This disclosure relates to electronic devices and control methods. More specifically, this disclosure relates to an electronic device and a control method thereof for maintaining an area on a projection surface where content is displayed. Background Technology

[0002] With the development of electronic technology, electronic devices offering various functions have been developed. Specifically, in recent years, projectors capable of projecting content while moving around have been developed.

[0003] However, when the projector is moving while projecting content, the size and shape of the content screen change with the change in projection position, disrupting the user's immersion and forcing the user to stop watching and adjust the content screen.

[0004] The above information is presented as background information only to aid in understanding this disclosure. No determination or assertion is made regarding whether any of the above content can be used as prior art with respect to this disclosure. Summary of the Invention

[0005] The aspects of this disclosure are intended to address at least the aforementioned problems and / or disadvantages, and to provide at least the advantages described below. Therefore, one aspect of this disclosure is to provide an electronic device and a control method.

[0006] Additional aspects will be set forth in part in the description below, and will be partly apparent from the description or may be understood by way of practical examples.

[0007] According to an aspect of this disclosure, an electronic device is provided. The electronic device includes: a projector; a driver; a memory storing one or more computer programs; and one or more processors communicatively coupled to the projector, the driver, and the memory, wherein the one or more computer programs include computer-executable instructions, which, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: controlling the projector to project first content onto a projection surface; moving the electronic device from a first position to a second position; identifying a projection angle of the projection surface based on the second position; obtaining second content by changing the screen format of the first content based on the second position and the projection angle; and controlling the projector to project the second content onto the projection surface based on the electronic device controlling the driver to move from the first position to the second position.

[0008] The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: identify an edge corresponding to the direction of movement of the electronic device in the left and right edges of the projection area on the projection surface in which the first content is projected, and identify a second position based on the identified edge.

[0009] The device further includes sensors, and the one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: identify a distance from a first position to the projection surface via the sensors, identify a distance from the first position to the identified edge based on the radial angle of the projector, and identify a second position based on the identified distance.

[0010] The distance from the second position to the identified edge is equal to or greater than the distance from the first position to the identified edge.

[0011] The projection angle includes the azimuth angle at the second position and the elevation angle at the second position, and the one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: identify the azimuth angle at the second position based on the distance from the first position to the projection surface, the distance from the first position to the second position, and the direction of movement of the electronic device; and identify the elevation angle at the second position based on the distance from the first position to the projection surface, the elevation angle at the first position, and the azimuth angle at the second position.

[0012] The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operation: scaling the second content based on the distance from the first position to the projection surface, the distance from the first position to the second position, the radial angle of the projector, and the azimuth angle at the second position.

[0013] The driver includes: a first driver configured to move the electronic device, and a second driver configured to control the projection direction of the projector, and the one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: control the first driver to move the electronic device from a first position to a second position, and, based on the electronic device being in the second position, control the second driver to cause the projector to project second content based on the projection angle.

[0014] The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: identify a plurality of third locations in a path from a first location to a second location, and perform operations at each of the plurality of third locations to identify the projection angle, change the screen format, and perform a projection operation.

[0015] The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by one or more processors, cause the electronic device to perform the following operations: identifying that the electronic device is moving from a first location to a second location based on at least one of the following: the charging state of the electronic device, the temperature of the electronic device, the type of first content, the number of users around the electronic device, or the location of the users.

[0016] The projector includes a first projector and a second projector, and the one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: control the first projector to project first content onto the projection surface, and control the second projector to project third content onto another projection surface.

[0017] The third content includes a control screen for controlling the first content, and the one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: identify a second location such that the control screen is presented in front of the user.

[0018] The overlap between the area corresponding to the first content and the area corresponding to the second content on the projection surface is less than a preset error.

[0019] According to another aspect of this disclosure, a method performed by an electronic device is provided. The method includes: projecting first content onto a projection surface by the electronic device; identifying a projection angle of the projection surface based on the second position as the electronic device moves from a first position to a second position; obtaining second content by the electronic device changing the screen format of the first content based on the second position and the projection angle; and projecting the second content onto the projection surface by the electronic device as the electronic device moves from the first position to the second position via a control driver.

[0020] The method further includes: identifying an edge corresponding to the movement direction of the electronic device in the left and right edges of the projection area on the projection surface where the first content is projected, and identifying a second position based on the identified edge.

[0021] The step of identifying the second position includes: identifying the distance from the first position to the projection surface, identifying the distance from the first position to the identified edge based on the radial angle of the projector included in the electronic device, and identifying the second position based on the identified distance.

[0022] The distance from the second position to the identified edge is equal to or greater than the distance from the first position to the identified edge.

[0023] The projection angle includes the azimuth angle at the second position and the elevation angle at the second position. The step of identifying the projection angle may include: identifying the azimuth angle at the second position based on the distance from the first position to the projection surface, the distance from the first position to the second position, and the direction of movement of the electronic device; and identifying the elevation angle at the second position based on the distance from the first position to the projection surface, the elevation angle at the first position, and the azimuth angle at the second position.

[0024] The acquisition steps include: scaling the second content based on the distance from the first position to the projection surface, the distance from the first position to the second position, the radial angle of the projector, and the azimuth angle at the second position.

[0025] The method further includes: identifying a plurality of third locations in the path from the first location to the second location, and performing an operation to identify the projection angle, an operation to change the screen format, and a projection operation at each of the plurality of third locations.

[0026] The method further includes identifying that the electronic device is moving from a first location to a second location based on at least one of the following: the charging state of the electronic device, the temperature of the electronic device, the type of first content, the number of users around the electronic device, or the location of the users.

[0027] Projecting the first content includes: controlling a first projector included in the electronic device to project the first content onto the projection surface, and controlling a second projector included in the electronic device to project the third content onto another projection surface.

[0028] The third content includes a control screen for controlling the first content, and the method may further include: identifying a second location such that the control screen is presented in front of the user.

[0029] The overlap between the area corresponding to the first content and the area corresponding to the second content on the projection surface is less than a preset error.

[0030] According to another aspect of this disclosure, one or more non-transitory computer-readable storage media are provided storing one or more computer programs, said one or more computer programs including computer-executable instructions that, when executed individually or jointly by one or more processors of an electronic device, cause the electronic device to perform operations. The operations include: projecting first content onto a projection surface by the electronic device; based on a movement of the electronic device from a first position to a second position, identifying a projection angle of the projection surface by the electronic device based on the second position; obtaining second content by the electronic device by changing the screen format of the first content based on the second position and the projection angle; and projecting the second content onto the projection surface by the electronic device based on a movement of the electronic device from the first position to the second position via a control driver.

[0031] Other aspects, advantages, and salient features of this disclosure will become apparent to those skilled in the art from the following detailed description of various embodiments disclosed in conjunction with the accompanying drawings. Attached Figure Description

[0032] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which: Figure 1 This is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure; Figure 2 This is a block diagram illustrating a detailed configuration of an electronic device according to embodiments of the present disclosure; Figure 3 and Figure 4 These are views provided to schematically explain the operation of an electronic device according to various embodiments of the present disclosure; Figure 5 This is a flowchart provided to explain the structure of an electronic device according to embodiments of the present disclosure; Figure 6 This is a flowchart provided to explain the operation of an electronic device according to embodiments of this disclosure; Figure 7 , Figure 8 and Figure 9 This is a view provided to explain the operation of identifying the position to be moved to and the projection angle according to various embodiments of this disclosure; Figure 10 , Figure 11 , Figure 12 , Figure 13 and Figure 14 This is a view provided to explain operations in the form of screens that change the first content according to various embodiments of this disclosure; Figure 15 , Figure 16 , Figure 17 , Figure 18 , Figure 19 , Figure 20 , Figure 21 , Figure 22 , Figure 23 and Figure 24 This is a view provided to explain the reasons for movement according to various embodiments of this disclosure; Figure 25 This is a view provided to explain the situation of an obstacle being identified during movement according to embodiments of this disclosure; and Figure 26 This is a flowchart provided to explain a control method for an electronic device according to embodiments of the present disclosure.

[0033] Throughout the accompanying drawings, the same reference numerals are used to denote the same elements. Detailed Implementation

[0034] The following description, with reference to the accompanying drawings, is intended to aid in a comprehensive understanding of the various embodiments of this disclosure as defined by the claims and their equivalents. It includes various specific details to aid understanding, but these details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of this disclosure. Furthermore, for clarity and brevity, descriptions of well-known functions and constructions may be omitted.

[0035] The terms and words used in the following description and claims are not limited to their literal meaning, but are used by the inventors only to enable a clear and consistent understanding of this disclosure. Therefore, those skilled in the art will understand that the following description of various embodiments of this disclosure is for illustrative purposes only and is not intended to limit the disclosure as defined by the appended claims and their equivalents.

[0036] It should be understood that, unless the context clearly specifies otherwise, the singular forms “a,” “an,” and “the” include plural indicators. Thus, for example, a reference to “component surface” includes a reference to one or more such surfaces.

[0037] This disclosure provides an electronic device and a method for controlling the same, wherein the electronic device maintains the size and shape of the content screen even when the electronic device is in motion and the content is projected.

[0038] In consideration of their function in this disclosure, currently widely used general terms are selected as the terms used in the embodiments of this disclosure, and may be changed based on the intent of those skilled in the art, judicial precedent, the emergence of new technologies, etc. Furthermore, in certain circumstances, terms arbitrarily chosen by the applicant may exist. In such cases, the meanings of these terms are mentioned in detail in the corresponding description of this disclosure. Therefore, the terms used in the embodiments of this disclosure need to be defined based on the meaning of the terms and the entire content of the disclosure, rather than based on the simple names of the terms.

[0039] In this disclosure, the terms “have,” “may have,” “include,” “may include,” etc., indicate the presence of a corresponding feature (e.g., a value, function, operation, or component such as a part) and do not exclude the presence of additional features.

[0040] The statement “at least one of A and / or B” should be understood as referring to any one of “A”, “B”, and “both A and B”.

[0041] The terms “first,” “second,” “first,” “second,” etc., used in this disclosure may refer to various components regardless of their order and / or importance. These terms are used only to distinguish one component from another and do not limit the corresponding component.

[0042] It will be understood that the terms “comprising,” “formed by,” etc., used in this application specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof mentioned in the specification, and do not exclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0043] In this disclosure, the term "user" may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0044] It should be understood that the boxes in each flowchart and the combination of flowcharts can be executed by one or more computer programs including instructions. The entirety of one or more computer programs can be stored in a single memory device, or one or more computer programs can be divided into different parts stored in multiple different memory devices.

[0045] Any function or operation described herein may be processed by a processor or a combination of processors. A processor or a combination of processors is circuitry that performs processing and includes circuitry such as an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connectivity chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio codec chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system-on-a-chip (SoC), an IC, etc.

[0046] Figure 1 This is a block diagram illustrating the configuration of an electronic device 100 according to an embodiment of the present disclosure.

[0047] Electronic device 100 can be a device that projects content when the position of electronic device 100 changes. For example, electronic device 100 is a projector that is capable of self-movement.

[0048] The electronic device 100 may be an apparatus for imaging content and projecting the imaged content when the position of the electronic device 100 changes. For example, the electronic device 100 may be an apparatus for performing image processing on content based on the changed position of the electronic device 100 and projecting the image-processed content to maintain a consistent area of ​​the projected content on the projection surface.

[0049] Reference Figure 1 The electronic device 100 includes a projector 110, a driver 120, and a processor 130.

[0050] The projector 110 can project content onto a projection surface. Specifically, the projector 110 can use lamps or light-emitting diodes (LEDs) to project images or videos, including at least one of content received from a source device or pre-stored content, onto the projection area.

[0051] The driver 120 may include a first driver for moving the electronic device 100 under the control of the processor 130. For example, the driver 120 may include wheels, a motor, etc. for moving the electronic device 100. However, the driver 120 is not limited to this, and the driver 120 may be any configuration capable of moving the electronic device 100 to a different position.

[0052] The driver 120 may include a second driver for controlling the projection direction of the projector 110 under the control of the processor 130. For example, the driver 120 may include a motor or the like for controlling the projection direction of the projector 110. However, the driver 120 is not limited to this, and the driver 120 may be any configuration capable of controlling the projection direction of the projector 110.

[0053] The processor 130 controls the overall operation of the electronic device 100. Specifically, the processor 130 can be connected to each configuration of the electronic device 100 to control the overall operation of the electronic device 100. For example, the processor 130 can be connected to configurations such as projector 110, driver 120, sensor (not shown), communication interface (not shown), etc., to control the operation of the electronic device 100.

[0054] One or more processors 130 may include one or more of a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), an integrated many-core processor (MIC), a neural processing unit (NPU), a hardware accelerator, or a machine learning accelerator. One or more processors 130 may control one or any combination of other components of the electronic device 100 and may perform communication-related operations or data processing. One or more processors 130 may execute one or more programs or instructions stored in memory. For example, one or more processors 130 may perform a method according to an embodiment by executing one or more instructions stored in memory.

[0055] When the method according to the embodiments includes multiple operations, the multiple operations can be executed by one processor or multiple processors. In other words, when the first operation, the second operation, and the third operation are performed by the method according to the embodiments, all of the first operation, the second operation, and the third operation can be executed by the first processor, or the first operation and the second operation can be executed by the first processor (e.g., a general-purpose processor), and the third operation can be executed by the second processor (e.g., an artificial intelligence-specific processor).

[0056] One or more processors 130 may be implemented as a single-core processor including a single core, or as one or more multi-core processors including multiple cores (e.g., homogeneous multi-core or heterogeneous multi-core). When one or more processors are implemented as multi-core processors, each of the multiple cores included in the multi-core processor may include processor internal memory, such as cache memory and on-chip memory, and a common cache shared by the multiple cores may be included in the multi-core processor. Furthermore, each (or some of the multiple cores) of the multiple cores included in the multi-core processor may independently read and execute program instructions to implement the method according to the embodiment, or all (or some of the multiple cores) may be coupled to read and execute program instructions to implement the method according to the embodiment.

[0057] When the method according to the embodiment includes multiple operations, the multiple operations may be executed by one core of a plurality of cores included in a multi-core processor, or may be executed by a plurality of cores. For example, when the first operation, the second operation, and the third operation are performed by the method according to the embodiment, all of the first operation, the second operation, and the third operation may be executed by the first core included in the multi-core processor, or the first operation and the second operation may be executed by the first core included in the multi-core processor, and the third operation may be executed by the second core included in the multi-core processor.

[0058] In embodiments of this disclosure, one or more processors 130 may represent a system-on-a-chip (SoC), a single-core processor, a multi-core processor, or a core included in a single-core or multi-core processor, integrating one or more processors and other electronic components. A core may be implemented as a CPU, GPU, APU, MIC, NPU, hardware accelerator, or machine learning accelerator, etc., but the core is not limited to the embodiments of this disclosure. However, for ease of explanation, the term "processor 130" will be used below to describe the operation of the electronic device 100.

[0059] The processor 130 can control the projector 110 to project the first content onto the projection surface.

[0060] While controlling the projector 110 to project the first content onto the projection surface, the processor 130 can recognize that the electronic device 100 is moving from a first position to a second position. For example, the processor 130 can recognize that the electronic device 100 is moving from the first position to the second position based on at least one of the following: the charging state of the electronic device 100, the temperature of the electronic device 100, the type of the first content, the number of users near the electronic device 100, or the location of the users. The second position can be represented by absolute coordinates, but it can also be represented by relative coordinates relative to the current position of the electronic device 100.

[0061] The processor 130 can identify edges corresponding to the direction of movement of the electronic device 100 in the left and right edges of the projection area of ​​the first content projected on the projection surface, and identify a second position based on the identified edges.

[0062] For example, the electronic device 100 also includes sensors, and the processor 130 can identify the distance from a first position to the projection surface via the sensors, identify the distance from the first position to the identified edge based on the radial angle of the projector 110, and identify a second position based on the identified distances. For example, the distance from the second position to the identified edge may be equal to or greater than the distance from the first position to the identified edge. Therefore, the projection area of ​​the projected content can be maintained. When the distance from the second position to the identified edge is less than the distance from the first position to the identified edge, the projection area of ​​the projector 110 can become smaller. In this case, the projection area of ​​the projected content becomes smaller, thereby reducing the user's immersion.

[0063] When the electronic device 100 moves from a first position to a second position, the processor 130 can identify the projection angle of the projection surface based on the second position. For example, when the electronic device 100 moves to the right based on the projection direction, the projection direction needs to be changed counterclockwise to maintain the projection area of ​​the projected content.

[0064] The processor 130 can obtain the second content by changing the screen format of the first content based on the second position and the projection angle. For example, when the electronic device 100 moves to the right based on the projection direction, the processor 130 shrinks the first content, but can process the left and right portions differently. For example, the processor 130 can obtain the second content by changing the screen format of the first content such that the length of the left edge of the first content is shorter than the length of the right edge of the second content.

[0065] The projection angle includes the azimuth angle at the second position and the elevation angle at the second position. The processor 130 can identify the azimuth angle at the second position based on the distance from the first position to the projection surface, the distance from the first position to the second position, and the direction of movement of the electronic device. It can also identify the elevation angle at the second position based on the distance from the first position to the projection surface, the elevation angle at the first position, and the azimuth angle at the second position. The processor 130 can scale the second content based on the distance from the first position to the projection surface, the distance from the first position to the second position, the radial angle of the projector 110, and the azimuth angle at the second position.

[0066] The method for identifying the projection angle based on the second position and the method for changing the screen format of the first content will be described in detail with reference to the following figures.

[0067] The driver 120 includes a first driver for moving the electronic device 100 and a second driver for controlling the projection direction of the projector 110, and the processor 130 can control the first driver to move the electronic device 100 from a first position to a second position, and when the electronic device 100 is in the second position, the processor 130 can control the second driver to cause the projector 110 to project second content based on the projection angle.

[0068] When the electronic device 100 moves from the first position to the second position via the control driver 120, the processor 130 can control the projector 110 to project the second content onto the projection surface.

[0069] For ease of explanation, the above description only depicts the movement of the electronic device 100 from a first position to a second position; however, such an operation can be more continuous. For example, the processor 130 can identify multiple third positions along the path from the first to the second position, and can perform operations such as identifying the projection angle, changing the screen format, and projection at each of these third positions. In other words, the operation can be more continuous to maintain user immersion. In this case, the area on the projection surface corresponding to the first content can overlap with the area on the projection surface corresponding to the second content by less than a preset error. Specifically, the more third positions there are, the smaller the error.

[0070] Furthermore, the projector 110 includes a first projector and a second projector, and the processor 130 can control the first projector to project first content onto a projection surface, and can control the second projector to project third content onto another projection surface. The third content includes a control screen for controlling the first content, and the processor 130 can identify a second position such that the control screen is provided in front of the user.

[0071] Figure 2 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0072] Reference Figure 2 The electronic device 100 may include a projector 110, a driver 120, and a processor 130. The electronic device 100 may also include a sensor 140, a communication interface 150, a user interface 160, a memory 170, a display 180, a microphone 185, a speaker 190, and a camera 195. Figure 2 The shown with Figure 1 The overlapping components shown will not be described in detail.

[0073] Sensor 140 is a sensor used to identify the distance from electronic device 100 to the projection surface, and can be implemented as a time-of-flight (ToF) sensor. However, sensor 140 can be any sensor capable of identifying the distance from electronic device 100 to the projection surface. Furthermore, processor 130 can also identify the distance from electronic device 100 to the projection surface via camera 195, which will be described later.

[0074] The communication interface 150 is configured to perform communication with various types of external devices according to various communication methods. For example, the electronic device 100 performs communication with a content server or user terminal device via the communication interface 150.

[0075] The communication interface 150 may include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, etc. Each communication module may be implemented as at least one hardware chip.

[0076] The Wi-Fi and Bluetooth modules perform communication using Wi-Fi and Bluetooth methods, respectively. When using either the Wi-Fi or Bluetooth module, various connection information (such as Service Set Identifier (SSID) and session key) is first sent and received, and various other information can be sent and received after a communication connection is established using this information. The infrared communication module performs communication according to Infrared Data Association (IrDA) communication technology, which uses infrared light—between visible light and millimeter waves—to wirelessly transmit data over short distances.

[0077] In addition to the communication methods described above, the wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G, 3GPP, LTE, LTE-A, 4G, 5G, etc.

[0078] Optionally, the communication interface 150 may include a wired communication interface, such as a high-definition media interface (HDMI), DP, Thunderbolt, USB, red-green-blue (RGB), D-SUB, digital video interface (DVI), etc.

[0079] In addition, the communication interface 150 may include at least one of a local area network (LAN) module, an Ethernet module, or a wired communication module, wherein the wired communication module uses paired cables, coaxial cables, or fiber optic cables to perform communication.

[0080] User interface 160 may be implemented as a button, touchpad, mouse, keyboard, etc., or may be implemented as a touch screen that can also perform display and input functions. Buttons may be various types of buttons (such as mechanical buttons, touchpads, scroll wheels, etc.) formed in any area (such as the front, side, or back) of the body of electronic device 100.

[0081] Memory 170 may refer to hardware that stores information (such as data) in electrical or magnetic form for access by processor 130 and the like. For this purpose, memory 170 may be implemented as at least one of the following hardware: non-volatile memory, volatile memory, flash memory, hard disk drive (HDD) or solid-state drive (SSD), random access memory (RAM), read-only memory (ROM), etc.

[0082] The memory 170 may store at least one instruction or module required for the operation of the display device (i.e., electronic device 100) or the processor 130. An instruction is a unit of code that directs the operation of the display device (i.e., electronic device 100) or the processor 130, and may be written in a machine language that a computer can understand. Optionally, the memory 170 may store multiple instructions for performing a specific task of the electronic device 100 or the processor 130 as an instruction set.

[0083] The memory 170 can store data that can represent bit or byte information such as characters, numbers, and images. For example, the memory 170 stores a projection angle recognition module, an image processing module, etc.

[0084] The memory 170 is accessed by the processor 130, and the processor 130 can execute read / write / modify / delete / update instructions, modules, or data.

[0085] The display 180 is configured to display images and can be implemented as various types of displays, such as liquid crystal displays (LCDs), organic light-emitting diode (OLED) displays, and plasma display panels (PDPs). The display 180 may also include driving circuitry, a backlight unit, etc., and can be implemented in the form of a-si TFTs, low-temperature polycrystalline silicon (LTPS) TFTs, organic TFTs (OTFTs), etc. Furthermore, the display 180 can be implemented as a touchscreen combined with a touch sensor, a flexible display, a three-dimensional (3D) display, etc.

[0086] Microphone 185 is configured to receive sound input and convert the sound input into an audio signal. Microphone 185 is electrically connected to processor 130 and can receive sound under the control of processor 130.

[0087] For example, the microphone 185 may be integrally formed on the top, front, side, or other parts of the electronic device 100. Alternatively, the microphone 185 may be formed on a remote control or similar device separate from the electronic device 100. In this case, the remote control can receive sound through the microphone 185 and provide the received sound to the electronic device 100.

[0088] Microphone 185 may include various components, such as a microphone for collecting analog sound, an amplifier circuit for amplifying the collected sound, an A / D conversion circuit for sampling the amplified sound and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0089] Furthermore, the microphone 185 can be implemented in the form of a sound sensor, and can be any configuration capable of collecting sound.

[0090] The speaker 190 is configured to output various notification sounds or voice messages as well as various audio data processed by the processor 130.

[0091] Camera 195 is configured to capture still images or moving images. Camera 195 can capture still images at a specific point in time, but it can also capture still images continuously.

[0092] Camera 195 can capture images of the area in front of electronic device 100 to capture projected content. Processor 130 can identify, based on the images captured by camera 195, whether the area of ​​projected content is maintained during movement of electronic device 100, and can change the screen format of the content based on the captured images when the area of ​​projected content changes beyond a preset error.

[0093] Camera 195 includes a lens, shutter, aperture, solid-state imaging device, analog front-end (AFE), and timing generator (TG). The shutter controls the time when light reflected from the subject enters camera 195, and the aperture controls the amount of light entering the lens by mechanically increasing or decreasing the size of the opening. When the light reflected from the subject is accumulated into photoelectric charge, the solid-state imaging device outputs the photoelectric charge as an electrical signal. The TG outputs a timing signal to read out the pixel data of the solid-state imaging device, and the AFE samples and digitizes the electrical signal output from the solid-state imaging device.

[0094] As described above, the electronic device 100 can change the projection angle and screen format of the content as the electronic device 100 moves, thereby enhancing the user's immersion by maintaining the area of ​​the projected content on the projection surface even when the electronic device 100 moves.

[0095] In the following text, reference will be made to Figures 3 to 25 The operation of electronic device 100 is described in more detail. For ease of explanation, Figures 3 to 25Various embodiments will be described. However, Figures 3 to 25 The various embodiments can be practiced in any combination.

[0096] Figure 3 and Figure 4 These are views provided to schematically explain the operation of an electronic device according to various embodiments of the present disclosure.

[0097] Reference Figure 3 and Figure 4 The electronic device 100 includes a driver 120, and a processor 130 can control the driver 120 to move the electronic device 100 as needed. For example, the processor 130 projects content at position A 310, then moves to position B 320, and finally to position C 330, as... Figure 3 As shown.

[0098] In this configuration, the processor 130 can gradually change the screen format of the content and control the projector 110 to project the content in the changed screen format. For example, at position A 310, as shown in 410-1, the screen format of the content remains unchanged, and as shown in 420-1, the processor 130 controls the projector 110 to project the content onto the projection surface.

[0099] When the electronic device 100 is in position B 320, as shown in 410-2, the processor 130 can change the screen format of the content and, as shown in 420-2, control the projector 110 to project the content onto the projection surface.

[0100] When the electronic device 100 is in position C, as shown in 410-3, the processor 130 can change the screen format of the content and, as shown in 420-3, control the projector 110 to project the content onto the projection surface.

[0101] The content can be changed from a screen format such as 410-1 to a screen format such as 410-3, wherein each corner of the content can be changed to face the center of the content in the screen format. Specifically, when the electronic device 100 moves to the right, the degree of change of the upper left corner of the content can be greater than the degree of change of the upper right corner of the content.

[0102] The shadows surrounding the content in 410-1 to 410-3 can be light from the area of ​​light emitted by the projector 110 that does not represent the content. In other words, although all the light emitted by the projector 110 in 410-1 to 410-3 can be the same, the area representing the content can become smaller as the screen format of the content changes (i.e., from 410-1 to 410-3).

[0103] On the other hand, as the electronic device 100 moves (i.e., from 420-1 to 420-3), the projection angle decreases, and therefore, the area on the projection surface corresponding to all the light emitted by the projector 110 can become larger. However, as the screen format of the content gradually changes (e.g., from 410-1 to 410-3), the area on the projection surface corresponding to the content can remain consistent. Therefore, even if the electronic device 100 moves, the user's immersion can be maintained.

[0104] Figure 5 This is a flowchart provided to explain the structure of an electronic device 100 according to embodiments of the present disclosure.

[0105] Electronic device 100 may include a first body and a second body.

[0106] Reference Figure 5 The electronic device 100 may include a first body 510 and a second body 520. The first body 510 includes a projector 110, and the second body 520 is formed in the lower part of the first body 510.

[0107] The first body 510 may include a projector 110 and a second driver that controls the projection direction of the projector 110, and the second body 520 may include a first driver that moves the electronic device 100. The processor 130 may control the first driver to move the electronic device 100 from a first position to a second position, and when the electronic device 100 is in the second position, the processor 130 may control the second driver to cause the projector 110 to project second content based on a projection angle. The second driver may be implemented to achieve at least one of translation or tilting of the projector 110.

[0108] Figure 6 This is a flowchart provided to explain the operation of an electronic device 100 according to embodiments of the present disclosure.

[0109] Reference Figure 6 During operation of S610, processor 130 can learn an indoor map by moving. For example, processor 130 controls driver 120 to move electronic device 100 and can learn an indoor map during movement.

[0110] During operation S620, processor 130 can identify the initial projection position. For example, when a content projection command is received, processor 130 identifies the initial projection position based on at least one of the user's position or the projection surface. However, this disclosure is not limited thereto, and processor 130 can also identify the initial projection position based on a user command.

[0111] When content is projected from the initial projection position, in operation S630, the processor 130 may determine the mobile electronic device 100. For example, when projecting content from the initial projection position, the processor 130 may determine the mobile electronic device 100 based on at least one of the following: the charging state of the electronic device 100, the temperature of the electronic device 100, the type of content, the number of users around the electronic device 100, or the location of the users.

[0112] In operation S640, processor 130 can set destination coordinates corresponding to the position to be moved to, and in operation S650, it determines whether there are obstacles on the movement path. For example, processor 130 identifies the edges corresponding to the movement direction of electronic device 100 in the left and right edges of the projection area of ​​the projected content, identifies the distance from the initial projection position to the projection surface, identifies the distance from the initial projection position to the identified edges based on the radial angle of projector 110, and identifies the position to be moved to based on the identified distances. The distance from the destination position to the identified edges can be equal to or greater than the distance from the initial projection position to the identified edges.

[0113] During operation S660, processor 130 can identify the optimal movement path and the projection angle on the path. For example, if there are no obstacles on the movement path to the destination corresponding to the desired location, processor 130 identifies the straight-line distance as the optimal movement path, and when obstacles exist, it can identify the shortest path to the destination as the optimal movement path while avoiding the obstacles. When obstacles exist, processor 130 can avoid obstacles by increasing the distance from the mobile electronic device 100 to the identified edge.

[0114] The processor 130 can identify the projection angle of each position at preset intervals along the optimal movement path. The preset interval can be determined based on the computing speed of the electronic device 100, the movement speed of the electronic device 100, etc.

[0115] For example, the processor 130 identifies a first projection angle at a first position based on a first position on the optimal movement path, and identifies a second projection angle at a second position based on a second position on the optimal movement path.

[0116] The projection angle includes the azimuth and elevation angles at each location, and the processor 130 can identify the azimuth angle at each location based on the distance from each location to the projection surface, the distance from the initial projection location to each location, and the direction of movement of the electronic device 100, and can identify the elevation angle at each location based on the distance from the initial projection location to the projection surface, the elevation angle at the initial projection location, and the azimuth angle at each location.

[0117] During operation S670, processor 130 can calculate projection screen correction values ​​along the movement path. For example, processor 130 scales the content based on the distance from the initial projection position to the projection surface, the distance from the initial projection position to each position, the radial angle of projector 110, and the azimuth angle at each position.

[0118] In operation S680, processor 130 can control projector 110 to project onto screen when mobile electronic device 100 is in use. As described above, the projection angle and the scaling of the content at each location can be varied.

[0119] During operation S690, processor 130 can identify whether obstacles exist during movement and projection operations. When a new obstacle is found on the optimal movement path, processor 130 can change the optimal movement path, and when no obstacle is found, processor 130 can maintain the existing operation.

[0120] During operation S695, the processor 130 can identify whether the screen is projected well. For example, the processor 130 identifies a first area of ​​content projected onto the projection surface via the camera 195 at the initial projection position, identifies a second area of ​​content projected onto the projection surface during the process of moving to the optimal movement path and the projection process, and identifies whether the error between the first area and the second area is less than a preset error.

[0121] When the error between the first region and the second region is less than a preset error, the processor 130 can maintain the existing operation, and when the error between the first region and the second region is equal to or greater than the preset error, the content scaling operation can be re-executed.

[0122] Furthermore, while the operation of processor 130 learning an indoor map has been described above, this disclosure is not limited thereto. For example, processor 130 identifies an initial projection position relative to a projection surface, identifies destination coordinates relative to the initial projection position or the projection surface based on a movement decision, and identifies a projection angle based on the destination coordinates.

[0123] Figures 7 to 9 This is a view provided to explain the operations of identifying the position to be moved to and the projection angle according to various embodiments of this disclosure. For ease of explanation, Figures 7 to 9 The electronic device 100 is shown moving from a first position A to a second position B while projecting first content.

[0124] Reference Figures 7 to 9 The processor 130 can control the projector 110 to project the first content at the first position A. In this case, the center of the horizontal axis of the projection area on the projection surface where the first content is projected can be Q, and the right edge of the projection area where the first content is projected can be Q'.

[0125] When a repositioning is required, the processor 130 can identify which of the left and right edges Q' of the projection area on the projection surface corresponds to the movement direction of the electronic device 100, and identify a second position B based on the identified edge. For example, when a repositioning is required, because the movement direction of the electronic device 100 is to the right of the left and right edges of the projection area on the projection surface, the processor 130 identifies the right edge Q' as a reference point. Subsequently, the processor 130 can identify the distance from the first position A to the projection surface. And based on the radial angle of the projector 110 Identify the distance from the first position A to the right edge Q'. The processor 130 can identify a second position B, wherein the distance from the second position B to the right edge Q' is equal to or greater than the distance from the first position A to the right edge Q'. For example, the processor 130 can identify a second position B, wherein the distance from the second position B to the right edge Q' is equal to the distance from the first position A to the right edge Q'.

[0126] Through this operation, even when the electronic device 100 projects a second content in the form of a screen that changes the first content at the second position B, the projection area can be consistently maintained. For example, as Figure 8 As shown on the left, processor 130 projects first content 810 at first position A. Figure 8 As shown on the upper right side, when the projection angle at the second position B is identified by referring to the center Q of the horizontal axis 820 of the projection area, the entire area of ​​the projector 110 projecting light on the projection surface can change from 830-1 to 830-2. In other words, area 830-2 may not include... Figure 8 The upper right and lower right portions of the projection area of ​​the first content shown on the left. On the other hand, as... Figure 8 As shown on the lower right side, when the projection angle at the second position B is identified with reference to the right edge 840 Q', the entire area of ​​the projector 110 projecting light onto the projection surface can change from 850-1 to 850-2. In other words, area 850-2 can include all projection areas of the first content, such as... Figure 8 On the left side.

[0127] Reference Figure 7The illustration shows the determination of the projection angle with reference to the right edge Q', but this disclosure is not limited thereto. For example, the processor 130 identifies an edge corresponding to the direction of movement of the electronic device 100 in the left and right edges of the projection area on the projection surface that projects the first content, and identifies a second position based on a point to which a margin is added to the identified edge. For example, the processor 130 may identify a right edge Q' corresponding to the direction of movement of the electronic device 100 in the left and right edges Q' of the projection area on the projection surface that projects the first content, and identify a second position based on a point further to the right than the right edge Q'.

[0128] The processor 130 can also identify margins based on the distance traveled by the electronic device 100. For example, as the distance traveled by the electronic device 100 increases, the entire area of ​​the projected light from the projector 110 becomes increasingly distorted, and the projection angle also decreases. Therefore, as the distance traveled by the electronic device 100 increases, the processor 130 can increase the margin added to the identified edges.

[0129] Once the second position B is determined, the processor 130 can identify the projection angle at the second position B based on the second position B. The projection angle may include the azimuth angle at the second position B and the elevation angle at the second position B.

[0130] first, Figure 7 Describe how to calculate the azimuth angle. Figure 9 Describe how to calculate the elevation angle.

[0131] Processor 130 can base its decisions on the distance from the first position A to the projection surface. The distance from position A to position B and the direction of movement of electronic device 100 Identify the azimuth angle at the second position B. The distance from the first position A to the projection surface It can be a value obtained via sensor 140, and the distance from the first position A to the second position B. and the direction of movement of electronic device 100 It could be the value calculated when identifying the second position B.

[0132] For example, processor 130 obtains the azimuth angle at the second position B via the following mathematical equation. .

[0133]

[0134]

[0135]

[0136]

[0137] Processor 130 can base its decisions on the distance from the first position A to the projection surface. The elevation angle at position A. and the azimuth at the second position B. Identify the elevation angle at the second position B. The distance from the first position A to the projection surface It can be the value obtained via sensor 140, the elevation angle at the first position A. It can be a value known via driver 120, and the azimuth angle at the second position B. It can be via Figure 7 The value obtained.

[0138] For example, processor 130 identifies the elevation angle at the second position B via the following mathematical equation. .

[0139]

[0140]

[0141]

[0142] Through the above process, the processor 130 can identify the azimuth angle at the second position B. and elevation angle .

[0143] According to an embodiment, the processor 130 can identify the second position B to calculate only the azimuth angle. Instead of calculating the azimuth angle at the second position B. and elevation angle Both. In other words, the processor 130 can identify the second position B, such that the elevation angle at the first position A and the azimuth angle at the second position B remain the same.

[0144] Figures 10 to 14 This is a view provided to explain the operation of changing the first content in the form of a screen according to various embodiments of this disclosure.

[0145] For ease of explanation, Figures 10 to 14 The electronic device 100 is described as moving, such as Figure 7 As described in [the text].

[0146] Reference Figure 10 , Figure 10 The top shows the first overall area on the projection surface where the projector 110 projects light when the electronic device 100 is in the first position A, and Figure 10The bottom shows a second overall area on the projection surface where the projector 110 projects light when the electronic device 100 is in the second position B, wherein, Figure 10 The bottom can have a higher degree of... Figure 10 The top has a larger area.

[0147] First, describe the horizontal axis. The distance from the center of the horizontal axis of the first overall region to the right edge is... The distance from the center of the horizontal axis of the second overall region to the right edge is And the distance from the center of the horizontal axis of the second overall region to the left edge is ,in, and Each of them can be greater than .

[0148] Processor 130 can be based on and Each of them with The ratio changes the horizontal screen format of the primary content. (Refer to...) Figure 11 The processor 130 can be obtained through the following mathematical equations. and The ratio A and and The ratio B.

[0149]

[0150] By reference Figure 12 Describe the vertical axis; the distance from the center of the vertical axis of the first overall region to the top edge can be... The distance from the center of the vertical axis of the second overall region to the upper right edge can be The distance from the center of the vertical axis of the second overall region to the upper left edge can be And the distance from the center of the vertical axis of the second overall region to the upper edge can be .

[0151] Processor 130 can be based on and Each of them with The ratio changes the vertical screen format of the primary content. For example, refer to... Figure 13 The processor 130 obtains the following mathematical equations respectively. and The ratio C and and The ratio D.

[0152]

[0153]

[0154]

[0155]

[0156] like Figure 14 As shown, the processor 130 can obtain second content by changing the screen form of the first content based on multiple ratios A, B, C, and D.

[0157] However, Figures 10 to 14 Assume only the azimuth angle is changed, not the elevation angle. Therefore, when both the elevation and azimuth angles change, additional operations are required, but the operations for correcting the azimuth angle and those for correcting the elevation angle can be distinguished. Furthermore, the elevation angle operation can be handled in a similar manner to the azimuth angle operation by rotating the coordinates. Therefore, the processor 130 can perform operations such as... by rotating the coordinates to obtain A', B', C', and D'. Figures 10 to 14 The method shown.

[0158] The processor 130 can obtain second content by changing the screen form of the first content based on a plurality of first ratios A, B, C and D associated with the azimuth angle and a plurality of second ratios A', B', C' and D' associated with the elevation angle.

[0159] For example, processor 130 performs a change operation via the following mathematical equation.

[0160]

[0161]

[0162]

[0163]

[0164]

[0165]

[0166]

[0167]

[0168] In this manner, the processor 130 can change the screen form of the first content in response to changes in azimuth and elevation angles, and can consistently maintain the projection area of ​​the content projection on the projection surface.

[0169] Figures 15 to 24 This is a view provided to explain the reasons for movement according to various embodiments of this disclosure.

[0170] The processor 130 can identify the charging status of the electronic device 100, and when it is identified that the electronic device 100 needs to be charged, the processor 130 can change the position of the electronic device 100.

[0171] Reference Figure 15 The processor 130 can identify the charging status of the electronic device 100 when projecting content, and when the charging status of the battery included in the electronic device 100 is less than a preset ratio, the processor 130 can control the driver 120 to move to the charging dock.

[0172] The processor 130 can detect the temperature of the electronic device 100, and change the position of the electronic device 100 when the temperature of the electronic device 100 rises above a preset value.

[0173] Reference Figure 16 The processor 130 can identify the temperature of the electronic device 100 when projecting content, and when the temperature of the electronic device 100 is identified to be equal to or greater than 60°C, the processor 130 can control the driver 120 to move the electronic device 100.

[0174] When the electronic device 100 is moved based on its temperature, the processor 130 can obtain captured images of the surrounding environment of the electronic device 100 by taking pictures of the camera 195, and control the driver 120 to move the electronic device 100 to a relatively open area.

[0175] Optionally, when the electronic device 100 is moved based on its temperature, the processor 130 may identify the temperature around the electronic device 100 via a thermal imaging camera and control the driver 120 to move the electronic device 100 to a location with a lower temperature.

[0176] The processor 130 can change the position of the electronic device 100 based on the user near the electronic device 100.

[0177] Reference Figure 17The processor 130 can identify a user near the electronic device 100, identify a projection surface based on the identified user, and control the driver 120 to move the electronic device 100 to a position for projecting content onto the identified projection surface. In this case, the processor 130 can identify the user via a sensor 140, a communication interface 150, a microphone 185, a camera 195, etc. However, this disclosure is not limited to this; the processor 130 can also identify at least one of the number of users or the location of users in any number of ways.

[0178] The processor 130 can control the driver 120 to move the electronic device 100 based on the user's location. For example, the processor 130 controls the driver 120 to move the electronic device 100 closer to the user. As a result, the electronic device 100 can provide the user with higher quality sound. Optionally, the electronic device 100 can more clearly recognize the user's spoken speech.

[0179] While projecting content and providing sound to the user, the processor 130 can also control the driver 120 to move the electronic device 100 based on the user's location.

[0180] Reference Figure 18 When the processor 130 is projecting cooking content and providing voice instructions to the user, as the user's position changes during the cooking process, the processor 130 can control the driver 120 to move the electronic device 100 based on the change in the user's position. In other words, the processor 130 can control the driver 120 to move the electronic device 100 based on at least one of the type of content being output or the user's position.

[0181] The processor 130 can control the driver 120 and the mobile electronic device 100 based on the user's context.

[0182] Reference Figure 19 The processor 130 can identify the user's context based on the operating state of at least one of the communication interface 150 or the camera 195, and when the user's context is identified as a preset situation, it can control the driver 120 to move the electronic device 100 based on the user's position. For example, the processor 130 can capture a picture of the user via the camera 195 and provide the captured image to an external server. When streaming the image from the external server and simultaneously projecting the streaming image, the processor 130 can identify that the user is currently in a video conference and control the driver 120 to move the electronic device 100 closer to the user in order to provide high-quality video and sound to the other party.

[0183] The processor 130 can also control the driver 120 to move the electronic device 100 based on the content type of the electronic device 100 or the surrounding sound.

[0184] Reference Figure 20When content requires a user's voice command, but the surrounding environment of the electronic device 100 is noisy, the processor 130 can control the driver 120 to move the electronic device 100 closer to the user.

[0185] The processor 130 can also control the driver 120 to move the electronic device 100 based on at least one of the number of users or the location of the users.

[0186] Reference Figure 21 When a new user is identified near the electronic device 100, the processor 130 can control the driver 120 to move the electronic device 100 to a position that provides the best sound for both the existing and new users.

[0187] The processor 130 can also control the driver 120 to move the electronic device 100 in response to a potential malfunction of the electronic device 100.

[0188] Reference Figure 22 When a collision with a user is anticipated, the processor 130 can control the driver 120 to move the electronic device 100 to a position that minimizes the likelihood of a collision with the user. However, this disclosure is not limited to this, and the processor 130 can also control the driver 120 to move the electronic device 100 from a position exposed to direct sunlight to a position away from direct sunlight.

[0189] Reference Figure 23 The processor 130 can project a photo area or preview it, and can also control the driver 120 to move the electronic device 100 based on additional user recognition, changes in posture, etc.

[0190] Reference Figure 24 The projector 110 includes a first projector and a second projector, and the processor 130 can control the first projector to project first content onto a projection surface, and control the second projector to project third content onto another projection surface. The third content includes a control screen for controlling the first content, and the processor 130 can control the driver 120 to move the electronic device 100 to a position in front of the user to provide the control screen. In other words, the processor 130 can control the driver 120 to move the electronic device 100 based on the area of ​​the third content projected onto the other projection surface and the user's position.

[0191] Figure 25 This is a view provided to explain the situation of an obstacle being identified during movement according to embodiments of this disclosure.

[0192] Reference Figure 25When it is detected that the electronic device 100 is moving, the processor 130 can identify a second location and an optimal movement path based on obstacles around the electronic device 100. For example, when it is detected that the electronic device 100 is moving, the processor 130 can identify a second location where there are no obstacles on the movement path.

[0193] The processor 130 can identify new obstacles as it moves from the first position to the second position. These new obstacles may be those that did not exist prior to determining the second position and the optimal path of movement.

[0194] When a new obstacle is detected while the electronic device 100 is moving, the processor 130 can change the movement path to one that increases the distance from the electronic device 100 to the detected edge. This is because if the movement path is changed to one that decreases the distance from the electronic device 100 to the detected edge, the total area of ​​light projected by the projector 110 on the projection surface may be reduced, and the projection area of ​​the projected content may not be maintained.

[0195] Figure 26 This is a flowchart provided to explain the control method of an electronic device according to an embodiment.

[0196] Reference Figure 26 In operation S2610, the first content is projected onto the projection surface. Then, in operation S2620, as the electronic device moves from the first position to the second position, the projection angle of the projection surface is identified based on the second position. In operation S2630, based on the second position and the projection angle, a second content whose screen format of the first content has been changed is obtained. Then, in operation S2640, as the electronic device moves from the first position to the second position, the second content is projected onto the projection surface.

[0197] The method may further include: identifying edges corresponding to the direction of movement of the electronic device in the left and right edges of the projection area of ​​the first content, and identifying a second position based on the identified edges.

[0198] The step of identifying the second position may include: identifying the distance from the first position to the projection surface; identifying the distance from the first position to the identified edge based on the radial angle of the projector included in the electronic device; and identifying the second position based on the identified distance.

[0199] Furthermore, the distance from the second position to the identified edge can be equal to or greater than the distance from the first position to the identified edge.

[0200] The projection angle includes the azimuth angle at the second position and the elevation angle at the second position, and the step of identifying the projection angle (S2620) may include: identifying the azimuth angle at the second position based on the distance from the first position to the projection surface, the distance from the first position to the second position, and the direction of movement of the electronic device, and identifying the elevation angle at the second position based on the distance from the first position to the projection surface, the elevation angle at the first position, and the azimuth angle at the second position.

[0201] Furthermore, obtaining step S2630 may include scaling the second content based on the distance from the first position to the projection surface, the distance from the first position to the second position, the radial angle of the projection, and the azimuth angle at the second position.

[0202] The method may further include: identifying multiple third positions on the path from the first position to the second position, and performing operations such as identifying the projection angle, changing the screen format, and projection at each of the multiple third positions.

[0203] In addition, the method may also include: identifying that the electronic device is moving from a first location to a second location based on at least one of the following: the charging state of the electronic device, the temperature of the electronic device, the type of the first content, the number of users around the electronic device, or the location of the users.

[0204] The projection steps may include: controlling a first projector included in an electronic device to project first content onto a projection surface, and controlling a second projector included in an electronic device to project third content onto another projection surface.

[0205] The third content may also include a control screen for controlling the first content, and the control method may further include: identifying a second location such that the control screen is provided in front of the user.

[0206] Furthermore, the area on the projection surface corresponding to the first content can overlap with the area on the projection surface corresponding to the second content by less than a preset error.

[0207] According to the various embodiments described above, when the electronic device moves, it can change the projection angle and screen format of the content so that even when the electronic device moves, it remains in the area of ​​the projected content on the projection surface, thereby enhancing the user's sense of immersion.

[0208] Furthermore, according to embodiments, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). A machine refers to a device that invokes instructions stored in the storage medium and is operable according to the invoked instructions, and this device may include an electronic device (e.g., electronic device (A)) according to the foregoing embodiments. When the instructions are executed by a processor, the processor may perform the function corresponding to the instructions itself, or, under the control of the processor, perform the function corresponding to the instructions by using other components. Instructions may include code generated by a compiler or code executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory" means that the storage medium is tangible and does not include signals, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0209] Furthermore, according to embodiments, the methods described above according to various embodiments may be included and provided in the computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)) or through an app store (e.g., the Play Store). TM Online distribution. In the case of online distribution, at least a portion of the computer program product may be stored, at least temporarily, in a storage medium (such as the manufacturer's server, the app store's server, or the memory of a forwarding server), or at least a portion of the computer program product may be temporarily generated.

[0210] Furthermore, according to embodiments, the various embodiments described above can be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination of software and hardware. In some cases, the embodiments described herein can be implemented by the processor itself. According to software implementation, embodiments such as the processes and functions described in this specification can be implemented as separate software. Each software can perform one or more functions and operations described in this disclosure.

[0211] Furthermore, computer instructions for performing processing operations of the apparatus according to the various embodiments described above may be stored in a non-transitory computer-readable medium. When executed by a processor of a particular apparatus, the computer instructions stored in such a non-transitory computer-readable medium allow the particular apparatus to perform the processing operations in the apparatus according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time (such as registers, caches, and memories). Specific examples of non-transitory computer-readable media may include CDs, digital versatile discs (DVDs), hard disks, Blu-ray discs, USB drives, memory cards, ROMs, etc.

[0212] Furthermore, components (e.g., modules or programs) according to the various embodiments described above may include a single entity or multiple entities, and some of the corresponding sub-components may be omitted, or other sub-components may be further included in the various embodiments. Optionally or additionally, some components (e.g., modules or programs) may be integrated into one entity and perform the same or similar functions performed by each corresponding component prior to integration. Operations performed by modules, programs, or other components according to the various embodiments may be performed sequentially, in parallel, iteratively, or heuristically, or at least some of the operations may be performed in a different order or omitted, or other operations may be added.

[0213] Although this disclosure has been shown and described with reference to various embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made therein without departing from the spirit and scope of this disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising: Projector; drive; Memory, which stores one or more computer programs; as well as One or more processors are communicatively coupled to the projector, the driver, and the memory. The one or more computer programs include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: The projector is controlled to project the first content onto the projection surface. Based on the electronic device moving from a first position to a second position, and based on the second position identifying the projection angle of the projection surface, The second content is obtained by changing the screen format of the first content based on the second position and the projection angle, and The electronic device controls the driver to move from a first position to a second position, thereby controlling the projector to project the second content onto the projection surface.

2. The electronic device as claimed in claim 1, wherein, The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: Identify the edges corresponding to the direction of movement of the electronic device in the left and right edges of the projection area on the projection surface where the first content is projected, and The second location is identified based on the identified edge.

3. The electronic device of claim 2, further comprising: sensor, The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: The distance from the first position to the projection surface is identified by the sensor. Based on the radial angle of the projector, the distance from the first position to the identified edge is identified, and The second location is identified based on the distance detected.

4. The electronic device as claimed in claim 3, wherein, The distance from the second position to the identified edge is equal to or greater than the distance from the first position to the identified edge.

5. The electronic device as claimed in claim 1, in, The projection angle includes the azimuth angle at the second position and the elevation angle at the second position, and The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: Based on the distance from the first position to the projection surface, the distance from the first position to the second position, and the direction of movement of the electronic device, the azimuth angle at the second position is identified, and The elevation angle at the second position is identified based on the distance from the first position to the projection surface, the elevation angle at the first position, and the azimuth angle at the second position.

6. The electronic device as claimed in claim 5, wherein, The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: The second content is scaled based on the distance from the first position to the projection surface, the distance from the first position to the second position, the radial angle of the projector, and the azimuth angle at the second position.

7. The electronic device as claimed in claim 1, in, The driver includes: A first driver, configured to move the electronic device; and The second driver is configured to control the projection direction of the projector, and The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: Control the first driver to move the electronic device from a first position to a second position, and Based on the electronic device being located in the second position, the second driver is controlled so that the projector projects the second content based on the projection angle.

8. The electronic device as claimed in claim 1, wherein, The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: Identify multiple third locations in the path from the first location to the second location, and At each of the plurality of third positions, operations such as identifying the projection angle, changing the screen format, and projection are performed.

9. The electronic device as claimed in claim 1, wherein, The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: Based on at least one of the following: the charging status of the electronic device, the temperature of the electronic device, the type of the first content, the number of users around the electronic device, or the location of the users, it is identified that the electronic device is moving from a first location to a second location.

10. The electronic device of claim 1, wherein, The projector includes: First projector; and Second projector, The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: Control the first projector to project the first content onto the projection surface, and Control the second projector to project the third content onto another projection surface.

11. The electronic device as claimed in claim 10, in, The third content includes a control screen for controlling the first content, and The one or more computer programs further include computer-executable instructions that, when executed individually or jointly by the one or more processors, cause the electronic device to perform the following operations: identify a second location, causing the control screen to be presented in front of the user.

12. The electronic device of claim 1, wherein, The overlap between the area corresponding to the first content and the area corresponding to the second content on the projection surface is less than a preset error.

13. A method performed by an electronic device, comprising: The electronic device projects the first content onto the projection surface; Based on the electronic device moving from the first position to the second position, the electronic device identifies the projection angle of the projection surface based on the second position; The electronic device obtains the second content by changing the screen format of the first content based on the second position and the projection angle; as well as The electronic device moves from a first position to a second position by controlling a driver, and then projects the second content onto the projection surface.

14. The method of claim 13, further comprising: Identify the edges corresponding to the direction of movement of the electronic device in the left and right edges of the projection area on the projection surface where the first content is projected; as well as The second location is identified based on the identified edge.

15. The method of claim 14, wherein, The steps for identifying the second location include: Identify the distance from the first position to the projection surface; Based on the radial angle of the projector included in the electronic device, the distance from the first position to the identified edge is identified; and The second location is identified based on the distance detected.

Images