Electronic apparatus for cutting and projecting image and method for controlling the same
By integrating sensors and processors in electronic devices, automatically identifying and cropping images to adapt to irregular projection surfaces, the problem of difficulty in automatic adjustment of existing projectors is solved, and a better projection effect is achieved.
Patent Information
- Application Number
- CN202380049254.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-09-28
- Filing Date
- 2023-05-25
- Publication Date
- 2025-02-11
AI Technical Summary
Existing projectors have difficulty automatically identifying and cropping images to adapt to irregular projection surfaces, resulting in poor projection effects.
An electronic device is designed, equipped with a sensor, a processor and a projection unit, and obtains information on the projection surface through the sensor. The processor identifies the region of interest and crops the image to adapt to the shape and size of the projection surface.
It realizes automatic identification and adaptation to projection surfaces of different shapes and sizes, and improves the clarity and projection effect of the projected image.
Smart Images

Figure CN119422370A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device for obtaining a projection image by cropping a portion of an image and projecting the obtained projection image onto a projection surface and a control method thereof. Background Art
[0002] The projector can perform basic correction operations to project an optimal image to the user. In detail, the basic correction operation may indicate a function of adjusting a projection ratio, resolution, brightness, focus, etc., or a function of changing an image, such as keystone correction. Summary of the invention
[0003] Technical issues
[0004] According to an embodiment of the present disclosure, an electronic device is provided, comprising: at least one sensor; a projection unit for projecting an image; a memory for storing at least one instruction; and at least one processor, wherein the at least one processor is configured to obtain information about a projection surface using the at least one sensor. The at least one processor is configured to identify a first region of interest in an image to be projected on the projection surface. The at least one processor is configured to obtain a projected image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest. The at least one processor is configured to control the projection unit to project the projection image on the projection surface.
[0005] According to an embodiment of the present disclosure, a method for controlling an electronic device is provided, the method comprising obtaining information about a projection surface using at least one sensor. The method comprises identifying a first region of interest in an image to be projected on the projection surface. The method comprises obtaining the projection image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest. The method comprises projecting the projection image onto the projection surface.
[0006] According to an embodiment of the present disclosure, there is provided a non-transitory computer-readable recording medium including a program for executing a method for controlling an electronic device, wherein the method includes obtaining information about a projection surface using at least one sensor. The method includes identifying a first region of interest in an image to be projected on the projection surface. The method includes obtaining a projection image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest. The method includes projecting the projection image onto the projection surface.
[0007] Technical Solution
[0008] According to an embodiment of the present disclosure, an electronic device is provided, comprising: at least one sensor; a projection unit for projecting an image; a memory for storing at least one instruction; and at least one processor, wherein the at least one processor is configured to obtain information about a projection surface using the at least one sensor. The at least one processor is configured to identify a first region of interest in an image to be projected on the projection surface. The at least one processor is configured to obtain a projected image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest. The at least one processor is configured to control the projection unit to project the projection image on the projection surface.
[0009] According to an embodiment of the present disclosure, a method for controlling an electronic device is provided, wherein the method includes obtaining information about a projection surface using at least one sensor. The method includes identifying a first region of interest in an image to be projected on the projection surface. The method includes obtaining a projection image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest. The method includes projecting the projection image onto the projection surface.
[0010] According to an embodiment of the present disclosure, there is provided a non-transitory computer-readable recording medium including a program for executing a method for controlling an electronic device, wherein the method includes obtaining information about a projection surface using at least one sensor. The method includes identifying a first region of interest in an image to be projected on the projection surface. The method includes obtaining a projection image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest. The method includes projecting the projection image onto the projection surface. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 is a perspective view showing an appearance of an electronic device according to various embodiments of the present disclosure.
[0012] Figure 2 is a block diagram illustrating a configuration of an electronic device according to various embodiments of the present disclosure.
[0013] Figure 3 is a block diagram illustrating a detailed configuration of an electronic device according to various embodiments of the present disclosure.
[0014] Figure 4 is a perspective view showing an appearance of an electronic device according to various embodiments of the present disclosure.
[0015] Figure 5 is a perspective view showing an appearance of an electronic device according to various embodiments of the present disclosure.
[0016] Figure 6 is a perspective view showing an appearance of an electronic device according to various embodiments of the present disclosure.
[0017] Figure 7 is a perspective view showing an appearance of an electronic device according to various embodiments of the present disclosure.
[0018] Figure 8 is a perspective view showing an appearance of an electronic device according to various embodiments of the present disclosure.
[0019] Fig. 9 is a perspective view showing an appearance of an electronic device according to various embodiments of the present disclosure.
[0020] Fig.10 is a flowchart for explaining a method for an electronic device to obtain information about a projection surface according to various embodiments of the present disclosure.
[0021] Fig.11 is a view for explaining a method for an electronic device to obtain information about a projection surface according to various embodiments of the present disclosure.
[0022] Fig.12 is a flowchart for explaining a method for an electronic device to crop an image according to various embodiments of the present disclosure.
[0023] Figures 13a to 13c is a view for explaining a method for an electronic device to recognize a region of interest according to various embodiments of the present disclosure.
[0024] Fig.14 is a flowchart for explaining a method for an electronic device to crop an image according to various embodiments of the present disclosure.
[0025] Fig.15a and Fig.15b is a view for explaining a method for an electronic device to crop an image according to various embodiments of the present disclosure.
[0026] Figures 16a to 16c is a view for explaining a method for an electronic device to crop an image according to various embodiments of the present disclosure.
[0027] Fig.17 is a flowchart for explaining a method for an electronic device to crop an image according to various embodiments of the present disclosure.
[0028] Figures 18a to 18eis a view for explaining a method for an electronic device to project an image according to various embodiments of the present disclosure.
[0029] Figures 19a to 19c is a view for explaining a method for an electronic device to crop an image according to various embodiments of the present disclosure.
[0030] Fig. 20 is a flowchart for explaining a method of projecting an image on a pre-identified projection surface according to various embodiments of the present disclosure.
[0031] Fig.21 is a view for explaining a method of setting a crop area according to various embodiments of the present disclosure.
[0032] Figures 22a to 22c is a view for explaining a method for an electronic device to project an image while avoiding an obstacle according to various embodiments of the present disclosure.
[0033] Fig.23 is a view for explaining a method for an electronic device to project an image based on an image type according to various embodiments of the present disclosure. DETAILED DESCRIPTION
[0034] Figure 1 is a perspective view showing the appearance of an electronic device 100 according to various embodiments of the present disclosure.
[0035] Reference Figure 1 , the electronic device 100 may include a projection lens 101 , a head 103 , a body 105 , a cover 107 , or a connector 130 .
[0036] The electronic device 100 may be any of various types of devices. Specifically, the electronic device 100 may be a projector device that magnifies and projects an image on a wall or a screen, and the projector device may be a liquid crystal display (LCD) projector or a digital light processing (DLP) type projector using a digital micromirror device (DMD).
[0037] In addition, the electronic device 100 may be a home display device or an industrial display device, a lighting device used in daily life, or an audio device including a sound module, or may be implemented as a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a wearable device, a home appliance, etc. In addition, the electronic device 100 according to various embodiments of the present disclosure is not limited to the above-mentioned devices, and may be implemented as an electronic device 100 having two or more functions of the above-mentioned devices. For example, the electronic device 100 may be used as a display device, a lighting device, or an audio device by turning off a projector function of the electronic device 100 and turning on a lighting function or a speaker function of the electronic device 100 based on manipulation of a processor, and may be used as an artificial intelligence (AI) speaker by including a microphone or a communication device.
[0038] The projection lens 101 may be arranged on one surface of the body 105 and project light passing through the lens array to the outside of the body 105. The projection lens 101 in various embodiments may be an optical lens coated with low dispersion to reduce chromatic aberration. The projection lens 101 may be a convex lens or a condenser lens, and the projection lens 101 according to various embodiments may adjust the focus by adjusting the positions of the plurality of sub-lenses.
[0039] The head 103 may be coupled to one surface of the body 105 so as to support and protect the projection lens 101. The head 103 may be coupled to the body 105 to swivel within a predetermined angle range based on one surface of the body 105.
[0040] The head 103 may be automatically or manually rotated by a user or a processor to freely adjust the projection angle of the projection lens 101. Alternatively, although not shown in the drawings, the head 103 may be coupled to the body 105 and include a neck extending from the body 105, and the head 103 may be tilted or inclined to adjust the projection angle of the projection lens 101.
[0041] The main body 105 is a housing constituting an exterior appearance, and may support or protect components of the electronic device 100 (eg, Figure 3 The main body 105 may have a Figure 1 However, the shape of the body 105 is not limited thereto, and according to various embodiments of the present disclosure, the body 105 may be implemented in various geometric shapes such as a column having a polygonal cross-section, a cone, or a sphere.
[0042] The body 105 may have a size that enables the body to be grasped or moved by a user with his / her one hand, or may be implemented in a miniature size that enables the body to be easily carried or a size that enables the body to be held on a table or combined with a lighting device.
[0043] The material of the main body 105 may be matte metal or synthetic resin so that the user's fingerprints or dust will not stain the main body. Optionally, the appearance of the main body 105 may be made of a smooth glossy material.
[0044] The body 105 may have a friction area arranged on a partial area of the exterior of the body 105 to be gripped and moved by a user. Optionally, the body 105 may have a folded grip portion or support 108a (see Figure 4 ), which gripping portion or support 108a is arranged in at least a partial area and can be gripped by a user.
[0045] The electronic device 100 can project light or an image to a desired position by adjusting the direction of the head 103 while the position and angle of the body 105 are fixed, and by adjusting the projection angle of the projection lens 101. In addition, the head 103 may include a handle that the user can grasp after rotating the head in a desired direction.
[0046] A plurality of openings may be arranged in the outer circumferential surface of the body 105. Audio output from the audio output unit may be output to the outside of the body 105 of the electronic device 100 through the plurality of openings. The audio output unit may include a speaker, and the speaker may be used for general purposes such as reproduction of multimedia or reproduction of recordings and output of voice.
[0047] According to various embodiments of the present disclosure, the body 105 may include a heat dissipation fan (not shown) disposed therein, and if the heat dissipation fan (not shown) is driven, air or heat in the body 105 may be discharged through the plurality of openings. Therefore, the electronic device 100 may discharge heat generated by driving the electronic device 100 to the outside, and prevent the electronic device 100 from overheating.
[0048] The connector 130 can connect the electronic device 100 to an external device to send or receive electronic signals, or receive power from an external device. The connector 130 according to various embodiments of the present disclosure can be physically connected to an external device. Here, the connector 130 may include an input / output interface to connect the connector 130 to an external device in a wired or wireless manner, or to receive power from an external device. For example, the connector 130 may include a high-definition multimedia interface (HDMI) connection terminal, a universal serial bus (USB) connection terminal, a secure digital (SD) card receiving slot, an audio connection terminal, or a power socket. Optionally, the connector 130 may include a Bluetooth, wireless fidelity (Wi-Fi) or wireless charging connection module that is connected to an external device in a wireless manner.
[0049] In addition, the connector 130 may have a socket structure connected to an external lighting device, and may be connected to a socket receiving groove of the external lighting device to receive power. Considering the receiving structure of the external device that can be coupled to the connector 130, the size and specification of the connector 130 having a socket structure can be implemented in various ways. For example, according to the international standard E26, the diameter of the joint of the connector 130 can be 26 mm, and in this case, the electronic device 100 can be coupled to an external lighting device, such as a bracket that replaces a commonly used light bulb. In addition, in the case of being connected to a socket located on an existing ceiling, the electronic device 100 having a structure that projects an image from the top to the bottom may not be rotated by being coupled to the socket, and in this case, the screen may also not be rotated. Therefore, the electronic device 100 can project or rotate the screen to a desired position while the socket is coupled to the bracket on the ceiling by allowing the head 103 to rotate to the adjusted projection angle on one surface of the body 105, so that the electronic device 100 can rotate even when the socket is coupled and receives power.
[0050] The connector 130 may include a coupling sensor, and the coupling sensor may sense whether the connector 130 and the external device are coupled to each other or their coupling states or coupling targets and transmit it to the processor, and the processor may control the operation of the electronic device 100 based on the received detection value.
[0051] The cover 107 may be coupled to or separated from the body 105, and protect the connector 130 so that the connector 130 is not always exposed to the outside. The cover 107 may have a Figure 1 The shape shown is continued from the shape of the body 105, or may be implemented to correspond to the shape of the connector 130. The cover 107 may support the electronic device 100, and the electronic device 100 may be used by being coupled to an external holder or being held on an external holder while being coupled to the cover 107.
[0052] In the electronic device 100 according to various embodiments, a battery may be disposed within the cover portion 107. The battery may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0053] Although not shown in the drawings, the electronic device 100 may include a camera module, and the camera module may capture still images and moving images. According to various embodiments, the camera module may include at least one lens, an image sensor, an image signal processor, or a flash.
[0054] Although not shown in the figures, the electronic device 100 may include a protective case (not shown) to protect the electronic device 100 and facilitate transportation of the electronic device 100, or include a bracket (not shown) for supporting or fixing the main body 105, or a bracket (not shown) that can be coupled to a wall or a partition.
[0055] In addition, the electronic device 100 can be connected to various external devices by using the socket structure of the electronic device 100, thereby providing various functions. The electronic device 100 according to various embodiments can be connected to an external camera device by using the socket structure. The electronic device 100 can provide an image stored in a camera device connected to the electronic device 100 or an image currently being captured by using the projection unit 112. In another embodiment, the electronic device 100 can be connected to a battery module using the socket structure and powered. In addition, the electronic device 100 can be connected to an external device using the socket structure, which is only one of the various embodiments, and can be connected to an external device using another interface (e.g., USB).
[0056] Figure 2 is a block diagram illustrating a configuration of an electronic device 100 according to various embodiments of the present disclosure.
[0057] Reference Figure 2 , the electronic device 100 may include at least one processor 111 , a projection unit 112 , a memory 113 , and a communication interface 114 .
[0058] At least one processor 111 may perform overall control operations of the electronic device 100. Specifically, at least one processor 111 may be used to control overall operations of the electronic device 100. Figure 3 A detailed description of at least one processor 111 is provided.
[0059] The projection unit 112 may be a component for projecting an image (eg, a projection image or content) to the outside. Figure 3 A detailed description of the projection unit 112 is provided.
[0060] In addition, in the above, only a brief configuration of configuring the electronic device 100 is shown and described. However, in implementation, various configurations may also be provided. Figure 3 Provide its description.
[0061] Figure 3 is a diagram showing various embodiments according to the present disclosure Figure 2 1 is a block diagram of a detailed configuration of the electronic device 100 shown in FIG.
[0062] Reference Figure 3The electronic device 100 may include at least one of a processor 111, a projection unit 112, a memory 113, a communication interface 114, a manipulation interface 115, an input / output interface 116, a speaker 117, a microphone 118, a power supply unit 119, a driving unit 120, or a sensor unit 121.
[0063] in addition, Figure 3 The configuration shown in is only one of various embodiments, some configurations may be omitted from the configuration, and new configurations may be added to the configuration.
[0064] In addition, the referenced Figure 2 Describe the details.
[0065] The processor 111 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) for processing digital signals. However, the processor 111 is not limited thereto and may include at least one of the following items or may be defined by these terms: a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a graphics processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machine (ARM) processor. In addition, the processor 111 may be implemented in a system on chip (SoC) or a large-scale integration (LSI) embedded with a processing algorithm, or may be implemented in the form of a field programmable gate array (FPGA). In addition, the processor 111 may perform various functions by executing computer executable instructions stored in the memory 113.
[0066] The projection unit 112 may be a component for projecting an image to the outside. The projection unit 112 according to various embodiments of the present disclosure may be implemented in any of various projection types (e.g., a cathode ray tube (CRT) type, a liquid crystal display (LCD) type, a digital light processing (DLP) type, or a laser type). As an example, the CRT type may have a principle substantially the same as that of a CRT monitor. The CRT type may display an image on a screen by magnifying the image using a lens in front of the cathode ray tube (CRT). The CRT type may be classified into a single tube type and a three-tube type based on the number of cathode ray tubes, and in the three-tube type, the cathode ray tubes of red, green, and blue may be separated from each other.
[0067] As another example, the LCD type can display an image by allowing light emitted from a light source to pass through liquid crystal. The LCD type can be classified into a single-panel type and a three-panel type. In the case of the three-panel type, the light emitted from the light source can be separated into red, green, and blue in a dichroic mirror (which is a mirror that reflects only light of a specific color and allows the rest of the light to pass), then can pass through the liquid crystal, and then can be collected again to one location.
[0068] As another example, the DLP type can display an image by using a digital micromirror device (DMD) chip. The DLP type projection unit may include a light source, a color wheel, a DMD chip, a projection lens, etc. The light emitted from the light source may be colored when passing through a rotating color wheel. The light passing through the color wheel may be input into the DMD chip. The DMD chip may include many micromirrors and reflect the light input into the DMD chip. The projection lens may expand the light reflected from the DMD chip to an image size.
[0069] As yet another example, the laser type may include a diode pumped solid-state (DPSS) laser and a galvanometer. A laser type that outputs various colors may use a laser in which three DPSS lasers are installed for red, green, and blue (RGB) colors, respectively, and the optical axes of the three DPSS lasers overlap each other by using a special mirror. The galvanometer may include a mirror and a high-power motor, and move the mirror at a high speed. For example, the galvanometer may rotate the mirror at a speed of up to 40kHz / sec. The galvanometer may be installed along the scanning direction, and typically, the projector performs a plane scan, and the galvanometer may therefore also be set by being divided into an x-axis and a y-axis.
[0070] In addition, the projection unit 112 may include various types of light sources. For example, the projection unit 112 may include at least one light source of a lamp, a light emitting diode (LED), or a laser.
[0071] The projection unit 112 can output images with a screen ratio of 4:3, a screen ratio of 5:4, and a wide screen ratio of 16:9 based on the purpose of the electronic device 100, user settings, etc., and can output images with various resolutions (such as wide video graphics array WVGA (854×480 pixels), super video graphics array SVGA (800×600 pixels), extended graphics array XGA (1024×768 pixels), wide extended graphics array WXGA (1280×720 pixels), WXGA (1280×800 pixels), super extended graphics array SXGA (1280×1024 pixels), ultra extended graphics array UXGA (1600×1200 pixels), and full high definition HD (1920×1080 pixels)) based on the screen ratio.
[0072] In addition, the projection unit 112 may perform various functions for adjusting the output image under the control of the processor 111. For example, the projection unit 112 may perform a zoom function, a keystone function, a fast-angle (or four-corner) keystone function, a lens shift function, and the like.
[0073] In detail, the projection unit 112 may enlarge or reduce the image based on the distance of the projection unit 112 from the screen (i.e., the projection distance). That is, the projection unit 112 may perform a zoom function based on the distance of the projection unit 112 from the screen. Here, the zoom function may include a hardware method for adjusting the screen size by moving the lens, a software method for adjusting the screen size by cropping the image, and the like. In addition, in the case of performing the zoom function, it is necessary to adjust the focus of the image. For example, the method for adjusting the focus may include a manual focusing method, an electric focusing method, and the like. The manual focusing method may indicate a method for manually adjusting the focus, and the electric focusing method may indicate a method in which the projector automatically adjusts the focus by using a motor built therein when performing the zoom function. In the case of performing the zoom function, the projection unit 112 may provide a digital zoom function through software, and may provide an optical zoom function for performing the zoom function by moving the lens using the drive unit 120.
[0074] In addition, the projection unit 112 may perform a keystone correction function. If the height does not match the front projection, the screen may be distorted upward or downward. The keystone correction function may be a function of correcting a distorted screen. For example, when the screen is distorted in the horizontal direction, horizontal keystone may be used to correct the distortion, and when the screen is distorted in the vertical direction, vertical keystone may be used to correct the distortion. The fast corner (or four-corner) keystone correction function may be a function of correcting the screen when the balance between the corner areas of the screen is not appropriate while the center area of the screen is normal. The lens shift function may be a function of moving the picture as it is when the picture is outside the screen.
[0075] In addition, the projection unit 112 can provide zoom / keystone / focus functions by automatically analyzing the surrounding environment and the projection environment without user input. In detail, the projection unit 112 can automatically provide zoom / keystone / focus functions based on the distance between the electronic device 100 and the screen detected by a sensor (e.g., a depth camera, a distance sensor, an infrared sensor, or a light sensor), information about the space where the electronic device 100 is currently located, information about the amount of ambient light, etc.
[0076] In addition, the projection unit 112 may provide a lighting function by using a light source. Specifically, the projection unit 112 may provide a lighting function by outputting a light source using an LED. In various embodiments, the projection unit 112 may include one LED, and in another embodiment, the electronic device 100 may include a plurality of LEDs. In addition, in an implementation example, the projection unit 112 may output a light source by using a surface-emitting LED. Here, the surface-emitting LED may be an LED in which an optical sheet is arranged on the upper side of the LED to evenly disperse and output the light source. In detail, in the case of output through the LED, the light source may be evenly dispersed by the optical sheet, and the light source dispersed by the optical sheet may be incident on the display panel.
[0077] In addition, the projection unit 112 may provide a dimming function for adjusting the intensity of the light source to the user. Specifically, when a user input for adjusting the intensity of the light source is received from the user through the manipulation interface 115 (e.g., touching a display button or a dial), the projection unit 112 may control the LED to output the intensity of the light source corresponding to the received user input.
[0078] In addition, the projection unit 112 may provide a dimming function without user input based on the content analyzed by the processor 111. In detail, the projection unit 112 may control the LED to output the light source of the intensity based on information about the currently provided content (eg, content type or content brightness).
[0079] In addition, the projection unit 112 may control the color temperature under the control of the processor 111. Here, the processor 111 may control the color temperature based on the content. In detail, if the content to be output is identified, the processor 111 may obtain color information for each frame of the content determined to be output. Then, the processor 111 may control the color temperature based on the obtained color information for each frame. Here, the processor 111 may obtain at least one main color of the frame based on the color information for each frame. Then, the processor 111 may control the color temperature based on the obtained at least one main color. For example, the color temperature adjustable by the processor 111 may be classified as a warm color type or a cold color type. Here, it may be assumed that the frame to be output (hereinafter, the output frame) includes a fire scene. The processor 111 may identify (or obtain) that the main color is red based on the color information included in the current output frame. Then, the processor 111 may identify the color temperature corresponding to the identified main color (red). Here, the color temperature corresponding to red may be a warm color type. In addition, the processor 111 may use an artificial intelligence model to obtain the color information or main color of the frame. In various embodiments, the artificial intelligence model may be stored in the electronic device 100 (eg, the memory 113). In another embodiment, the artificial intelligence model may be stored in an external server that can communicate with the electronic device 100.
[0080] The memory 113 may be implemented as an internal memory included in the processor 111, such as a read-only memory (ROM, for example, an electrically erasable programmable read-only memory (EEPROM)) or a random access memory (RAM), or may be implemented as a memory separate from the processor 111. In this case, based on the data storage purpose, the memory 113 may be implemented in the form of a memory embedded in the electronic device 100 or in the form of a memory detachable from the electronic device 100. For example, data for driving the electronic device 100 may be stored in the memory embedded in the electronic device 100, and data for extended functions of the electronic device 100 may be stored in the memory detachable from the electronic device 100.
[0081] In addition, the memory embedded in the electronic device 100 can be implemented as a volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM) or synchronous dynamic RAM (SDRAM)) or a non-volatile memory (for example, a one-time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (for example, a NAND flash memory or a NOR flash memory), a hard disk drive or a solid-state drive (SSD), and the memory removable from the electronic device 100 can be implemented as a memory card (for example, compact flash (CF), secure digital (SD)), micro secure digital (Micro-SD), mini secure digital (mini-SD), extreme digital (xD) or multimedia card (MMC)), or an external memory connectable to a universal serial bus (USB) port (for example, a USB memory), etc.
[0082] The memory 113 may store at least one instruction in the electronic device 100. In addition, the memory 113 may store an operating system (O / S) for driving the electronic device 100. The memory 113 may also store various software programs or applications for operating the electronic device 100 according to various embodiments of the present disclosure. In addition, the memory 113 may include a semiconductor memory (such as a flash memory) or a magnetic storage medium (such as a hard disk).
[0083] In detail, the memory 113 may store various software modules for operating the electronic device 100 according to various embodiments of the present disclosure, and the processor 111 may control the operation of the electronic device 100 by executing the various software modules stored in the memory 113. That is, the memory 113 may be accessed by the processor 111, and the processor 111 may perform reading, recording, correction, deletion, updating, etc. of data in the memory 113.
[0084] In addition, in the present disclosure, the term “memory 113” may include a storage device, a read-only memory (ROM) or a random access memory (RAM) in the processor 111, or a memory card (e.g., a micro secure digital (SD) card or a memory stick) installed in the electronic device 100.
[0085] The communication interface 114 may be a component for communicating with various types of external devices by using various types of communication methods. The communication interface 114 may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.
[0086] The wireless communication module may be a module for communicating with an external device in a wireless manner. For example, the wireless communication module may include at least one of a wireless fidelity (Wi-Fi) module, a Bluetooth module, an infrared communication module, or another communication module.
[0087] The Wi-Fi module and the Bluetooth module can perform communication in a Wi-Fi manner and a Bluetooth manner, respectively. In the case of using the Wi-Fi module or the Bluetooth module, the communication interface can first send and receive various connection information (such as a service set identifier (SSID) or a session key), connect the communication by using the connection information, and then send and receive various information.
[0088] The infrared communication module may perform communication based on an Infrared Data Association (IrDA) technology that transmits data over a short distance in a wireless manner by using infrared rays between visible light and millimeter waves.
[0089] In addition to the above-mentioned communication methods, another communication module may include at least one communication chip for performing communication based on various wireless communication standards (such as Zigbee, third generation (3G), third generation partnership project (3GPP), long term evolution (LTE), advanced LTE (LTE-A), fourth generation (4G) and fifth generation (5G)).
[0090] The wired communication module may be a module for communicating with an external device in a wired manner. For example, the wired communication module may include at least one of a local area network (LAN) module, an Ethernet module, a twisted pair, a coaxial cable, an optical fiber cable, or an ultra-wideband (UWB) module.
[0091] The manipulation interface 115 may include various types of input devices. For example, the manipulation interface 115 may include a physical button. Here, the physical button may include a function key, a direction key (e.g., a four-way key) or a dial button. In various embodiments, the physical button may be implemented as a plurality of keys. In another example, the physical button may be implemented as one key. Here, in the case where the physical button is implemented as one key, the electronic device 100 may receive a user input that a key is pressed for a critical time or longer. In the case of receiving a user input that a key is pressed for a critical time or longer, the processor 111 may execute a function corresponding to the user input. For example, the processor 111 may provide a lighting function based on the user input.
[0092] In addition, the manipulation interface 115 may receive user input by using a non-contact method. In the case of receiving user input by using a contact method, it may be necessary to transmit a physical force to the electronic device 100. Therefore, a method of controlling the electronic device 100 regardless of the physical force may be required. In detail, the manipulation interface 115 may receive a user gesture and may perform an operation corresponding to the received user gesture. Here, the manipulation interface 115 may receive a user gesture through a sensor (e.g., an image sensor or an infrared sensor).
[0093] In addition, the manipulation interface 115 can receive user input by using a touch method. For example, the manipulation interface 115 can receive user input by using a touch sensor. In various embodiments, the touch method can be implemented as a non-contact method. For example, the touch sensor can determine whether the user's body is close to a critical distance. Here, the touch sensor can recognize the user input even if the user does not touch the touch sensor. In addition, in another implementation example, the touch sensor can recognize the user input of the user touching the touch sensor.
[0094] In addition, the electronic device 100 may receive user input in various ways other than the above-mentioned manipulation interface 115. In various embodiments, the electronic device 100 may receive user input from an external remote control device. Here, the external remote control device may be a remote control device corresponding to the electronic device 100 (e.g., a control device dedicated to the electronic device 100) or a portable communication device of the user (e.g., a smart phone or a wearable device). Here, the user's portable communication device may store an application for controlling the electronic device 100. The portable communication device may obtain user input from the application stored therein and send the obtained user input to the electronic device 100. The electronic device 100 may receive user input from the portable communication device and perform operations corresponding to the user's control command.
[0095] In addition, the electronic device 100 may receive user input by using voice recognition. In various embodiments, the electronic device 100 may receive user voice through a microphone included in the electronic device 100. In various embodiments, the electronic device 100 may receive user voice from a microphone or an external device. In detail, the external device may obtain the user voice through the microphone of the external device and send the obtained user voice to the electronic device 100. The user voice sent from the external device may be audio data or digital data converted from the audio data (e.g., audio data converted to the frequency domain). Here, the electronic device 100 may perform an operation corresponding to the received user voice. In detail, the electronic device 100 may receive audio data corresponding to the user voice through a microphone. Then, the electronic device 100 may convert the received audio data into digital data. Then, the electronic device 100 may convert the converted digital data into text data by using a speech-to-text (STT) function. In various embodiments, the speech-to-text (STT) function may be directly performed by the electronic device 100.
[0096] In another embodiment, a speech-to-text (STT) function may be performed by an external server. The electronic device 100 may send digital data to the external server. The external server may convert the digital data into text data and obtain control command data based on the converted text data. The external server may send the control command data (which may also include text data) to the electronic device 100. The electronic device 100 may perform an operation corresponding to the user's voice based on the obtained control command data.
[0097] In addition, the electronic device 100 can provide a voice recognition function by using one assistant (or an artificial intelligence agent (such as Bixby TM)), which is only one of various embodiments, and the electronic device 100 can provide a voice recognition function by using multiple assistants. Here, the electronic device 100 can provide a voice recognition function by selecting one of the multiple assistants based on a trigger word corresponding to the assistant or a specific key included in the remote controller.
[0098] In addition, the electronic device 100 may receive user input by using screen interaction. The screen interaction may indicate a function in which the electronic device 100 identifies whether a predetermined event is generated by an image projected on a screen (or projection plane), and obtains user input based on the predetermined event. Here, the predetermined event may be an event in which a predetermined object is recognized at a specific location (e.g., a location where a user interface (UI) for receiving user input is projected). Here, the predetermined object may include at least one of a user body part (e.g., a finger), a pointer, or a laser point. If it is recognized that a predetermined object exists at a location corresponding to the projected UI, the electronic device 100 may recognize that a user input for selecting the projected UI is received. For example, the electronic device 100 may project a guide image to display a UI on the screen. Then, the electronic device 100 may recognize whether the user selects the projected UI. In detail, if a predetermined event is recognized at the location of the projected UI, the electronic device 100 may recognize that the user selects the projected UI. Here, the projected UI may include at least one item. Here, the electronic device 100 may perform spatial analysis to recognize whether a predetermined event exists at the location of the projected UI. Here, the electronic device 100 may perform spatial analysis through a sensor (e.g., an image sensor, an infrared sensor, a depth camera, or a distance sensor). The electronic device 100 may identify whether a predetermined event is generated at a specific location (i.e., the location where the UI is projected) by performing spatial analysis. In addition, if it is identified that a predetermined event is generated at a specific location (i.e., the location where the UI is projected), the electronic device 100 may recognize that a user input for selecting a UI corresponding to the specific location is received.
[0099] The input / output interface 116 may be a component for inputting or outputting at least one of an audio signal or an image signal. The input / output interface 116 may receive at least one of an audio signal or an image signal from an external device and output a control command to the external device.
[0100] In some implementation examples, the input / output interface 116 may be implemented as an interface that inputs and outputs only audio signals, an interface that inputs and outputs only image signals, or one interface that inputs and outputs both audio signals and image signals.
[0101] In addition, the input / output interface 116 according to various embodiments of the present disclosure may be implemented as a wired input / output interface of at least one of the following: High Definition Multimedia Interface (HDMI), Mobile High Definition Link (MHL), Universal Serial Bus (USB), USB Type-C, Display Port (DP), Thunderbolt, Video Graphics Array (VGA) port, Red Green Blue (RGB) port, D-Subminiature (D-SUB), or Digital Visual Interface (DVI). In various embodiments, the wired input / output interface may be implemented as an interface for inputting and outputting only audio signals or an interface for inputting and outputting only image signals, or as one interface for inputting and outputting both audio signals and image signals.
[0102] In addition, the electronic device 100 can receive data through the wired input / output interface, which is only one of various embodiments, and the electronic device 100 can receive power through the wired input / output interface. As an example, the electronic device 100 can receive power from an external battery by using a USB C type, or receive power from an outlet by using a power adapter. As another example, the electronic device 100 can receive power from an external device (e.g., a laptop or monitor) through a display port (DP).
[0103] In addition, audio signals can be input through a wired input / output interface, and image signals can be input through a wireless input / output interface (or communication interface). Alternatively, audio signals can be input through a wireless input / output interface (or communication interface), and image signals can be input through a wired input / output interface.
[0104] The speaker 117 may be a component for outputting an audio signal. Specifically, the speaker 117 may include an audio output mixer, an audio signal processor, or an audio output module. The audio output mixer may mix a plurality of audio signals to output as at least one audio signal. For example, the audio output mixer may mix an analog audio signal with another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to various embodiments, the audio output module may include a plurality of speakers. In this case, the audio output module may be arranged in the main body, and the audio emitted by at least a portion of the diaphragm covering the audio output module may pass through a waveguide to be transmitted to the outside of the main body. The audio output module may include a plurality of audio output units, and the plurality of audio output units may be symmetrically arranged on the appearance of the main body, so that the audio may be emitted in all directions, i.e., in all directions of 360 degrees.
[0105] The microphone 118 may be a component for receiving a user voice or another sound and converting it into audio data. The microphone 118 may receive the user voice while being activated. For example, the microphone 118 may be integrated with the electronic device 100 above, in front of, or in a horizontal direction of the electronic device 100. The microphone 118 may include various components, such as a microphone for collecting the user voice in analog form, an amplifier circuit for amplifying the collected user voice, an analog-to-digital (A / D) conversion circuit for sampling the amplified user voice and converting it into a digital signal, a filter circuit for removing noise components from the converted digital signal, etc.
[0106] The power supply unit 119 may receive power from the outside and supply power to various components of the electronic device 100. The power supply unit 119 according to various embodiments of the present disclosure may receive power in various ways. In various embodiments, the power supply unit 119 may receive power by using a power supply such as Figure 3 The power supply unit 119 may receive power by using a 220 V DC power line. However, the electronic device 100 is not limited thereto and may receive power by using a USB power line or may receive power by using a wireless charging method.
[0107] In addition, the power supply unit 119 can receive power by using an internal battery or an external battery. The power supply unit 119 according to various embodiments of the present disclosure can receive power through the internal battery. For example, the power supply unit 119 can charge the internal battery by using at least one of a 220V DC power cord, a USB power cord, or a USB C type power cord, and can receive power through the charged internal battery. In addition, the power supply unit 119 according to various embodiments of the present disclosure can receive power through an external battery. For example, in the case where the electronic device 100 and the external battery are connected to each other through various wired communication methods (such as USB power code, USB C type power code, or socket slot), the power supply unit 119 can receive power through an external battery. That is, the power supply unit 119 can receive power directly from the external battery, or charge the internal battery through the external battery and receive power from the charged internal battery.
[0108] The power supply unit 119 according to the present disclosure may receive power by using at least one of the aforementioned various power supply methods.
[0109] In addition, regarding power consumption, the electronic device 100 may have a power consumption of a predetermined value (e.g., 43 W) or less due to a socket type, another standard, etc. Here, in the case of using a battery, the electronic device 100 may change the power consumption to reduce the power consumption. That is, the electronic device 100 may change the power consumption based on the power supply method, the amount of power usage, etc.
[0110] The driving unit 120 may drive at least one hardware component included in the electronic device 100. The driving unit 120 may generate a physical force and transmit it to at least one hardware component included in the electronic device 100.
[0111] Here, the driving unit 120 may generate a driving force for movement of a hardware component included in the electronic device 100 (eg, movement of the electronic device 100 ) or a rotation operation of a component (eg, rotation of a projection lens).
[0112] The driving unit 120 may adjust the projection direction (or projection angle) of the projection unit 112. In addition, the driving unit 120 may move the position of the electronic device 100. Here, the driving unit 120 may control the moving member 109 to move the electronic device 100. For example, the driving unit 120 may control the moving member 109 by using a motor.
[0113] The sensor unit 121 may include at least one sensor. In detail, the sensor unit 121 may include at least one of a tilt sensor for sensing the tilt of the electronic device 100 or an image sensor for capturing an image. Here, the tilt sensor may indicate an accelerometer or a gyroscope sensor, and the image sensor may indicate a camera or a depth camera. In addition, the tilt sensor may be described as a motion sensor. In addition, the sensor unit 121 may also include various sensors other than the tilt sensor or the image sensor. For example, the sensor unit 121 may include a light sensor or a distance sensor. The distance sensor may be a time of flight (ToF) sensor. In addition, the sensor unit 121 may include a light detection and ranging (LiDAR) sensor.
[0114] In addition, the electronic device 100 may control the lighting function in linkage with an external device. In detail, the electronic device 100 may receive lighting information from the external device. Here, the lighting information may include at least one of brightness information or color temperature information set by the external device. Here, the external device may indicate a device connected to the same network as the electronic device 100 (e.g., an Internet of Things (IoT) device included in the same home / work network), or a device that is not connected to the same network as the electronic device 100 and is capable of communicating with the electronic device 100 (e.g., a remote control server). For example, it can be assumed that an external lighting device (e.g., an IoT device) included in the same network as the electronic device 100 outputs red light with a brightness of 50. The external lighting device (e.g., an IoT device) may directly or indirectly send lighting information (e.g., information indicating that red light with a brightness of 50 is output) to the electronic device 100. Here, the electronic device 100 may control the output of the light source based on the lighting information received from the external lighting device. For example, if the lighting information received from the external lighting device includes information to output red light with a brightness of 50, the electronic device 100 may output red light with a brightness of 50.
[0115] In addition, the electronic device 100 may control the lighting function based on biometric information. In detail, the processor 111 may obtain user biometric information. Here, the biometric information may include at least one of the user's body temperature, heart rate, blood pressure, respiration, or electrocardiogram. Here, the biometric information may include various information in addition to the above information. As an example, the electronic device 100 may include a sensor for measuring biometric information. The processor 111 may obtain user biometric information through the sensor, and control the output of the light source based on the obtained biometric information. As another example, the processor 111 may receive biometric information from an external device through the input / output interface 116. Here, the external device may indicate a portable communication device (e.g., a smart phone or a wearable device) of the user. The processor 111 may obtain user biometric information from an external device, and control the output of the light source based on the obtained biometric information. In addition, according to an embodiment example, the electronic device 100 may identify whether the user is sleeping, and if the user is identified as sleeping (or preparing to sleep), the processor 111 may control the output of the light source based on the user biometric information.
[0116] In addition, the electronic device 100 according to various embodiments of the present disclosure may provide various smart functions.
[0117] In detail, the electronic device 100 may be connected to a portable terminal device for controlling the electronic device 100, and a screen output by the electronic device 100 may be controlled by a user input input from the portable terminal device. For example, the portable terminal device may be implemented as a smart phone including a touch display, the electronic device 100 may receive screen data provided by the portable terminal device from the portable terminal device and output the data, and the screen output by the electronic device 100 may be controlled based on the user input input from the portable terminal device.
[0118] The electronic device 100 can be connected to a portable terminal device by using various communication methods (such as wireless display (miracast), airplay, wireless dalvik executable file (DEX), and remote personal computer (PC) methods), and can share content or music provided by the portable terminal device.
[0119] In addition, the portable terminal device and the electronic device 100 may be connected to each other through various connection methods. In various embodiments, the portable terminal device may search for the electronic device 100 and perform a wireless connection therebetween, or the electronic device 100 may search for the portable terminal device and perform a wireless connection therebetween. Then, the electronic device 100 may output the content provided from the portable terminal device.
[0120] In various embodiments, while outputting specific content or music from a portable terminal device, when the portable terminal device is arranged around the electronic device 100 and then a predetermined gesture (e.g., a motion click view) is detected through the display of the portable terminal device, the electronic device 100 may output the content or music output from the portable terminal device.
[0121] In various embodiments, while specific content or music is output from the portable terminal device, when the portable terminal device becomes close to the electronic device 100 at a predetermined distance or less (e.g., non-contact click view) or the portable terminal device touches the electronic device 100 twice at short intervals (e.g., contact click view), the electronic device 100 may output the content or music output from the portable terminal device.
[0122] The above-mentioned embodiment describes that the screen provided by the portable terminal device is the same as the screen provided by the electronic device 100. However, the present disclosure is not limited to this. That is, in a case where the portable terminal device and the electronic device 100 are connected to each other, the portable terminal device may output a first screen provided by the portable terminal device, and the electronic device 100 may output a second screen provided by the portable terminal device that is different from the first screen. For example, the first screen may be a screen provided by a first application installed in the portable terminal device, and the second screen may be a screen provided by a second application installed in the portable terminal device. For example, the first screen and the second screen may be screens different from each other provided by an application installed in the portable terminal device. In addition, for example, the first screen may be a screen including a UI in the form of a remote controller for controlling the second screen.
[0123] The electronic device 100 according to the present disclosure may output a standby screen. For example, when the electronic device 100 and an external device are not connected to each other or when no input is received from an external device within a predetermined time, the electronic device 100 may output a standby screen. The conditions under which the electronic device 100 outputs the standby screen are not limited to the above examples, and the standby screen may be output based on various conditions.
[0124] The electronic device 100 may output the standby screen in the form of a blue screen, and the present disclosure is not limited thereto. For example, the electronic device 100 may obtain an atypical object by extracting only the shape of a specific object from data received from an external device, and output the standby screen including the obtained atypical object.
[0125] In addition, the electronic device 100 may further include a display (not shown).
[0126] The display (not shown) may be implemented as any of various types of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, and a plasma display panel (PDP). The display (not shown) may also include a driving circuit, a backlight unit, and the like, which may be implemented in the form of an amorphous silicon thin film transistor (a-siTFT), a low temperature polycrystalline silicon (LTPS) TFT, or an organic TFT (OTFT). In addition, the display (not shown) may be implemented as a touch screen, a flexible display, a three-dimensional (3D) display, and the like combined with a touch sensor. In addition, the display (not shown) according to various embodiments of the present disclosure may include not only a display panel for outputting an image, but also a frame for accommodating the display panel. Specifically, according to various embodiments of the present disclosure, the frame may include a touch sensor (not shown) for detecting user interaction.
[0127] In addition, the electronic device 100 may further include a shutter unit (not shown).
[0128] The baffle unit (not shown) may include at least one of a baffle, a fixing member, a rail, or a body.
[0129] Here, the baffle may block light output from the projection unit 112. Here, the fixing member may fix the position of the baffle. Here, the track may be a path for moving the baffle and the fixing member. Here, the body may be an assembly including the baffle and the fixing member.
[0130] Figure 4 is a perspective view showing the appearance of an electronic device 100 according to various embodiments of the present disclosure.
[0131] Reference Figure 4 In the embodiment 410, the electronic device 100 may include a support (or "handle") 108a.
[0132] The support 108 a in various embodiments may be a handle or a ring provided for a user to grasp or move the electronic device 100 , or the support 108 a may be a stand that supports the main body 105 while the main body 105 is lowered in a horizontal direction.
[0133] The support member 108a may be connected to the main body 105 by having a hinge structure to be coupled to or separated from the outer circumferential surface of the main body 105, and may be selectively separated from or fixed to the outer circumferential surface of the main body 105 based on user needs. The number, shape, or arrangement structure of the support member 108a may be implemented in various ways without any limitation. Although not shown in the figure, the support member 108a may be built into the main body 105 and taken out for use by the user as needed, or the support member 108a may be implemented as a separate accessory and may be detachable from the electronic device 100.
[0134] The support 108a may include a first support surface 108a-1 and a second support surface 108a-2. The first support surface 108a-1 may be a surface facing the outside of the body 105 when the support 108a is separated from the outer circumferential surface of the body 105, and the second support surface 108a-2 may be a surface facing the inside of the body 105 when the support 108a is separated from the outer circumferential surface of the body 105.
[0135] The first support surface 108a-1 may be gradually formed from the lower part of the main body 105 to the upper part of the main body 105 while being further away from the main body 105, and the first support surface 108a-1 may have a flat or uniformly curved shape. If the electronic device 100 is held so that the outer surface of the main body 105 is in contact with the bottom surface (i.e., so that the projection lens 101 is arranged to face forward), the first support surface 108a-1 may support the main body 105. In an embodiment where the electronic device 100 includes two or more support members 108a, the projection angle of the head 103 and the projection lens 101 may be adjusted by adjusting the gap between the two support members 108a or the hinge opening angle of the two support members 108a.
[0136] If the support member 108a is supported by a user or an external holding structure, the second support surface 108a-2 may be a surface in contact with the user or the external holding structure, and may have a shape corresponding to the gripping structure of the user's hand or the external holding structure so as not to slip when supporting or moving the electronic device 100. The user may use the electronic device 100 like a flashlight by fixing the head 103 to allow the projection lens 101 to face forward and moving the electronic device 100 while holding the support member 108a.
[0137] The support member groove 104 may be arranged in the body 105 while having a groove structure that can accommodate the support member 108a if the support member 108a is not used, and may be implemented as being arranged in the outer circumferential surface of the body 105 while having a groove structure corresponding to the shape of the support member 108a. By using the support member groove 104, if the support member 108a is not used, the support member 108a can be stored in the outer circumferential surface of the body 105, and the outer circumferential surface of the body 105 can be kept smooth.
[0138] Alternatively, the support member 108a may be stored in the main body 105, and if the support member 108a is needed, it may be taken out of the main body 105. In this case, the support member groove 104 may be recessed in the main body 105 to accommodate the support member 108a, and the second support surface 108a-2 may be in close contact with the outer circumferential surface of the main body 105, or the support member groove 104 may include a separate door (not shown) for opening and closing the support member groove 104.
[0139] Although not shown in the drawings, the electronic device 100 may include various types of accessories that assist in the use or storage of the electronic device 100. For example, the electronic device 100 may include a protective case (not shown) to easily transport the electronic device 100 while protecting the electronic device 100. Alternatively, the electronic device 100 may include a tripod (not shown) to support or fix the body 105 or a stand (not shown) coupled to an outer surface to fix the electronic device 100.
[0140] Figure 4 Embodiment 420 in FIG. 4 shows that the electronic device 100 in embodiment 410 remains in contact with the bottom surface.
[0141] Figure 5 is a perspective view showing the appearance of an electronic device 100 according to various embodiments of the present disclosure.
[0142] Reference Figure 5 In the embodiment 510, the electronic device 100 may include a support (or "handle") 108b.
[0143] The support 108b in various embodiments may be a handle or a ring provided for a user to grasp or move the electronic device 100. Alternatively, the support 108b may be a stand that supports the main body 105 to be directed at an arbitrary angle while the main body 105 is lowered in a horizontal direction.
[0144] In detail, the support 108b may be connected to the main body 105 at a predetermined point (e.g., 2 / 3 to 3 / 4 of the main body height) of the main body 105. If the support 108b is rotated toward the main body, the support 108 may support the main body 105 to face any angle while the main body 105 is lowered in the horizontal direction.
[0145] Figure 5 Embodiment 520 in FIG. 5 shows a state in which the electronic device 100 in embodiment 510 remains in contact with the bottom surface.
[0146] Figure 6 is a perspective view showing the appearance of an electronic device 100 according to various embodiments of the present disclosure.
[0147] Reference Figure 6 In the embodiment 610, the electronic device 100 may include a support (or "pedestal") 108c.
[0148] The support 108c in various embodiments may include a base plate 108c-1 and two support members 108c-2 configured to support the electronic device 100 on the ground. Here, the two support members 108c-2 may each connect the base plate 108c-1 and the body 105 to each other.
[0149] In various embodiments of the present disclosure, the two support members 108c - 2 may have the same height, and thus, each cross section of the two support members 108c - 2 may be combined or separated by the grooves arranged on the outer circumferential surface of the body 105 and the hinge member 108c - 3 .
[0150] Each of the two supporting members may be hingedly connected to the main body 105 at a predetermined point on the main body 105 (eg, 1 / 3 to 2 / 4 of the height of the main body).
[0151] If the two supporting members and the main body are coupled to each other through the hinge member 108 c - 3 , the main body 105 may rotate about an imaginary horizontal axis formed by the two hinge members 108 c - 3 , thereby adjusting the projection angle of the projection lens 101 .
[0152] Figure 6 Embodiment 620 in the embodiment 610 shows a state where the electronic device 100 is rotated.
[0153] Figure 6 An embodiment in which two support members 108c-2 are connected to the body 105 is shown. However, the present disclosure is not limited thereto, and as Figure 7 As shown, a support member and the main body 105 may be connected to each other via a hinge member.
[0154] Figure 7 is a perspective view showing the appearance of an electronic device 100 according to various embodiments of the present disclosure.
[0155] Reference Figure 7 In the embodiment 710, the electronic device 100 may include a support (or "base") 108d.
[0156] The support member 108d in various embodiments may include a base plate 108d-1 configured to support the electronic device 100 on the ground and a support member 108d-2 connecting the base plate 108d-1 and the body 105 to each other.
[0157] In addition, a cross section of one supporting member 108 d - 2 may be coupled or separated by a groove disposed on the outer circumferential surface of the body 105 and a hinge member (not shown).
[0158] If one supporting member 108d-2 and the main body 105 are coupled to each other through one hinge member (not shown), the main body 105 may rotate about an imaginary horizontal axis formed by one hinge member (not shown).
[0159] Figure 7 Embodiment 720 in the embodiment 710 shows a state where the electronic device 100 is rotated.
[0160] Figure 8 is a perspective view showing the appearance of an electronic device 100 according to various embodiments of the present disclosure.
[0161] Reference Figure 8 In the embodiment 810, the electronic device 100 may include a support (or "base") 108e.
[0162] The support 108e in various embodiments may include a base plate 108e-1 and two support members 108e-2 configured to support the electronic device 100 on the ground. Here, the two support members 108e-2 may connect the base plate 108e-1 and the body 105 to each other.
[0163] In various embodiments of the present disclosure, the two support members 108e-2 may have the same height, and therefore, each cross-section of the two support members 108e-2 may be combined or separated by grooves and hinge members (not shown) arranged on the outer circumferential surface of the body 105.
[0164] Each of the two supporting members may be hingedly connected to the main body 105 at a predetermined point on the main body 105 (eg, 1 / 3 to 2 / 4 of the height of the main body).
[0165] If the two supporting members and the body are coupled to each other through a hinge member (not shown), the body 105 may rotate about an imaginary horizontal axis formed by the two hinge members (not shown), thereby adjusting a projection angle of the projection lens 101 .
[0166] In addition, the electronic device 100 may rotate the body 105 including the projection lens 101. The body 105 and the support 108e may rotate around an imaginary vertical axis at the center point of the base plate 108e-1.
[0167] Figure 8 Embodiment 820 in the embodiment 810 shows a state where the electronic device 100 is rotated.
[0168] in addition, Figure 4 , Figure 5 , Figure 6 , Figure 7 or Figure 8 The support member shown in FIG. 1 is only one of various embodiments, and the electronic device 100 may have a support member in any of various positions or shapes.
[0169] Fig. 9 is a perspective view showing the appearance of an electronic device 100 according to various embodiments of the present disclosure.
[0170] Reference Fig. 9 In the embodiment 910, the electronic device 100 may include a moving member 109. The moving member 109 may indicate a member for performing the following operation: moving the electronic device 100 from a first position to a second position in a space where the electronic device 100 is arranged. The electronic device 100 may control the moving member 109 to move the electronic device 100 by using the force generated by the driving unit 120.
[0171] Fig. 9Embodiment 920 in the embodiment 910 may be a diagram of the electronic device 100 observed from a different direction.
[0172] In addition, detailed operations of the processor 111 according to the present disclosure may be described using the following drawings.
[0173] The processor 111 may recognize the projection surface using the sensor unit 121 .
[0174] For details, refer to Fig.10 , the processor 111 may obtain information about the surrounding environment of the electronic device 100 using the sensor unit 121 (S1010).
[0175] In addition, the processor 111 may identify at least one projection surface candidate based on information about the surrounding environment of the electronic device 100 (S1020). Fig.11 As shown, the processor 111 may identify a region of the wall 10 surrounding the electronic device 100 excluding the obstacles 11 , 12 , and 13 as one or more projection surface candidates 20 and 21 .
[0176] In addition, if one or more projection surface candidates are identified, the processor 111 may identify one projection surface candidate among the one or more projection surface candidates as a projection surface on which the projection image is projected ( S1030 ).
[0177] For example, the processor 111 may obtain a user input for selecting one of the one or more projection surface candidates. In addition, the processor 111 may identify the projection surface candidate selected from the one or more projection surface candidates as the projection surface.
[0178] Optionally, the processor 111 may identify one of the one or more projection surface candidates as the projection surface based on a color, a curvature, a size, or a ratio of the one or more projection surface candidates.
[0179] In detail, the processor 111 may identify a projection surface candidate whose horizontal length is a predetermined value (e.g., 1 m) or longer as a projection surface. Alternatively, the processor 111 may identify a projection surface candidate whose color is a solid color other than black and similar to white as a projection surface candidate. Alternatively, the processor 111 may identify a projection surface candidate whose ratio of vertical length to horizontal length is a predetermined value (4:1, 1:4, or 16:9) or is close to the predetermined value as a projection surface candidate.
[0180] In addition, the processor 111 may obtain information about the projection surface using the sensor unit 121 (S1040). In detail, the processor 111 may obtain information about the projection surface using an image sensor, a depth sensor, or a distance sensor. Here, the information about the projection surface may include at least one of a ratio of the projection surface, a horizontal length of the projection surface, or a vertical length of the projection surface.
[0181] In addition, the processor 111 may identify whether the ratio of the projection surface is different from the ratio of the image to be projected on the projection surface.
[0182] Here, the image may indicate an image to be projected on the projection surface. In addition, the image may be stored in the memory 113, received from an external device through the communication interface 114, or obtained through an input / output interface.
[0183] In addition, in the present disclosure, the ratio may indicate the ratio of the vertical length to the horizontal length or the ratio of the vertical length to the horizontal length. For example, the ratio of the projection surface may indicate the ratio of the vertical length to the horizontal length of the projection surface. Alternatively, the ratio of the image may indicate the ratio of the vertical length to the horizontal length of the image. Alternatively, the ratio of the region of interest may indicate the ratio of the vertical length of the region of interest to the horizontal length of the region of interest.
[0184] If the ratio of the projection surface is the same as the ratio of the image, the processor 111 may project the image on the projection surface without cropping the image.
[0185] In addition, if the projection surface and the image have different ratios, the processor 111 may obtain a projection image by cutting out a portion of the image, and project the obtained projection image on the recognized projection surface. Fig.12 A detailed method in which the processor 111 obtains a projection image by cutting out a portion of an image is described.
[0186] Reference Fig.12 , the processor 111 may obtain information about the projection surface (S1210). In addition, the processor 111 may identify a first region of interest (ROI) in the image (S1220).
[0187] In detail, the processor 111 may obtain a saliency map of the image. Here, the saliency map may indicate a map representing a saliency value for each pixel of the projected image. In addition, the saliency value may indicate the probability that each pixel of the image belongs to an object of interest or a region of interest.
[0188] In addition, the processor 111 may identify a first region of interest in the image based on the saliency map. Here, the processor 111 may identify a region in the saliency map where a saliency value is concentrated and has a predetermined saliency value (e.g., 0.6) or greater as the first region of interest. Here, the first region of interest may be a region including an object of interest.
[0189] For example, Fig.13a As shown, the processor 111 may identify a region in the image 30 where saliency values having a predetermined saliency value or greater are concentrated as the first region of interest 40. Here, the first region of interest 40 may be a region including the sun as an object of interest.
[0190] In addition, in the present disclosure, the size of the region of interest may be changed based on the saliency value used to identify the region of interest. Fig.13b , the processor 111 may identify the region of interest 40 having a first size based on a first significance value (e.g., 0.6). In addition, the processor may identify the region of interest 41 having a second size smaller than the first size based on a second significance value (e.g., 0.4) smaller than the first significance value. In addition, the processor 111 may identify the region of interest 42 having a third size larger than the first size based on a third significance value (e.g., 0.8) larger than the first significance value.
[0191] In addition, according to an embodiment of the present disclosure, the processor 111 may identify a plurality of regions of interest, and identify a first region of interest based on a user input for selecting the first region of interest from among the plurality of regions of interest.
[0192] In detail, Fig.13c As shown, the processor 111 can identify multiple regions of interest 43a, 43b and 43c, control the display to display the multiple regions of interest 43a, 43b and 43c together with at least a portion of the image 30 on the display, or control the projection unit 112 to display the multiple regions of interest 43a, 43b and 43c on the projection surface.
[0193] Here, the processor 111 may also display identification information 47, 48 or 49 for each of the plurality of interest regions 43a, 43b, 43c. Fig.13c As shown, identification information 44a, 44b or 44c for each of the plurality of interest regions 43a, 43b and 43c may be displayed as numbers such as 1, 2 and 3, which is only an embodiment, and the plurality of interest regions may be displayed in various forms.
[0194] In addition, the processor 111 may obtain a user input for selecting one of the plurality of interest regions 43a, 43b, and 43c through the manipulation interface 115, the microphone 118, or the camera module.
[0195] For example, the processor 111 may obtain a user input for selecting one of the plurality of interest regions 43a, 43b, and 43c through a physical button included in the manipulation interface 115, such as an arrow key (eg, up, down, or left and right arrow keys).
[0196] Optionally, the processor 111 may obtain a user voice input for selecting a specific region of interest from the multiple regions of interest 43a, 43b, and 43c through the microphone 118. Here, the user voice may be a voice including identification information corresponding to the specific region of interest. For example, the user voice input for selecting a specific region of interest from the multiple regions of interest 43a, 43b, and 43c may be "select region of interest 1" or "select region 1".
[0197] Optionally, the processor 111 may detect a user gesture for selecting a specific region of interest from the multiple regions of interest 43a, 43b, and 43c through the camera module. For example, the user gesture for selecting a specific region of interest from the multiple regions of interest 43a, 43b, and 43c may be a gesture of pointing a finger at the specific region of interest.
[0198] In addition, if a specific region of interest is selected from the plurality of regions of interest 43a, 43b, 43c, the processor 111 may identify the selected specific region of interest as the first region of interest.
[0199] In addition, if the first region of interest is identified, the processor 111 may obtain a projection image by cropping a portion of the image to include at least a portion of the first region of interest (S1230). Here, the projection image may indicate a remaining image of the image excluding the cropped portion.
[0200] In addition, the processor 111 may obtain a projected image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest.
[0201] According to an embodiment of the present disclosure, the processor 111 may obtain the projection image by cropping a portion of the image so that at least a portion of the first region of interest is included in the projection image.
[0202] Here, the processor 111 may obtain the projection image by cropping a portion of the image so that the ratio of the projection image is the same as the ratio of the projection surface.
[0203] For details, refer to Fig.14 If a first region of interest in the image is identified (S1410), the processor 111 may identify whether a ratio of a vertical length of the first region of interest to a horizontal length of the image is the same as a ratio of a vertical length of the projection surface to a horizontal length of the projection surface (S1420).
[0204] If the ratio of the vertical length of the first region of interest to the horizontal length of the image and the ratio of the vertical length of the projection plane to the horizontal length of the projection plane are not the same (S1420-No), the processor 111 may identify a second region of interest included in the first region of interest (S1430). Here, the second region of interest may be a region corresponding to the ratio of the projection plane and the horizontal length of the image.
[0205] In detail, the processor 111 may identify the second region of interest so that a ratio of a vertical length of the second region of interest to a horizontal length of the image and a ratio of the projection surface are the same.
[0206] For example, Fig.15a As shown, the horizontal length of the image 30 may be W2, and the vertical length of the image 30 may be H2. In addition, the horizontal length of the first region of interest 40 may be W1, and the vertical length of the first region of interest 40 may be H1. In addition, the horizontal length of the projection plane 20 may be PW, and the vertical length of the projection plane may be PH.
[0207] Here, the ratio of H2 to W1 may be different from the ratio of PH to PW. Here, the processor 111 may identify the second region of interest 41 included in the first region of interest 40. In detail, the processor 111 may identify the second region of interest 41 so that the ratio of the vertical length H3 of the second region of interest 41 to the horizontal length W2 of the image 30 and the ratio of the projection surface 20 (the ratio of PH to PW) are the same.
[0208] Here, the processor 111 may adjust the size of the second region of interest 41 by adjusting the significance value for identifying the region of interest. In detail, the processor 111 may reduce the significance value to be less than a predetermined value so that the height of the second region of interest 41 is lower than that of the first region of interest. In addition, the processor 111 may identify the second region of interest by using a significance value for making the ratio of the vertical length of the second region of interest to the horizontal length of the image the same as the ratio of the projection surface.
[0209] In addition, the processor 111 may identify the first region of interest based on a saliency value corresponding to the ratio of the projection surface and the horizontal length of the image. In detail, the memory 113 may store values for saliency values corresponding to the ratio of the projection surface and the horizontal length of the image in the form of a lookup table, and the processor 111 may obtain a saliency value corresponding to the projection surface. In addition, the processor 111 may identify the first region of interest in the image by using the saliency value corresponding to the projection surface.
[0210] In addition, if the second region of interest is identified, the processor 111 may obtain a projection image by cropping a portion of the image to include the entire second region of interest (S1440).
[0211] In detail, if the second region of interest is identified, the processor 111 may obtain a projected image by cropping a region in the image having a height different from that of the second region of interest. Here, the projected image may include the entire second region of interest. That is, the processor 111 may obtain a projected image by maintaining the horizontal length of the image and cropping the image 30 so that the vertical length of the image is the same as that of the second region of interest.
[0212] For example, Fig.15b As shown, the processor 111 may identify a region 50 in the image 30 having a height different from that of the second region of interest 41. In addition, the processor 111 may also obtain the projection image 31 by cutting out the region 50 in the image 30 having a height different from that of the second region of interest 41. Here, the projection image 31a may include a portion of the first region of interest 40 and the entire second region of interest 41. In addition, the horizontal length of the projection image 31a may be the same as the horizontal length of the image 30, and the vertical length of the projection image 31a may be the same as the vertical length of the second region of interest 41.
[0213] In addition, if the ratio of the vertical length of the first region of interest to the horizontal length of the image and the ratio of the vertical length of the projection surface to the horizontal length of the projection surface are the same (S1420-Yes), the processor 111 can obtain a projected image by cropping the image to include the entire first region of interest (S1450).
[0214] For example, Fig.16a As shown, the horizontal length of the image 30a may be W2a, and the vertical length of the image 30a may be H2a. In addition, the horizontal length of the first region of interest 40a may be W1a, and the vertical length of the first region of interest 40a may be H1a. In addition, the horizontal length of the projection plane 20 may be PW, and the vertical length of the projection plane may be PH. In addition, the ratio of H1a to W2a may be the same as the ratio of PH to PW.
[0215] Here, if Fig.16b As shown, the processor 111 can obtain the projection image 31a by cutting the region 50a having a height different from that of the first region of interest 40a in the image 30a. Here, the projection image 31a can have the same horizontal length as that of the image 30a, and the same vertical length as that of the first region of interest 40a.
[0216] In addition, if Fig.16c As shown, the processor 111 may project the projection image 31 a onto the projection surface 20 .
[0217] According to an embodiment of the present disclosure, the processor 111 may obtain a projection image by cropping a portion of the image so that the entire first region of interest is included in the projection image.
[0218] Here, the processor 111 may obtain the projected image by cropping a portion of the image so that the ratio of the vertical length to the horizontal length of the projected image is the ratio of the vertical length to the horizontal length of the projection surface or greater. Alternatively, the processor 111 may obtain the projected image by cropping a portion of the image so that the ratio of the vertical length of the first region of interest to the horizontal length of the projected image is the ratio of the vertical length to the horizontal length of the projection surface or greater.
[0219] For details, refer to Fig.17 If a first region of interest in the image is identified (S1710), the processor 111 may obtain a first cropped image by cropping a region in the image having a height different from that of the first region of interest (S1720).
[0220] For example, Fig.18a As shown, if the first region of interest 40 in the image 30 is identified, the processor 111 may obtain a first cropped image 32 by cropping a region 51 in the image 30 having a height different from that of the first region of interest 40 .
[0221] In addition, the processor 111 may compare the ratio of the first crop image with the ratio of the projection surface. In detail, the processor 111 may identify whether the ratio of the vertical length to the horizontal length of the first crop image is the ratio of the vertical length to the horizontal length of the projection surface or more (S1730).
[0222] In addition, if the ratio of the vertical length to the horizontal length of the first cropped image is the ratio of the vertical length to the horizontal length of the projection surface or more (S1730-No), the processor 111 may project the first cropped image as a projection image on the projection surface (S1740). Here, the vertical length of the first cropped image may be the vertical length of the first region of interest.
[0223] For example, Fig.18b As shown in FIG. 1 , if the ratio H1 / W2 of the vertical length to the horizontal length of the first cropped image 32 is the ratio PH / PW of the vertical length PH to the horizontal length PW of the projection surface 20 or greater, then Fig.18c As shown, the processor 111 may project the first cropped image 32 onto the projection surface 20 .
[0224] In addition, here, the processor 111 may not project any light onto the area 23 or 24 of the projection surface 20, project light of a specific color onto the area 23 or 24 of the projection surface 20, or project a widget image onto the area 23 or 24 of the projection surface 20, wherein the first cropped image 32 as the projection image is not projected into the area 23 or 24 of the projection surface 20.
[0225] For example, Fig.18d As shown, the processor 111 may project black light onto the left area 23 and the right area 24 in the first cropped image 32. Therefore, the electronic device 100 may provide the user with an immersive experience of the image projected on the projection surface 20.
[0226] Optionally, the processor 111 may project the widget image onto the left area 23 or the right area 24 in the first cropped image 32. Here, the widget image may include an object such as a clock. Fig.18e As shown, the processor 111 may project the widget image 25 including the clock object onto the right area 24 in the first cropped image 32 .
[0227] In addition, if the ratio of the vertical length to the horizontal length of the first cropped image is less than the ratio of the vertical length to the horizontal length of the projection surface (S1730-Yes), the processor 111 may obtain the second cropped image by cropping a portion of the first cropped image (S1750). In detail, the processor 111 may obtain the second cropped image by cropping a portion of the first cropped image so that the ratio of the vertical length of the first region of interest to the horizontal length of the second cropped image and the ratio of the vertical length PH to the horizontal length PW of the projection surface 20 are the same.
[0228] For example, Fig.19a As shown, the processor 111 may identify the first region of interest 43 in the image 33. In addition, the processor 111 may obtain the first cropped image 34 by cropping a region 52 or 53 having a height different from that of the first region of interest 43 in the image 33.
[0229] In addition, if Fig.19bAs shown, the ratio of the vertical length H5 to the horizontal length W4 of the first cropped image may be smaller than the ratio of the vertical length PH to the horizontal length PW of the projection surface 20. Here, the processor 111 may obtain the second cropped image 35 by cropping a portion of the first cropped image 34. In detail, the processor 111 may obtain the second cropped image 35 by cropping the first cropped image 34 so that the ratio of the vertical length H5 to the horizontal length W6 of the second cropped image 35 and the ratio of the vertical length PH to the horizontal length PW of the projection surface 20 are the same.
[0230] In addition, if Fig.19c As shown, the processor 111 may project the second cropped image 35 onto the projection surface 20 .
[0231] In addition, according to an embodiment of the present disclosure, the processor 111 may identify multiple candidate cropping regions, and obtain a projection image by cropping a portion of the image based on a user input for selecting a cropping region from the multiple candidate cropping regions. Here, the cropping region may indicate an area in the image that the user wants to crop out.
[0232] In detail, Fig. 20 As shown, the processor 111 may identify multiple candidate cropping regions 45a, 45b, and 45c based on the identified first region of interest 40. Here, each of the multiple candidate cropping regions 45a, 45b, and 45c may be a region including at least a portion of the first region of interest 40.
[0233] In addition, the processor 111 may control the display to display the identified multiple candidate cropping areas 45a, 45b, and 45c, or control the projection unit 112 to display the multiple candidate cropping areas 45a, 45b, and 45c on the projection surface. Here, the processor 111 may control the projection unit 112 to display identification information 46a, 46b, or 46c of each of the identified multiple candidate cropping areas 45a, 45b, and 45c.
[0234] In addition, the processor 111 may obtain a user input for selecting a specific region from among the plurality of candidate cropping regions 45a, 45b, and 45c through the manipulation interface 115, the microphone 118, or the camera module. Here, the selected specific region may be a cropping region.
[0235] For example, the processor 111 may obtain user input for selecting a specific area from among multiple candidate cropping areas 45a, 45b, and 45c through a physical button included in the manipulation interface 115, such as an arrow key (e.g., a down arrow key, a left arrow key, a right arrow key, or a right arrow key).
[0236] Optionally, the processor 111 may obtain a user voice input for selecting a specific area from the plurality of candidate cropping areas 45a, 45b, and 45c through the microphone 118. Here, the user voice may be a voice including identification information corresponding to the specific area. For example, the user voice input for selecting a specific area from the plurality of candidate cropping areas may be "select candidate cropping area 1" or "select area 1".
[0237] Optionally, the processor 111 may detect a user gesture for selecting a specific region from a plurality of candidate cropping regions through a camera module. For example, the user gesture for selecting a specific region from a plurality of candidate cropping regions may be a gesture of pointing a finger at the cropping region.
[0238] In addition, if a specific area is selected as a crop area from among a plurality of candidate crop areas, the processor 111 may obtain a projected image by cropping a portion of the image to include the crop area.
[0239] In addition, according to an embodiment of the present disclosure, the processor 111 may identify a projection surface, obtain a projection image by cropping an image, and project the projection image on the projection surface. Here, if the image is projected on the projection surface, the processor 111 may store projection history information of the image projected on the projection surface in the memory 113. Here, the projection history information may be information stored by matching a setting value for projecting an image on the projection surface with the projection surface.
[0240] Therefore, if the projection surface is re-recognized, the processor 111 may project the image on the re-recognized projection surface based on the projection history.
[0241] In detail, the processor 111 may project the image on the re-identified projection surface by using a pre-stored setting value. Here, the setting value may indicate a setting value for projecting the image on the projection surface. In detail, the setting value may include a saliency value for identifying a first region of interest in the image, a saliency value for identifying a second region of interest, information about a cropping area, information about a cropping position, information about a cropping ratio, information about a projection position, information about projection light (e.g., projecting a black light on an area where the image of the projection surface is not projected), information about a projection widget, or information about a projected image (e.g., a ratio of a projected image or a size of a projected image).
[0242] That is, the electronic device 100 may sense the surrounding environment of the electronic device 100, and if a predetermined projection surface is recognized, the electronic device 100 may project an image on the predetermined projection surface.
[0243] Reference Fig.21 A to Fig.21D describes a method for the electronic device 100 to re-recognize a projection surface by using pre-stored setting values and project an image on the projection surface.
[0244] For details, refer to Fig.21 A, the processor 111 may sense the surrounding environment of the electronic device 100 using the sensor unit 121 (S2110).
[0245] In addition, the processor 111 may identify one or more projection surface candidates based on information about the surrounding environment of the electronic device 100 ( S2120 ).
[0246] In addition, the processor 111 may identify whether there is a projection surface pre-stored in the memory 113 among the one or more projection surface candidates ( S2130 ).
[0247] In detail, the memory 113 may store information about the pre-recognized projection surface. Here, the information about the pre-recognized projection surface may include information about feature points of the pre-recognized projection surface image.
[0248] Here, the processor 111 can identify whether there is a pre-identified projection surface among one or more projection surface candidates by extracting feature points from images of one or more projection surface candidates obtained via an image sensor and comparing the extracted feature points with information about feature points of the pre-identified projection surface.
[0249] In addition, if there is no pre-identified projection surface in the one or more projection surface candidates (S2130-No), the processor 111 may identify one of the one or more projection surface candidates as the projection surface on which the image is projected (S2140). Here, the method in which the processor 111 identifies one of the one or more projection surface candidates as the projection surface is as described above.
[0250] In addition, if there is a pre-recognized projection surface among the one or more projection surface candidates ( S2130 -Y), the processor 111 may recognize the pre-recognized projection surface as a projection surface on which an image is to be projected ( S2150 ).
[0251] In addition, the processor 111 may project the image on the projection surface based on the settings matched with the pre-recognized projection surface and stored in the memory 113 (S2160).
[0252] In detail, the processor 111 may project the image on the projection surface in the same position, shape, or size as the image previously projected on the pre-recognized projection surface.
[0253] In addition, if there is a pre-recognized projection surface among one or more projection surface candidates, an obstacle may be arranged between the electronic device 100 and the projection surface 20. In this case, the electronic device 100 may move to a position where the electronic device 100 can project an image on the projection surface 20 without an obstacle being arranged between the electronic device 100 and the projection surface 20. If the movement is completed, the electronic device 100 may project the image on the pre-recognized projection surface.
[0254] For example, Fig.22a As shown, the electronic device 100 may project the projection image 32 and the clock widget image 25 on the projection surface 20 at the first position. In addition, the electronic device 100 may store the projection history information in the memory 113. Here, the projection history may be the history of the electronic device 100 projecting the projection image 32 and the clock widget image 25 on the projection surface 20 at the first position. In addition, the projection history information may include information about the setting values used by the electronic device 100 to project the projection image 32 and the clock widget image 25 on the projection surface 20 at the first position.
[0255] Then, the electronic device 100 may identify one or more projection surface candidates, and may identify the pre-identified projection surface 20 from among the one or more projection surface candidates 20 and 21. Here, Figure 22b As shown, if the obstacle 14 is arranged between the electronic device 100 and the projection surface 20 , the electronic device 100 may not be able to project an image on the projection surface 20 .
[0256] To solve this problem, Fig.22c As shown, the electronic device 100 may move to a second position where there is no obstacle 14 between the electronic device 100 and the projection surface 20 , and project the projection image 32 and the clock widget image 25 on the projection surface 20 by using the setting values stored in the memory 113 .
[0257] In addition, the electronic device 100 may project a projection image obtained by cropping an image on the projection surface, or project an uncropped image on the projection surface.
[0258] According to an embodiment of the present disclosure, the electronic device 100 may determine whether to crop an image based on an image type. Here, the image type may indicate an image obtained from an external server or an image obtained from a user terminal device.
[0259] For details, refer to Fig.23 , the processor 111 may obtain information about the image (S2310). Here, the processor 111 may obtain information about the image from a content provider, or obtain information about the image from a user.
[0260] In detail, the processor 111 may obtain information about the image provided by the content provider from the external server. In addition, the processor 111 may also obtain information about the image provided by the user from the user terminal device.
[0261] In addition, the processor 111 may identify whether the obtained image is received from an external server (S2320).
[0262] If the image is not received from an external server (S2320-No), that is, if the image is received from a user terminal device, the processor 111 may obtain a projection image by cutting a portion of the image, and project the obtained projection image on a projection surface (S2330). Here, the method in which the processor 111 cuts a portion of the image may be the same as the above method.
[0263] In addition, in a case where the image is received from the external server (S2320-Y), the processor 111 may identify whether a user command for cropping the image is obtained (S2340).
[0264] In detail, the processor 111 may control the speaker 117 to output a voice asking whether to crop an image, or control the projection unit 112 to output a UI asking whether to crop an image.
[0265] In addition, the processor 111 may also obtain a user command regarding whether to crop an image. Here, the user command may be a user command for cropping an image and projecting the cropped image, or a user command for projecting an uncropped image.
[0266] Therefore, in the case where a user command for cropping an image is obtained (S2340-Y), the processor 111 may obtain a projection image by cropping a portion of the image, and project the obtained projection image on the projection surface (S2330).
[0267] In addition, in the case where a user command for not cropping the image is obtained (S2340-N), the processor 111 may project the uncropped image on the projection surface (S2350).
[0268] Here, the processor 111 may project the image so that the center of the uncropped image is arranged at the center of the projection surface where the center is identified. Optionally, the processor 111 may identify a region of interest in the uncropped image and project the image so that the center of the region of interest is arranged at the center of the projection surface where the center is identified.
[0269] In addition, the term "processor" or "module" used in the present disclosure may include a unit including hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component or circuit. "Processor" or "module" may be an integrally formed component, or a minimum unit or component that performs one or more functions. For example, a module may include an application specific integrated circuit (ASIC).
[0270] Various embodiments of the present disclosure may be implemented by software including instructions stored in a machine-readable storage medium (e.g., a computer-readable storage medium). The machine may be a device that calls the stored instructions from a storage medium, may operate based on the called instructions, and may include an electronic device 100 according to the disclosed embodiments. If the instructions are executed by a processor, the processor may directly execute the functions corresponding to the instructions, or other components may execute the functions corresponding to the instructions under the control of the processor. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory" indicates that the storage medium is tangible without including a signal, and does not distinguish whether the data is stored semi-permanently or temporarily in the storage medium.
[0271] According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be available through an application store (e.g., PlayStore). TM ) Online distribution. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored in a storage medium (such as a memory of a manufacturer's server, an application store's server, or a relay server), or may be temporarily provided.
[0272] Each of the components (e.g., modules or programs) according to various embodiments may include one or more entities, and some of the above-mentioned corresponding subcomponents may be omitted, or other subcomponents may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into one entity, and the functions performed by each corresponding component may be performed before being integrated in the same or similar manner. The operations performed by the modules, programs or other components according to various embodiments may be performed in a sequential manner, in a parallel manner, in an iterative manner or in a heuristic manner, and at least some operations may be performed in a different order or omitted, or other operations may be added.
Claims
1. An electronic device, comprising: at least one sensor; A projection unit, used for projecting an image; A memory, configured to store at least one instruction; as well as at least one processor, Wherein, the at least one processor is configured to: obtaining information about the projection surface using the at least one sensor, identifying a first region of interest in the image to be projected on the projection surface, obtaining a projection image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest, and The projection unit is controlled to project the projection image onto a projection surface.
2. The device according to claim 1, wherein: The at least one processor is configured to: identifying a second region of interest in the first region of interest based on a ratio of a vertical length to a horizontal length of the projection surface, and A portion of the projection image is cropped to include a second region of interest.
3. The device as claimed in claim 2, wherein: The information about the projection surface includes a first ratio of a vertical length to a horizontal length of the projection surface, and The at least one processor is configured to identify a second region of interest such that a second ratio of a vertical length of the second region of interest to a horizontal length of the projection image is the first ratio.
4. The device according to claim 1, wherein: The at least one processor is configured to crop a portion of the projection image such that a first region of interest is included in the projection image.
5. The device according to claim 4, wherein: The information about the projection surface includes a first ratio of a vertical length to a horizontal length of the projection surface, and The at least one processor is configured to crop a portion of the projection image so that a second ratio of a vertical length of a first region of interest to a horizontal length of the projection image is a first ratio or greater.
6. The device according to claim 1, wherein: The information about the projection surface is information about the ratio of the vertical length to the horizontal length of the projection surface.
7. The device of claim 1, wherein: The at least one processor is configured to: using the at least one sensor, obtaining information about the surrounding environment of the electronic device, identifying one or more projection surface candidates based on information about the surrounding environment of the electronic device, obtaining a user input for selecting a projection surface from the one or more projection surface candidates, and Get information about the selected projection surface.
8. The device of claim 1, wherein: The at least one processor is configured to: using the at least one sensor, obtaining information about the surrounding environment of the electronic device, identifying a pre-identified projection surface based on information about the surrounding environment of the electronic device, and The cropped projection image is projected onto a pre-stored projection surface.
9. The apparatus of claim 8, further comprising: a driving unit for moving the electronic device, Wherein, the at least one processor is configured to: If an obstacle is identified as existing between the electronic device and the pre-stored projection surface, controlling the driving unit to move the electronic device to a position where the obstacle does not exist between the electronic device and the projection surface, and If the electronic device moves to a position where the obstacle does not exist between the electronic device and the projection surface, the cropped projection image is projected onto the pre-stored projection surface.
10. The device of claim 1, wherein: The at least one processor is configured to: in a case where information about the image is obtained from an external server, obtaining a user input as to whether to crop a portion of the image obtained from the external server, In a case where a user input for cropping a portion of the image obtained from the external server is obtained, the projection image is obtained by cropping a portion of the image, and the projection unit is controlled to project the projection image on a projection surface, controlling the projection unit to project the image on a projection surface in a case where a user input for not cropping a portion of the image obtained from the external server is obtained, and In a case where information on the projection image is obtained from a user terminal device, the projection image is obtained by cutting out a portion of the image obtained from the user terminal device, and the projection unit is controlled to project the projection image on a projection surface.
11. The device of claim 1, wherein: The at least one processor is configured to: If a first ratio of a vertical length to a horizontal length of the image and a second ratio of a vertical length to a horizontal length of the projection surface are different from each other, obtaining the projection image by cutting off a portion of the image, and controlling the projection unit to project the projection image on the projection surface, and If the first ratio and the second ratio are identical to each other, the projection unit is controlled to project the image on a projection surface.
12. A method for controlling an electronic device, the method comprising: obtaining information about the projection surface using at least one sensor; identifying a first region of interest in an image to be projected onto a projection surface; Based on the information about the projection surface and the information about the first region of interest, obtaining a projection image by cropping a portion of the image to include at least a portion of the first region of interest; as well as The projection image is projected onto a projection surface.
13. The method of claim 12, wherein: In the step of obtaining the projection image by cutting out a portion of the image, identifying a second region of interest in the first region of interest based on a ratio of a vertical length to a horizontal length of the projection surface, and A portion of the projection image is cropped to include a second region of interest.
14. The method of claim 13, wherein: The information about the projection surface includes a first ratio of a vertical length to a horizontal length of the projection surface, and In the step of obtaining the projection image by cropping a portion of the image, a second region of interest is identified so that a second ratio of a vertical length of the second region of interest to a horizontal length of the projection image is a first ratio.
15. A non-transitory computer-readable recording medium comprising a program for executing a method for controlling an electronic device, wherein: The method comprises: obtaining information about the projection surface using at least one sensor, identifying a first region of interest in the image to be projected on the projection surface, obtaining a projection image by cropping a portion of the image to include at least a portion of the first region of interest based on the information about the projection surface and the information about the first region of interest, and Project the image onto the projection surface.