Electronic device and control method of electronic device

Abstract

Disclosed are an electronic device and a control method of an electronic device. For example, the electronic device may comprise: a projection unit; at least one sensor; a memory that stores at least one instruction; and at least one processor that includes a processing circuit and individually and / or collectively executes the at least one instruction, wherein the at least one processor is configured to individually and / or collectively: acquire information on a first distance between the electronic device and a screen through the at least one sensor; acquire information on a second distance between the electronic device and a user through the at least one sensor; acquire information on a third distance for the distance between the user and the screen on the basis of the information on the first distance and the information on the second distance; adjust at least one parameter related to the image quality of a projected image on the basis of the information on the first distance, the information on the third distance, and information on the user's eyesight; and control the projection unit to emit light corresponding to the image on the basis of the adjusted at least one parameter.

Description

Electronic devices and methods of controlling electronic devices

[0001] The present disclosure relates to an electronic device and a method for controlling the electronic device, and for example, to an electronic device capable of providing a projection image of a quality suitable for a user's eyesight and a method for controlling the same.

[0002] Recently, technological advancements in projectors, electronic devices capable of projecting images, have been accelerating. In particular, to address the limitations of projector installation location, ultra-short-throw projectors have been introduced, capable of projecting images even at extremely short distances from the screen. Furthermore, portable or movable projectors, which allow for the freedom of image projection without (or with reduced) location constraints, are attracting attention.

[0003] However, unlike fixed-position projectors, portable or mobile projectors have variable positions of the projector and screen, which means that the distance between the projector and the screen, as well as the distance between the user and the screen, is also variable. Therefore, in the case of portable or mobile projectors, the size and brightness of the projected image projected onto the screen by the projector can change depending on the positions of the projector, the screen, and the user, which can result in a deterioration in the image quality.

[0004] Meanwhile, as a conventional technology for fixed projectors, there exists a technology to improve the image quality of a projected image based on a predefined viewing distance (e.g., the distance between the user and the screen), but there is a limitation in that it cannot be directly applied to portable or mobile projectors with variable viewing distances.

[0005] Furthermore, although there exists a technology for adjusting the size and shape of a projected image by performing functions such as zoom in / out, keystone correction, and lens shift when the positions of at least one of the projector, screen, and user change, it has the limitation of not being able to provide a projected image with improved image quality by compensating for the deterioration of the projected image quality due to the change in position. In other words, the prior art is unable to improve the image quality of the projected image by taking into account the various image quality change factors of a portable or mobile projector.

[0006] The present disclosure is intended to address the limitations of the prior art as described above, and an object of the present disclosure is to provide an electronic device and a method of controlling the same that can provide a projection image of a quality suitable for a user's eyesight even when at least one of the electronic device, the screen, and the user's position changes.

[0007] According to an exemplary embodiment of the present disclosure, an electronic device includes a projection unit including a projector, at least one sensor, a memory storing at least one instruction, and a processing circuit, and at least one processor individually and / or collectively executing the at least one instruction, wherein the at least one processor individually and / or collectively obtains information about a first distance between the electronic device and a screen through the at least one sensor, obtains information about a second distance between the electronic device and a user through the at least one sensor, obtains information about a third distance between the user and the screen based on the information about the first distance and the information about the second distance, adjusts at least one parameter related to the image quality of a projection image based on the information about the first distance, the information about the third distance, and the information about the eyesight of the user, and controls the projection unit to emit light corresponding to the image based on the adjusted at least one parameter.

[0008] Meanwhile, the at least one parameter may include a parameter for at least one of contrast, sharpness, color, and contrast enhancement of the projection image.

[0009] Meanwhile, the at least one processor may individually and / or collectively obtain information about the size of the projection image based on information about the first distance, obtain information about the brightness of the projection image based on information about the size of the projection image, and adjust the at least one parameter based on information about the brightness of the projection image.

[0010] Meanwhile, the at least one processor may individually and / or collectively obtain information about a contrast sensitivity that the user can perceive based on information about the user's eyesight, and adjust the at least one parameter based on the information about the contrast sensitivity and the information about the third distance.

[0011] Meanwhile, the at least one processor individually and / or collectively controls the projector to emit light corresponding to the image when a request for providing an image is received, identifies the size and shape of the projection image projected on the screen through the at least one sensor when the light emitted through the projector is projected onto a screen, performs keystone correction on the projection image based on the identified size and shape, obtains information about the size of the projection image corrected according to the keystone correction, and additionally adjusts the at least one parameter based on the information about the information about the size of the corrected projection image.

[0012] Meanwhile, the at least one processor may individually and / or collectively additionally adjust the at least one parameter to compensate for a reduction in resolution of the projection image based on the reduction in size of the projection image by the keystone correction, based on information about the size of the corrected projection image.

[0013] Meanwhile, the at least one processor individually and / or collectively identifies a parameter set corresponding to the information about the size, the first distance information, the third distance information, and the information about the user's eyesight among a plurality of parameter sets stored in the memory, and adjusts the at least one parameter by interpolating at least one parameter included in each of the identified parameter set and the currently set parameter set.

[0014] Meanwhile, the at least one processor individually and / or collectively controls the projector to emit light corresponding to the user interface, and when an input for selecting one of a plurality of UI items included in the user interface is received, the at least one parameter can be adjusted based on the input.

[0015] Meanwhile, the user interface may include a graph representing contrast sensitivity corresponding to the user's eyesight and a plurality of UI items representing each of a plurality of locations of the graph.

[0016] Meanwhile, the at least one processor may individually and / or collectively input information about the first distance, information about the third distance, and information about the user's eyesight into a learned neural network model to obtain a parameter set for adjusting at least one parameter related to the image quality of the projection image, and adjust the at least one parameter based on the obtained parameter set.

[0017] According to an exemplary embodiment of the present disclosure, a method for controlling an electronic device includes the steps of: obtaining information about a first distance between the electronic device and a screen; obtaining information about a second distance between the electronic device and a user; obtaining information about a third distance between the user and the screen based on the information about the first distance and the information about the second distance; adjusting at least one parameter related to the image quality of a projection image based on the information about the first distance, the information about the third distance, and the information about the eyesight of the user; and projecting the image based on the adjusted at least one parameter.

[0018] Meanwhile, the at least one parameter may include a parameter for at least one of contrast, sharpness, color, and contrast enhancement of the projection image.

[0019] Meanwhile, the control method of the electronic device may further include a step of obtaining information about the size of the projection image based on information about the first distance and a step of obtaining information about the brightness of the projection image based on information about the size of the projection image, and the step of adjusting the at least one parameter may include a step of adjusting the at least one parameter based on information about the brightness of the projection image.

[0020] Meanwhile, the method for controlling the electronic device may further include a step of obtaining information on contrast sensitivity that the user can perceive based on information on the user's eyesight, and the step of adjusting the at least one parameter may include a step of adjusting the at least one parameter based on the information on the contrast sensitivity and the information on the third distance.

[0021] Meanwhile, the control method of the electronic device may further include, when a request for providing an image is received, a step of controlling the projection unit to emit light corresponding to the image, a step of identifying the size and shape of a projection image projected on the screen through the at least one sensor when the light emitted through the projection unit is projected on the screen, a step of performing keystone correction on the projection image based on the identified size and shape, a step of obtaining information on the size of the projection image corrected according to the keystone correction, and a step of additionally adjusting the at least one parameter based on information on the size of the corrected projection image.

[0022] Meanwhile, the step of additionally adjusting at least one parameter may include a step of additionally adjusting the at least one parameter to compensate for a reduction in the resolution of the projection image based on a reduction in the size of the projection image by the keystone correction, based on information about the size of the corrected projection image.

[0023] Meanwhile, the step of additionally adjusting at least one parameter may further include the step of identifying a parameter set corresponding to the information about the size, the first distance information, the third distance information, and the information about the user's eyesight among a plurality of parameter sets stored in the memory, and the step of adjusting the at least one parameter by interpolating at least one parameter included in each of the identified parameter set and the currently set parameter set.

[0024] Meanwhile, the method for controlling the electronic device may further include a step of projecting a user interface, and the step of adjusting the at least one parameter may include a step of adjusting the at least one parameter based on a user input when a user input for selecting one UI item from among a plurality of UI items included in the user interface is received.

[0025] Meanwhile, a control method of an electronic device, wherein the user interface includes a graph representing contrast sensitivity corresponding to the user's eyesight and a plurality of UI items representing each of a plurality of positions of the graph.

[0026] According to an exemplary embodiment of the present disclosure, a non-transitory computer-readable recording medium including a program that, when individually and / or collectively executed by at least one processor of an electronic device, causes an electronic device to perform a method of controlling the electronic device, the method of controlling the electronic device including the steps of: obtaining information on a first distance between the electronic device and a screen; obtaining information on a second distance between the electronic device and a user; obtaining information on a third distance between the user and the screen based on the information on the first distance and the information on the second distance; adjusting at least one parameter related to the image quality of a projection image based on the information on the first distance, the information on the third distance, and the information on the eyesight of the user; and projecting the image based on the adjusted at least one parameter.

[0027] Other aspects, features and advantages of one or more embodiments according to the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

[0028] FIG. 1 is a block diagram exemplarily showing the configuration of an electronic device according to various embodiments of the present disclosure;

[0029] FIG. 2 is a diagram illustrating a plurality of modules according to various embodiments of the present disclosure;

[0030] FIG. 3 is a drawing for exemplarily explaining a process of acquiring distance information according to various embodiments of the present disclosure;

[0031] FIG. 4 is a drawing for exemplarily explaining a keystone correction and a parameter adjustment process according to various embodiments of the present disclosure;

[0032] FIG. 5 is a diagram illustrating a user interface according to various embodiments of the present disclosure;

[0033] FIG. 6 is a diagram exemplarily showing a user interface according to various embodiments of the present disclosure;

[0034] FIG. 7 is a block diagram exemplarily showing the configuration of an electronic device according to various embodiments of the present disclosure, and

[0035] FIG. 8 is a flowchart exemplarily showing a method for controlling an electronic device according to various embodiments of the present disclosure.

[0036] The present embodiments may be modified and have various embodiments, and various embodiments are illustrated in the drawings and described in more detail in the detailed description. However, it should be understood that the scope of the present disclosure is not limited to the embodiments, but includes various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0037] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof may be omitted.

[0038] Additionally, the following examples may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following examples. Rather, these examples are provided to explain the technical concepts of the present disclosure to those skilled in the art.

[0039] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0040] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0041] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0042] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0043] When it is said that a component (e.g., a first component) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., a second component), it should be understood that the component can be directly coupled to the other component, or can be connected via another component (e.g., a third component). When it is said that a component (e.g., a first component) is "directly coupled to" or "directly connected to" another component (e.g., a second component), it should be understood that no other component (e.g., a third component) exists between the first component and the other component.

[0044] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily indicate, for example, something "specifically designed to" in hardware.

[0045] Instead, in some contexts, the phrase "a device configured to" may indicate that the device, for example, is "capable of" doing something in conjunction with other devices or components. For example, the phrase "a processor configured (or set) to perform a, b, and c" may indicate a dedicated processor (e.g., an embedded processor) for performing the actions, or a general-purpose processor (e.g., a CPU or application processor) that can perform the actions by executing one or more software programs stored in a memory device.

[0046] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0047] The various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacings drawn in the attached drawings.

[0048] Hereinafter, various embodiments according to the present disclosure will be described in more detail with reference to the attached drawings.

[0049] FIG. 1 is a block diagram exemplarily showing the configuration of an electronic device (100) according to various embodiments of the present disclosure.

[0050] The term "electronic device (100)" refers to a device capable of projecting an image onto a screen. For example, the electronic device (100) may be implemented as a type of device referred to as a beam projector or a projector, and may also be implemented as a device such as a movable projector or a portable projector. In addition, the electronic device (100) may be implemented by mounting a projection unit (110) on various types of devices such as a smart phone, a tablet PC, a robot, etc. In other words, there is no particular limitation on the type of the electronic device (100) according to the present disclosure.

[0051] As illustrated in FIG. 1, the electronic device (100) may include a projection unit (110) (e.g., including a projector), at least one sensor (120), a memory (130), and a processor (140) (e.g., including a processing circuit).

[0052] The 'projector (110)' refers to a configuration that emits light corresponding to an image in order to project the image onto a screen. Here, the term 'emission' can be replaced with the term 'radiate', etc. The number of projectors (110) may be one or more. When there are multiple projectors (110), the plurality of projectors (110) may include a first projector (110) that emits light to be provided to the user's left eye and a second projector (110) that emits light to be provided to the user's right eye.

[0053] The projection unit (110) may include various detailed configurations such as a light source, a projection lens, and a reflector, and may perform various functions related to the projected image. An exemplary configuration and various functions of the projection unit (110) will be described in more detail with reference to FIG. 7.

[0054] A "screen" refers to a structure capable of reflecting light emitted through a projection unit (110) and providing it to a user. The screen may be fixedly attached to a wall or object in a viewing space, or any wall or object located in the viewing space itself may function as a screen. Furthermore, the screen may be implemented as a separate object capable of moving or rolling. There are no particular limitations on the type of screen according to the present disclosure.

[0055] At least one sensor (120) can obtain various information inside and outside the electronic device (100). In particular, at least one sensor (120) can include at least one of various sensors that can obtain information about the distance to an object, such as an image sensor (e.g., a camera), a lidar sensor, a laser sensor, an ultrasonic sensor, an infrared sensor, a time-of-flight (TOF) sensor, a color vision sensor, etc.

[0056] For example, in various embodiments, at least one sensor (120) may obtain information about the distance between the electronic device (100) and the screen, information about the distance between the electronic device (100) and the user, etc. For example, when at least one sensor (120) includes a TOF (Time-of-Flight) sensor, the TOF sensor may obtain information about the distance between the electronic device (100) and the screen, and information about the distance between the electronic device (100) and the user, based on the speed of light emitted by the sensor.

[0057] When at least one sensor (120) includes an image sensor, the image sensor can obtain information about the distance between the electronic device (100) and the screen and information about the distance between the electronic device (100) and the user by obtaining an image of the screen or an image of the user. The process of obtaining information about the distance between the electronic device (100) and the screen and information about the distance between the electronic device (100) and the user using the image sensor can be performed by the processor (140), and details related to obtaining information about the distance are described in detail in the description of the processor (140).

[0058] At least one instruction regarding the electronic device (100) may be stored in the memory (130). In addition, an O / S (Operating System) for driving the electronic device (100) may be stored in the memory (130). In addition, various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (130). In addition, the memory (130) may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

[0059] For example, various software modules for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (130), and the processor (140) may control the operation of the electronic device (100) by executing the various software modules stored in the memory (130). That is, the memory (130) is accessed by the processor (140), and data reading / recording / modifying / deleting / updating, etc. may be performed by the processor (140).

[0060] And, in the present disclosure, the term memory (130) may be used to mean a memory (130), a ROM, a RAM in a processor (140), or a memory card (e.g., a micro SD card, a memory stick) mounted in an electronic device (100).

[0061] For example, in various embodiments, the memory (130) may store various information / data / signals, such as information about an image, information about a plurality of parameter sets related to the image quality of a projection image, information about a first distance, information about a second distance, information about a third distance, information about a user's eyesight, information about contrast sensitivity corresponding to the user's eyesight, information about keystone correction, etc.

[0062] In addition, various information necessary within the scope of achieving the purpose of the present disclosure may be stored in the memory (130), and the information stored in the memory (130) may be updated as received from an external device or input by a user.

[0063] The processor (140) may include a processing circuit and control the overall operation of the electronic device (100). For example, the processor (140) is connected to a configuration of the electronic device (100) including a projection unit (110), at least one sensor (120), and a memory (130), and may control the overall operation of the electronic device (100) by executing at least one instruction stored in the memory (130) (by way of example, but not limited thereto).

[0064] The processor (140) may be implemented in various ways. For example, the processor (140) may be implemented as at least one of an Application Specific Integrated Circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), and a digital signal processor (DSP). Meanwhile, the term “processor (140)” in the present disclosure may be used to mean a central processing unit (CPU), a graphic processing unit (GPU), and a microprocessor unit (MPU). The processor (140) may include various processing circuits and / or multiple processors. For example, as used in the present disclosure, including the claims, the term “processor” may include various processing circuits including at least one processor, wherein one or more of the at least one processor may be configured to individually and / or collectively (collectively) perform various functions described in the present disclosure in a distributed manner. When “processor,” “at least one processor,” and “one or more processors” are described herein as being configured to perform multiple functions, these terms include, but are not limited to, situations where one processor performs some of the described functions and another processor performs other of the described functions, and situations where a single processor can perform all of the described functions. Furthermore, the at least one processor may comprise a combination of processors that perform various described / disclosed functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0065] For example, in various embodiments, the processor (140) may adjust at least one parameter related to the image quality of the projected image based on information about the distance between the electronic device (100), the screen, and the user when at least one of the positions of the electronic device (100), the screen, and the user changes.

[0066] For example, the processor (140) can obtain information about a first distance between the electronic device (100) and the screen through at least one sensor (120). In addition, the processor (140) can obtain information about a second distance between the electronic device (100) and the user through at least one sensor (120).

[0067] As described above, at least one sensor (120) may include at least one of various sensors capable of obtaining information on a distance to an object, and may obtain information on a first distance and information on a second distance using at least one of the various sensors. The term 'first distance' may be used to refer to the distance between the electronic device (100) and the screen, and the term 'second distance' may be used to refer to the distance between the electronic device (100) and the user.

[0068] For example, if at least one sensor (120) is a Time-of-Flight (TOF) sensor, the processor (140) can obtain first distance information about the distance between the electronic device (100) and the screen based on the speed of light emitted by the TOF sensor.

[0069] Additionally, the processor (140) can obtain information on a second distance between the electronic device (100) and the user based on the size of the user's Ω Shape. For example, the processor (140) can obtain a user image through an image sensor, identify the user's face size by detecting an Ω Shape in the user image, and compare the identified user's face size with a preset face size or a previously detected face size, thereby obtaining information on a second distance between the electronic device (100) and the user.

[0070] In addition, the processor (140) may obtain a user image through an image sensor, identify a distance between the user's eyes in the user image, and compare the identified distance between the user's eyes with a preset distance between the eyes or a previously detected distance between the eyes, thereby obtaining information on a second distance between the electronic device (100) and the user.

[0071] When information about the first distance and information about the second distance are obtained, the processor (140) can obtain information about a third distance between the user of the electronic device (100) and the screen based on the information about the first distance and the information about the second distance. In the description of the present disclosure, the term "third distance" is used to refer to the distance between the user and the screen.

[0072] For example, the processor (140) can obtain information about the third distance using triangulation. For example, the processor (140) can obtain information about the third distance using information about the first distance and information about the second distance, as well as information about the angle between the directions toward the first distance and the second distance, respectively. The angle between the directions toward the first distance and the second distance, respectively, can be calculated based on the angle between the direction in which light is emitted from the sensor used to measure the first distance and the direction in which light is emitted from the sensor used to measure the second distance.

[0073] The processor (140) can adjust at least one parameter related to the image quality of the projection image based on information about the first distance, information about the third distance, and information about the user's eyesight.

[0074] Adjusting at least one parameter based on information about the first distance, information about the third distance, and information about the user's eyesight may, for example, independently perform each of adjusting at least one parameter based on information about the first distance, adjusting at least one parameter based on information about the third distance, and adjusting at least one parameter based on information about the user's eyesight, or may indicate adjusting at least one parameter using the information about the first distance, the information about the third distance, and the information about the user's eyesight together.

[0075] The term "at least one parameter" is used to collectively refer to parameters related to the image quality of a projection image, and may be replaced with terms such as "image quality setting value" or "image quality adjustment value." For example, the at least one parameter may include a parameter for at least one of contrast, sharpness, color, and contrast enhancement of the projection image. In addition, the at least one parameter may include various parameters related to image quality improvement, such as setting an outline emphasis.

[0076] For example, the at least one parameter may include one or more first parameters for at least one of contrast, sharpness, color, and contrast enhancement of the projected image, and one or more second parameters that change together as the one or more first parameters change. Here, 'contrast enhancement' may represent, for example, a parameter for more clearly expressing the difference between dark and bright areas, or for better viewing of details on a dark background.

[0077] For example, a plurality of parameter sets may be stored in the memory (130), and each of the plurality of parameter sets refers to a set of at least one parameter related to image quality. The plurality of parameter sets may each correspond to a 'mode' related to the operation of the electronic device (100), such as a first image quality improvement mode, a second image quality improvement mode, an image quality emphasis mode (strong), an image quality emphasis mode (weak), etc.

[0078] Multiple parameter sets can be established through clinical trials. For example, the multiple parameter sets can be obtained by providing images corresponding to various parameter sets to multiple users with varying visual acuity, including those with low vision or visual impairment, while maintaining the electronic device (100), screen, and user positions fixed, and receiving user input regarding the visibility of the provided images. At least one of the multiple parameter sets can correspond to default parameter settings for users with specific visual acuity.

[0079] In a clinical trial, the distance between the electronic device (100) and the screen, the distance between the electronic device (100) and the user, and the distance between the screen and the user, depending on the position of the fixed electronic device (100), the screen, and the user, may each be referred to as a 'reference distance'.

[0080] Increasing the number of clinical trials and diversifying the conditions can yield a diverse set of parameters. However, simply increasing the number of clinical trials and diversifying the conditions of clinical trials is not sufficient to address the wide variety of factors related to image quality adjustment that vary depending on the variable positions of the electronic device (100), the screen, and the user. Therefore, the processor (140) can perform an image quality improvement function by adjusting at least one parameter included in a plurality of pre-established parameter sets.

[0081] Information about the user's eyesight may be stored in memory (130) and may be obtained by the user directly inputting a numerical value for eyesight. Furthermore, information about the user's eyesight may be obtained by the electronic device (100) providing an image (e.g., a projected image) and receiving a response from the user regarding whether the user can identify an object within the image.

[0082] When information about the user's eyesight is acquired, the processor (140) can identify a reference distance corresponding to the user's eyesight and a parameter set suitable for the reference distance, and provide a projection image based on the identified parameter set. However, as described above, when the first distance between the electronic device (100) and the screen, the second distance between the electronic device (100) and the user, and the third distance between the screen and the user are changed from the reference distance, it is preferable to identify a parameter set suitable for the changed first distance, second distance, and third distance, or to adjust the parameter set to be suitable for the changed first distance, second distance, and third distance.

[0083] In various embodiments, the processor (140) may obtain information about the brightness of the projected image based on information about the first distance, and adjust at least one parameter based on the information about the brightness of the projected image. For example, if the first distance is identified as being farther than the reference distance, the processor (140) may adjust at least one parameter to make the brightness of the projected image higher than the brightness corresponding to the reference distance in order to prevent or reduce a decrease in the brightness of the projected image. If the first distance is identified as being closer than the reference distance, the processor (140) may adjust at least one parameter to make the brightness of the projected image lower than the brightness corresponding to the reference distance in order to prevent or reduce an excessive increase in the brightness of the projected image, and may not adjust at least one parameter to maintain the brightness of the projected image.

[0084] In various embodiments, the processor (140) may adjust at least one parameter based on information about the third distance. For example, if the third distance is identified as being farther than the reference distance, the processor (140) may adjust at least one parameter to improve the visibility of the projected image in order to prevent the visibility of the projected image from being reduced. Conversely, if the third distance is identified as being closer than the reference distance, there is no need to prevent the visibility of the projected image from being reduced, and therefore the processor (140) may adjust at least one parameter to reduce the visibility of the projected image within a range that does not significantly reduce the visibility of the projected image, or may not adjust at least one parameter to maintain the visibility of the projected image.

[0085] A more specific method involving adjusting at least one parameter is described in detail with reference to FIG. 2 below.

[0086] The processor (140) can control the projector (110) to emit light corresponding to the image based on at least one adjusted parameter. That is, the processor (140) can control the projector (110) to emit light by adjusting the characteristics of the light corresponding to the image with the adjusted contrast, sharpness, color, and contrast enhancement as described above.

[0087] According to various embodiments, the electronic device (100) can improve the image quality of a projected image to suit the distance between the electronic device (100), the screen, and the user. Accordingly, particularly when the user of the electronic device (100) has low vision, it is possible to provide a projected image with an image quality suitable for the user's eyesight even if at least one of the positions of the electronic device (100), the screen, and the user changes.

[0088] FIG. 2 is a diagram showing a plurality of modules according to various embodiments of the present disclosure, FIG. 3 is a diagram for exemplarily explaining a process of acquiring distance information according to various embodiments of the present disclosure, FIG. 4 is a diagram for exemplarily explaining a process of adjusting parameters according to keystone correction and the corresponding parameters according to various embodiments of the present disclosure, FIG. 5 is a diagram showing a user interface according to various embodiments of the present disclosure, and FIG. 6 is a diagram showing a user interface according to various embodiments of the present disclosure.

[0089] The processor (140) may perform processes related to various embodiments according to the present disclosure using a plurality of modules. As illustrated in FIG. 2, the plurality of modules according to the present disclosure may include a first distance information acquisition module (11), an image brightness information acquisition module (12), a second distance information acquisition module (13), a third distance information acquisition module (14), a vision information application module (15), a keystone correction module (16), an image size information acquisition module (17), a user interface provision module (18), a user input reception module (19), and a parameter adjustment module (20). Each module may include various circuits and / or executable program instructions.

[0090] The plurality of modules may be implemented as hardware modules or software modules, and at least some of the modules may include a neural network model. For convenience of explanation, the description will assume that all of the plurality of modules are implemented through the memory (130) and processor (140) of the electronic device (100). However, depending on various embodiments, at least some of the plurality of modules may be implemented by an external device or server.

[0091] Below, first, various embodiments of adjusting at least one parameter based on distance information are described with reference to FIG. 3 together with FIG. 2.

[0092] In various embodiments, the processor (140) may perform an adaptive image quality improvement process depending on the variable position of the projector. For example, the processor (140) may adjust at least one parameter using the first distance information acquisition module (11), the image brightness information acquisition module (12), and the parameter adjustment module (20).

[0093] The 'first distance information acquisition module (11)' can acquire information about the first distance between the electronic device (100) and the screen. When information about the first distance is received from the first distance information acquisition module (11), the image brightness information acquisition module (12) can acquire information about the size of the projection image based on the first distance information, and can acquire information about the brightness of the projection image based on the information about the size of the projection image. For example, as illustrated in FIG. 3, as the first distance increases, the size of the projection image may increase and the brightness of the projection image may decrease.

[0094] Therefore, when information on the brightness of the projection image is received from the image brightness information acquisition module (12), the parameter adjustment module (20) can adjust at least one parameter based on the information on the brightness of the projection image.

[0095] For example, if the first distance between the electronic device (100) and the screen is doubled compared to the reference distance, the brightness of the projected image may generally be reduced to 1 / 4 compared to the brightness according to the reference distance. Accordingly, the parameter adjustment module (20) may adjust at least one parameter to compensate for the brightness of the projected image being reduced to 1 / 4.

[0096] In various embodiments, the processor (140) may perform an adaptive image quality improvement process based on the user's variable location. For example, the processor (140) may adjust at least one parameter using the first distance information acquisition module (11), the second distance information acquisition module (13), the third distance information acquisition module (14), the vision information application module (15), and the parameter adjustment module (20).

[0097] The first distance information acquisition module (11) can acquire information about a first distance between the electronic device (100) and the screen, and the second distance information acquisition module (13) can acquire information about a second distance between the electronic device (100) and the user. Then, when information about the first distance is received from the first distance information acquisition module (11) and information about the second distance is received from the second distance information acquisition module (13), the third distance information acquisition module (14) can acquire information about a third distance between the screen and the user based on the information about the first distance and the information about the second distance.

[0098] As described above, the third distance information acquisition module (14) can acquire information about the third distance using triangulation. For example, in FIG. 3, if the first distance is 5 m, the second distance is 3 m, and the angle between the lines representing the first and second distances is 90 degrees, the third distance may be approximately 5.83 m.

[0099] The vision information application module (15) can obtain information about the user's vision and apply the information about the user's vision so that it can be used to adjust at least one parameter. For example, the vision information application module (15) can obtain information about the user's perceptible contrast sensitivity based on the information about the user's vision. Contrast sensitivity can represent a measure of the user's ability to distinguish patterns or objects with different contrast levels, and can be statistically estimated based on the information about the vision. For example, the vision information application module (15) can estimate the contrast sensitivity, which indicates the degree to which the user can perceive contrast sensitivity according to the user's vision, based on statistical data previously stored in the memory (130). For example, as illustrated in FIG. 3, as the third distance increases, the user's contrast sensitivity for the projected image may decrease.

[0100] Accordingly, when information about the third distance is received from the third distance information acquisition module (14) and information about the user's contrast sensitivity is received from the vision information application module (15), the parameter adjustment module (20) can adjust at least one parameter based on the information about the sensitivity and the information about the third distance. That is, the parameter adjustment module (20) can adjust at least one parameter so as to compensate for the decrease in the user's cognitive ability for the projected image as the third distance between the screen and the user increases compared to the reference distance.

[0101] According to the various embodiments described above with reference to FIGS. 2 and 3, the electronic device (100) can improve the image quality of the projection image to be optimized for the distance between the electronic device (100), the screen, and the user. Accordingly, especially when the user of the electronic device (100) has low vision (or is visually impaired), it is possible to provide a projection image with an image quality that is suitable for the user's eyesight even if at least one of the positions of the electronic device (100), the screen, and the user changes.

[0102] Hereinafter, various embodiments of adjusting at least one parameter based on the result of keystone correction will be described with reference to FIG. 4 together with FIG. 2.

[0103] In various embodiments, the processor (140) may perform an adaptive image quality improvement process based on the results of keystone correction. For example, the processor (140) may additionally adjust at least one parameter using the keystone correction module (16), the image size information acquisition module (17), and the parameter adjustment module (20).

[0104] The processor (140) may receive a request to provide an image. The 'request to provide an image' may be received based on an input (e.g., user input), may be received from an external device, or may be received based on the occurrence of a predefined event that requires the provision of an image.

[0105] For example, a request to provide an image may be received based on a user's touch input for selecting an image to be played back, a control signal received from a remote control device, etc. A request to provide an image may be received based on an event occurring in the electronic device (100), such as powering on the electronic device (100), unlocking the electronic device (100), etc.

[0106] When a request to provide an image is received, the processor (140) can control the projector (110) to emit light corresponding to the image. For example, the processor (140) can project the image on a screen by controlling the projector (110) to emit light corresponding to the image based on image data stored in the memory (130).

[0107] When light emitted through the projector (110) is projected onto the screen, the keystone correction module (16) can identify the size and shape of the projection image projected onto the screen through at least one sensor (120). The keystone correction module (16) can perform keystone correction on the projection image based on the identified size and shape of the projection image. A more specific description of the keystone correction is described in detail in the description of FIG. 7.

[0108] The image size information acquisition module (17) can acquire information about the size of the projection image corrected according to the keystone correction. As illustrated in FIG. 4, when light emitted through the projection unit (110) is projected, a projection image having a non-rectangular shape, such as the first image (41) of FIG. 4, can be provided on the screen. When keystone correction is performed on the projection image, a projection image having a rectangular shape, such as the second image (42) of FIG. 4, can be provided. As illustrated in FIG. 4, the size of the projection image (42) corrected according to the keystone correction can be smaller than the size of the projection image (41) before correction.

[0109] When information about the size of the projection image is received from the image size information acquisition module (17), the parameter adjustment module (20) can additionally adjust at least one parameter based on the information about the size of the corrected projection image.

[0110] That is, since the size of the projection image (42) corrected according to the keystone correction may become smaller than the size of the projection image (41) before correction, the resolution of the projection image may be reduced. Therefore, the parameter adjustment module (20) may adjust at least one parameter to compensate for the reduction in the resolution of the projection image due to the reduction in the size of the projection image due to the keystone correction, based on information about the size of the corrected projection image.

[0111] In the above, various embodiments have been described on the assumption that the screen is not tilted, but if the screen is tilted, the processor (140) may obtain information about the tilt of the screen and use the information about the tilt for keystone correction.

[0112] According to the various embodiments described above with reference to FIGS. 2 and 4, the electronic device (100) can improve the image quality of a projection image provided to a user by preventing or reducing the deterioration of the image quality of the projection image due to keystone correction.

[0113] Referring to FIGS. 5 and 6 along with FIG. 2, various embodiments of adjusting at least one parameter based on user input are described.

[0114] In various embodiments, the processor (140) may perform additional image quality enhancement processes based on user input. For example, the processor (140) may additionally adjust at least one parameter using the user interface provision module (18), the user input reception module (19), and the parameter adjustment module (20).

[0115] The user interface provision module (18) can control the projector (110) to emit light corresponding to the user interface. In addition, the user input reception module (19) can receive a user input for selecting one UI item among a plurality of UI items included in the user interface. When the user input is received, the parameter adjustment module (20) can additionally adjust at least one parameter based on the user input.

[0116] The user interface may include a graph representing contrast sensitivity corresponding to the user's eyesight, and a plurality of UI items representing each of a plurality of locations on the graph. In the example of Fig. 5, vertical lines and curves of different thicknesses represent a graph representing contrast sensitivity corresponding to the user's eyesight, and the circled numbers 1 through 8 represent a plurality of UI items (or checkpoints) representing each of a plurality of locations on the graph.

[0117] When a user selects one item corresponding to an area that is judged to have poor visibility (e.g., an area that the user wants to emphasize because it is difficult to distinguish contrast or sharpness) among a plurality of UI items corresponding to circle numbers 1, 2, 3, 4, 5, 6, 7, 8 (which can be represented as 1 to 8), a user interface as illustrated in FIG. 6 may be additionally provided. In addition, the first element (61) in the form of a bar in FIG. 6 represents an area between the minimum level and the maximum level of at least one parameter, and the second element (62) in the form of a circle in FIG. 6 may represent a level selected according to a user input. If the second element (62) represents 80% of the maximum level of the parameter, the parameter adjustment module (20) may adjust the corresponding parameter to 80% of the maximum level.

[0118] In the example of Fig. 5, when a user selects a UI item corresponding to numbers 6 to 7, the contrast may be primarily adjusted, and when a user selects a UI item corresponding to numbers 1 to 5, the sharpness may be primarily adjusted. For example, when a user selects a UI item corresponding to number 3, the contrast may be increased or decreased by 30%, and the sharpness may be increased or decreased by 70%.

[0119] User input may be received based on a control signal received from a remote control device for controlling the electronic device (100), for example, but may also be received in various other ways.

[0120] In various embodiments, the processor (140) may identify a parameter set corresponding to information about a first distance, information about a third distance, and information about the user's eyesight among a plurality of parameter sets stored in the memory (130), and adjust at least one parameter by interpolating at least one parameter included in each of the identified parameter set and the currently set parameter set.

[0121] For example, if parameter set A including currently set parameter values ​​has parameter values ​​of contrast 30, sharpness 10, color 25, and contrast enhancement low, and parameter set B including maximum values ​​for adjusting image quality has parameter values ​​of contrast 50, sharpness 20, color 30, and contrast enhancement high, and the current screen size after keystone correction is 1 / 3 of the reference screen size, the parameter adjustment module (20) can obtain a new parameter set by adding a value obtained by multiplying the values ​​of parameter set A by 1 / 3 and a value obtained by multiplying the values ​​of parameter set B by 2 / 3, and adjust at least one parameter according to the new parameter set.

[0122] For another example, if parameter set A including currently set parameter values ​​and parameter set B including maximum values ​​for adjusting image quality have the same parameter values ​​as in the above example, and the distance between the screen and the user is 1 / 4 of the reference distance, the parameter adjustment module (20) can obtain a new parameter set by adding a value obtained by multiplying the values ​​of parameter set A by 1 / 4 and a value obtained by multiplying the values ​​of parameter set B by 3 / 4, and adjust at least one parameter according to the new parameter set.

[0123] The parameter adjustment module (20) can be implemented as a neural network model, and can adjust at least one parameter using the neural network model. For example, the neural network model can be trained based on a plurality of parameter sets as described above. In addition, when at least some of information about the brightness of the projection image, information about the third distance, and information about the size of the image corrected according to keystone correction are input, the neural network model can be trained to output a parameter set corresponding to the input information. In addition, the processor (140) can adjust at least one parameter based on the parameter set output by the artificial intelligence model.

[0124] In the above, referring to FIG. 2, etc., it is assumed that the electronic device (100) performs all of the functions of improving image quality according to a change in the distance between the electronic device (100) and the screen, improving image quality according to a change in the distance between the screen and the user, improving image quality reflecting the result of keystone correction, and improving image quality according to reception of user input. However, depending on the embodiment, it is of course possible to perform only some of the above image quality improvement functions.

[0125] According to the various embodiments described above with reference to FIGS. 2, 5 and 6, user satisfaction with the image quality of a projection image can be improved by allowing the user to make additional image quality adjustments.

[0126] For example, if a user inputs information about his or her eyesight, the contrast sensitivity corresponding to the user's eyesight is identified and the image quality of the projected image is adjusted based on that. However, if the user is still not satisfied, a user interface directly indicating the contrast sensitivity is provided, thereby allowing the image quality of the projected image to be further adjusted based on the user's intuitive perception.

[0127] FIG. 7 is a block diagram exemplarily showing the configuration of an electronic device (100) according to various embodiments of the present disclosure.

[0128] As illustrated in FIG. 7, the electronic device (100) may further include a projection unit (110), at least one sensor (120), a memory (130), and a processor (140), as well as a communication unit (150) (e.g., including a communication circuit), an input unit (160) (e.g., including an input circuit), and an output unit (e.g., including an output circuit). However, the configurations illustrated in FIGS. 1 and 7 are merely examples, and it is to be understood that new configurations may be added or some configurations may be omitted in addition to the configurations illustrated in FIGS. 1 and 7 when implementing the present disclosure.

[0129] Next, the projection unit (110) according to the present disclosure will be described in more detail, followed by the communication unit (150), input unit (160), and output unit.

[0130] The projection unit (110) can be implemented using various projection methods (e.g., CRT (cathode-ray tube) method, LCD (Liquid Crystal Display) method, DLP (Digital Light Processing) method, laser method, etc.). For example, the CRT method is basically the same or similar in principle to a CRT monitor. The CRT method displays an image on a screen by magnifying the image with a lens in front of the cathode-ray tube (CRT). Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of a three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0131] Another example is the LCD method, which displays images by passing light from a light source through liquid crystals. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into red, green, and blue by a dichroic mirror (a mirror that reflects only a specific color of light and transmits all others). After passing through the liquid crystals, the light can be refocused into a single point.

[0132] Another example is the DLP method, which displays images using a DMD (Digital Micromirror Device) chip. The DLP projection unit may include a light source, a color wheel, a DMD chip, a projection lens, etc. Light output from the light source can be colored as it passes through the rotating color wheel. The light passing through the color wheel is input to the DMD chip. The DMD chip contains numerous micromirrors and reflects the light input to the DMD chip. The projection lens can play a role in magnifying the light reflected from the DMD chip to the size of the image.

[0133] Another example is a laser system that uses a Diode Pumped Solid State (DPSS) laser and a galvanometer. A multi-color laser uses three DPSS lasers, one for each RGB color, with their optical axes overlapped by a special mirror. The galvanometer includes a mirror and a high-power motor that moves the mirror at high speeds. For example, the galvanometer can rotate the mirror at up to 40 kHz / sec. The galvanometer is mounted according to the scan direction, but since projectors typically scan in a planar manner, the galvanometer can also be positioned separately along the x and y axes.

[0134] The projection unit (110) may include various types of light sources. For example, the projection unit (110) may include at least one light source among a lamp, an LED, and a laser.

[0135] For example, but without limitation, the projector (110) can output images with a 4:3 screen ratio, a 5:4 screen ratio, a 16:9 wide screen ratio, etc. depending on the purpose of the electronic device (100) or the user's settings, and can output light corresponding to the image with various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), Full HD (1920*1080), etc. depending on the screen ratio.

[0136] The projection unit (110) can perform various functions to adjust the output image (i.e., the image projected onto the screen). For example, the projection unit (110) can adjust the size and shape of the output image by performing functions such as zoom, keystone, quick corner (4-corner) keystone, and lens shift.

[0137] For example, the projector (110) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, the zoom function can be performed depending on the distance from the screen. At this time, the zoom function may include a hardware method that adjusts the screen size by moving the lens and a software method that adjusts the screen size by cropping the image, etc. When the zoom function is performed, the focus of the image needs to be adjusted. For example, the method of adjusting the focus includes a manual focus method, an electric focus method, etc. The manual focus method refers to a method of focusing manually, and the electric focus method refers to a method of automatically focusing using a motor built into the projector when the zoom function is performed. When performing the zoom function, the projector (110) may provide a digital zoom function through software, and may provide an optical zoom function that performs the zoom function by moving the lens through the driving unit (120).

[0138] The projection unit (110) can perform a keystone correction function. If the height is not right for front projection, the screen may be distorted upwards or downwards. The keystone correction function refers to a function that corrects a distorted screen. For example, if distortion occurs in the left and right directions of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up and down directions, it can be corrected using vertical keystone. The quick corner (4 corner) keystone correction function is a function that corrects the screen when the center area of ​​the screen is normal but the corner areas are not balanced. The lens shift function is a function that moves the screen as it is when the screen is off the screen.

[0139] The projection unit (110) can automatically analyze the surrounding environment and projection environment without user input to provide zoom / keystone / focus functions. Specifically, the projection unit (110) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected by a sensor (depth camera, distance sensor, infrared sensor, light sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0140] The projection unit (110) can provide a lighting function using a light source. In particular, the projection unit (110) can provide a lighting function by outputting a light source using an LED. According to various embodiments, the projection unit (110) can include one LED, and according to various embodiments, the electronic device (100) can include a plurality of LEDs. The projection unit (110) can output a light source using a surface-emitting LED according to an implementation example. Here, the surface-emitting LED can mean an LED having a structure in which an optical sheet is arranged on the upper side of the LED so that the light source is evenly distributed and output. For example, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0141] The projector (110) may provide the user with a dimming function for adjusting the intensity of the light source. For example, when a user input for adjusting the intensity of the light source is received from the user through an operating interface (e.g., a touch display button or dial), the projector (110) may control the LED to output the intensity of the light source corresponding to the received user input.

[0142] The projector (110) can provide a dimming function based on content analyzed by the processor (140) without user input. For example, the projector (110) can control the LED to output the intensity of the light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0143] The projection unit (110) can control the color temperature under the control of the processor (140). The processor (140) can control the color temperature based on the content. For example, if the content is identified to be output, the processor (140) can obtain frame-by-frame color information of the content whose output has been determined. For example, the processor (140) can control the color temperature based on the obtained frame-by-frame color information. The processor (140) can obtain at least one primary color of the frame based on the frame-by-frame color information. The processor (140) can adjust the color temperature based on the obtained at least one primary color. For example, the color temperature that the processor (140) can adjust can be classified into a warm type or a cold type. Assume that a frame to be output (hereinafter, referred to as an output frame) includes a scene in which a fire has occurred. The processor (140) can identify (or obtain) that the primary color is red based on the color information included in the current output frame. In addition, the processor (140) can identify a color temperature corresponding to the identified primary color (red). The color temperature corresponding to red may be a warm type. The processor (140) can utilize an artificial intelligence model to obtain color information or a primary color of the frame. According to various embodiments, the artificial intelligence model can be stored in the electronic device (100) (e.g., memory (130)). According to various embodiments, the artificial intelligence model can be stored in an external server capable of communicating with the electronic device (100).

[0144] The communication unit (150) includes a circuit and can perform communication with an external device. For example, the processor (140) can receive various data or information from an external device connected via the communication unit (150) and can also transmit various data or information to the external device.

[0145] The communication unit (150) may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and a UWB module (Ultra-Wide Band). Specifically, the WiFi module and the Bluetooth module may each perform communication in the WiFi or Bluetooth manner. When using a WiFi module or a Bluetooth module, various connection information, such as an SSID, may be first transmitted and received, and then communication may be established using this, after which various pieces of information may be transmitted and received.

[0146] In addition, the wireless communication module can perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), etc. And, the NFC module can perform communication in the NFC (Near Field Communication) method using the 13.56MHz band among various RF-ID frequency bands such as 135kHz, 13.56MHz, 433MHz, 860~960MHz, 2.45GHz, etc. In addition, the UWB module can accurately measure ToA (Time of Arrival), which is the time it takes for a pulse to reach a target, and AoA (Ange of Arrival), which is the pulse arrival angle at the transmitting device, through communication between UWB antennas, and accordingly, precise distance and location recognition is possible within an error range of several tens of centimeters indoors.

[0147] For example, in various embodiments, the processor (140) may receive, from a remote control device for controlling the electronic device (100) via the communication unit (150), a control signal corresponding to a user input for inputting information about the user's eyesight, a control signal corresponding to a request for providing an image, a control signal corresponding to a user input for selecting one UI item from among a plurality of UI items included in a user interface, and the like.

[0148] The input unit (160) includes a circuit, and the processor (140) can receive a user command to control the operation of the electronic device (100) through the input unit (160). For example, the input unit (160) can be configured with components such as a microphone, a camera, and a remote control signal receiving unit. In addition, the input unit (160) can also be implemented in a form included in a display as a touch screen. For example, the microphone can receive a voice signal and convert the received voice signal into an electrical signal.

[0149] In particular, in various embodiments, the processor (140) may receive, through the input unit (160), a user input for inputting information about the user's eyesight, a user input corresponding to a request for providing an image, a user input for selecting one UI item from among a plurality of UI items included in the user interface, and the like.

[0150] The processor (140) can receive a user input to turn on or off a picture quality mode function dedicated to low vision (or the visually impaired) through the input unit (160), and when the picture quality mode function dedicated to low vision is turned on, can perform parameter adjustments according to various embodiments as described above.

[0151] The output unit (170) includes a circuit, and the processor (140) can output various functions that the electronic device (100) can perform through the output unit (170). In addition, the output unit (170) can include at least one of a display, a speaker, and an indicator.

[0152] The display can output image data under the control of the processor (140). For example, the display can output an image previously stored in the memory (130) under the control of the processor (140). For example, the display according to an embodiment of the present disclosure can also display a user interface stored in the memory (130). The display can be implemented as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), etc., and in some cases, the display can also be implemented as a flexible display, a transparent display, etc. However, the display according to the present disclosure is not limited to a specific type.

[0153] The speaker can output audio data under the control of the processor (140), and the indicator can be turned on under the control of the processor (140).

[0154] For example, in various embodiments, the processor (140) may control the display to display a user interface for requesting input of information about eyesight, a user interface for requesting user input for selecting a desired image, and a user interface for receiving user input for improving image quality. That is, various user interfaces, including the user interface described with reference to FIGS. 5 and 6 , may be provided to the user not only by being projected onto a screen through the projector (110), but also by being displayed on a display included in the electronic device (100).

[0155] FIG. 8 is a flowchart exemplarily showing a method for controlling an electronic device (100) according to various embodiments of the present disclosure.

[0156] The electronic device (100) can obtain information about a first distance between the electronic device (100) and the screen (S810). The electronic device (100) can obtain information about a second distance between the electronic device (100) and the user (S820). For example, the electronic device (100) can obtain information about the first distance and information about the second distance by using at least one of various sensors capable of obtaining information about the distance to an object.

[0157] The electronic device (100) can obtain information about a third distance between the user and the screen based on information about the first distance and information about the second distance (S830). For example, the electronic device (100) can obtain information about the third distance using triangulation.

[0158] The electronic device (100) can adjust at least one parameter related to the image quality of the projection image based on information about the first distance, information about the third distance, and information about the user's eyesight (S840).

[0159] The term 'at least one parameter' is used to collectively refer to parameters related to the image quality of a projection image, and may be replaced with terms such as 'image quality setting value', 'image quality adjustment value', etc. Specifically, the at least one parameter may include a parameter for at least one of contrast, sharpness, color, and contrast enhancement of the projection image.

[0160] In various embodiments, the electronic device (100) may obtain information about the brightness of the projected image based on information about the first distance, and adjust at least one parameter based on the information about the brightness of the projected image. For example, if the first distance is identified as being farther than a reference distance, the electronic device (100) may adjust at least one parameter so that the brightness of the projected image becomes higher than the brightness corresponding to the reference distance in order to prevent and / or reduce a decrease in the brightness of the projected image. If the first distance is identified as being closer than the reference distance, the electronic device (100) may adjust at least one parameter so that the brightness of the projected image becomes lower than the brightness corresponding to the reference distance in order to prevent and / or reduce an excessive increase in the brightness of the projected image, and may not adjust at least one parameter so as to maintain the brightness of the projected image.

[0161] In various embodiments, the electronic device (100) may adjust at least one parameter based on information about the third distance. For example, if the third distance is identified as being farther than the reference distance, the electronic device (100) may adjust at least one parameter to improve the visibility of the projected image in order to prevent and / or reduce the visibility of the projected image from being reduced. If the third distance is identified as being closer than the reference distance, there is no need to prevent the visibility of the projected image from being reduced, and therefore the electronic device (100) may adjust at least one parameter to reduce the visibility of the projected image within a range that does not significantly reduce the visibility of the projected image, or may not adjust at least one parameter to maintain the visibility of the projected image.

[0162] The electronic device (100) can project an image based on at least one adjusted parameter (S850). The electronic device (100) can control the projector (110) to emit light by adjusting the characteristics of light corresponding to the image with the adjusted contrast, sharpness, color, and contrast enhancement as described above.

[0163] In various embodiments, when a request to provide an image is received, the electronic device (100) can project light corresponding to the image. When the light emitted through the projector (110) is projected onto a screen, the electronic device (100) can identify the size and shape of the projection image projected onto the screen through at least one sensor (120). The electronic device (100) can perform keystone correction on the projection image based on the identified size and shape, and can obtain information on the size of the projection image corrected according to the keystone correction. In addition, the electronic device (100) can additionally adjust at least one parameter based on information on the size of the corrected projection image.

[0164] Meanwhile, in various embodiments, the electronic device (100) may project light corresponding to the user interface. When a user input for selecting one of a plurality of UI items included in the user interface is received, the electronic device (100) may adjust at least one parameter based on the user input.

[0165] Meanwhile, the control method of the electronic device (100) according to the above-described embodiment may be implemented as a program and provided to the electronic device (100). For example, the program including the control method of the electronic device (100) may be stored and provided in a non-transitory computer readable medium.

[0166] For example, in a non-transitory computer-readable recording medium including a program that causes the electronic device (100) to perform a control method of the electronic device (100) when individually and / or collectively executed by at least one processor (140) of the electronic device (100), the control method of the electronic device (100) may include a step of obtaining information on a first distance between the electronic device (100) and a screen, a step of obtaining information on a second distance between the electronic device (100) and a user, a step of obtaining information on a third distance between the user and the screen based on the information on the first distance and the information on the second distance, a step of adjusting at least one parameter related to the image quality of a projection image based on the information on the first distance, the information on the third distance, and the information on the user's eyesight, and a step of projecting the image based on the adjusted at least one parameter.

[0167] In the above, a method for controlling an electronic device (100) and a computer-readable recording medium including a program for executing the method for controlling an electronic device (100) have been briefly described, but this is only to omit redundant descriptions, and it goes without saying that various embodiments of the electronic device (100) can also be applied to a method for controlling an electronic device (100) and a computer-readable recording medium including a program for executing the method for controlling an electronic device (100).

[0168] The artificial intelligence-related function according to the present disclosure is operated through the processor (140) and memory (130) of the electronic device (100). The processor (140) may include one or more processors (140). The one or more processors (140) may include at least one of a central processing unit (CPU), a graphic processing unit (GPU), and a neural processing unit (NPU), but are not limited to the examples of the processors (140) described above.

[0169] The CPU may be a general-purpose processor (140) capable of performing not only general operations but also artificial intelligence operations, and can efficiently execute complex programs through a multi-layer cache structure. The CPU is advantageous in a serial processing method that enables organic linking of previous and subsequent calculation results through sequential calculations. The general-purpose processor (140) is not limited to the examples described above, except in cases where it is specifically referred to as a CPU.

[0170] A GPU may include a processor (140) for large-scale operations such as floating point operations used in graphics processing, and may perform large-scale operations in parallel by integrating a large number of cores. In particular, a GPU may be advantageous compared to a CPU in parallel processing methods such as convolution operations. A GPU may be used as a co-processor (140) to supplement the functions of a CPU. The processor (140) for large-scale operations is not limited to the examples described above, except in cases where it is specified as a GPU described above.

[0171] The NPU may include a processor (140) specialized in artificial intelligence operations using an artificial neural network, and each layer constituting the artificial neural network may be implemented with hardware (e.g., silicon). Since the NPU is designed specifically according to the required specifications of the company, it has a lower degree of freedom compared to a CPU or GPU, but it can efficiently process artificial intelligence operations requested by the company. As a processor (140) specialized in artificial intelligence operations, the NPU may be implemented in various forms such as a Tensor Processing Unit (TPU), an Intelligence Processing Unit (IPU), a Vision Processing Unit (VPU), etc. The artificial intelligence processor (140) is not limited to the above-described examples, except in cases where it is specified as the above-described NPU.

[0172] Additionally, one or more processors (140) may be implemented as a System on Chip (SoC). In addition to one or more processors (140), the SoC may further include a memory (130) and a network interface such as a bus for data communication between the processor (140) and the memory (130).

[0173] When a plurality of processors (140) are included in a SoC (System on Chip) included in an electronic device (100), the electronic device (100) can perform operations related to artificial intelligence (e.g., operations related to learning or inference of an artificial intelligence model) by using some of the processors (140) among the plurality of processors (140). For example, the electronic device (100) can perform operations related to artificial intelligence by using at least one of a GPU, an NPU, a VPU, a TPU, and a hardware accelerator specialized in artificial intelligence operations such as convolution operations and matrix multiplication operations among the plurality of processors (140). However, this is merely an example, and it is of course possible to process operations related to artificial intelligence by using a CPU or a general-purpose processor (140).

[0174] Additionally, the electronic device (100) can perform operations related to functions related to artificial intelligence by utilizing multiple cores (e.g., dual cores, quad cores, etc.) included in a single processor (140). For example, the electronic device (100) can perform artificial intelligence operations such as convolution operations, matrix multiplication operations, etc. in parallel by utilizing multiple cores included in the processor (140).

[0175] One or more processors (140) are controlled to process input data according to predefined operation rules or artificial intelligence models stored in the memory (130). The predefined operation rules or artificial intelligence models are characterized by being created through learning.

[0176] "Creating through learning" can refer to, for example, the creation of predefined behavioral rules or artificial intelligence models with desired characteristics by applying a learning algorithm to a large number of training data sets. This learning can occur on the device itself, where the artificial intelligence according to the present disclosure is implemented, or through a separate server / system.

[0177] An artificial intelligence model may include multiple neural network layers. At least one layer has at least one weight value and performs its operation through the operation result of the previous layer and at least one defined operation. Examples of neural networks include a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, and a transformer. The neural networks in the present disclosure are not limited to the above-described examples unless otherwise specified.

[0178] A learning algorithm is a method for training a target device (e.g., a robot) using a large amount of learning data, enabling the target device to make decisions or predictions on its own. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. Unless otherwise specified, the learning algorithms in this disclosure are not limited to the aforementioned examples.

[0179] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" may exemplarily indicate a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0180] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be at least temporarily stored or temporarily created in a device-readable storage medium, such as a manufacturer's server, an application store's server, or a memory (130) of an intermediary server.

[0181] Each of the components (e.g., modules or programs) according to the various embodiments of the present disclosure as described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in the various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration.

[0182] According to various embodiments, operations performed by a module, program or other component may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0183] Meanwhile, the terms "part" or "module" used in the present disclosure include units composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A "part" or "module" may be an integrally composed component, a minimum unit performing one or more functions, or a portion thereof. For example, a module may be composed of an application-specific integrated circuit (ASIC).

[0184] Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device (e.g., an electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored in the storage medium and operating according to the called instructions.

[0185] When the above instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0186] While the present disclosure has been illustrated and described with reference to various embodiments, it will be understood that the various embodiments are illustrative and not restrictive. Those skilled in the art will further appreciate that various changes in form and detail may be made without departing from the true spirit and scope of the present disclosure, including the appended claims and their corresponding claims. Furthermore, it will be understood that any of the embodiments described herein may be used in conjunction with any other embodiments described herein.

Claims

1. In electronic devices, A projection unit including a projector; At least one sensor; a memory storing at least one instruction; and At least one processor comprising processing circuitry and individually and / or collectively executing said at least one instruction; The above at least one processor individually and / or collectively, Obtaining information about a first distance between the electronic device and the screen through at least one sensor; Obtaining information about a second distance between the electronic device and the user through at least one sensor; Obtaining information about a third distance between the user and the screen based on information about the first distance and information about the second distance, Based on the information about the first distance, the information about the third distance, and the information about the user's eyesight, at least one parameter related to the image quality of the projection image is adjusted, An electronic device that controls the projector to emit light corresponding to the image based on at least one adjusted parameter.

2. In paragraph 1, An electronic device wherein said at least one parameter comprises a parameter for at least one of contrast, sharpness, color and contrast enhancement of said projected image.

3. In paragraph 1, The above at least one processor individually and / or collectively, Obtain information about the size of the projection image based on information about the first distance, Obtain information about the brightness of the projection image based on information about the size of the projection image, An electronic device for adjusting said at least one parameter based on information about the brightness of said projected image.

4. In paragraph 1, The above at least one processor individually and / or collectively, Obtain information about the contrast sensitivity that the user can perceive based on information about the user's eyesight, An electronic device that adjusts said at least one parameter based on information about said contrast sensitivity and information about said third distance.

5. In paragraph 1, The above at least one processor individually and / or collectively, When a request to provide an image is received, the projector is controlled to emit light corresponding to the image, When the light emitted through the above projector is projected onto a screen, the size and shape of the projection image projected onto the screen are identified through the at least one sensor, Perform keystone correction on the projection image based on the identified size and shape, Obtain information about the size of the projection image corrected according to the above keystone correction, An electronic device further adjusting said at least one parameter based on information about the size of said compensated projection image.

6. In paragraph 5, The above at least one processor individually and / or collectively, An electronic device further adjusting the at least one parameter to compensate for a reduction in the resolution of the projection image based on information about the size of the corrected projection image due to a reduction in the size of the projection image by the keystone correction.

7. In paragraph 6, The above at least one processor individually and / or collectively, Identifying a parameter set corresponding to the information about the size, the first distance information, the third distance information and the information about the user's eyesight among the plurality of parameter sets stored in the memory, An electronic device for adjusting at least one parameter by interpolating at least one parameter included in each of the identified parameter set and the currently set parameter set.

8. In paragraph 1, The above at least one processor individually and / or collectively, Controlling the projector to emit light corresponding to a user interface (UI), An electronic device that adjusts at least one parameter based on an input received for selecting one of a plurality of UI items included in the user interface.

9. In paragraph 8, An electronic device wherein the user interface comprises a graph representing contrast sensitivity corresponding to the user's eyesight and a plurality of UI items representing each of a plurality of locations of the graph.

10. In paragraph 1, The above at least one processor individually and / or collectively, By inputting information about the first distance, information about the third distance, and information about the user's eyesight into a learned neural network model, a parameter set for adjusting at least one parameter related to the image quality of the projection image is obtained, An electronic device for adjusting at least one parameter based on the acquired parameter set.

11. In a method for controlling an electronic device, A step of obtaining information about a first distance between the electronic device and the screen; A step of obtaining information about a second distance between the electronic device and the user; A step of obtaining information about a third distance between the user and the screen based on information about the first distance and information about the second distance; A step of adjusting at least one parameter related to the image quality of a projection image based on information about the first distance, information about the third distance, and information about the user's eyesight; and A method of controlling an electronic device, comprising: projecting the image based on at least one adjusted parameter; 12. In paragraph 11, A method of controlling an electronic device, wherein said at least one parameter comprises a parameter for at least one of contrast, sharpness, color and contrast enhancement of said projection image.

13. In paragraph 11, A step of obtaining information about the size of the projection image based on information about the first distance; and A step of obtaining information about the brightness of the projection image based on information about the size of the projection image; further comprising; The step of adjusting at least one parameter above comprises: A method for controlling an electronic device, comprising: adjusting at least one parameter based on information about the brightness of the projection image; 14. In paragraph 11, A step of obtaining information on contrast sensitivity that the user can perceive based on information on the user's eyesight; further comprising: The step of adjusting at least one parameter above comprises: A method for controlling an electronic device, comprising: adjusting the at least one parameter based on information about the contrast sensitivity and information about the third distance; 15. In Article 11, When a request to provide an image is received, a step of controlling the projector to emit light corresponding to the image; A step of identifying the size and shape of a projection image projected on the screen through at least one sensor when light emitted through the above projector is projected on a screen; A step of performing keystone correction on the projection image based on the identified size and shape; A step of obtaining information on the size of a projection image corrected according to the above keystone correction; and A method for controlling an electronic device, further comprising: a step of additionally adjusting at least one parameter based on information about the size of the corrected projection image;

Images