Electronic device and operating method thereof
By integrating a processor and memory into the projector, combined with a camera and sensors, a list of projection information is generated and stored, solving the problem of precise control of the projection position and purpose in different environments, and achieving flexible and precise projection effects.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2024-08-20
- Publication Date
- 2026-04-21
AI Technical Summary
Existing projectors struggle to quickly and accurately meet diverse user needs when adjusting projection position and purpose, especially in terms of poor projection quality in different environments.
By integrating a projector, memory, and processor into an electronic device, the processor executes stored instructions to receive projection information selection, adjusts the projection direction and content, and combines cameras and sensors to acquire environmental information, generating and storing a list of projection information, thereby achieving precise control over the projection position and purpose.
It enables the projector to quickly and accurately adjust the projection position and purpose in different environments, meeting diverse user needs and improving the flexibility and accuracy of projection effects.
Smart Images

Figure CN121909640A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of this disclosure relate to an electronic device and a method of operating the same, and more specifically, to an electronic device and a method of operating the same for projecting information onto various projection areas for various projection purposes. Background Technology
[0002] With the development of optical technology, various types of projectors have been developed. A projector is an electronic device used to project images by projecting light onto a specific space or plane. Users can utilize projectors to access various types of content or images. Summary of the Invention
[0003] Solution to the problem
[0004] An electronic device according to an embodiment of the present disclosure includes: a projector; a memory storing at least one instruction; and at least one processor configured to execute the at least one instruction stored in the memory.
[0005] At least one processor may be configured to execute at least one instruction stored in memory to receive a selection of first projection information, including a first projection position and a first projection purpose, from at least one projection information included in a list of projection information.
[0006] Each projection information in at least one projection information includes the projection position corresponding to the position of the projector and the projection purpose.
[0007] At least one processor may be configured to execute at least one instruction stored in memory to adjust the projection direction of the projector to a first projection position.
[0008] At least one processor may be configured to execute at least one instruction stored in memory to control the projector to project first content corresponding to the first projection purpose from a first projection position. Attached Figure Description
[0009] The above and other aspects, features, and advantages of certain embodiments of this disclosure will become clearer from the following description taken in conjunction with the accompanying drawings.
[0010] Figure 1 This is a diagram illustrating an electronic device that outputs content based on projection information according to an embodiment of the present disclosure.
[0011] Figure 2 This is a block diagram of an electronic device according to an embodiment of the present disclosure.
[0012] Figure 3 This is an internal block diagram of an electronic device according to an embodiment of the present disclosure.
[0013] Figure 4 This is a diagram used to describe the adjustment of the projection position of an electronic device according to embodiments of the present disclosure.
[0014] Figure 5 An embodiment of the present disclosure illustrates how a user can directly adjust the projection position of an electronic device.
[0015] Figure 6 This is a diagram used to describe a comparison guide image of an electronic device according to embodiments of the present disclosure.
[0016] Figure 7 An embodiment of the present disclosure illustrates how a user controls an electronic device to store projection information using a control device.
[0017] Figure 8 An embodiment of the present disclosure illustrates how a user controls an electronic device to use projection information by using a control device.
[0018] Figure 9 An embodiment of the present disclosure illustrates how a user controls the projection operation of an electronic device using a control device.
[0019] Figure 10 An embodiment of the present disclosure illustrates how a user controls the projection operation of an electronic device using a control device.
[0020] Figure 11 An embodiment of the present disclosure illustrates how a user controls the projection operation of an electronic device using a control device.
[0021] Figure 12 An embodiment of the present disclosure illustrates how a user controls the projection operation of an electronic device using a control device.
[0022] Figure 13 An embodiment of the present disclosure illustrates how a user controls the projection operation of an electronic device using a control device.
[0023] Figure 14 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure.
[0024] Figure 15 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure. Detailed Implementation
[0025] According to an embodiment of the present disclosure, an operating method of an electronic device includes: receiving a selection of first projection information, including a first projection position and a first projection purpose, from at least one projection information included in a projection information list.
[0026] The operation method includes: adjusting the projection direction to the first projection position based on the first projection information.
[0027] The operation method includes: outputting first content corresponding to the first projection target from the first projection position.
[0028] According to an embodiment of the present disclosure, a computer-readable recording medium has thereon recorded a program for performing an operation method of an electronic device on a computer, the operation method comprising: receiving a selection of first projection information including a first projection position and a first projection purpose from at least one projection information included in a projection information list.
[0029] A computer-readable recording medium has a program recorded thereon for an operation method to be executed on a computer, the operation method including: adjusting a projection direction to a first projection position based on first projection information.
[0030] A computer-readable recording medium has a program recorded thereon for an operation method to be executed on a computer, the operation method including: outputting first content corresponding to a first projection target from a first projection position.
[0031] Throughout this disclosure, the expression "at least one of a, b or c" means only a, only b, only c, both a and b, both a and c, both b and c, all of a, b and c, or variations thereof.
[0032] In the following description, embodiments of the present disclosure will be illustrated in detail with reference to the accompanying drawings, enabling those skilled in the art to readily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.
[0033] The terminology used in this disclosure is described as general terms currently in use in consideration of the functions described herein, but these terms may have different meanings depending on the intent of a person skilled in the art, precedent, or the emergence of new technologies. Therefore, the terms used herein should not be interpreted solely by their names, but must be defined based on the meaning of the terms and the description throughout the specification.
[0034] Furthermore, the terminology used in this disclosure is only for describing specific embodiments of this disclosure and is not intended to limit this disclosure.
[0035] Throughout the instruction manual, when one component is "connected" to another component, the component can not only be "directly connected" to the other component, but also be "electrically connected" to the other component through another element in between.
[0036] In this specification, particularly in the claims, the use of "the" and similar designations can refer to both the singular and the plural. Furthermore, unless there is a clear description of the order of operations according to the method of this disclosure, the described operations may be performed in a suitable order. This disclosure is not limited to the order in which the described operations are presented.
[0037] The phrases “some embodiments of this disclosure” or “embodiments of this disclosure” appearing in various places in this specification do not necessarily refer to the same embodiments of this disclosure.
[0038] Some embodiments of this disclosure can be represented by functional block configurations and various processing operations. Some or all of these functional blocks can be implemented by various numbers of hardware and / or software configurations performing a specific function. For example, the functional blocks of this disclosure can be implemented by one or more microprocessors or circuit configurations for a specific function. Additionally, for example, the functional blocks of this disclosure can be implemented using various programming languages or scripting languages. Functional blocks can be implemented by algorithms executed in one or more processors. Furthermore, this disclosure can employ common techniques of electronic environment setup, signal processing, and / or data processing. Terms such as “mechanism,” “component,” “device,” and “configuration” can be used broadly and are not limited to mechanical and physical configurations.
[0039] Furthermore, the connecting lines or components shown in the attached diagrams are only functional and / or physical or electrical connections. In actual equipment, connections between components can be represented by various replaceable or addable functional, physical, or electrical connections.
[0040] In addition, terms such as “unit,” “...device,” and “module” as described in the specification refer to a unit that performs at least one function or operation, which can be implemented in hardware or software, or in a combination of hardware and software.
[0041] Additionally, the term "user" in the instruction manual refers to a person who uses the electronic device, and may include consumers, evaluators, viewers, administrators, and installation engineers.
[0042] The present disclosure will be described in detail below with reference to the accompanying drawings.
[0043] Figure 1 This is a diagram illustrating an electronic device 100 that outputs content based on projection information according to an embodiment of the present disclosure.
[0044] refer to Figure 1 The electronic device 100 may be an electronic device capable of outputting images. According to embodiments of the present disclosure, the electronic device 100 may be a projector configured to project images onto a projection space.
[0045] Electronic device 100 can be located in any of a variety of indoor or outdoor environments. Electronic device 100 can be located on the inner or outer floor, ceiling, or side surface of any of the various facilities, equipment, and furniture around electronic device 100, such as the floor, ceiling, wall, corner of a wall or floor, partition, or other facilities, equipment, and furniture around electronic device 100.
[0046] According to embodiments of this disclosure, the electronic device 100 can be mobile. A user can place the electronic device 100 at a specific location or point, and when the desired location changes, the electronic device 100 can be moved to the new location or point desired by the user.
[0047] For example, electronic device 100 can be movably placed on a table, such as... Figure 1 As shown.
[0048] However, this disclosure is not limited thereto, and according to embodiments of this disclosure, the electronic device 100 may be stationary. The electronic device 100 may be detachably attached to a particular location, or it may be non-detachably fixed to a particular location.
[0049] Figure 1 An embodiment of the present disclosure illustrates an electronic device 100 as a stand-mounted projector. According to an embodiment of the present disclosure, the electronic device 100 may include a stand, a projector, and a connector.
[0050] The bracket can be operated as a support for holding the electronic device 100. The bracket can support the electronic device 100, so that the electronic device 100 is upright.
[0051] A projector can be a component configured to project light. According to embodiments of this disclosure, a projector can project content corresponding to a specific projection purpose from a specific projection position.
[0052] Connectors can be components that connect the projector and the stand to each other. According to embodiments of this disclosure, electronic device 100 may include one or more connectors.
[0053] According to embodiments of the present disclosure, the electronic device 100 may further include a driver configured to adjust the position of at least one of a projector, a stand, or a connector that connects the projector and the stand to each other.
[0054] According to embodiments of this disclosure, electronic device 100 can use a driver to adjust the position of at least one of a bracket, projector, or connector, thereby controlling the projector to project light from a constant (uniform) projection position.
[0055] According to embodiments of this disclosure, an electronic device 100 may be requested to generate projection information.
[0056] According to embodiments of this disclosure, electronic device 100 may include a user input unit. A user can request electronic device 100 to generate projection information by using the user input unit included in electronic device 100.
[0057] According to embodiments of this disclosure, the electronic device 100 can be controlled by a control device. According to embodiments of this disclosure, a user can send a control signal requesting the electronic device 100 to generate projection information using the control device.
[0058] According to embodiments of this disclosure, the projection information may be information about the light output by the electronic device 100. According to embodiments of this disclosure, the projection information may include the projection location and the projection purpose.
[0059] According to embodiments of this disclosure, the projection position may be information indicating the position of the projector illuminating light. The light projected by the projector may be formed in the projection area. However, this disclosure is not limited thereto, and according to embodiments of this disclosure, the projection information may include information about the position of the projection area forming the projected light, which may be included with or replace the projection position.
[0060] According to embodiments of this disclosure, the projection purpose may be information indicating the purpose of the projected content. According to embodiments of this disclosure, the electronic device 100 can be used for various purposes. For example, the electronic device 100 can be used for at least one of the following purposes: lighting purpose, application output purpose, display device purpose (e.g., monitor or television), external device content output purpose, projection keyboard purpose, and scanner purpose. The electronic device 100 can project light onto content corresponding to a specific purpose.
[0061] According to embodiments of this disclosure, electronic device 100 can generate new projection information including projection position and projection purpose in response to a request for generating projection information.
[0062] According to embodiments of this disclosure, electronic device 100 can determine the current projection position of the projector as the projection position to be included in the projection information. For example, a user can adjust the position of at least one of the projector, connector, or stand to adjust the position of the projector so that content is projected from the position desired by the user.
[0063] According to embodiments of this disclosure, based on a request received from a user for generating projection information, the electronic device 100 can determine the current projection position of the projector, adjusted by the user, as the projection position to be included in the projection information.
[0064] According to embodiments of this disclosure, the electronic device 100 may further include a camera. According to embodiments of this disclosure, the electronic device 100 can obtain images of the surrounding environment by using the camera to capture images. According to embodiments of this disclosure, the electronic device 100 can recommend appropriate projection positions based on the images obtained by capturing the surrounding environment. A user can select a projection position recommended by the electronic device 100 as the projection position to be included in the projection information by using a user input unit. The electronic device 100 can include the user-selected projection position in the projection information.
[0065] When multiple projection positions are recommended by the electronic device 100, the user can select one of them. The electronic device 100 can include the user-selected projection position in the projection information and store the projection information.
[0066] According to embodiments of this disclosure, when the projection position is determined, the electronic device 100 can project a guide pattern onto the projection area from the projection position. According to embodiments of this disclosure, the electronic device 100 can perform keystone correction on the guide pattern projected onto the projection area. According to embodiments of this disclosure, the electronic device 100 can include the keystone correction amount of the guide pattern in the projection information and store the projection information.
[0067] According to embodiments of this disclosure, electronic device 100 can perform keystone correction on a guide pattern projected onto a projection area, and then use a camera to capture the projection area on which the keystone-corrected guide pattern is projected to obtain a guide image. According to embodiments of this disclosure, electronic device 100 can include the guide image in projection information and store the projection information.
[0068] According to embodiments of this disclosure, the electronic device 100 can receive a selection of the projection purpose from a user via a user input unit. The user can select the projection purpose from a variety of purposes that can be performed by the electronic device 100 by using the user input unit.
[0069] According to embodiments of this disclosure, electronic device 100 may recommend a projection purpose based on a projection position and / or a projection area corresponding to the projection position. According to embodiments of this disclosure, electronic device 100 may recommend at least one projection purpose based on at least one of the projection position, the material, color, or size of the projection area corresponding to the projection position.
[0070] Users can select a projection destination recommended by electronic device 100 as the projection destination to be included in the projection information by using the user input unit. When multiple projection destinations recommended by electronic device 100 exist, users can select one of the multiple recommended projection destinations.
[0071] According to embodiments of this disclosure, the electronic device 100 can adjust the position of the projector to a projection position selected by the user, and then use a camera to capture an image of the projection area or projection plane corresponding to the projection position.
[0072] According to embodiments of this disclosure, electronic device 100 can analyze an image of a projection plane to identify at least one of the following: flatness, material, color, or brightness of the projection plane.
[0073] According to embodiments of this disclosure, electronic device 100 can identify ambient brightness via an illuminance sensor.
[0074] According to embodiments of this disclosure, electronic device 100 can obtain correction values for adjusting at least one of the form / shape, color, or luminance of content corresponding to a projection purpose selected by the user, based on at least one of the flatness, material, color, brightness, or ambient brightness of the projection area. According to embodiments of this disclosure, electronic device 100 can include the correction values of the content corresponding to the projection purpose in the projection information and store the projection information.
[0075] According to embodiments of this disclosure, electronic device 100 can generate projection information, which includes projection position and projection purpose as a set.
[0076] According to embodiments of this disclosure, electronic device 100 can set unique identification information for each set of projection information. For example, electronic device 100 can receive identification information, such as numbers, symbols, characters, or IDs, from a user through a user input unit or control device that indicates specific projection information.
[0077] According to embodiments of this disclosure, electronic device 100 can generate a projection information list that includes at least one piece of projection information. The projection information list may be a list that includes one or more pieces of projection information generated according to the method described above.
[0078] Therefore, according to embodiments of this disclosure, electronic device 100 can generate and store projection information including projection position and projection purpose that is expected or frequently used by the user.
[0079] According to embodiments of this disclosure, in addition to the projection information generated by the method described above, the projection information list may also include projection information pre-generated by the manufacturer of the electronic device 100. The manufacturer may pre-generate projection information and store it in the projection information list, which includes a specific projection location and a specific projection purpose as a set.
[0080] For example, manufacturers can pre-generate projection information and store it in a projection information list, in which the projection purpose is illumination when the projector's projection direction is facing the floor surface where the bracket is located and the projection area is on the floor surface.
[0081] For example, when the projection direction of the projector is perpendicular to the floor surface where the bracket is located, the manufacturer can pre-generate the projection purpose as a display extension purpose (e.g., dual-monitor function) and store the projection purpose in the projection information list.
[0082] According to embodiments of this disclosure, electronic device 100 can receive from a user selection of one of a plurality of projection information items included in a projection information list via a user input unit.
[0083] According to embodiments of this disclosure, a user can select projection information pre-generated by the manufacturer, instead of projection information set by the user. The electronic device 100 can output content corresponding to a specific projection purpose from a specific projection location based on the projection location and projection purpose included in the pre-generated projection information.
[0084] According to embodiments of this disclosure, the electronic device 100 can receive from a user, via a user input unit, a selection of one of a plurality of projection information items (e.g., first projection information) included in a projection information list. The first projection information may be information including a first projection position and a first projection purpose as a set.
[0085] According to embodiments of this disclosure, based on the selection of first projection information, the electronic device 100 can adjust the projection direction of the projector to the first projection position according to the first projection position included in the first projection information.
[0086] According to embodiments of this disclosure, when the first projection information includes information about the location of the projection area forming the projected light rather than the projection location of the projector, the electronic device 100 can adjust the projection direction of the projector to face the projection area by using the information about the location of the projection area.
[0087] According to embodiments of this disclosure, electronic device 100 can adjust the projection position of the projector to a first projection position by controlling a driver to adjust the position of at least one of the projector, the stand, or the connector that connects the projector and the stand to each other.
[0088] According to embodiments of this disclosure, based on the selection of first projection information, the electronic device 100 can control the projector to output content corresponding to the first projection purpose according to the first projection purpose included in the first projection information.
[0089] According to embodiments of this disclosure, the first projection purpose may include at least one of the following: lighting purpose, application output purpose, display purpose (e.g., monitor or television), external device content output purpose, projection keyboard purpose, or scanner purpose.
[0090] According to an embodiment of this disclosure, when the content corresponding to the first projection purpose is the first content, the electronic device 100 can output the first content corresponding to the first projection purpose to the first projection area from the first projection position.
[0091] In the following text, reference will be made to Figure 1 This disclosure will be described in more detail.
[0092] Figure 1 Reference numeral 101 in the accompanying drawings shows that when a user selects the first projection information from the pre-stored projection information, the electronic device 100 projects content A, which is the first content corresponding to the first projection purpose, from the first projection position according to the first projection information.
[0093] According to embodiments of this disclosure, the first projection information may include a first guide image. When the electronic device 100 generates the first projection information, the first guide image may be an image obtained by projecting a guide pattern from a first projection position onto a first projection area and then capturing an image of the projection area on which the guide pattern is projected.
[0094] According to embodiments of this disclosure, the first guide image may be an image obtained by electronic device 100 performing trapezoidal correction on the guide pattern and then capturing a projection area on which the trapezoidally corrected guide pattern is projected.
[0095] According to embodiments of this disclosure, electronic device 100 can adjust the position of at least one of a projector, stand, or connector in response to a user selecting first projection information, such that the projection position of the projector is at the first projection position included in the first projection information. For example... Figure 1 As indicated by reference numeral 101 in the accompanying drawings, the content A projected from the first projection position is projected onto a surface of the partition.
[0096] According to embodiments of this disclosure, electronic device 100 can project a guide pattern after adjusting the projection position of the projector to a first projection position.
[0097] According to an embodiment of this disclosure, when the trapezoidal correction amount of the guide pattern is included in the first projection information, the electronic device 100 can obtain the trapezoidal correction amount of the guide pattern from the first projection information, and perform high-speed trapezoidal correction on the guide pattern projected by the projector based on the trapezoidal correction amount.
[0098] However, this disclosure is not limited thereto, and when the trapezoidal correction amount of the guide pattern is not included in the first projection information, according to embodiments of this disclosure, the electronic device 100 can adjust the projection position of the projector to the first projection position, project the guide pattern, and then perform trapezoidal correction on the guide pattern.
[0099] According to embodiments of this disclosure, electronic device 100 can obtain a guide image by using a camera to photograph a projection area on which a guide pattern is projected.
[0100] In the following text, the guide image obtained by the electronic device 100 through the following operations will be referred to as the current guide image: in response to receiving a selection of projection information from the user, adjusting the position of the projector to a projection position according to the projection information, projecting the guide pattern from the adjusted position, and capturing an image of the projection area on which the guide pattern is projected. The current guide image can be distinguished from the image of the guide pattern included in the projection information, which was obtained when storing the projection position during the generation of the projection information. According to an example embodiment, the image of the guide pattern included in the projection information can be referred to as the stored guide image.
[0101] For example, in Figure 1 In this system, after adjusting the projection position of the projector to a first projection position, the electronic device 100 can project a guide pattern through the projector. The electronic device 100 can obtain the current guide image by using a camera to photograph the projection area on which the guide pattern is projected.
[0102] According to embodiments of this disclosure, electronic device 100 can compare the current guide image with a first guide image included in the first projection information to obtain the difference between the two.
[0103] According to embodiments of this disclosure, when the difference is equal to or greater than a certain size, the electronic device 100 can reduce the difference. To reduce the difference, the electronic device 100 can further adjust the current projection position of the projector or warp the current guiding image. Then, the electronic device 100 can output content corresponding to the projection purpose by using the projector.
[0104] According to embodiments of this disclosure, an image of a first projection area corresponding to a first projection position can be obtained using a camera, and at least one of the flatness, material, color, or brightness of the first projection area can be obtained based on the image of the first projection area.
[0105] According to embodiments of the present disclosure, the electronic device 100 may further include an illuminance sensor. According to embodiments of the present disclosure, the electronic device 100 can identify ambient brightness via the illuminance sensor.
[0106] According to embodiments of this disclosure, electronic device 100 can output first content by adjusting at least one of the form, color, or brightness of first content corresponding to the first projection purpose based on at least one of the flatness, material, color, brightness, or ambient brightness of the first projection area.
[0107] Alternatively, as described above, when a correction value for adjusting at least one of the form, color, or brightness of the first content corresponding to the first projection purpose is included in the first projection information, the electronic device 100 can obtain the correction value from the first projection information and output the first content by adjusting at least one of the form, color, or brightness of the first content corresponding to the first projection purpose using the correction value.
[0108] Figure 1 Reference numeral 103 illustrates the case where the user selects a third projection information from the list of projection information. When the user selects the third projection information, the electronic device 100 can identify the third projection position and the third projection purpose included in the third projection information.
[0109] According to embodiments of this disclosure, the electronic device 100 can adjust the projection direction of the projector to a third projection position. For example... Figure 1 As shown by reference numeral 103 in the attached figure, content B can be projected onto the table.
[0110] According to embodiments of this disclosure, electronic device 100 can adjust the projection position of the projector to a third projection position, project a guide pattern, and then perform keystone correction on the guide pattern.
[0111] According to an embodiment of this disclosure, when the keystone correction amount of the guide pattern is included in the third projection information, the electronic device 100 can obtain the keystone correction amount from the third projection information and perform keystone correction on the guide pattern projected by the projector based on the keystone correction amount.
[0112] According to embodiments of this disclosure, electronic device 100 can obtain a current guide image by using a camera to photograph a projection area on which a guide pattern is projected.
[0113] According to embodiments of this disclosure, electronic device 100 can compare the current guide image with a third guide image included in third projection information to obtain the difference between the two.
[0114] According to embodiments of this disclosure, when the difference is within a certain range, the electronic device 100 can further adjust the current projection position of the projector or distort the current guiding image to reduce the difference.
[0115] According to an embodiment of this disclosure, the electronic device 100 can output content B as third content corresponding to the third projection purpose from a third projection position.
[0116] According to embodiments of this disclosure, when a correction value for adjusting at least one of the form, color, or brightness of content corresponding to a projection purpose is included in the projection information, the electronic device 100 can obtain the correction value from the projection information and adjust at least one of the form, color, or brightness of the third content corresponding to the third projection purpose by using the correction value.
[0117] According to embodiments of this disclosure, when the correction value used to adjust content corresponding to the projection purpose is not included in the projection information, the electronic device 100 can adjust the projection position of the projector to a third projection position and use a camera to photograph the projection plane to identify the flatness, material, color, or brightness of the table serving as the projection plane. Additionally, the electronic device 100 can identify ambient brightness using an illuminance sensor.
[0118] According to embodiments of this disclosure, electronic device 100 can output third content by adjusting at least one of the form, color, or brightness of third content corresponding to a third projection purpose based on at least one of the flatness, material, color, or brightness of the projection area, or ambient brightness.
[0119] In addition to the purpose of outputting content, the purpose of projection can also include the purpose of receiving information.
[0120] According to embodiments of this disclosure, when the projection purpose includes the purpose of receiving information in addition to the purpose of outputting content, the electronic device 100 can receive information corresponding to the content output by using a camera and / or another sensor.
[0121] For example, in Figure 1 In the accompanying reference numeral 103, the third projection destination included in the third projection information may be a projection keyboard destination. According to embodiments of this disclosure, the electronic device 100 can output content B corresponding to the projection keyboard destination. The content B corresponding to the projection keyboard destination may include input keys similar to those on an actual keyboard.
[0122] Just like using a physical keyboard, users can input various keys included in content B, which is the shape of a virtual keyboard.
[0123] According to embodiments of this disclosure, electronic device 100 can receive information corresponding to content output using a camera or sensor. For example, electronic device 100 can obtain movement information of a user's finger pressing keys included in a virtual keyboard using a camera and / or an infrared sensor. Electronic device 100 can identify the key selected by the user using the position or movement information of the user's finger and perform the corresponding operation. Alternatively, electronic device 100 can connect to an external electronic device connected via a communication network and send information input based on content output to the external electronic device.
[0124] For example, in Figure 1 In the accompanying reference numeral 103, electronic device 100 can send finger position or movement information, obtained through the use of a camera or sensor, to a computer, which is an external electronic device 105. The computer can receive the finger position or movement information from electronic device 100 and recognize it as input to the computer. The computer can then perform an operation corresponding to that input.
[0125] Therefore, according to embodiments of this disclosure, users can store frequently used projection locations and projection purposes as projection information.
[0126] Furthermore, by simply selecting the desired projection information from the projection information list, the user can have the electronic device 100 project content from a specific projection location according to a specific projection purpose. The electronic device 100 can satisfy the user's needs by performing operations from various projection locations according to various projection purposes based on the projection information.
[0127] Figure 2 This is a block diagram of an electronic device 100 according to an embodiment of the present disclosure.
[0128] Figure 2 Electronic device 100 can be Figure 1 Example of an electronic device 100.
[0129] refer to Figure 2 The electronic device 100 may include a processor 110, a memory 120, and a projector 130.
[0130] The projector 130 according to embodiments of the present disclosure may be a component configured to project light outward to display images or content. The projector 130 may also be referred to as a head or projection unit. The projector 130 may include various specific components, such as a light source, a projection lens, and a reflector.
[0131] The projector 130 can project images using various projection methods, such as cathode ray tube (CRT), liquid crystal display (LCD), digital light processing (DLP), and laser methods.
[0132] Projector 130 may include various types of light sources. For example, projector 130 may include at least one of lamps, light-emitting diodes (LEDs), and lasers.
[0133] The projector 130 can output images in a 4:3 aspect ratio, a 5:4 aspect ratio, or a 16:9 aspect ratio, depending on the purpose of the electronic device 100 or the user settings. It can also output images in various resolutions (e.g., WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1180*720), WXGA (1180*800), SXGA (1180*1024), UXGA (1600*1100), Full HD (1920*1080)) depending on the aspect ratio.
[0134] The projector 130 can perform various functions for adjusting the output image. For example, the projector 130 can perform functions such as zoom, keystone correction, and lens shift. The projector 130 can perform zoom, keystone correction, and focus adjustment functions by analyzing the surrounding environment and projection environment, either under user control or automatically without user control.
[0135] The projector 130 can use red, green, and blue (RGB) LEDs as its light source. Alternatively, the projector 130 can use a white light source instead of red, green, and blue LEDs.
[0136] Projector 130 may include a digital micromirror device (DMD). Projector 130 can form patterns by controlling each of the multiple mirrors included in the DMD. A DMD is a component of fine mirrors, with tens of thousands of mirrors arranged like a chessboard, and each mirror can act as a pixel. Projector 130 can control the mirrors included in the DMD to be turned on or off. The mirrors have different tilt angles in the on and off states, thus adjusting the brightness as light is emitted or not emitted.
[0137] According to embodiments of this disclosure, when the positions of the projector 130, connector, and bracket are adjusted, the projector 130 can rotate about the x-axis, y-axis, or z-axis.
[0138] The memory 120 according to an embodiment of the present disclosure may store at least one instruction.
[0139] The memory 120 may store at least one program executed by the processor 110. In addition, the memory 120 may store data input to or output from the electronic device 100.
[0140] The memory 120 may include at least one type of storage medium selected from flash memory, hard disk, multimedia card micro, card-type memory (e.g., Secure Digital (SD) or Extreme Digital (XD) memory), random access memory (RAM), static RAM (SRAM), read-only memory (ROM), electrically erasable programmable ROM (EEPROM), programmable ROM (PROM), magnetic storage, magnetic disk, and optical disk.
[0141] According to embodiments of this disclosure, the memory 120 may store a list of projection information. The list of projection information may include at least one piece of projection information. According to embodiments of this disclosure, the projection information may be identified by unique identification information.
[0142] When the user selects the first projection information from the projection information included in the projection information list, the first projection information may include the first projection location and the first projection purpose as a set.
[0143] According to embodiments of this disclosure, the first projection purpose may include at least one of lighting purpose, application output purpose, display purpose, external device content output purpose, projection keyboard purpose, or scanner purpose. The application output purpose may indicate the output of content corresponding to various applications that can be executed by the electronic device 100, such as calendar, clock, weather, temperature, map, navigation, and notepad. The display purpose may instruct the electronic device 100 to project the corresponding content onto a monitor or television screen.
[0144] According to embodiments of this disclosure, the first projection information may further include a trapezoidal correction amount for the guide pattern.
[0145] According to embodiments of this disclosure, the first projection information may further include a first guide image, which is an image of a projection area on which a guide pattern is projected. The guide image may also be referred to as an image of the guide pattern.
[0146] According to embodiments of this disclosure, the first projection information may further include a correction value for adjusting at least one of the form, color, or brightness of the content corresponding to the first projection purpose selected by the user.
[0147] According to embodiments of the present disclosure, memory 120 may store at least one instruction for obtaining at least one of the flatness, material, color, or brightness of a projection area from a projection plane image obtained by a camera.
[0148] According to embodiments of the present disclosure, memory 120 may store at least one instruction for adjusting at least one of the form, color, or brightness of a first content corresponding to a first projection purpose by using a correction value included in the first projection information or based on at least one of the flatness, material, color, brightness, or ambient brightness of the projection area.
[0149] According to embodiments of the present disclosure, memory 120 may store at least one instruction for receiving a selection of one of the projection information included in the projection information list.
[0150] According to embodiments of the present disclosure, memory 120 may store at least one instruction for adjusting the projection position of projector 130 to a first projection position included in the first projection information based on the selection of first projection information.
[0151] According to embodiments of the present disclosure, memory 120 may store at least one instruction for controlling a driver configured to adjust the position of at least one of the bracket, projector 130, or connector.
[0152] According to embodiments of this disclosure, memory 120 may store at least one instruction for receiving information corresponding to the first content output. For example, when the first projection purpose is for projecting a keyboard or a scanner, memory 120 may store at least one instruction for receiving information corresponding to the first content output using a camera or sensor.
[0153] According to embodiments of the present disclosure, the memory 120 may store at least one instruction for adjusting the position of the projector 130 to a projection position based on a selection of projection information received from a user, projecting a guide pattern from the adjusted position, and obtaining a current guide image by photographing the projection area on which the guide pattern is projected.
[0154] According to embodiments of the present disclosure, memory 120 may store at least one instruction for obtaining the difference between the current guide image and the first guide image included in the projection information.
[0155] According to embodiments of the present disclosure, memory 120 may store at least one instruction for adjusting the difference to be within the second reference range when the difference is included in the first reference range but not included in the second reference range which is smaller than the first reference range.
[0156] According to embodiments of this disclosure, memory 120 may store at least one instruction for further adjusting the current projection position by controlling a driver.
[0157] According to embodiments of this disclosure, memory 120 may store at least one instruction for distorting the current boot image.
[0158] According to embodiments of this disclosure, memory 120 may store at least one instruction for outputting information about the guided position movement when the difference is not included in the first reference range.
[0159] According to embodiments of this disclosure, memory 120 may store at least one instruction for receiving a request for generating projection information via a user input unit.
[0160] In the following text, the projection information generated when a request for generating projection information is received from the user via the user input unit will be referred to as the second projection information. The second projection information may be information that includes a second projection position and a second projection destination as a set.
[0161] According to embodiments of the present disclosure, memory 120 may store at least one instruction for determining the current projection position of projector 130 as a second projection position based on a received request for generating projection information.
[0162] According to embodiments of the present disclosure, memory 120 may store at least one instruction for recommending a projection location based on surrounding images obtained by a camera in response to receiving a request for generating projection information.
[0163] According to embodiments of the present disclosure, memory 120 may store at least one instruction for determining a projection position selected by the user from recommended projection positions as a second projection position.
[0164] According to embodiments of the present disclosure, memory 120 may store at least one instruction for determining a projection destination selected by the user input unit as a second projection destination.
[0165] According to embodiments of the present disclosure, memory 120 may store at least one instruction for recommending at least one projection purpose based on at least one of a second projection position or a second projection region corresponding to the second projection position.
[0166] According to embodiments of the present disclosure, memory 120 may store at least one instruction for determining a projection destination selected by a user from at least one recommended projection destination as a second projection destination.
[0167] According to embodiments of the present disclosure, memory 120 may store at least one instruction for recommending at least one projection purpose based on at least one of the material, color, or size of a second projection area corresponding to a second projection position.
[0168] According to embodiments of the present disclosure, the memory 120 may store at least one instruction for controlling the projector 130 to project a guide pattern from a second projection position onto a second projection area, performing keystone correction on the projected guide pattern, and storing second projection information by including the keystone correction amount of the guide pattern into the second projection information.
[0169] According to embodiments of the present disclosure, the memory 120 may store at least one instruction for controlling the projector 130 to project a guide pattern from a second projection position onto a second projection area, performing keystone correction on the projected guide pattern, obtaining a second guide image of a second projection area on which the keystone-corrected guide pattern is projected, and storing second projection information by including the second guide image in the second projection information.
[0170] According to embodiments of the present disclosure, memory 120 may store at least one instruction for obtaining at least one of the flatness, material, color, or brightness of a projection area from an image obtained by photographing the projection plane from a second projection position with a camera, obtaining ambient brightness by an illuminance sensor, and storing second projection information by including correction information for correcting at least one of the form, color, or brightness of a second content corresponding to a second projection purpose based on at least one of the flatness, material, color, brightness, or ambient brightness of the projection area into the second projection information.
[0171] According to embodiments of the present disclosure, the electronic device 100 may include at least one processor 110. The processor 110 according to embodiments of the present disclosure can control the overall operation of the electronic device 100.
[0172] At least one processor 110 can execute at least one instruction stored in memory 120 to control the operation of electronic device 100.
[0173] According to embodiments of the present disclosure, at least one processor 110 may execute at least one instruction to receive a selection of first projection information, including a first projection position and a first projection purpose, from at least one piece of projection information included in a projection information list.
[0174] According to embodiments of this disclosure, at least one processor 110 can adjust the projection direction of the projector 130 to a first projection position based on first projection information, and output first content corresponding to the first projection purpose from the first projection position.
[0175] According to embodiments of the present disclosure, at least one processor 110 can adjust the projection direction of the projector 130 to a first projection position by controlling a driver configured to adjust the position of at least one of the bracket, projector 130, or connector.
[0176] According to embodiments of this disclosure, when the first projection information includes a correction value for the first content corresponding to the first projection purpose, at least one processor 110 can output the first content by correcting the first content using the correction value.
[0177] According to embodiments of this disclosure, when the correction value of the first content corresponding to the first projection purpose is not included in the first projection information, at least one processor 110 can obtain at least one of the flatness, material, color, or brightness of the projection area from the projection plane image, obtain the ambient brightness through an illuminance sensor, and output the first content by adjusting at least one of the form, color, or brightness of the first content corresponding to the first projection purpose based on at least one of the flatness, material, color, brightness, or ambient brightness of the projection area.
[0178] According to embodiments of this disclosure, when the first projection purpose is one of the projection keyboard purpose and the scanner purpose, at least one processor 110 can receive information corresponding to the first content output by using a camera.
[0179] According to embodiments of this disclosure, when the first projection purpose is to project a keyboard, at least one processor 110 can receive information corresponding to the first content output by using a camera and an infrared sensor together.
[0180] According to embodiments of this disclosure, the first projection information may include a first guide image, and the first guide image may be an image of a guide pattern projected from a first projection position when the first projection information is generated.
[0181] According to embodiments of the present disclosure, at least one processor 110 can obtain a current guide image by projecting a guide pattern from a first projection position adjusted based on first projection information, and obtain the difference between the current guide image and the first guide image.
[0182] According to embodiments of this disclosure, when the difference is included in a first reference range but not in a second reference range smaller than the first reference range, at least one processor 110 may perform at least one of distorting the current guide image or further adjusting the current projection position by controlling a driver, such that the difference is within the second reference range.
[0183] According to embodiments of this disclosure, when the difference is not included in the first reference range, at least one processor 110 can output information about the movement of the guide position.
[0184] According to embodiments of this disclosure, at least one processor 110 may receive a request from a user for generating projection information.
[0185] According to embodiments of the present disclosure, at least one processor 110 can obtain a surrounding image, namely at least one of a surrounding space image or surrounding space depth information, and obtain information about the surrounding space based on the surrounding image.
[0186] According to embodiments of this disclosure, in response to receiving a request from a user for generating projection information, at least one processor 110 may recommend a projection position based on at least one of information about the surrounding space or the current projection position of the projector 130.
[0187] According to embodiments of this disclosure, at least one processor 110 can determine a projection position selected from recommended projection positions as a second projection position.
[0188] According to embodiments of this disclosure, at least one processor 110 may receive a selection of a second projection destination from a user. The processor 110 may generate second projection information that includes a second projection position and a second projection destination as a set.
[0189] According to embodiments of the present disclosure, at least one processor 110 may recommend at least one projection target based on a second projection position or at least one of a second projection region corresponding to the second projection position, and determine the projection target selected from the recommended at least one projection target by the user input unit as the second projection target.
[0190] According to embodiments of the present disclosure, at least one processor 110 may recommend at least one projection purpose based on at least one of a second projection position, the material, color, or size of a second projection area corresponding to the second projection position.
[0191] According to embodiments of the present disclosure, at least one processor 110 can control a projector 130 to project a guide pattern onto a second projection area from a second projection position, and perform keystone correction on the projected guide pattern.
[0192] According to embodiments of this disclosure, at least one processor 110 can store second projection information by controlling the projector 130 to include a keystone correction amount for the guide pattern.
[0193] According to embodiments of the present disclosure, at least one processor 110 can obtain a second guide image on which a second projection area with a trapezoidally corrected guide pattern is projected.
[0194] According to embodiments of the present disclosure, at least one processor 110 can store second projection information by including a second guide image in the second projection information.
[0195] According to embodiments of this disclosure, at least one processor 110 can obtain at least one of the flatness, material, color, or brightness of the projection area from an image obtained by capturing a projection plane from a second projection position. At least one processor 110 can obtain ambient brightness via an illuminance sensor.
[0196] According to embodiments of the present disclosure, at least one processor 110 can store second projection information by including correction information for correcting at least one of the form, color, or brightness of a second content corresponding to a second projection purpose based on at least one of the flatness, material, color, brightness, or ambient brightness of the projection area into the second projection information.
[0197] Figure 3 This is an internal block diagram of an electronic device 100 according to an embodiment of the present disclosure.
[0198] Figure 3 Electronic device 100 can be Figure 1 or Figure 2 Example of an electronic device 100.
[0199] refer to Figure 3 According to embodiments of this disclosure, in addition to the processor 110, memory 120, and projector 130, the electronic device 100 may also include a user input unit 140, a driver 150, a sensing unit 160, a communicator 170, and an external device interface 180. In the following, references to [other components] are omitted. Figure 1 or Figure 2 The description is a repetitive description.
[0200] According to embodiments of the present disclosure, the user input unit 140 can receive user input for controlling the electronic device 100. The user input unit 140 may include various types of user input devices, including touch panels for detecting user touch, touchpads (contact capacitive, pressure resistance, infrared detection, surface ultrasonic conduction, overall tension measurement, or piezoelectric effect types), buttons for receiving user push operations, scroll wheels for receiving user rotation operations, toggle switches, keyboards, keypads, dome switches, microphones for voice recognition, and motion detection sensors for detecting motion, but not limited to these.
[0201] According to embodiments of this disclosure, the user input unit 140 may be disposed in the bracket of the electronic device 100. The user input unit 140 may be disposed on the top or side of the bracket, or disposed on the main body of the bracket.
[0202] According to an embodiment of this disclosure, when the electronic device 100 is operated by a control device (remote controller), the user input unit 140 can receive control signals from the control device.
[0203] According to embodiments of this disclosure, the control device configured to control electronic device 100 may be a remote control dedicated to electronic device 100 (which only controls electronic device 100) or an integrated remote control configured to control other electronic devices. According to embodiments of this disclosure, electronic device 100 may be controlled by a smartphone or computer. For example, a user may install an application for controlling electronic device 100 on a smartphone and execute the application to control various functions of electronic device 100. Alternatively, a user may use a computer to browse a website for controlling electronic device 100 and control various functions of electronic device 100 from that website.
[0204] According to embodiments of this disclosure, the user input unit 140 can receive control signals from a user. The user can input control signals using the user input unit 140 to generate projection information. The user can send control signals to the electronic device 100 to generate projection information by using a smartphone application or by selecting a specific button on the user input unit 140 (e.g., a button or key located in a bracket included in the electronic device 100).
[0205] According to embodiments of this disclosure, the user input unit 140 may receive from the user the selection of the projection position and / or projection purpose for generating projection information.
[0206] According to embodiments of this disclosure, users can directly set the projection position by physically adjusting the position, height, angle, etc. of the projector 130, connector, or bracket.
[0207] According to embodiments of this disclosure, when a user can control the position of the projector 130 or the driver 150 by using the user input unit 140, the user can adjust the projection position of the projector 130 by using a knob or wheel or by using a key or button provided in the user input unit 140.
[0208] According to embodiments of this disclosure, when the electronic device 100 recommends a projection location or projection purpose by analyzing an image on a projection plane, the user can select the projection location and / or projection purpose recommended by the electronic device 100 by using the user input unit 140.
[0209] According to embodiments of this disclosure, the user input unit 140 can receive from a user a selection of one of a plurality of projection information items included in a projection information list.
[0210] According to embodiments of the present disclosure, the driver 150 can adjust the position of at least one of the bracket, projector 130, or connector. According to embodiments of the present disclosure, the driver 150 may include at least one of a gear, motor, or reducer. According to embodiments of the present disclosure, the driver 150 can adjust the rotation angle of each of the bracket, projector 130, and connector to allow the projector 130 to rotate freely along the x, y, and z axes.
[0211] According to embodiments of this disclosure, when the height of the bracket is adjustable, the driver 150 can adjust the height of the bracket according to the control of the processor 110. The driver 150 can adjust the height of the bracket by increasing or decreasing the height of the overlapping portion of the bracket and connector.
[0212] According to embodiments of this disclosure, the driver 150 can adjust the rotational angle between the bracket and the connector. Additionally, when two or more connectors are included in the electronic device 100, the driver 150 can adjust the rotational angle between the connectors. The driver 150 can also adjust the rotational angle between the projector 130 and the connector.
[0213] According to embodiments of this disclosure, the sensing unit 160 may include a sensor. The sensor can obtain sensing information by detecting the state of the electronic device 100 or the state around the electronic device 100, and send the sensing information to the processor 110.
[0214] According to embodiments of this disclosure, the sensing unit 160 may include an image sensor. According to embodiments of this disclosure, the image sensor may include a camera. The camera can capture images of objects located adjacent to the projector 130. The camera may include a lens and a sensor, such as a charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS), and can acquire an image formed on a screen by capturing the object. The image sensor can convert information about the object formed by light into an electrical signal. Additionally, the image sensor can perform one or more of the following signal processing on the captured image: automatic exposure (AE), automatic white balance (AWB), color restoration, corrective sharpening, gamma correction, and lens shading correction.
[0215] According to embodiments of this disclosure, the sensing unit 160 may include a depth sensor. The depth sensor can calculate the distance between the camera and the object and obtain information about the space in which the object is located by using the time required for light emitted toward the object (e.g., a projection plane) to be reflected back after being reflected at the object. According to embodiments of this disclosure, the depth sensor can identify three-dimensional (3D) depth using one of a stereo-type method, a time-of-flight (ToF) method, and a structured patterning method.
[0216] The depth sensor may be included in the electronic device 100 as a separate module or block from the image sensor, but is not limited thereto, and the depth sensor may be included in the image sensor. For example, the depth sensor may be included in a camera with depth functionality, and the distance to the object is obtained when an image of the object is acquired.
[0217] The sensing unit 160 may further include at least one of a position sensor, an accelerometer, or a gyroscope sensor. The sensing unit 160 can detect the orientation of the electronic device 100 by using at least one of the position sensor, accelerometer, or gyroscope sensor.
[0218] According to embodiments of the present disclosure, the sensing unit 160 can obtain raw data for estimating the rotation angle of the electronic device 100 by using at least one of a position sensor, an accelerometer, or a gyroscope sensor. According to embodiments of the present disclosure, the processor 110 can identify the rotation angle of the electronic device 100 relative to three axes (i.e., the x-axis, y-axis, and z-axis) based on the raw data obtained by the sensing unit 160.
[0219] The sensing unit 160 may include an illuminance sensor. The sensing unit 160 can detect the brightness around the electronic device 100 by using the illuminance sensor.
[0220] According to embodiments of the present disclosure, the communicator 170 can connect the electronic device 100 to a peripheral device, external device, or server under the control of the processor 110. Based on the performance and architecture of the electronic device 100, the communicator 170 may include at least one of a wireless local area network (LAN), Bluetooth, or wired Ethernet.
[0221] According to embodiments of this disclosure, the communicator 170 can communicate with at least one external electronic device or external server via a wired or wireless communication network. The communicator 170 can receive video or images from the external electronic device or external server, receive content corresponding to the projection purpose, or download various applications.
[0222] According to embodiments of this disclosure, the communicator 170 may include at least one short-range communication module that performs communication according to a communication standard (e.g., Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), NFC / RFID, Wi-Fi Direct, UWB, or ZigBee).
[0223] Additionally, the communicator 170 may also include a long-distance communication module that communicates with a server according to long-distance communication standards to support long-distance communication. Specifically, the communicator 170 may include a long-distance communication module that performs communication via a network used for Internet communication. For example, the communicator 170 may include a long-distance communication module that performs communication via a communication network according to communication standards (e.g., third-generation (3G), fourth-generation (4G), and / or fifth-generation (5G)).
[0224] According to embodiments of this disclosure, the communicator 170 can receive control signals via a control device (e.g., a remote control or a smartphone). The control signals can be Bluetooth type, radio frequency (RF) signal type, or Wi-Fi type.
[0225] An external device interface 180 according to an embodiment of the present disclosure can perform communication by being connected to an external electronic device via a wired connection. According to an embodiment of the present disclosure, the external device interface 180 may include at least one port to be connected to an external electronic device via a wired cable.
[0226] According to embodiments of this disclosure, the external device interface 180 may include at least one of a high-definition multimedia interface (HDMI) port, a component jack, a personal computer (PC) port, or a universal serial bus (USB) port.
[0227] According to embodiments of this disclosure, the external device interface 180 may be disposed in a region of the electronic device 100. For example, the external device interface 180 may be disposed on the rear surface of a support member of a bracket included in the electronic device 100. The electronic device 100 may receive external input signals from external devices through the external device interface 180, and may also output external input signals through the electronic device 100.
[0228] According to embodiments of this disclosure, the external device interface 180 can receive additional information from a device outside the electronic device 100, such as video (e.g., motion picture signals or still image signals), audio (e.g., voice signals or music signals), and metadata.
[0229] According to embodiments of this disclosure, at least one processor 110 may recommend a projection location based on a request received from a user for generating projection information.
[0230] According to embodiments of the present disclosure, the processor 110 can obtain information about the surrounding space through the sensing unit 160. According to embodiments of the present disclosure, the projector 130 of the electronic device 100 can rotate by a specific angle or a larger angle on each of the x-axis, y-axis and z-axis. Therefore, the sensing unit 160 disposed near the projector 130 can also rotate with the projector 130 to obtain images of the surrounding space at multiple angles.
[0231] According to embodiments of this disclosure, the processor 110 can obtain ambient spatial depth information via a depth sensor. According to embodiments of this disclosure, the ambient spatial depth information can represent distance information from the surrounding environment or structures.
[0232] According to embodiments of this disclosure, processor 110 can acquire information about the surrounding space based on at least one of an image of the surrounding space or depth information of the surrounding space obtained by sensing unit 160. According to embodiments of this disclosure, processor 110 can acquire information about the surrounding space by considering the environment connecting the surrounding space with points, lines, or surfaces, the surfaces or positions of objects arranged in the surrounding space, and geometric information. According to embodiments of this disclosure, processor 110 can acquire color information and depth information based on the rotation angle of projector 130 for each axis.
[0233] According to embodiments of this disclosure, processor 110 can recommend a projection location based on information about the surrounding space.
[0234] According to embodiments of this disclosure, processor 110 can identify less curved and flat regions in the projection space based on information about the surrounding space, and recommend flat regions as projection locations.
[0235] When the color of the projection plane is darker, the projected light appears dimmer because even when light is projected with the same brightness or luminance, the amount of light reflected from the object is less. According to embodiments of this disclosure, the processor 110 can recommend areas of the projection plane that are brighter than a certain luminance as projection locations based on information about the surrounding space.
[0236] According to embodiments of this disclosure, processor 110 can identify, based on information about the surrounding space, the location where the trapezoidally corrected projected image can be projected widest, and recommend that location as the projection location.
[0237] According to embodiments of this disclosure, processor 110 can recommend projection targets. According to embodiments of this disclosure, processor 110 can recommend projection targets suitable for a projection location based on at least one of information about the surrounding space or the projection location.
[0238] According to embodiments of this disclosure, the processor 110 can identify whether the projection position is facing a wall or partition, above a table, or towards the ceiling based on information about the surrounding space and the projection position of the projector 130 (i.e., the rotation angle relative to each of the x, y, and z axes).
[0239] For example, when the projection location is determined to be facing a wall or partition, the processor 110 can recommend a dual-monitor purpose or an application execution purpose as the projection purpose. For example, when the projection location is determined to be facing above a table, the processor 110 can recommend a scanning function, a virtual keyboard function, or a lighting function as the projection purpose. For example, when the projection location is determined to be facing the ceiling, the processor 110 can recommend a sleep function, etc., as the projection purpose.
[0240] According to embodiments of this disclosure, processor 110 can predict the size of the projection plane based on at least one of information about the surrounding space or the projection position of projector 130. According to embodiments of this disclosure, processor 110 can recommend another projection purpose based on the size of the projection plane. For example, when the size of the projection plane is a specific size or smaller, processor 110 can recommend an application execution / output purpose (e.g., a clock or calendar) as the projection purpose. For example, when the size of the projection plane is larger than a specific size, processor 110 can recommend a display device purpose (e.g., dual displays) or an external device content output purpose as the projection purpose.
[0241] When the user selects the first projection information from the pre-stored projection information, the processor 110 can correct and output the shape of the first content corresponding to the first projection purpose based on the projection position and information about the surrounding space.
[0242] According to embodiments of this disclosure, processor 110 can correct the shape of the first content, such as the color, brightness, form, and size of the first content. For example, when the first projection area corresponding to the first projection position is darker than the reference brightness, processor 110 can project the first content after correcting the brightness of the first content to be brighter than the original brightness. For example, when the first projection area is redder than the reference area, processor 110 can project the first content after correcting the color of the first content to reduce the red portion of the first content.
[0243] Figure 4 This is a diagram illustrating the adjustment of the projection position of an electronic device 100 according to an embodiment of the present disclosure.
[0244] refer to Figure 4 The electronic device 100 may include a head 401, a connector 402, and a bracket 404. Figure 4 The electronic device 100 shown is an example, and the structure or shape of the head 401, connector 402 and bracket 404 may vary.
[0245] According to embodiments of the present disclosure, head 401 is a component configured to project light and may be included in projector 130.
[0246] The bracket 404 can operate as a support for holding the electronic device 100. The bracket 404 can support the electronic device 100 so that the electronic device 100 is upright. The bracket 404 may include other components, such as a body portion 404-1 for supporting the connector 402 and a support member 404-2 for holding the bracket 404 in the upright position.
[0247] However, Figure 4 The electronic device 100 shown is an example, and the electronic device 100 may not include the bracket 404 and may be attached to and suspended from the wall or ceiling.
[0248] Connector 402 may be an assembly that connects head 401 and support 404 to each other. Connector 402 may be referred to as an arm or skeleton. According to embodiments of this disclosure, electronic device 100 may include one or more connectors 402.
[0249] exist Figure 4 In this example, the electronic device 100 includes two connectors 402, namely a first connector 402-1 and a second connector 402-2. However, this is only an example, and the electronic device 100 may include one connector 402, or three or more connectors 402.
[0250] According to an embodiment of this disclosure, the head 401 can be rotatably connected to the first connector 402-1. The head 401 and the first connector 402-1 can be rotatably connected to each other using a motor. The head 401 can be rotated from 0° to 360° using a straight line extending from the first connector 402-1 as a rotation axis. In the following, the rotation angle of the head 401 will be referred to as θ1.
[0251] exist Figure 4 In the first connector 402-1, the head 401 and the connector 403 can be connected to each other, and the second connector 402-2 can connect the connector 403 and the bracket 404 to each other.
[0252] like Figure 4 As shown, when the electronic device 100 includes a plurality of connectors 402, the plurality of connectors 402 can be rotatably combined via a connector 403. The connector 403 may also be referred to as a hinge. According to an embodiment of the present disclosure, the connector 403 may include a motor for rotatably combining the first connector 402-1 and the second connector 402-2 with each other.
[0253] For example, in the XYZ coordinate system, when the support 404-2 is located on the XY plane formed by the X-axis and Y-axis, the second connector 402-2 is parallel to the Z-axis.
[0254] According to embodiments of this disclosure, the first connector 402-1 can rotate in a circular manner on the YZ plane, which is a horizontal plane formed by the Y-axis and the Z-axis. In other words, the first connector 402-1 can rotate using the X-axis as the axis of rotation. The first connector 402-1 can rotate about the X-axis while forming a rotation angle from 0° to 360° with the Z-axis. The rotation angle of the first connector 402-1 will be referred to as θ2.
[0255] According to embodiments of this disclosure, when θ2 is 0°, the content can be projected onto the ceiling. According to embodiments of this disclosure, when θ2 is 90°, the content projected from the projection position can be projected onto a wall or partition. According to embodiments of this disclosure, when θ2 is 180°, the content projected from the projection position can be projected onto the surface of a table or floor where the support member 404-2 of the bracket 404 is located.
[0256] According to an embodiment of this disclosure, the second connector 402-2 can be rotatably connected to the bracket 404. A motor is disposed between the second connector 402-2 and the main body portion 404-1, so that the second connector 402-2 can be rotated from 0° to 360° around the Z-axis in the XY plane using the motor and the Z-axis as the rotation axis. The rotation angle of the second connector 402-2 will be referred to as θ3.
[0257] According to embodiments of the present disclosure, the driver 150 can adjust each of θ1, θ2 and θ3 by using at least one of gears, motors or reducers, where θ1, θ2 and θ3 are rotation angles of the head 401, the first connector 402-1 and the second connector 402-2.
[0258] According to an embodiment of this disclosure, the projection position of the projector 130 can be determined by a combination of θ1, θ2 and θ3, where θ1, θ2 and θ3 are the rotation angles of the head 401, the first connector 402-1 and the second connector 402-2.
[0259] Figure 5 An embodiment of the present disclosure is shown in which a user directly adjusts the projection position of an electronic device 100.
[0260] According to embodiments of this disclosure, electronic device 100 may output guide pattern 510 to notify user of projection position.
[0261] like Figure 5 As shown, the user can directly set the projection direction by adjusting the rotation angles of the head 401, the first connector 402-1, and the second connector 402-2. For example, the user can directly adjust the rotation angles of the head 401, the first connector 402-1, and the second connector 402-2.
[0262] Users can adjust the projection position to the desired position by directly adjusting the rotation angle of the head 401, the first connector 402-1 and the second connector 402-2, while viewing the position where the guide pattern 510 is formed.
[0263] Then, the user can request the generation of projection information by using the user input unit 140.
[0264] According to embodiments of this disclosure, when a user requests the generation of projection information, the electronic device 100 can store the current projection position of the projector in the projection information.
[0265] According to embodiments of the present disclosure, electronic device 100 can project a guide pattern 510 from a current projection position and perform keystone correction on the projected guide pattern 510.
[0266] According to embodiments of this disclosure, electronic device 100 can obtain a trapezoidal correction amount of guide pattern 510 or an image of guide pattern 510 with trapezoidal correction, and store projection information by including the trapezoidal correction amount or image together with the projection position in projection information.
[0267] However, this disclosure is not limited thereto, and according to embodiments of this disclosure, electronic device 100 can obtain images of its surroundings by using a camera to capture images of the area around electronic device 100, and determine the optimal projection area or projection plane by analyzing the surrounding images.
[0268] According to embodiments of this disclosure, electronic device 100 can obtain information about the surrounding space and identify at least one of the material, color, or size of the projected area from the information about the surrounding space.
[0269] According to embodiments of this disclosure, electronic device 100 may recommend a projection plane or a projection position corresponding to the projection plane based on at least one of the material, color, or size of the projection area.
[0270] For example, electronic device 100 can determine the optimal projection plane and recommend it to the user by considering factors such as whether the projection plane is flat, whether the size of the keystone-corrected image is a specific size or larger, or whether the color of the projection area is bright. Electronic device 100 can receive the user's selection of the projection position and store the projection information by including the projection position in the projection information.
[0271] Therefore, according to embodiments of this disclosure, a user or electronic device 100 can adjust the rotation angle of the head 401, the first connector 402-1, and the second connector 402-2 to adjust the projection position of the projector and project content in various directions.
[0272] Figure 6This is a diagram used to describe a comparison guide image of an electronic device 100 according to an embodiment of the present disclosure.
[0273] According to embodiments of this disclosure, when generating projection information, the electronic device 100 may include a guide image in the projection information.
[0274] According to an embodiment of this disclosure, when generating first projection information, the electronic device 100 can receive a selection of a first projection position and project a guide pattern from the first projection position onto a first projection area.
[0275] exist Figure 6 In the figure, reference numeral 610 shows an example of a guide pattern.
[0276] According to embodiments of this disclosure, electronic device 100 can generate a guide pattern with a specific pattern. According to embodiments of this disclosure, electronic device 100 can generate patterned light using a DMD. According to embodiments of this disclosure, the guide pattern can have any pattern, such as a straight line pattern, a diagonal pattern, or a grid pattern. Alternatively, the guide pattern can be a white monochrome pattern without any design. Alternatively, the guide pattern can be a rectangle with no internal color and only four white sides or only four white corners.
[0277] According to embodiments of this disclosure, electronic device 100 can obtain the geometric relationship between electronic device 100 and projection plane by using projection position, and perform trapezoidal correction on guide pattern based on the geometric relationship.
[0278] According to embodiments of this disclosure, electronic device 100 can capture a guide pattern that has undergone trapezoidal correction by projecting it onto a first projection area using a camera. Electronic device 100 can obtain a first guide image by capturing the projection area that forms the guide pattern.
[0279] exist Figure 6 In the figure, reference numeral 620 shows a first guide image obtained by capturing a guide pattern projected from a first projection position.
[0280] According to embodiments of this disclosure, electronic device 100 can store first projection information by including a first guide image in first projection information.
[0281] Then, the electronic device 100 can project content from different projection positions based on different projection information. Alternatively, the user can move the support of the bracket included in the electronic device 100 to a position different from its original position.
[0282] Then, when the electronic device 100 receives a control signal from the user through the user input unit to operate according to the first projection information, the electronic device 100 can identify the first projection position from the first projection information and adjust the position of the projector to the first projection position.
[0283] According to embodiments of this disclosure, the electronic device 100 can adjust the projection position of the projector to a first projection position included in the first projection information by adjusting the position of at least one of the projector, bracket, or connector.
[0284] According to embodiments of this disclosure, electronic device 100 can project a guide pattern from a current position that has been adjusted to a first projection position. According to embodiments of this disclosure, electronic device 100 can obtain a current guide image by using a camera to photograph the projection area on which the guide pattern is projected.
[0285] exist Figure 6 In the figure, reference numeral 630 shows an example of a current guide image obtained by taking a picture of a guide pattern projected from the adjusted current position.
[0286] According to embodiments of this disclosure, the electronic device 100 can compare the current guide image 630 with the first guide image 620 included in the first projection information to obtain the difference between the two. As described above, when the position of the support member of the bracket changes, there is a difference between the two images exceeding a certain size.
[0287] For example, electronic device 100 can obtain the coordinate values of the four corners of the rectangle forming the guide pattern included in the two guide images, and obtain the difference between the two guide images by comparing the coordinate values. Figure 6 As shown, the electronic device 100 can obtain the coordinate values (x1, y1), (x2, y2), (x3, y3), and (x4, y4) of the four corners of the guide pattern included in the first guide image 620, obtain the coordinate values (x1', y1'), (x2', y2'), (x3', y3'), and (x4', y4') of the four corners of the guide pattern included in the current guide image 630, and compare the coordinate values of each corner.
[0288] According to embodiments of the present disclosure, the electronic device 100 can determine whether the difference in coordinate values between two images exceeds a reference value. According to embodiments of the present disclosure, the electronic device 100 can adjust the difference to fall within the second reference range if the difference is included within a first reference range but not within a second reference range smaller than the first reference range.
[0289] According to embodiments of this disclosure, the electronic device 100 can further adjust the current projection position by controlling the driver. For example, the electronic device 100 can adjust the projection position of the projector to be closer to the first projection position by adjusting the rotation angle of the head or connector or adjusting the height of the stand.
[0290] According to embodiments of this disclosure, electronic device 100 can modify the image itself by distorting the current boot image.
[0291] According to embodiments of this disclosure, electronic device 100 can correct a guiding image through geometric correction. Geometric correction is a method that inversely utilizes the projection principle of an image.
[0292] According to embodiments of this disclosure, electronic device 100 can perform geometric correction by obtaining the degree of distortion of the current guide image and by inversely using the degree of distortion to correct the current guide image with its reverse distortion.
[0293] According to embodiments of this disclosure, electronic device 100 can sample some pixels included in a current guide image and correct the positions of the sampled pixels for projection. According to embodiments of this disclosure, electronic device 100 can perform geometric correction by interpolating and compensating between pixels with corrected positions.
[0294] According to embodiments of this disclosure, when the difference is large, such as when the difference is not included in the first reference range, the electronic device 100 can determine that the difference cannot be resolved by adjusting the projection position of the projector or distorting the image. In this case, the electronic device 100 can output information to the user indicating the position of the mobile electronic device 100.
[0295] According to embodiments of this disclosure, electronic device 100 can output information about guiding positional movement in various forms. For example, electronic device 100 can provide guidance for positional movement by outputting audio signals, vibrations, flashing, or video content that guides positional movement.
[0296] Figure 7 An embodiment according to this disclosure is shown in which a user controls an electronic device 100 to store projection information using a control device 700.
[0297] According to embodiments of this disclosure, the electronic device 100 can be controlled by the control device 700. The electronic device 100 can be controlled in conjunction with the control device 700 based on control signals received from the control device 700.
[0298] According to embodiments of this disclosure, the control device 700 may be an electronic device capable of performing operations for controlling the electronic device 100. For example, the control device 700 may be a smartphone.
[0299] Figure 7 An embodiment according to this disclosure is shown in which a user controls the operation of an electronic device 100 by using a control device 700.
[0300] According to embodiments of this disclosure, the control device 700 can execute applications for controlling the operation of the electronic device 100. According to embodiments of this disclosure, the control device 700 can output a screen for controlling the operation of the electronic device 100. According to embodiments of this disclosure, the control device 700 can display a user interface screen in a partial area of the display as a text window for selecting information from the user regarding the use of projected information. The size, output position, transparency, and / or shape of the user interface screen can be varied.
[0301] Users can view the user interface screen output from the control device 700 and use the selection buttons to choose whether to generate projection information.
[0302] According to embodiments of this disclosure, regarding the use of projection information, the control device 700 can output an "Add New Set" button for newly generated projection information and an "Import Stored Set" button for importing pre-stored projection information, as shown by reference numeral 701.
[0303] When the user selects the "Add New Collection" button, the control device 700 can display a text window that requires the selection of a projection plane, as shown in the attached figure 702.
[0304] When the user selects the projection plane or adjusts the projection position and then selects the "Save" button, the control device 700 can store the projection position as angle information. For example, the control device 700 can store the projection position as (θ1, θ2, θ3).
[0305] Then, as indicated by reference numeral 703, the control device 700 can display a text window instructing the user to press the save button after selecting a projection destination. When the user selects the "Select Projection Destination" button, the control device 700 can output a list of various destinations as indicated by reference numeral 704. When the user selects one of the various destinations, the control device 700 can again output the screen indicated by reference numeral 703. The user can then select the "Save" button on the screen indicated by reference numeral 703 to easily save the projection information.
[0306] When the user selects the "Choose from Recommendations" button on the screen shown by reference numeral 703, the control device 700 can send a signal to the electronic device 100 requesting a recommended projection target. The control device 700 can receive recommended projection targets suitable for the projection position from the electronic device 100 and output the recommended projection targets on the screen to receive the user's selection of one of the recommended projection targets.
[0307] According to embodiments of this disclosure, as indicated by reference numeral 705, the control device 700 can output text requesting the storage of a collection's name. Users can input the collection's name using numbers, characters, special characters, symbols, etc. For example, Figure 7 This shows that the user has entered A as the name of the set.
[0308] Then, the control device 700 can output a screen asking whether to keep the current screen, as shown by reference numeral 706. When the user selects to keep the current screen, the control device 700 can store the projection information with the set name A. When the user selects to return to the main screen, the control device 700 can output the screen shown by reference numeral 701 again.
[0309] Therefore, according to embodiments of this disclosure, a user can easily store projection information by using a control device 700 associated with the electronic device 100.
[0310] Figure 8 An embodiment according to this disclosure is shown in which a user controls an electronic device 100 to use projection information by using a control device 700.
[0311] Figure 8 An embodiment according to this disclosure is shown in which a user controls the operation of an electronic device 100 by using a control device 700 based on pre-stored projection information.
[0312] According to embodiments of this disclosure, the control device 700 may display a user interface screen in the form of a text window in a portion of the display area, for selecting information from the user regarding the use of the projected information. The size, output position, transparency, and / or shape of the user interface screen may vary.
[0313] Users can view the user interface screen output from the control device 700 and use the selection buttons to choose whether to generate projection information.
[0314] According to embodiments of this disclosure, regarding the use of projection information, the control device 700 can output an "Add New Set" button for newly generated projection information and an "Import Stored Set" button for importing pre-stored projection information, as shown by reference numeral 801.
[0315] When the user selects the "Import Stored Collection" button, the control device 700 can output a list of multiple projection information items included in the projection information list, as shown in the attached figure 802.
[0316] When a user selects one of multiple projection information items from the projection information list, the electronic device 100 associated with the control device 700 can execute the projection information selected by the user. According to embodiments of this disclosure, the electronic device 100 can adjust the projection position based on the projection information selected by the user, and output content corresponding to the projection purpose from the adjusted projection position according to the projection information.
[0317] Therefore, according to embodiments of this disclosure, a user can easily select pre-stored projection information by using a control device 700 associated with the electronic device 100, and operate the electronic device 100 according to the projection information.
[0318] Figure 9 An embodiment of the present disclosure is shown in which a user controls the projection operation of an electronic device 100 by using a control device 700.
[0319] refer to Figure 9 Users can control the operation of electronic device 100 through control device 700 associated with electronic device 100. Users can select desired projection information by using buttons included in the user interface screen output from control device 700.
[0320] exist Figure 9 In this process, the user has selected projection information SET A (set A) from multiple projection information. According to an embodiment of this disclosure, based on the user's selection of SET A, the control device 700 can send a control signal to the electronic device 100 indicating that SET A has been selected.
[0321] According to embodiments of this disclosure, based on the selection of SET A, electronic device 100 can identify the projection position and projection purpose included in SET A.
[0322] According to embodiments of this disclosure, electronic device 100 can adjust the position of the projector to correspond to the projection position included in the projection information of SET A. According to embodiments of this disclosure, electronic device 100 can adjust the projection position of the projector to the projection position included in the projection information of SET A by adjusting the position of at least one of the head, connector, or bracket.
[0323] According to embodiments of this disclosure, electronic device 100 can output content based on the projection purpose from an adjusted projection position. Figure 9 In an embodiment of this disclosure, the projection purpose included in the projection information of SET A is for display expansion purposes.
[0324] According to embodiments of this disclosure, electronic device 100 can be connected to external electronic device 105 via an external device interface. For example, electronic device 100 can be connected to external electronic device 105 via HDMI. According to embodiments of this disclosure, electronic device 100 can be connected to the output terminal of external electronic device 105 via an HDMI cable and operate as a dual display together with external electronic device 105. According to embodiments of this disclosure, electronic device 100 can project content 901 corresponding to the dual display purpose from a projection position.
[0325] Figure 10 An embodiment of the present disclosure is shown in which a user controls the projection operation of an electronic device 100 by using a control device 700.
[0326] refer to Figure 10 Users can select the desired projection information by using buttons included in the user interface screen output from the control device 700.
[0327] exist Figure 10 In this process, the user has already selected the projection information for SET B from multiple projection information options. According to embodiments of this disclosure, the user can select SET B from the user interface screen output on the control device 700.
[0328] According to embodiments of this disclosure, based on the already selected SET B, the electronic device 100 can identify the projection location and projection purpose included in the SET B.
[0329] According to embodiments of this disclosure, electronic device 100 can adjust the projection position of the projector to correspond to the projection position included in the projection information of the SETB. According to embodiments of this disclosure, electronic device 100 can adjust the projection position of the projector to the projection position included in the projection information of the SETB by adjusting the position of at least one of the head, connector, or bracket.
[0330] For example, suppose θ2 in the projection position of SET B is 180°. This could indicate that the content projected from the projection position is projected onto the floor surface or table where the support of the bracket is located.
[0331] According to embodiments of this disclosure, electronic device 100 can output content based on the projection purpose from an adjusted projection position.
[0332] exist Figure 10 In an embodiment of this disclosure, the projection purpose included in the projection information of SET B is the output purpose of a calendar application.
[0333] According to embodiments of this disclosure, electronic device 100 can execute a calendar application to project the content 1001 of the calendar application from a projection location.
[0334] Figure 11 An embodiment of the present disclosure is shown in which a user controls the projection operation of an electronic device 100 by using a control device 700.
[0335] refer to Figure 11 Users can select the desired projection information by using buttons included in the user interface screen output from the control device 700.
[0336] exist Figure 11 In this process, the user has selected the projection information for SET C from multiple projection information. According to embodiments of this disclosure, based on the selection of SET C, the electronic device 100 can identify the projection position and projection purpose included in SET C.
[0337] According to embodiments of this disclosure, the electronic device 100 can adjust the position of the projector to correspond to the projection position included in the projection information of SET C. For example, if θ2 of the projection position of SET C is 180°, then the content projected from the projection position can be projected onto the table where the support of the stand is located.
[0338] According to embodiments of this disclosure, electronic device 100 can output content based on the projection purpose from an adjusted projection position.
[0339] exist Figure 11 In an embodiment of this disclosure, the projection purpose included in the projection information of SET C is the scanner purpose.
[0340] According to embodiments of this disclosure, electronic device 100 can project content corresponding to the scanner's purpose from a projection position. According to embodiments of this disclosure, when the projection purpose is the scanner's purpose, electronic device 100 can project light onto the object to be scanned to perform a scanning operation.
[0341] When the projection purpose is for the scanner purpose, in addition to the operation of outputting content, the electronic device 100 can also perform the operation of receiving information corresponding to the output content.
[0342] According to embodiments of this disclosure, when the projection purpose is for scanning purposes, the electronic device 100 may output a signal requesting the user to perform a specific operation to receive information corresponding to the output content. For example, the electronic device 100 may project light containing text such as "Please place the document to be scanned". Alternatively, the electronic device 100 may output an audio signal requesting the document to be scanned to be placed at the location where the document to be scanned will be placed, or project flashing light at the location where the document to be scanned will be placed.
[0343] According to embodiments of this disclosure, electronic device 100 can receive information corresponding to content output by using a camera and / or other sensors.
[0344] Users can identify the location where the document to be scanned 1101 will be placed by using light or audio signals projected by the electronic device 100, and place the document to be scanned 1101 at the identified location.
[0345] According to embodiments of this disclosure, electronic device 100 can project light onto document 1101 and obtain the light reflected from document 1101. An optical sensor of electronic device 100 can scan document 1101 by analyzing the reflected light. In other words, according to embodiments of this disclosure, electronic device 100 can receive light reflected from document 1101 as information corresponding to content output based on light projected for a scanning operation.
[0346] Figure 12 An embodiment of the present disclosure is shown in which a user controls the projection operation of an electronic device 100 by using a control device 700.
[0347] refer to Figure 12 Users can select the desired projection information by using buttons included in the user interface screen output from the control device 700.
[0348] exist Figure 12 In the middle, the user has already selected the projection information of SET D from multiple projection information.
[0349] According to embodiments of this disclosure, based on the already selected SET D, the electronic device 100 can identify the projection position and projection purpose included in SET D.
[0350] According to embodiments of this disclosure, the electronic device 100 can adjust the position of the projector to correspond to the projection position included in the projection information of SET D. For example, if θ2 of the projection position of SET D is 180°, then the content projected from the projection position can be projected onto the table where the support of the stand is located.
[0351] According to embodiments of this disclosure, the electronic device 100 can adjust the projection position of the projector to the projection position included in the projection information of SET D by adjusting the position of at least one of the head, connector, or bracket.
[0352] According to embodiments of this disclosure, electronic device 100 can output content based on the projection purpose from an adjusted projection position. Figure 12In an embodiment of this disclosure, the projection purpose included in the projection information of SET D is a projection keyboard purpose. According to an embodiment of this disclosure, the projection keyboard can be a keyboard used with an external electronic device 105.
[0353] According to an embodiment of this disclosure, when the projection purpose is to project a keyboard, the electronic device 100 can project content in the shape of a virtual keyboard onto the projection area, and the content is content corresponding to the projection keyboard purpose.
[0354] According to embodiments of this disclosure, electronic device 100 can output content 1201 corresponding to the purpose of projecting a keyboard from a projection position. The content 1201 corresponding to the purpose of projecting a keyboard can be virtual keyboard-shaped content having a shape similar to that of an actual keyboard.
[0355] Based on the content 1201 corresponding to the purpose of the projected keyboard, the user can input various keys included in the content 1201 corresponding to the purpose of the projected keyboard in a manner similar to using an actual keyboard.
[0356] According to embodiments of this disclosure, electronic device 100 can receive information corresponding to content output by using a camera and / or other sensors.
[0357] According to embodiments of this disclosure, electronic device 100 can acquire images of user finger movements using a camera to detect user selection and pressing of keys included in a virtual keyboard. Electronic device 100 can receive images acquired by capturing user finger movements as information corresponding to content output, based on the content of the virtual keyboard shape.
[0358] According to embodiments of this disclosure, the electronic device 100 may further include an infrared sensor. For example, the electronic device 100 can use an infrared sensor to obtain movement information of a user's finger pressing keys included in a virtual keyboard.
[0359] According to embodiments of this disclosure, the electronic device 100 can also accurately detect the movement of a user's fingers using a projected keyboard by receiving information corresponding to the content output by using a camera and an infrared sensor together.
[0360] According to embodiments of this disclosure, electronic device 100 can identify a key selected by a user by using information about the movement or position of the user's finger. According to embodiments of this disclosure, electronic device 100 can send information about the user-selected key to external electronic device 105.
[0361] Alternatively, according to embodiments of the present disclosure, the external electronic device 105 may include an infrared sensor, and the external electronic device 105 may obtain information about the movement of a user's finger on the virtual keyboard and perform corresponding operations.
[0362] Figure 13 An embodiment of the present disclosure is shown in which a user controls the projection operation of an electronic device 100 by using a control device 700.
[0363] refer to Figure 13 Users can select the desired projection information by using buttons included in the user interface screen output from the control device 700.
[0364] exist Figure 13 In, such as Figure 12 Similarly, the user has already selected the projection information for SET D from multiple projection information sources. According to embodiments of this disclosure, based on the already selected SET D, the electronic device 100 can identify the projection position and projection purpose included in SET D.
[0365] According to embodiments of this disclosure, electronic device 100 can adjust the position of the projector to correspond to the projection position included in the projection information of SET D.
[0366] exist Figure 13 In, with Figure 12 Different, suppose electronic device 100 is moved to a position different from the position where the projection information of SET D was stored.
[0367] According to embodiments of this disclosure, in order to adjust the position of the projector to the projection position included in the projection information, the electronic device 100 may adjust the position of at least one of the head, connector, or stand. However, since the electronic device 100 has been moved to a table corner different from its previous position, even when the electronic device 100 adjusts the position of at least one of the head, connector, or stand, the position of the projector is different from the projection position included in the projection information of SET D.
[0368] According to embodiments of this disclosure, the projection information of SET D may include a guide image. The guide image may be an image obtained by capturing a guide pattern projected from the projection position included in the projection information of SET D onto a projection area when generating the projection information of SET D.
[0369] According to embodiments of this disclosure, electronic device 100 can adjust the projection position to the projection position of SET D, and then project a guide pattern from the current projection position. According to embodiments of this disclosure, electronic device 100 can obtain a current guide image of the projection area on which the guide pattern is projected.
[0370] According to embodiments of this disclosure, electronic device 100 can compare the current guide image with the guide image stored in the projection information of SET D to obtain the difference between the two. According to embodiments of this disclosure, when the difference is equal to or greater than a certain size, electronic device 100 can adjust the current projection position of the projector to reduce the difference, and then output content corresponding to the projection purpose.
[0371] According to embodiments of this disclosure, electronic device 100 can adjust the difference to reduce it when the difference is included in a first reference range but not in a second reference range smaller than the first reference range. According to embodiments of this disclosure, electronic device 100 can control a driver such that the difference is within the second reference range, therefore, the current projection position is closer to the projection position of SET D.
[0372] For example, electronic device 100 can adjust the projection position of the projector so that the projection is closer to the target area. Figure 12 The projection position shown represents the shape of the virtual keyboard.
[0373] According to embodiments of this disclosure, electronic device 100 can distort the current guide image such that the difference is within a second reference range.
[0374] According to embodiments of this disclosure, when the difference is not included in the first reference range, the electronic device 100 can output information about the guided position movement.
[0375] exist Figure 13 When the difference is determined to be outside a specific range (i.e., a first reference range), the electronic device 100 can output information about the position of the guided electronic device 100. For example, the electronic device 100 can output information about the positional movement of the guided electronic device 100 by using various methods (e.g., vibration, audio signals, text, and flashing).
[0376] The user can guide the electronic device 100 to move according to the positional guidance output by the electronic device 100, for example, towards... Figure 12 The inside of the table shown is moved to another position.
[0377] Figure 14 This is a flowchart of an operation method of an electronic device 100 according to an embodiment of the present disclosure.
[0378] refer to Figure 14 Electronic device 100 can receive a request from the user for generating projection information (operation 1410).
[0379] According to embodiments of this disclosure, electronic device 100 can determine the projection position (operation 1420).
[0380] According to embodiments of this disclosure, a user can set the projection position by adjusting the position of at least one of the projector, stand, or connector included in the electronic device 100. Based on a request received from the user for generating projection information, the electronic device 100 can determine the current projection position of the projector as the projection position to be included in the projection information.
[0381] According to embodiments of this disclosure, electronic device 100 can obtain at least one of an image of the surrounding space or depth information of the surrounding space through a sensing unit, and obtain information about the surrounding space based thereon. According to embodiments of this disclosure, electronic device 100 can recommend a projection location based on the information about the surrounding space.
[0382] According to embodiments of this disclosure, electronic device 100 can identify flat areas that are not severely curved, areas where the color of the projection plane is brighter than a certain brightness, and locations where the keystone-corrected projection image can be projected to the widest extent, and recommend locations that meet these conditions as projection locations.
[0383] According to embodiments of this disclosure, electronic device 100 can recommend projection purposes. According to embodiments of this disclosure, electronic device 100 can recommend projection purposes suitable for a projection location based on at least one of information about the surrounding space or the projection location.
[0384] According to embodiments of this disclosure, the electronic device 100 may recommend a projection purpose based on whether the size of the projection plane is large and whether the projection direction is the ceiling, floor or wall.
[0385] Users can directly select the projection target or choose one of the projection targets recommended by the electronic device 100.
[0386] According to embodiments of this disclosure, electronic device 100 can determine the projection purpose based on user selection (operation 1430).
[0387] According to embodiments of this disclosure, electronic device 100 can generate projection information including projection position and projection purpose (operation 1440).
[0388] Electronic device 100 can store projection information by including projection information in a projection information list.
[0389] Figure 15 This is a flowchart of an operation method of an electronic device 100 according to an embodiment of the present disclosure.
[0390] refer to Figure 15 The electronic device 100 can receive the selection of the first projection information in the projection information list (operation 1510).
[0391] According to embodiments of this disclosure, the electronic device 100 can identify a first projection position included in the first projection information. The first projection position can be determined as a rotation angle, such as θ1, θ2, and θ3.
[0392] According to an embodiment of this disclosure, the electronic device 100 can adjust the projection direction to a first projection position (operation 1520).
[0393] According to embodiments of this disclosure, electronic device 100 can identify a first projection destination included in the first projection information.
[0394] According to an embodiment of this disclosure, electronic device 100 can output content according to a first projection purpose from a first projection position (operation 1530).
[0395] According to embodiments of this disclosure, electronic device 100 can obtain a keystone correction amount from first projection information and perform keystone correction on content based on the keystone correction amount.
[0396] According to embodiments of this disclosure, electronic device 100 can obtain at least one of the flatness, material, color, or brightness of the first projection area. According to embodiments of this disclosure, electronic device 100 can obtain ambient brightness via an illuminance sensor. According to embodiments of this disclosure, electronic device 100 can output first content corresponding to a first projection purpose by adjusting at least one of the form, color, or brightness of the first content based on at least one of the flatness, material, color, brightness, or ambient brightness of the first projection area.
[0397] According to some embodiments of this disclosure, electronic devices and their operating methods may also be implemented in the form of recording media, which include computer-executable instructions, such as computer-executable program modules. Computer-readable media can be any available medium accessible by a computer, and includes all volatile and non-volatile media, as well as removable and non-removable media. Furthermore, examples of computer-readable media may include computer storage media and communication media. Examples of computer storage media include all volatile and non-volatile media, as well as removable and non-removable media, implemented by any method or technology for storing information (e.g., computer-readable instructions, data structures, program modules, and other data). Communication media typically include computer-readable instructions, data structures, program modules, other data modulated data signals (e.g., carrier waves), or another transmission mechanism, and examples of communication media include any information transmission medium.
[0398] Furthermore, according to embodiments of this disclosure, an electronic device and its operating method can be implemented by a computer program product, the computer program product including a computer-readable recording medium / storage medium having a program thereon for performing the operating method, the operating method including: receiving a selection of first projection information including a first projection position and a first projection purpose from at least one projection information included in a projection information list; adjusting the projection direction to the first projection position based on the first projection information; and outputting first content corresponding to the first projection purpose from the first projection position.
[0399] Machine-readable storage media can be provided in the form of non-transitory storage media. Here, "non-transitory storage media" refers only to tangible devices and does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is stored semi-permanently in the storage medium and cases where data is temporarily stored in the storage medium. For example, "non-transitory storage media" may include buffers for temporarily storing data.
[0400] According to embodiments of this disclosure, methods according to various embodiments of this disclosure can be provided by including them in a computer program product. A computer program product is a product that can be traded between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)), or distributed through an app store (e.g., downloaded or uploaded), or distributed directly or online between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) can be at least temporarily generated in or temporarily stored in a machine-readable storage medium (e.g., the memory of a manufacturer's server, an app store's server, or a relay server).
Claims
1. An electronic device, comprising: Projector; Memory, storing at least one instruction; as well as At least one processor is configured to execute the at least one instruction stored in the memory to: The system receives a selection of at least one piece of projection information from a list of projection information, which includes a first projection position and a first projection purpose. Each piece of projection information includes a projection position corresponding to the position of the projector and a projection purpose. Adjust the projection direction of the projector to the first projection position, and The projector is controlled to project a first content corresponding to the first projection objective from the first projection position.
2. The electronic device according to claim 1, further comprising: support; At least one connector for connecting the projector to the bracket; as well as The driver is configured to adjust the position of at least one of the bracket, the projector, or the at least one connector. The at least one processor is configured to control the driver to adjust the projection direction of the projector to the first projection position.
3. The electronic device according to claim 1 or 2, wherein, The projection purpose of each of the at least one projection information includes at least one of the following: lighting purpose, application output purpose, display purpose, external device content output purpose, projection keyboard purpose, or scanner purpose.
4. The electronic device according to any one of claims 1 to 3, further comprising: Camera; and Illuminance sensor, Wherein, the at least one processor is configured to: A projection plane image is obtained by controlling the camera to capture images of the first projection area corresponding to the first projection position. Based on the obtained projection plane image, at least one of the following properties of the first projection area is determined: flatness, material, color, or brightness. The ambient brightness is obtained through the illuminance sensor, and Based on at least one of the flatness, material, color, brightness of the first projection area or the obtained ambient brightness, the projector is controlled to adjust at least one of the form, color, or brightness of the first content.
5. The electronic device according to any one of claims 1 to 3, further comprising: camera, Wherein, when the first projection purpose is either a keyboard projection purpose or a scanner projection purpose, the at least one processor is configured to receive information corresponding to the projection of the first content via the camera.
6. The electronic device according to claim 5, further comprising: Infrared sensor, Wherein, when the first projection purpose is the projection keyboard purpose, the at least one processor is configured to receive information corresponding to the projection of the first content via the camera and the infrared sensor.
7. The electronic device according to any one of claims 1 to 6, further comprising: camera; as well as The driver is configured to adjust the position of the projector. The first projection information includes a first guide image, wherein the first guide image is an image of a guide pattern projected from the first projection position when the first projection information is generated, and The at least one processor is configured to: Project a guide pattern from the first projection position. The image of the projected guide pattern obtained by the camera is used as the current guide image. Obtain the difference between the current guide image and the first guide image, and When the difference between the current guide image and the first guide image is included within a first reference range but not within a second reference range smaller than the first reference range, the driver is controlled to adjust the projection position or distort the current guide image so that the difference between the current guide image and the first guide image is within the second reference range.
8. The electronic device according to claim 7, wherein, The at least one processor is configured to: When the difference between the current guide image and the first guide image is not included in the first reference range, information about guiding the position movement of the projector is output.
9. The electronic device according to any one of claims 1 to 3, further comprising: User input unit; as well as camera, Wherein, the at least one processor is configured to: The user input unit receives a request to generate new projection information, and The projection position selected from the projector's current projection position and the projection position recommended based on the surrounding images obtained by the camera is determined as the second projection position to be included in the new projection information.
10. The electronic device according to claim 9, wherein, The at least one processor is configured to: The user input unit receives a selection of a second projection destination to be included in the new projection information, and A second projection information is generated as the new projection information, the second projection information including the second projection position and the second projection destination as a set.
11. The electronic device according to claim 10, wherein, The at least one processor is configured to: Based on the projection position or at least one of the second projection regions corresponding to the second projection position, output at least one recommended projection destination; as well as The user input unit receives the selection of one of the at least one recommended projection destination as the second projection destination.
12. The electronic device according to claim 11, wherein, The at least one processor is configured to: Based on the second projection position, at least one of the material, color, or size of the second projection area corresponding to the second projection position, the at least one recommended projection destination is output.
13. The electronic device according to claim 10, wherein, The at least one processor is configured to: The projector is controlled to project the guide pattern from the second projection position onto the second projection area; Perform trapezoidal correction on the projected guide pattern; as well as Add the trapezoidal correction amount of the guide pattern to the second projection information and store the second projection information.
14. The electronic device according to claim 10, wherein, The at least one processor is configured to: The projector is controlled to project the guide pattern from the second projection position onto the second projection area; Perform trapezoidal correction on the projected guide pattern; A second guide image of the second projection area is obtained through the camera, and the projected guide pattern, which has undergone the keystone correction, is projected onto the second projection area; as well as The second guide image is added to the second projection information and the second projection information is stored.
15. A method of operating an electronic device including a projector, the method comprising: The system receives a selection of at least one projection information from a list of projection information, which includes a first projection position and a first projection purpose. Each projection information in the list of at least one projection information includes a projection position and a projection purpose corresponding to the position of the projector. Adjust the projection direction of the projector to the first projection position; and The projector is controlled to project a first content corresponding to the first projection objective from the first projection position.