Electronic device and control method therefor

Abstract

An electronic device and a control method therefor are provided. The electronic device comprises: a communication interface; a memory for storing at least one instruction; and a processor, which acquires specification information about performance by which an external device can process an image, analyzes, when the image is input, the input image so as to acquire processing information of the input image, processes the input image on the basis of the processing information of the input image and the specification information of the external device, generates, on the basis of the processed image, wireless data to be transmitted to the external device, and transmits the generated wireless data through the communication interface to the external device.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more particularly, to an electronic device that provides wireless data generated using an image to an external device and a method for controlling the same.

[0002] Recently, with the development of wireless communication technology, a service has been provided that transmits images stored in electronic devices to external devices and provides images through the external devices.

[0003] However, when an image stored by an electronic device is provided through an external device, there is a limitation in that an optimized image cannot be provided because the electronic device cannot support image processing for the image transmitted according to the specification information supported by the external device.

[0004] In addition, while various new image processing methods are being developed with the advancement of image processing technology, conventional external devices cannot process images using new image processing methods, and thus there are limitations in providing improved images.

[0005] According to one embodiment of the present disclosure, an electronic device includes: a communication interface; a memory storing at least one instruction; and a processor that obtains specification information on the performance of an external device to process an image, analyzes the input image when an image is input to obtain processing information of the input image, processes the input image based on the processing information of the input image and the specification information of the external device, generates wireless data to be transmitted to the external device based on the processed image, and transmits the generated wireless data to the external device through the communication interface.

[0006] The processor may identify whether the external device can process the input image based on the processing information of the input image based on the specification information of the external device, and if it is identified that the external device cannot process the input image based on the processing information of the input image, process the input image based on the processing information of the input image, and generate first wireless data to be transmitted to the external device based on the processed image.

[0007] The processor, when it is determined that the external device can process the input image based on processing information of the input image, generates second wireless data to be transmitted to the external device based on the input image, and the second wireless data may include processing information of the input image.

[0008] The specification information of the external device includes information on whether the external device supports multi-view performance, and when an image is input, the processor can analyze the input image to obtain processing information that the input image includes multiple images for providing a multi-view image.

[0009] The processor may control the communication unit to generate third wireless data for the plurality of images and transmit the third wireless data to the external device when the external device is identified as supporting multi-view performance based on specification information of the external device, and may control the communication unit to process the input images to generate a multi-view image based on the plurality of images, generate fourth wireless data for the generated multi-view image, and transmit the fourth wireless data to the external device when the external device is identified as not supporting multi-view performance based on specification information of the external device.

[0010] The specification information of the external device includes information on whether the external device supports HDR (High Dynamic Range) performance, and when an image is input, the processor can analyze the input image to obtain processing information necessary for HDR processing of the input image.

[0011] The processor controls the communication unit to generate fifth wireless data based on the input image and transmit the fifth wireless data to the external device when the external device is identified as supporting HDR performance based on specification information of the external device, wherein the fifth wireless data includes processing information for the HDR processing, and controls the communication unit to perform HDR processing on the input image and generate sixth wireless data for the image on which the HDR processing has been performed, and transmit the sixth wireless data to the external device when the external device is identified as not supporting HDR performance based on specification information of the external device.

[0012] The specification information of the external device includes information on whether the external device supports AI image / AI audio processing performance, and when an image is input, the processor can obtain processing information requiring AI image or AI audio processing for the input image.

[0013] The processor controls the communication unit to generate seventh wireless data based on the input image and transmit the seventh wireless data to the external device when the external device is identified as supporting AI image processing performance based on specification information of the external device, wherein the seventh wireless data includes processing information for the AI ​​image processing, and controls the communication unit to perform AI image processing on the input image and generate eighth wireless data for the image on which the AI ​​image processing has been performed, and transmit the eighth wireless data to the external device when the external device is identified as not supporting AI image processing performance based on specification information of the external device.

[0014] The processor controls the communication unit to generate ninth wireless data based on the input image and transmit the ninth wireless data to the external device when the external device is identified as supporting AI audio processing performance based on specification information of the external device, and at this time, the seventh wireless data includes processing information for the AI ​​audio processing, and controls the communication unit to perform AI audio processing on audio of the input image and generate tenth wireless data for the image including audio on which the AI ​​audio processing has been performed, and transmit the tenth wireless data to the external device when the external device is identified as not supporting AI audio processing performance based on specification information of the external device.

[0015] The specification information of the external device includes information on whether the external device supports an edge blending function, and the processor, when an image is input, obtains processing information that requires edge blending processing for the input image, and if it is determined that the external device supports the edge blending function based on the specification information of the external device, generates eleventh wireless data based on the input image, and controls the communication unit to transmit the eleventh wireless data to the external device, wherein the eleventh wireless data includes processing information for the edge blending processing, and if it is determined that the external device does not support the edge blending function based on the specification information of the external device, performs edge blending processing for the input image, generates twelfth wireless data for the image on which the edge blending processing has been performed, and controls the communication unit to transmit the twelfth wireless data to the external device.

[0016] Meanwhile, according to one embodiment of the present disclosure, a method for controlling an electronic device includes: a step of obtaining specification information on the performance of an external device capable of processing an image; a step of analyzing the input image when an image is input to obtain processing information of the input image; a step of processing the input image based on the processing information of the input image and specification information of the external device; a step of generating wireless data to be transmitted to the external device based on the processed image; and a step of transmitting the generated wireless data to the external device.

[0017] The processing step includes: a step of identifying whether the external device can process the input image according to processing information of the input image based on specification information of the external device; and a step of processing the input image based on the processing information of the input image when it is identified that the external device cannot process the input image according to the processing information of the input image; and the generating step may generate first wireless data to be transmitted to the external device based on the processed image.

[0018] The generating step generates second wireless data to be transmitted to the external device based on the input image when it is identified that the external device can process the input image based on the processing information of the input image, and the second wireless data may include the processing information of the input image.

[0019] The specification information of the external device includes information on whether the external device supports multi-view performance, and the step of obtaining processing information of the input image includes, when an image is input, analyzing the input image to obtain processing information that the input image includes a plurality of images for providing a multi-view image.

[0020] The processing step may process the input image to generate a multi-view image based on the plurality of images if the external device is identified as not supporting multi-view performance based on the specification information of the external device, and the generating step may generate third wireless data for the plurality of images if the external device is identified as supporting multi-view performance based on the specification information of the external device, and may generate fourth wireless data for the generated multi-view image if the external device is identified as not supporting multi-view performance based on the specification information of the external device.

[0021] The specification information of the external device includes information on whether the external device supports HDR (High Dynamic Range) performance, and the step of obtaining processing information of the input image can obtain processing information necessary for HDR processing of the input image by analyzing the input image when the image is input.

[0022] The processing step performs HDR processing on the input image when the external device is identified as not supporting HDR performance based on specification information of the external device, and the generating step generates fifth wireless data based on the input image when the external device is identified as supporting HDR performance based on specification information of the external device, wherein the fifth wireless data includes processing information for the HDR processing, and when the external device is identified as not supporting HDR performance based on specification information of the external device, sixth wireless data for the image on which the HDR processing is performed can be generated.

[0023] The specification information of the external device includes information on whether the external device supports AI image / AI audio processing performance, and the step of obtaining processing information of the input image can obtain processing information that requires AI image or AI audio processing for the input image when an image is input, and the step of processing can perform AI image processing for the input image when it is determined that the external device does not support AI image processing performance based on the specification information of the external device, and the step of generating can generate seventh wireless data based on the input image when it is determined that the external device supports AI image processing performance based on the specification information of the external device, and at this time, the seventh wireless data includes processing information for the AI ​​image processing, and when it is determined that the external device does not support AI image processing performance based on the specification information of the external device, it can generate eighth wireless data for the image on which the AI ​​image processing has been performed.

[0024] According to one embodiment of the present disclosure, a computer-readable recording medium including a program for executing a control method of an electronic device, the control method comprises: a step of obtaining specification information on the performance of an external device capable of processing an image; a step of analyzing the input image when an image is input to obtain processing information of the input image; a step of processing the input image based on the processing information of the input image and the specification information of the external device; a step of generating wireless data to be transmitted to the external device based on the processed image; and a step of transmitting the generated wireless data to the external device.

[0025] FIG. 1A and FIG. 1B are diagrams illustrating an image transmission system according to one embodiment of the present disclosure;

[0026] FIG. 2 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure;

[0027] FIG. 3 is a block diagram illustrating a configuration of an electronic device and an external device for image processing and image transmission according to one embodiment of the present disclosure;

[0028] FIG. 4 is a flowchart for explaining an example of image transmission depending on whether an external device supports a multi-view function according to an embodiment of the present disclosure;

[0029] FIG. 5 is a flowchart for explaining an example of image transmission depending on whether an external device supports an HDR function according to an embodiment of the present disclosure;

[0030] FIG. 6 is a flowchart for explaining an example of image transmission depending on whether an external device supports AI image / AI audio processing functions according to one embodiment of the present disclosure;

[0031] FIG. 7 is a flowchart for explaining an example of image transmission depending on whether an external device supports an edge blending function according to an embodiment of the present disclosure, and

[0032] FIG. 8 is a flowchart for explaining a method for controlling an electronic device according to one embodiment of the present disclosure.

[0033] The present embodiments may be modified and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0034] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0035] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0036] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0037] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0038] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0039] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0040] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0041] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0042] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0043] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0044] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0045] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0046]

[0047] Hereinafter, various embodiments of the present invention will be described in detail using the attached drawings. FIGS. 1A and 1B are diagrams illustrating an image transmission system according to one embodiment of the present disclosure. As illustrated in FIGS. 1A and 1B, the system may include an electronic device (100) and an external device (200). In this case, the electronic device (100) may be implemented as a set-top box (100-1) as illustrated in FIG. 1A, and the external device (200) may be implemented as a TV (200-1) as illustrated in FIG. 1A. Alternatively, the electronic device (100) may be implemented as a TV (100-2) as illustrated in FIG. 1B, and the external device (200) may be implemented as a projector (200-2) as illustrated in FIG. 1B. However, the electronic device (100) and external device (200) described in FIGS. 1A and 1B are merely examples, and the electronic device (100) may be implemented as various electronic devices such as a stick TV, a smart phone, a notebook PC, etc., and the external device (200) may be implemented as various electronic devices equipped with an output device such as a display, etc., such as a smart phone, a notebook PC, etc.

[0048] The electronic device (100) can obtain specification information of the external device (200) from the external device (200). At this time, the specification information is information about the performance of the external device (200) to process images (or audio), and may include, for example, information about whether the external device (200) supports a multi-view function, whether the external device (200) supports an HDR function, whether the external device (200) supports an AI image / AI audio processing function, etc. However, this is only one example, and various specification information can be obtained, such as information about whether the external device (200) supports a room-to-room share (or screen link) function, whether the external device (200) supports a mirroring function, whether the external device (200) supports a variable refresh rate (VRR) function, and whether the external device (200) supports an edge blending function.

[0049] The electronic device (100) can receive an image. At this time, the input image may be an image stored in the electronic device (100), but this is only one example and may include images received by the electronic device (100) from various sources.

[0050] When an image is input, the electronic device (100) can analyze the input image to obtain processing information of the input image. At this time, the processing information of the input image is information about image processing that can be applied to the input image, and may include, for example, information about multi-view image processing, HDR processing, AI image / AI audio processing, room-to-room sharing, mirroring, variable refresh rate processing, and edge blending processing. Meanwhile, the processing information of the input image can be obtained by analyzing the input image, but this is only one embodiment, and may be obtained according to a user input.

[0051] The electronic device (100) can process the input image based on the processing information of the input image and the specification information of the external device (200), and generate wireless data to be transmitted to the external device (200) based on the processed image. Specifically, the electronic device (100) can identify whether the external device (200) can process the input image according to the processing information of the input image based on the specification information of the external device (200). At this time, the electronic device (100) can obtain the specification information based on the identification information of the external device (200). Specifically, the electronic device (100) can obtain identification information (e.g., model name, model number, etc.) for the external device (200) through a user input or obtain identification information (e.g., EDID (Extended Display Identification Date)) for the external device (200) during a pairing process with the external device (200). In addition, the electronic device (100) can obtain specification information of the external device (200) through an external DB or website based on the obtained identification information about the external device (200). In addition, the electronic device (100) can identify whether the external device (200) can process the input image according to the processing information of the input image based on the obtained specification information of the external device (200).

[0052] If it is determined that the external device (200) cannot process the input image based on the processing information of the input image, the electronic device (100) can process the input image based on the processing information of the input image. Then, the electronic device (100) can generate first wireless data to be transmitted to the external device (200) based on the processed image. However, if it is determined that the external device (200) can process the input image based on the processing information of the input image, the electronic device (100) can generate second wireless data to be transmitted to the external device (20) based on the input image. That is, if it is determined that the external device (200) can process the input image based on the processing information of the input image, the electronic device (100) can generate second wireless data using the input image without processing the image based on the processing information. At this time, the second wireless data may include processing information of the input image.

[0053] The electronic device (100) can transmit the generated wireless data to the external device (200). Then, the external device (200) can provide the input image based on the received wireless data. In particular, if the external device (200) is identified as not being able to process the input image based on the processing information of the input image, the external device (200) can receive first wireless data generated based on the processed image and provide the image to the user based on the received wireless data. However, if the external device (200) is identified as being able to process the input image based on the processing information of the input image, the external device (200) can receive second wireless data generated based on the input image, process the input image based on the processing information included in the second wireless data, and provide the processed image to the user.

[0054] As described above, since the electronic device (100) performs an image processing function that is not supported by the external device (200), it is possible to provide the latest image processing function using a previously purchased external device (200) without purchasing a new device.

[0055]

[0056] FIG. 2 is a block diagram illustrating a configuration of an electronic device according to one embodiment of the present disclosure. As illustrated in FIG. 2, the electronic device (100) may include a user input unit (110), a communication interface (120), an input / output interface (130), a memory (140), and a processor (150). However, this is merely an example, and it is to be understood that some components may be removed or added depending on the type of the electronic device (100). For example, if the electronic device (100) is implemented as a TV, the electronic device (100) may include various components such as a display, a camera, a speaker, and the like.

[0057] The user input unit (110) may include a remote control receiver, a button, a lever, a switch, a touch interface, etc. In this case, the touch interface may be implemented in a way that receives input by the user's touch on the display screen of the electronic device (100).

[0058] In particular, the user input unit (110) can receive user input regarding whether to apply an image processing (or audio processing) function to an input image. For example, the user input unit (110) can receive user input regarding whether to apply an AI image / AI audio processing function to an input image.

[0059] The communication interface (120) includes at least one circuit and can communicate with various types of external devices or servers. The communication interface (120) can include at least one of a BLE (Bluetooth Low Energy) module, a Wi-Fi communication module, a cellular communication module, a 3G (third generation) mobile communication module, a 4G (fourth generation) mobile communication module, a 4th generation LTE (Long Term Evolution) communication module, and a 5G (fifth generation) mobile communication module.

[0060] In particular, the communication interface (120) can receive images from an external source. In addition, the communication interface (120) can transmit wireless data generated by the processor (150) to an external device (200). In addition, the communication interface (120) can receive specification information of the external device (200) from the external device (200).

[0061] The input / output interface (130) is configured to input / output at least one of audio and video signals. For example, the input / output interface (130) may be an HDMI (High Definition Multimedia Interface), but this is only one embodiment, and may be any one of an MHL (Mobile High-Definition Link), a USB (Universal Serial Bus), a DP (Display Port), a Thunderbolt, a VGA (Video Graphics Array) port, an RGB port, a D-SUB (D-subminiature), and a DVI (Digital Visual Interface). Depending on the implementation example, the input / output interface (130) may include a port that inputs / outputs only audio signals and a port that inputs / outputs only video signals as separate ports, or may be implemented as a single port that inputs / outputs both audio signals and video signals.

[0062] In particular, the input / output interface (130) can receive images from an external source. In addition, the input / output interface (130) can transmit wireless data generated by the processor (150) to an external device (200). In addition, the input / output interface (130) can receive specification information of the external device (200) from the external device (200).

[0063] The memory (140) may store an operating system (OS) for controlling the overall operation of the components of the electronic device (100) and instructions or data related to the components of the electronic device (100). In particular, the memory (140) may include a plurality of modules (e.g., a specification information receiving module (305), an input image analysis module (310), a processing information acquisition module (315), an image decoder (320), an image processing module (325), an audio processing module (330), a wireless data generation module (335), a wireless data transmission module (340), etc., illustrated in FIG. 3) for generating wireless data using an input image and transmitting the generated wireless data to an external device (200). In particular, when a function for generating wireless data using an input image and transmitting the generated wireless data to an external device (200) is executed, the electronic device (100) may load data for performing various operations by various modules stored in a non-volatile memory into a volatile memory. Here, loading means an operation of loading and storing data stored in non-volatile memory into volatile memory so that the processor (150) can access it.

[0064] Additionally, the memory (140) can store a learned neural network model for performing AI image / AI audio processing. However, the neural network model being stored in the memory (140) is merely an example, and it is of course possible for the neural network model to be stored in an external server.

[0065] Meanwhile, the memory (140) may be implemented as a non-volatile memory (e.g., hard disk, SSD (Solid state drive), flash memory), volatile memory (which may also include memory within the processor (150)), etc.

[0066] The processor (150) can control the electronic device (100) according to at least one instruction stored in the memory (140).

[0067] In particular, the processor (150) may include one or more processors. Specifically, the one or more processors may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors may control one or any combination of other components of the electronic device and perform operations related to communication or data processing. The one or more processors may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory.

[0068] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one processor or by a plurality of processors. That is, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-only processor). For example, according to an embodiment of the present disclosure, AI image / AI audio processing operations, etc. may be performed by a processor that performs parallel operations, such as a GPU or NPU, and multi-view image generation, HDR processing, etc. may be performed by a general-purpose processor, such as a CPU.

[0069] One or more processors may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include internal processor memory, such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0070] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among a plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0071] In one or more embodiments of the present disclosure, the processor (150) obtains specification information regarding the performance of an external device (200) capable of processing an image. When an image is input, the processor (150) analyzes the input image to obtain processing information of the input image. The processor (150) processes the input image based on the processing information of the input image and the specification information of the external device. The processor (150) generates wireless data to be transmitted to the external device based on the processed image. The processor (150) transmits the generated wireless data to the external device (200) via the communication interface (120).

[0072] In one embodiment, the processor (150) may identify whether the external device (200) can process the input image based on the processing information of the input image based on the specification information of the external device (200). If it is determined that the external device (200) cannot process the input image based on the processing information of the input image, the processor (150) may process the input image based on the processing information of the input image and generate first wireless data to be transmitted to the external device (200) based on the processed image. However, if it is determined that the external device (200) can process the input image based on the processing information of the input image, the processor (150) may generate second wireless data to be transmitted to the external device (200) based on the input image. At this time, the second wireless data may include the processing information of the input image.

[0073] Hereinafter, various embodiments of the present disclosure will be described in more detail with reference to FIGS. 3 to 6.

[0074] FIG. 3 is a block diagram illustrating a configuration of an electronic device and an external device for image processing and image transmission according to one embodiment of the present disclosure. As illustrated in FIG. 3, the electronic device (100) may include a specification information reception module (305), an input image analysis module (310), a processing information acquisition module (315), an image decoder (320), an image processing module (325), an audio processing module (330), a wireless data generation module (335), and a wireless data transmission module (340). The external device (200) may include a specification information transmission module (345), a wireless data reception module (350), a wireless data restoration module (355), an image processing module (360), and an audio processing module (365). In this case, each module may be implemented in software, but this is merely an embodiment, and it is to be understood that the modules may also be implemented in a combination of software and hardware.

[0075] The specification information receiving module (305) can receive specification information of the external device (200) from the specification information transmission module (345) of the external device (200). At this time, the specification information can be received when the electronic device (100) and the external device (200) are first connected, but this is only one embodiment, and the specification information can be received when a user command is input that performs a function of providing an image acquired by the electronic device (100) to the external device (200).

[0076] The specification information may include information about the performance of the external device (200) to process images (or audio). For example, the specification information may include whether the external device (200) can process multi-view images, whether it can perform HDR processing, whether it can perform AI image / AI audio processing, and whether it can perform an edge blending function. In this case, the multi-view image refers to an image that processes multiple images to provide multiple images on a single screen, and HDR (High Dynamic Range) processing is an image processing that improves the contrast ratio by maximizing the difference between bright and dark parts in the image, AI image processing is an image that uses a learned neural network model to process an input image (e.g., object recognition or SR (Super resolution) processing), AI audio processing is an image that uses a learned neural network model to process audio included in an input image (e.g., separate voice / background sound and process at least one of voice and background sound), and the edge blending function may be a function that removes a boundary line that occurs when images projected from multiple projectors overlap. However, this is only one example, and the specification information may include information about whether other image processing (or audio processing) can be performed (e.g., information about room-to-room sharing function, mirroring function, variable refresh rate processing function, etc.).

[0077] The input image analysis module (310) can analyze the input image to obtain information about the input image. Specifically, the input image analysis module (310) can analyze whether the input image includes multiple images. Alternatively, the input image analysis module (310) can analyze the metadata of the input image to analyze the image processing function that can be applied to the input image. For example, if the metadata of the input image includes HDR information, the input image analysis module (310) can analyze that the input image requires HDR processing.

[0078] The processing information acquisition module (315) can acquire processing information based on information about the input image received from the input image analysis module (310). In particular, the processing information acquisition module (315) can acquire processing information by determining a codec, an image processing method, an audio processing method, etc. to process the input image based on information about the input image received from the input image analysis module (310).

[0079] Specifically, the processing information acquisition module (315) can acquire image processing information to be applied to the input image. In one embodiment, when information that there is one input image is acquired from the input image analysis module (310), the processing information acquisition module (315) can acquire processing information for not applying multi-view image processing to the one input image. When information that there are multiple input images is acquired from the input image analysis module (310), the processing information acquisition module (315) can acquire processing information for applying multi-view image processing to the multiple input images. In one embodiment, when the input image analysis module (310) identifies that the input image does not include HDR information, the processing information acquisition module (315) can acquire processing information for not applying HDR processing to the input image. When the input image analysis module (310) identifies that the input image includes HDR information, the processing information acquisition module (315) can acquire processing information for applying HDR processing to the input image.

[0080] In addition, the processing information acquisition module (315) can acquire processing information through user input rather than information about the input image received from the input image analysis module (310). In one embodiment, when a user command to turn on AI image / AI audio processing is input from the user input unit (110), the processing information acquisition module (315) can acquire processing information for applying AI image / AI audio processing to the input image. When a user command to turn off AI image / AI audio processing is input from the user input unit (110), the processing information acquisition module (315) can acquire processing information for not applying AI image / AI audio processing to the input image. In one embodiment, when a user command to perform a multi-projection function is input from the user input unit (110), the processing information acquisition module (315) can acquire processing information for performing an edge blending function on the input image.

[0081] The video decoder (320) can decode the input video. Specifically, the video decoder (320) can decompress video data compressed through encoding or decrypt encrypted video data. In this case, if there are multiple input videos, the video decoder (2320) can perform decoding on the multiple videos.

[0082] The image processing module (325) can process the input image based on the processing information acquired from the processing information acquisition module (315). Specifically, when processing information for applying at least one of multi-view image processing, HDR processing, and AI image processing is acquired, the image processing module (325) can process the input image according to the image processing method included in the processing information. In one embodiment, when processing information for applying multi-view image processing is input, the image processing module (325) can perform a scaling operation on a plurality of input images and perform image processing so that the plurality of images for which the scaling operation has been performed can be displayed on a single screen. In one embodiment, when processing information for applying HDR processing is input, the image processing module (325) can perform HDR processing on the input image based on pixel information and HDR information of the input image. In one embodiment, when processing information for applying AI image processing is input, the image processing module (325) can input the input image into a neural network model to perform image quality improvement processing. In one embodiment, when processing information for performing an edge blending function is input, the image processing module (325) can perform image processing to remove a boundary line (or boundary surface) that occurs when performing multi-projection using the input image.

[0083] The audio processing module (330) can process audio included in an input image based on processing information acquired from the processing information acquisition module (315). Specifically, when processing information for applying at least one of multi-view image processing and AI audio processing is acquired, the audio processing module (330) can process audio included in the input image according to an audio processing method included in the processing information. In one embodiment, when processing information for applying multi-view image processing is input, the audio processing module (330) can perform a processing task for mixing a plurality of audios corresponding to a plurality of input images. In one embodiment, when processing information for applying AI image processing is input, the audio processing module (330) can input audio included in the input image into a neural network model to perform sound improvement processing.

[0084] The wireless data generation module (335) can generate wireless data using processed images and audio. At this time, the wireless data generation module (335) can generate wireless data by performing low-latency compression (e.g., DXT (DirectX Texture) compression). Meanwhile, if the external device (200) is identified as performing image / audio processing, the wireless data may include processing information about the input image. At this time, the processing information may be stored in the wireless data in the form of metadata of the input image.

[0085] The wireless data transmission module (340) can transmit the generated wireless data. At this time, the wireless data transmission module (340) can transmit the wireless data using a short-range communication interface (e.g., a Wi-Fi direct interface, a Bluetooth interface, etc.). Meanwhile, in the above-described embodiment, it has been described that wireless data is generated and transmitted to an external device (200) through a wireless communication interface, but this is only one embodiment, and data for an input image can be generated and the generated data can be transmitted through an input / output interface (130).

[0086] The specification information transmission module (345) can transmit specification information to the electronic device (100). At this time, the specification information may be transmitted when the electronic device (100) and the external device (200) are first connected, but this is only an example. The specification information may be transmitted when a user command is input that performs a function of displaying an image acquired by the electronic device (100) on the external device (200). Alternatively, the specification information transmission module (345) may transmit specification information to the electronic device (100) when the function of the external device (200) is updated.

[0087] The wireless data reception module (350) can receive wireless data received from the electronic device (100). At this time, the wireless data reception module (350) can receive wireless data using a short-range communication interface.

[0088] The wireless data restoration module (355) can restore the input image (or audio, metadata) using compressed wireless data.

[0089] The image processing module (360) can process the restored image into an image to be output through a display. At this time, if metadata including processing information of the image input into the wireless data is included, the image processing module (360) can process the image based on the processing information included in the metadata. Specifically, if the metadata includes processing information for applying at least one of multi-view image processing, HDR processing, AI image processing, and edge blending functions, the image processing module (360) can process the input image according to the image processing method included in the processing information. In addition, the image processed by the image processing module (360) can be output through the display.

[0090] The audio processing module (365) can process the restored audio into audio to be output through a speaker (or audio output configuration). At this time, if metadata including processing information of audio input into the wireless data is included, the audio processing module (365) can process the audio based on the processing information included in the metadata. Specifically, if the metadata includes processing information for applying at least one of multi-view image processing and AI image processing, the audio processing module (365) can process the input image according to an audio processing method included in the processing information. In addition, the audio processed by the audio processing module (365) can be output through the speaker (or audio output configuration).

[0091] FIG. 4 is a flowchart illustrating an example of image transmission depending on whether an external device supports a multi-view function according to one embodiment of the present disclosure.

[0092] First, the electronic device (100) can obtain specification information on whether the external device (200) supports a multi-view function (S410). That is, the electronic device (100) can obtain specification information on whether the external device (200) supports a multi-view function that processes multiple images into a single screen.

[0093] The electronic device (100) can receive an image including multiple images (S420). At this time, the electronic device (100) can receive information (or control commands) for generating the input multiple images into a multi-view image together with the input image. Accordingly, when the input multiple images are included, the electronic device (100) can obtain processing information for applying multi-view image processing to the input image.

[0094] The electronic device (100) can identify whether the external device (200) supports the multi-view function (S430). That is, the electronic device (100) can identify whether the external device (200) supports the multi-view function based on the specification information of the external device (200).

[0095] If the external device (200) is identified as supporting the multi-view function (S430-Y), the electronic device (100) can generate wireless data using each of the plurality of images (S440). Specifically, the electronic device (100) can generate wireless data using each of the plurality of images for generating a multi-view image. At this time, the electronic device (100) can generate the wireless data so as to include processing information for processing the plurality of images into a multi-view image within the wireless data.

[0096] If the external device (200) is identified as not supporting the multi-view function (S430-N), the electronic device (100) can generate a multi-view image using multiple images (S450). That is, the electronic device (100) can generate a multi-view image by performing a scaling operation on the multiple images so that they can be displayed on a single screen. In addition, the electronic device (100) can generate audio for the multi-view image by mixing multiple audios corresponding to each of the multiple images. The electronic device (100) can generate wireless data using the multi-view image (including audio for the multi-view image) (S460).

[0097] And, the electronic device (100) can transmit wireless data generated in step S440 or step S460 to an external device (200) (S470).

[0098]

[0099] FIG. 5 is a flowchart illustrating an example of image transmission depending on whether an external device supports an HDR function according to one embodiment of the present disclosure.

[0100] First, the electronic device (100) can obtain specification information on whether the external device (200) supports HDR function (S510). That is, the electronic device (100) can obtain specification information on whether the external device (200) supports HDR processing for input images.

[0101] An electronic device (100) can receive an image containing HDR information (S520). At this time, the input image may include HDR information in the form of metadata.

[0102] The electronic device (100) can identify whether the external device (200) supports the HDR function (S530). That is, the electronic device (100) can identify whether the external device (200) supports the HDR function based on the specification information of the external device (200).

[0103] If the external device (200) is identified as supporting the HDR function (S530-Y), the electronic device (100) can generate wireless data using the input image (S540). At this time, the electronic device (100) can generate the wireless data so as to include processing information for performing HDR processing on the input image within the wireless data.

[0104] If the external device (200) is identified as not supporting the HDR function (S530-N), the electronic device (100) can perform HDR processing on the input image (S550). That is, the electronic device (100) can perform HDR processing on the input image to obtain an image with a disclosed contrast ratio. The electronic device (100) can generate wireless data using the HDR-processed image (S560).

[0105] And, the electronic device (100) can transmit wireless data generated in step S540 or step S560 to an external device (200) (S570).

[0106] FIG. 6 is a flowchart illustrating an example of video transmission depending on whether an external device supports AI video / AI audio processing functions according to one embodiment of the present disclosure.

[0107] First, the electronic device (100) can obtain specification information on whether or not the external device (200) supports AI image / AI audio processing functions (S610). That is, the electronic device (100) can obtain specification information on whether or not the external device (200) supports AI image / AI audio processing functions for input images. At this time, the AI ​​image / AI audio processing function may be a function that inputs the input image / audio into a trained neural network model to obtain an image / audio with improved image quality or sound.

[0108] The electronic device (100) receives an image (S620).

[0109] The electronic device (100) can receive a user command for AI image / AI audio processing (S630). That is, the electronic device (100) can receive a user command to turn on the AI ​​image / AI audio processing function. In this case, step S630 may be performed before step S620.

[0110] The electronic device (100) can identify whether the external device (200) supports AI image / AI audio processing functions (S640). That is, the electronic device (100) can identify whether the external device (200) supports AI image / AI audio processing functions based on specification information of the external device (200).

[0111] If the external device (200) is identified as supporting AI image / AI audio processing functions (S640-Y), the electronic device (100) can generate wireless data using the input image (S650). At this time, the electronic device (100) can generate the wireless data so as to include processing information for performing AI image / AI audio processing functions on the input image within the wireless data.

[0112] If the external device (200) is identified as not supporting the AI ​​image / AI audio processing function (S640-N), the electronic device (100) can perform AI image / AI audio processing on the input image (S660). That is, the electronic device (100) can perform AI image / AI audio processing on the input image to obtain an image with improved picture quality / sound. The electronic device (100) can generate wireless data using the AI ​​image / AI audio processed image / audio (S670).

[0113] And, the electronic device (100) can transmit wireless data generated in step S650 or step S670 to an external device (200) (S680).

[0114] FIG. 7 is a flowchart illustrating an example of image transmission according to an embodiment of the present disclosure, depending on whether an external device supports an edge blending function. Meanwhile, the embodiment of FIG. 7 may be an example in which the electronic device (100) is implemented as a TV and the external device (200) is implemented as a projector, as illustrated in FIG. 1B.

[0115] First, the electronic device (100) can obtain specification information regarding whether edge blending is supported from the external device (200) (S710). That is, the electronic device (100) can obtain specification information regarding whether the external device (200) supports the edge blending function for the input image. In this case, the edge blending function may be a function for removing a boundary line that occurs in an overlapping portion of images projected by multiple projectors when projecting images through multiple projectors.

[0116] The electronic device (100) receives an image (S720).

[0117] The electronic device (100) can receive a user command to perform a multi-projection function (S730). That is, the electronic device (100) can receive a user command to activate a function for implementing a single screen through multiple projectors. In this case, step S730 may be performed before step S720.

[0118] The electronic device (100) can identify whether the external device (200) supports the edge blending function (S740). That is, the electronic device (100) can identify whether the external device (200) supports the edge blending function based on the specification information of the external device (200).

[0119] If the external device (200) is identified as supporting the edge blending function (S740-Y), the electronic device (100) may generate wireless data using the input image (S750). At this time, the electronic device (100) may generate the wireless data so as to include processing information for performing the edge blending function on the input image within the wireless data.

[0120] If the external device (200) is identified as not supporting the edge blending function (S740-N), the electronic device (100) can perform the edge blending function on the input image (S760). That is, the electronic device (100) can perform edge blending on the input image to obtain an image from which noise occurring at the boundary between multiple images is removed. The electronic device (100) can generate wireless data using the edge blended image (S670).

[0121] And, the electronic device (100) can transmit wireless data generated in step S750 or step S770 to an external device (200) (S780).

[0122] Meanwhile, in FIGS. 4 to 7, it has been described that the specification information of the external device (200) acquired by the electronic device (100) is information on whether the external device (200) supports the multi-view function, whether the external device (200) supports the HDR function, whether the external device (200) supports the AI ​​image / AI audio processing function, and whether the external device (200) supports the edge blending function. However, this is merely an example, and various specification information such as whether the external device (200) supports the room-to-room share (or screen link) function, whether the external device (200) supports the mirroring function, and whether the external device (200) supports the variable refresh rate (VRR) function. In this case, when the external device (200) does not support the room-to-room share function, the mirroring function, or the variable refresh rate function, the electronic device (100) performs image processing on the input image according to the acquired processing information to generate wireless data, thereby supporting the external device (200) to perform the room-to-room share function, the mirroring function, and the variable refresh rate function. For example, the electronic device (100) can generate wireless data by processing an input image to correspond to a room-to-room sharing function or a mirroring function, and can generate wireless data by processing an input image to increase the injection rate.

[0123] FIG. 8 is a flowchart for explaining a method for controlling an electronic device according to one embodiment of the present disclosure.

[0124] The electronic device (100) obtains specification information about the performance of an external device capable of processing an image (S810).

[0125] An electronic device (100) receives an image (S820). At this time, the input image may include metadata related to a processing method of the input image.

[0126] The electronic device (100) analyzes the input image to obtain processing information about the input image (S830). At this time, the electronic device (100) may obtain processing information about the input image by analyzing the number of images included in the input image or metadata included in the input image. In addition, the electronic device (100) may obtain processing information about the input image based on user input.

[0127] The electronic device (100) can process the input image based on the processing information of the input image and the specification information of the external device (S840). Then, the electronic device (100) generates wireless data to be transmitted to the external device (200) based on the processed image (S850). Specifically, the electronic device (100) can identify whether the external device (200) can process the input image based on the processing information of the input image based on the specification information of the external device (200). If it is determined that the external device (200) cannot process the input image based on the processing information of the input image, the electronic device (100) can process the input image based on the processing information of the input image and generate first wireless data to be transmitted to the external device based on the processed image. However, if it is determined that the external device (200) can process the input image based on the processing information of the input image, the electronic device (100) can generate second wireless data to be transmitted to the external device (200) based on the input image. At this time, the second wireless data may include processing information of the input image.

[0128] The electronic device (100) transmits the generated wireless data to an external device (200) (S860). At this time, the electronic device (100) can transmit the wireless data to the external device (200) via a short-range wireless communication interface.

[0129] Meanwhile, in the above-described embodiment, the specification information of the external device (200) is described as including only whether the image processing function / audio processing function is applied, but this is only one embodiment, and may include information on the performance of the image processing function / audio processing function. For example, if the external device (200) also applies the multi-view image processing function, but the number of images that can create a multi-view image is up to 4, the specification information may include information that the multi-view image processing function is supported and information on creating a multi-view image using up to 4 images. At this time, depending on the number of images input to the electronic device (100), the electronic device (100) may create a multi-view image or the external device (200) may create a multi-view image. For example, if there are two input images, the electronic device (100) can generate wireless data using each of the two images, but if there are six input images, the electronic device (100) can generate a multi-view image using the six images, and then generate wireless data using the generated multi-view image. As another example, if the external device (200) also applies the AI ​​image processing function, but the first version of the neural network model for AI image processing is stored, the specification information may include information about the first version of the neural network model along with information that the AI ​​image processing function is supported. At this time, if a user command to perform AI image processing using the second version of the neural network model is input, the electronic device (100) can input the input image into the second version of the neural network model to obtain a processed image, and generate wireless data using the processed image.

[0130] Meanwhile, the method according to various embodiments of the present disclosure may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0131] The methods according to various embodiments of the present disclosure may be implemented as software including commands stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call commands stored in the storage medium and operate according to the called commands, and may include an electronic device (e.g., a TV) according to the disclosed embodiments.

[0132] Meanwhile, a device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0133] When the above instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0134] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, communication interface; memory for storing at least one instruction; and Obtain specification information about the external device's ability to process images, When an image is input, the input image is analyzed to obtain processing information of the input image. Processes the input image based on the processing information of the input image and the specification information of the external device, Generate wireless data to be transmitted to the external device based on the processed image, An electronic device comprising a processor that transmits the generated wireless data to an external device through the communication interface.

2. In paragraph 1, The above processor, Based on the specification information of the external device, identify whether the external device can process the input image according to the processing information of the input image, An electronic device that processes the input image based on the processing information of the input image and generates first wireless data to be transmitted to the external device based on the processed image, when the external device is identified as being unable to process the input image based on the processing information of the input image.

3. In paragraph 2, The above processor, If the external device is identified as being capable of processing the input image based on processing information of the input image, second wireless data to be transmitted to the external device is generated based on the input image, The above second wireless data is, An electronic device including processing information of the input image.

4. In paragraph 1, Specification information of the above external device is: Contains information about whether the external device supports multi-view performance; The above processor, An electronic device that, when an image is input, analyzes the input image and obtains processing information that the input image includes multiple images for providing a multi-view image.

5. In paragraph 4, The above processor, If it is identified that the external device supports multi-view performance based on the specification information of the external device, the communication unit is controlled to generate third wireless data for the plurality of images and transmit the third wireless data to the external device. An electronic device that processes the input image to generate a multi-view image based on the plurality of images, generates fourth wireless data for the generated multi-view image, and controls the communication unit to transmit the fourth wireless data to the external device when it is determined that the external device does not support multi-view performance based on specification information of the external device.

6. In paragraph 1, Specification information of the above external device is: Contains information about whether the external device supports HDR (High Dynamic Range) performance. The above processor, An electronic device that, when an image is input, analyzes the input image and obtains processing information necessary for HDR processing of the input image.

7. In paragraph 6, The above processor, If the external device is identified as supporting HDR performance based on the specification information of the external device, the fifth wireless data is generated based on the input image, and the communication unit is controlled to transmit the fifth wireless data to the external device, wherein the fifth wireless data includes processing information for the HDR processing. An electronic device that performs HDR processing on the input image when the external device is identified as not supporting HDR performance based on specification information of the external device, generates sixth wireless data for the image on which the HDR processing has been performed, and controls the communication unit to transmit the sixth wireless data to the external device.

8. In paragraph 1, Specification information of the above external device is: Contains information on whether the external device supports AI image / AI audio processing performance. The above processor, An electronic device that, when an image is input, acquires processing information requiring AI image or AI audio processing for the input image.

9. In paragraph 8, The above processor, If it is identified that the external device supports AI image processing performance based on the specification information of the external device, the seventh wireless data is generated based on the input image, and the communication unit is controlled to transmit the seventh wireless data to the external device, wherein the seventh wireless data includes processing information for the AI ​​image processing. An electronic device that performs AI image processing on the input image when it is determined that the external device does not support AI image processing performance based on specification information of the external device, generates eighth wireless data for the image on which the AI ​​image processing has been performed, and controls the communication unit to transmit the eighth wireless data to the external device.

10. In paragraph 8, The above processor, If it is identified that the external device supports AI audio processing performance based on the specification information of the external device, the 9th wireless data is generated based on the input image, and the communication unit is controlled to transmit the 9th wireless data to the external device, wherein the 7th wireless data includes processing information for the AI ​​audio processing. An electronic device that performs AI audio processing on audio of the input image when it is determined that the external device does not support AI audio processing performance based on specification information of the external device, generates tenth wireless data for the image including the audio on which the AI ​​audio processing has been performed, and controls the communication unit to transmit the tenth wireless data to the external device.

11. In paragraph 1, Specification information of the above external device is: Contains information about whether the external device supports edge blending functionality; The above processor, When an image is input, processing information required for edge blending processing for the input image is obtained. If it is identified that the external device supports the edge blending function based on the specification information of the external device, the communication unit is controlled to generate 11th wireless data based on the input image and transmit the 11th wireless data to the external device, wherein the 11th wireless data includes processing information for the edge blending processing. An electronic device that performs edge blending processing on the input image when it is determined that the external device does not support an edge blending function based on specification information of the external device, generates 12th wireless data for the image on which the edge blending processing has been performed, and controls the communication unit to transmit the 12th wireless data to the external device.

12. In a method for controlling an electronic device, A step of obtaining specification information on the performance of an external device to process images; When an image is input, a step of analyzing the input image to obtain processing information of the input image; A step of processing the input image based on processing information of the input image and specification information of the external device; A step of generating wireless data to be transmitted to the external device based on the processed image; and A control method comprising: a step of transmitting the generated wireless data to the external device.

13. In paragraph 12, The above processing steps are: A step of identifying whether the external device can process the input image according to processing information of the input image based on the specification information of the external device; and If it is determined that the external device cannot process the input image according to the processing information of the input image, a step of processing the input image based on the processing information of the input image is included; The above generating steps are: A control method for generating first wireless data to be transmitted to the external device based on the processed image.

14. In paragraph 13, The above generating steps are: If the external device is identified as being capable of processing the input image based on processing information of the input image, second wireless data to be transmitted to the external device is generated based on the input image, The above second wireless data is, A control method including processing information of the input image.

15. In paragraph 12, Specification information of the above external device is: Contains information about whether the external device supports multi-view performance; The step of obtaining processing information of the input image above is: A control method for analyzing an image when an image is input and obtaining processing information that the input image includes multiple images for providing a multi-view image.

Images