Display apparatus and operating method thereof

Abstract

A display device according to a disclosed embodiment includes a display; a communication interface that communicates with a source device; and a processor that executes at least one instruction. A display device according to the disclosed embodiment can output an optimized full screen in response to a change in aspect ratio when the aspect ratio of an image corresponding to the content is changed.

Description

Technology Field

[0001] The disclosed embodiment relates to a display device capable of playing content and a method of operating the same.

[0002] Specifically, the disclosed embodiment relates to a display device capable of displaying content (e.g., game content) on a wide screen by supporting the output of images having various aspect ratios, and a method of operating the same. Background Technology

[0003] Due to technological advancements in display devices, display devices capable of implementing various functions are being developed.

[0004] A typical example of a display device is a TV. Conventional TVs simply received broadcast signals and performed the function of playing corresponding broadcast content (e.g., news, dramas, music programs, etc.).

[0005] Recently, due to technological development of display devices, various applications or programs can be stored and installed on a TV to perform various functions, and various functions and services can be provided through the installed applications in addition to the function of playing broadcast content. For example, a game application can be stored and installed on the TV, and game content can be executed through the game application.

[0006] Alternatively, as communication technology or communication connection functions of display devices are developed, display devices are being developed to provide various functions or services through wired or wireless communication with external devices. For example, a display device is connected to an external device (e.g., a source device, a game console device) via wired or wireless communication, and can receive content (e.g., game content) from the external device (e.g., a game console device) through the aforementioned wired or wireless communication.

[0007] In providing game content through a display device, it is necessary to provide a method and device capable of outputting a game content playback screen in a way that increases user satisfaction.

[0008] For example, in a display device that supports output of various aspect ratios, when the aspect ratio of the game content being played changes, it is necessary to provide a method and device that can increase the satisfaction a user can feel when using the content by flexibly changing the entire screen output in accordance with the change in aspect ratio. The problem to be solved

[0009] The disclosed embodiment aims to provide a display device capable of outputting an optimized full screen in response to a change in aspect ratio when the aspect ratio of an image corresponding to the content is changed, and a method of operating the same.

[0010] Specifically, the disclosed embodiment aims to provide a display device capable of outputting an optimized full screen in response to a change in the aspect ratio of an image (e.g., a game image) of a received game content, and a method of operating the same.

[0011] Specifically, the purpose is to provide a display device capable of outputting an optimized full screen and a method of operation thereof, wherein when the aspect ratio of a game image is changed after the game image, having a partial area set for enlargement display, is displayed, the enlargement display of the partial area is flexibly changed in response to the aforementioned change in aspect ratio. means of solving the problem

[0012] A display device according to a disclosed embodiment includes a display; a communication interface communicating with a source device; and a processor that executes at least one instruction. The processor executes the at least one instruction to receive a first image corresponding to a first aspect ratio from the source device, and based on identifying a first partial region for enlargement display within the first image, generates and displays a first full screen including the first image and a first enlarged image corresponding to the first partial region, and when a second image corresponding to a second aspect ratio different from the first aspect ratio is received from the source device, identifies a second partial region corresponding to the first partial region within the second image based on the first aspect ratio and the second aspect ratio, and generates and displays a second full screen including the second image and a second enlarged image corresponding to the identified second partial region.

[0013] For example, the processor may, based on the first aspect ratio and the second aspect ratio, identify the second partial region within the second image that includes an image object identical to the image object displayed in the first partial region included in the first image, and obtain the second enlarged image corresponding to the identified second partial region.

[0014] For example, the processor can control the communication interface to receive the second image having the second aspect ratio from the source device based on user input received while receiving the first image from the source device.

[0015] For example, the processor may identify as the first partial area an area in which at least one of a moving object, a minimap, an item-related window, a character-related window, a chat window, and a current status information window included in the first image is displayed, and acquire a first enlarged image corresponding to the first partial area.

[0016] For example, the processor can identify the first partial region based on user input selecting a partial region included in the first image.

[0017] Additionally, the display device according to the disclosed embodiment may further include a user interface that receives user input. The processor may display a user interface screen that displays at least one guide area on the first image, and identify the first partial area based on user input selecting at least one of the at least one guide area.

[0018] For example, the processor recognizes at least one image object corresponding to at least one of a mini map, at least one moving object, an item-related window, a character-related window, a chat window, and a current status information window included in the first image, displays a user interface screen for selecting the recognized at least one image object, and can identify the first partial area based on user input selecting at least one of the at least one image object.

[0019] For example, if the aspect ratio of the display is the same as the second aspect ratio, the processor can divide the entire screen of the display into two partial screens, display the second image in one partial screen, and display the second enlarged image in the other partial screen.

[0020] For example, if the aspect ratio of the display is different from the second aspect ratio, the processor may display the second enlarged image on at least a portion of the remaining area excluding the area where the second image is displayed on the entire screen of the display.

[0021] For example, the processor may adjust the size of the second enlarged image so that the screen utilization efficiency of the remaining area is maximized, and display the resized second enlarged image on the remaining area.

[0022] For example, the processor can adjust at least one of the size and position of the second enlarged image included in the second full screen based on the second aspect ratio and the overall screen aspect ratio of the display.

[0023] For example, the first image may include an image corresponding to game content corresponding to the first aspect ratio. Additionally, the second image may include an image corresponding to game content corresponding to the second aspect ratio.

[0024] For example, the processor may identify an area in which a mini-map included in the first image corresponding to a playback image of game content is displayed as the first partial area, generate a first enlarged image corresponding to the first partial area, and generate and display the first full screen including the first enlarged image and the first image.

[0025] A control method for a display device according to a disclosed embodiment may include: receiving a first image corresponding to a first aspect ratio from a source device; generating and displaying a first full screen including the first image and a first enlarged image corresponding to the first part area, based on identifying a first part area for enlarged display within the first image; receiving a second image corresponding to a second aspect ratio different from the first aspect ratio from the source device; identifying a second part area corresponding to the first part area within the second image based on the first aspect ratio and the second aspect ratio; and generating and displaying a second full screen including the second image and a second enlarged image corresponding to the identified second part area.

[0026] For example, the step of identifying the second partial region may include: identifying the second partial region containing an image object identical to the image object displayed in the first partial region included in the first image, based on the first aspect ratio and the second aspect ratio within the second image; and obtaining the second enlarged image corresponding to the identified second partial region.

[0027] For example, the step of generating and displaying the first full screen may include: identifying as the first partial area an area in which at least one of a moving object, a mini-map, an item-related window, a character-related window, a chat window, and a current status information window included in the first image is displayed; and obtaining a first enlarged image corresponding to the first partial area.

[0028] Additionally, a control method for a display device according to a disclosed embodiment may further include the step of displaying a user interface screen having at least one guide area displayed on the first image; and the step of identifying the first partial area based on a user input selecting at least one of the at least one guide area.

[0029] Additionally, a control method for a display device according to a disclosed embodiment may further include: a step of recognizing at least one image object corresponding to at least one of a mini map, at least one moving object, an item-related window, a character-related window, a chat window, and a current status information window included in the first image; a step of displaying a user interface screen for selecting the recognized at least one image object; and a step of identifying the first partial region based on a user input selecting at least one of the at least one image object.

[0030] Additionally, the step of generating and displaying the second full screen may include, if the aspect ratio of the display included in the display device is different from the second aspect ratio, the step of displaying the second enlarged image in at least a portion of the remaining area excluding the area where the second image is displayed on the full screen of the display.

[0031] For example, the step of generating and displaying the second full screen may further include the step of adjusting at least one of the size and position of the second enlarged image included in the second full screen based on the second aspect ratio and the overall screen aspect ratio of the display. Effects of the invention

[0032] A display device and its operation method according to the disclosed embodiment can increase the satisfaction of a game user by minimizing user inconvenience by outputting an optimized full screen in response to a change in aspect ratio when the aspect ratio of a game image corresponding to game content is changed.

[0033] Specifically, the display device and the method of operation according to the disclosed embodiment can prevent display errors in the enlarged display area that occur when the aspect ratio of the game content changes by automatically changing the enlarged display of the partial area based on the changed aspect ratio when the aspect ratio of the game image, in which a partial area for enlarged display is set, is displayed. Accordingly, the disclosed embodiment can increase the satisfaction of the game user. Brief explanation of the drawing

[0034] FIG. 1 is a diagram illustrating a display device that receives content from a source device. FIG. 2 is a diagram illustrating a display device that supports output of various aspect ratios. Figure 3 is another drawing for illustrating a display device that supports output of various aspect ratios. FIG. 4 is a drawing for illustrating a full screen containing a game image having an aspect ratio of 21:9 output from a display device. Figure 5 is a diagram illustrating the change in the full screen corresponding to the change in the aspect ratio of a game image from 21:9 to 32:9. FIG. 6 is a drawing for illustrating a full screen containing a game image having a 32:9 aspect ratio output from a display device. Figure 7 is a diagram illustrating the change in the full screen corresponding to the change in the aspect ratio of a game image from 32:9 to 21:9. FIG. 8 is a block diagram showing a display device according to a disclosed embodiment. FIG. 9 is a block diagram showing a display device according to a disclosed embodiment in detail. FIG. 10 is a drawing for explaining operations performed in a display device according to a disclosed embodiment. FIG. 11a is a flowchart illustrating a method of operation of a display device according to a disclosed embodiment. FIG. 11b is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. FIG. 12 is a diagram illustrating an aspect ratio change operation performed in a disclosed embodiment. FIG. 13 is a diagram illustrating the switching operation of a full screen output from a display device according to a disclosed embodiment. FIG. 14 is a drawing showing an example of a user interface screen displayed on a display device according to a disclosed embodiment. FIG. 15 is a drawing showing an example of a full screen displayed in a display device according to a disclosed embodiment. FIG. 16 is a drawing showing another example of a full screen displayed in a display device according to a disclosed embodiment. FIG. 17 is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. Figure 18 is a drawing showing a game image. Figure 19 is a diagram illustrating the identification operation of a partial region included within a game image. FIG. 20 is a drawing showing an example of a full screen output in a disclosed embodiment. FIG. 21 is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. Figure 22 is another diagram illustrating the identification operation of a partial region included within a game image. Figure 23 is another diagram illustrating the identification operation of a partial region included within a game image. Figure 24 is a drawing showing another example of a full screen including a game image and an enlarged image. FIG. 25 is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. Specific details for implementing the invention

[0035] Embodiments of the present invention are described below with reference to the attached drawings so that those skilled in the art can easily implement the invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are given similar reference numerals. Additionally, identical components throughout the drawings are given the same reference numerals.

[0036] Throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" with other components interposed between them. Furthermore, when a part is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0037] Phrases such as "in some embodiments" or "in one embodiment" appearing in various places in this specification do not necessarily refer to the same embodiment.

[0038] Some embodiments may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various numbers of hardware and / or software configurations that execute specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more processors or microprocessors, or by circuit configurations for performing the intended functions. Additionally, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented as algorithms executed on one or more processors. Furthermore, the present disclosure may employ prior art for electronic configuration, signal processing, and / or data processing, etc. Terms such as modules and configurations may be used broadly and are not limited to mechanical and physical configurations.

[0039] Furthermore, the connecting lines or connecting members between the components depicted in the drawings are merely illustrative of functional connections and / or physical or circuit connections. In the actual device, connections between components may be represented by various alternative or added functional connections, physical connections, or circuit connections.

[0040] Additionally, the description 'at least one of A, B, and C' means that it may be any one of 'A', 'B', 'C', 'A and B', 'A and C', 'B and C', and 'A, B, and C'.

[0041] In the disclosed embodiment, the display device may refer to any electronic device capable of receiving content from a source device and displaying a corresponding screen. Here, the content may be games, lectures, movies, home training service content, etc.

[0042] Specifically, the display device according to the embodiment of the present disclosure is any electronic device capable of selectively displaying at least one content, and may exist in various forms such as a TV, smart TV, digital broadcasting terminal, tablet PC, smartphone, mobile phone, computer, laptop, etc. In addition, the display device may have a form that is not only fixed but also movable or portable by the user.

[0043] FIG. 1 is a diagram illustrating a display device that receives content from a source device.

[0044] Referring to FIG. 1, the display device (100) can be connected to the source device (101) via a wired or wireless communication network.

[0045] The source device (101) can provide content such as video and audio to the display device (100). The source device (101) may be a video game console. As another example, the source device (101) may include various types of electronic devices capable of providing content to the display device (100), such as a video game console, a set-top box, a DVD player, a Blu-ray disc player, a PC, a game console, etc. The source device (101) may be referred to as a source device in terms of providing content, and may also be referred to as a host device, a content providing device, an electronic device, a storage device, a computing device, a server device, a server, etc.

[0046] The display device (100) can output or display content received from the source device (101). The display device (100) may include various types of electronic devices capable of receiving and outputting content, such as, for example, a network TV, a smart TV, an internet TV, a web TV, an IPTV, a PC, etc. The display device (100) may be referred to as a display device in terms of receiving and displaying content, and may also be referred to as a content receiving device, a sink device, an electronic device, a computing device, etc.

[0047] A source device (101) and a display device (100) can perform content transmission and reception by being connected through a wired connection means to form a wired network. For example, the wired connection means may include a cable, and each of the source device (101) and the display device (100) may include one or more ports for cable connection. One or more ports may include digital input interfaces such as, for example, an HDMI port, a DisplayPort, or Type-C.

[0048] Alternatively, the source device (101) and the display device (100) may perform content transmission and reception by being connected through a wireless connection means for forming a wireless network. For example, the wireless connection means may include a wireless HDMI communication module, and each of the source device (101) and the display device (100) may include a wireless HDMI communication module. As another example, the wireless connection means may include at least one communication module (not shown) that performs communication according to communication standards such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, ZIGBEE, the Internet, 3G, 4G, 5G and / or 6G, etc.

[0049] In FIG. 1, an example is illustrated in which a source device (101) and a display device (100) are connected via an HDMI cable (105) to perform wired HDMI communication.

[0050] For example, a source device (101) and a display device (100) may each have an HDMI port and may communicate through an HDMI cable (105) connected to the port. When the source device (101) provides content to the display device (100), the source device (101) may first receive an EDID provided by the display device (100), and create content in a format corresponding to the received EDID and provide it to the display device (100).

[0051] EDID is data or information that defines display performance or display specifications that enable a display device (100) to display content. Specifically, EDID may include at least one of information about the manufacturer of the display device, product information, EDID version information, timing information, information about screen size, information about brightness, and information about pixels. Here, the information about screen size may include information about at least one of the resolution and aspect ratio that the display device can provide.

[0052] The source device (101) can acquire an EDID provided by the display device (100), generate a format of content to be sent to the display device (100) based on the acquired EDID, and provide it to the display device (100). For example, if the aspect ratio identified according to the acquired EDID (specifically, the value of the identified aspect ratio) is 32:9, the source device (101) can generate an image having the identified aspect ratio value of 32:9 and transmit it to the display device (100). That is, the source device (101) that receives the EDID from the display device (100) can provide the display device (100) with content in a format suitable for the display performance of the display device (100). Here, the image is an image corresponding to the content and may include a playback screen of the content, a menu screen of the content, etc.

[0053] For convenience in describing the disclosed embodiments, it has been described as 'transmitting an image,' but this may mean transmitting a video signal corresponding to an image, a packet or stream containing a video signal, or audio / video data (AV data) containing a video signal.

[0054] Hereinafter, images displayed on a display device that supports output of various aspect ratios are described with reference to FIGS. 2 and FIGS. 3.

[0055] FIG. 2 is a diagram illustrating a display device that supports output of various aspect ratios.

[0056] The display device (100) according to the disclosed embodiment can support the output of a screen having a plurality of aspect ratios. Here, the aspect ratio represents the ratio of the vertical length to the horizontal length of the screen and can be expressed as a value such as 4:3, 16:9, 16:10, 21:9, 32:9, etc. Additionally, since the aspect ratio represents the ratio of the horizontal and vertical lengths of the output screen or image, it may be referred to as 'screen ratio', 'image ratio', etc. The aspect ratio of the screen can be optimized according to the type of input image (or video).

[0057] For example, depending on the type of image displayed on the screen, an aspect ratio that increases user satisfaction can be selected.

[0058] For example, the 16:9 aspect ratio is the most commonly used screen ratio and can be used for outputting menu screens, work screens, etc. As another example, the 21:9 aspect ratio can be used when more information is to be displayed on the screen in the left-right (or horizontal) direction, such as when watching movies or playing games. As yet another example, the 32:9 aspect ratio can be used for outputting images that provide a wide field of view or are intended to be displayed. Specifically, the 32:9 aspect ratio can be frequently used in games that utilize 360-degree images or panoramic video, such as sports games, racing games, and battle games, in order to enhance user satisfaction.

[0059] When displaying images of the same game content, different viewing angles can be provided depending on the aspect ratio of the image. For example, as the aspect ratio of the image increases in the direction of horizontal expansion, a wider field of view (FoV) or viewing angle can be provided. For example, a wider field of view or viewing angle can be provided in the order of a 32:9 aspect ratio, a 21:9 aspect ratio, and a 16:9 aspect ratio.

[0060] Referring to FIG. 2, an image (210) having an aspect ratio of 32:9, an image (230) having an aspect ratio of 21:9, and an image (250) having an aspect ratio of 16:9 are shown.

[0061] For example, a wide viewing angle can be provided in the order of an image (210) having an aspect ratio of 32:9, an image (230) having an aspect ratio of 21:9, and an image (250) having an aspect ratio of 16:9.

[0062] Referring to FIG. 2, an image (210) having an aspect ratio of 32:9 can provide the widest field of view. An image (230) having an aspect ratio of 21:9 does not provide a field of view for the area to the left of line 201 and the area to the right of line 202 compared to an image (210) having an aspect ratio of 32:9, but can provide a field of view for the area between line 201 and line 202 (231). Additionally, an image (250) having an aspect ratio of 16:9 does not provide a field of view for the area to the left of line 203 and the area to the right of line 204 compared to an image (210) having an aspect ratio of 32:9, but can provide a field of view for the area between line 202 and line 204 (251).

[0063] As described above, an image (210) having a 32:9 aspect ratio can provide a wider field of view compared to an image (230) having a 21:9 aspect ratio or an image (250) having a 16:9 aspect ratio, thereby providing more information to the user receiving the game content. For example, when displaying a certain area of ​​the game content image based on the user's location among a 360-degree image or a panoramic image, the image (210) having a 32:9 aspect ratio among the images (210, 230, 250) shown in FIG. 2 can provide the widest field of view. Accordingly, the user of the game content can play the game while viewing the image with the widest field of view, and can enjoy a more vivid and immersive game.

[0064] Furthermore, in the case of general game content, if a game user can see a wider field of view during gameplay, they can receive more information through the provided images, thereby gaining an advantageous position in the outcome of the game. Therefore, game users will likely desire to be provided with game content images that offer even a slightly wider field of view. Here, game users can include not only users who play the game but also users who spectate it.

[0065] Accordingly, a display device (100) that supports the output of an image corresponding to a plurality of aspect ratios can display an image at the aspect ratio with the largest left-right expansion ratio among the plurality of aspect ratios when playing game content (e.g., the aspect ratio of 32:9 among the aspect ratios of 32:9, 21:9 and 16:9).

[0066] Figure 3 is another drawing for illustrating a display device that supports output of various aspect ratios.

[0067] In FIG. 3, screens output from a display device (100) are illustrated as examples when the ratio of the longitudinal length to the transverse length of a display (or display panel) included in the display device (100) is 16:9. That is, '16:9' can be the aspect ratio of the display device (100) itself, or the overall screen aspect ratio of the display device (100).

[0068] For example, in the case where the game content is 3D game content, the source device (101) can store a 360-degree image (210) corresponding to the game content. In FIG. 3, an example is shown where the 360-degree image (210) is identical to the image having a 32:9 aspect ratio shown in FIG. 2. Based on the EDID of the display device (100), the source device (101) can transmit to the display device (100) an image having an aspect ratio identified in the set EDID that corresponds to the current field of view.

[0069] For example, if the aspect ratio identified based on the EDID of the display device (100) is 16:9, the source device (101) can transmit an image (340) having an aspect ratio of 16:9 to the display device (100). Additionally, transmitting an image may mean transmitting image data corresponding to the image. Then, the display device (100) can output a full screen (370) corresponding to the received image (340). Since the aspect ratio of the received image (340) and the aspect ratio of the display included in the display device (100) are the same at 16:9, the full screen (370) can display the image (340) without any black areas.

[0070] As another example, if the aspect ratio identified based on the EDID of the display device (100) is 21:9, the source device (101) can transmit an image (330) having an aspect ratio of 21:9 to the display device (100). Then, the display device (100) can output a full screen (350) corresponding to the received image (330). Since the aspect ratio of the received image (330) is different from the aspect ratio of the display itself included in the display device (100), the full screen (350) can display the image (330) including a black area.

[0071] As another example, if the aspect ratio identified based on the EDID of the display device (100) is 32:9, the source device (101) can transmit an image (320) having an aspect ratio of 32:9 to the display device (100). Then, the display device (100) can output a full screen (360) corresponding to the received image (320). Since the aspect ratio of the received image (310) and the aspect ratio of the display included in the display device (100) are different, the full screen (360) can display the image (320) with a wider black area compared to the full screen (350).

[0072] As described with reference to FIGS. 1 to 3, the disclosed embodiment is a display device according to the disclosed embodiment that can support the output of images having various aspect ratio values. The disclosed embodiment relates to a device and method for minimizing errors in the output screen and / or user inconvenience that may occur when the aspect ratio of an image is changed, in a display device capable of supporting the output of images having different aspect ratio values, and is described in detail below with reference to FIGS. 4 to 25. Furthermore, FIGS. 4 to 25 described below illustrate, as exemplified in FIG. 3, the case in which the ratio of the longitudinal length to the transverse length of a display (or display panel) included in the display device according to the disclosed embodiment is 16:9.

[0073] FIG. 4 is a drawing for illustrating a full screen including a game image having an aspect ratio of 21:9 output from a display device. Specifically, FIG. 4 illustrates an example of an image (410) received from a display device and a corresponding full screen (450). The images and full screens illustrated in FIG. 4 through 7 are described by exemplifying cases where they are received and output from the display device (100) described in FIG. 1. Additionally, the images (e.g., game images) illustrated in FIG. 4 through 7 are described by exemplifying cases where they are generated from the source device (101) described in FIG. 1 and transmitted to the display device (100).

[0074] Referring to FIG. 4, a display device (100) can receive game content from a source device (101). For example, the game content may be received in the form of a stream, packet, etc., containing audio and / or video data. Additionally, a stream or packet corresponding to the game content may include a plurality of images. Here, the images may be images displayed for the playback of the game content, such as a game content playback screen or a menu screen. For example, the images may be in the form of an image frame, a frame, a group of pictures (GOP), etc.

[0075] In the drawings to be referenced below, including FIG. 4, an example is illustrated and described in which an image received by a display device according to the disclosed embodiment is an image corresponding to game content (hereinafter, 'game image').

[0076] Additionally, the game content provided by the source device (101) may be 3D game content. A 3D game refers to a game that allows a user to enjoy the game within a 3D space (e.g., a 3D space created by expressing a virtual three-dimensional space and shape). For example, a user playing a 3D game may proceed with the game by engaging in competition, racing, combat, fighting, or war with virtual characters, etc., within a designated point within the 3D space. As another example, in addition to content that performs the game within a 3D space, such as a 3D game, there may be general games that perform the game within a 2D space.

[0077] In the aforementioned 3D game or general game, etc., the game image may include at least one sub-window. For example, the sub-window is displayed in a partial area on the game playback screen and may contain information related to the progress of the game or services for game participants (e.g., a chat window, etc.). For example, the sub-window may be a mini map, a skill window, an item-related window, a character-related window, a chat window, a control-related window, etc. Additionally, the type of sub-window included in the game image may vary depending on the type of game.

[0078] Specifically, the minimap can be an image that displays a small map representing the entire space where the game is played. The skill window can be a status window that indicates the cooldown time of a skill. The item-related window can be a window that provides information about items used in the game. For example, the item-related window may include an item inventory window. The item inventory window can display the types of items the user possesses and / or their reuse times. The character-related window can be a window that provides information about the character performing the game. For example, the character-related window can include a character status window. In games where there are allies and enemies, such as battle games, the character status window can be a window that provides the HP (Health Point) and / or MP (Mana Point), respawn time, etc., for each ally and / or enemy. The chat window can be a window that displays the chat content of multiple people participating in or spectating the game. Alternatively, the chat window can be a window that displays messages related to the game.

[0079] For example, a control-related window may be a window for providing information related to the cockpit or driver's seat in a game where the game user controls an object used in the game (e.g., a flying object, a car, etc.). For example, the control-related window may include a flight simulation cockpit window for providing information necessary or provided during flight or operation. The flight simulation cockpit window may display airspeed, engine status, fuel, flaps, trim, altitude status, etc.

[0080] The aforementioned sub-window may be displayed in a form that is separately partitioned and / or displayed on the game image. Alternatively, the sub-window may be displayed in an opaque or translucent form on a partial area of ​​the game image, rather than in the form of a separately partitioned sub-window.

[0081] Referring to the example illustrated in FIG. 4, a minimap (401) and an item window (402) can be displayed on a game image (410) having an aspect ratio of 21:9 as illustrated. In the example of FIG. 4, two sub-windows, a minimap (401) and an item window (402), are displayed within the game image (410).

[0082] For example, a partial area included within the game image (410) and intended to be enlarged can be the aforementioned sub-window. As another example, a partial area included within the game image (410) and to be enlarged separately from the game image (410) can be an area where moving objects within the game image (410) are displayed.

[0083] For example, the display device (100) can display an entire screen including a game image (410) and an enlarged image corresponding to a sub-window (e.g., a minimap (401), an item window (402), etc.) included in the game image (410) so that the sub-window (e.g., a minimap (401), an item window (402), etc.) included in the game image (410) is displayed enlarged.

[0084] For example, sub-windows can provide useful information to the user playing the game. For instance, the user can view the provided mini-map and move the position of objects corresponding to the user in a way that increases their win rate.

[0085] Alternatively, sub-windows (e.g., chat windows) can support the exchange of opinions or information between users playing the game or watching the game. Accordingly, the convenience of game users can be enhanced.

[0086] Alternatively, the sub-window can provide information regarding the game's progress and the game's win / loss or win rate.

[0087] Alternatively, the sub-window may provide additional services related to the game. For example, the sub-window may provide separate services related to the game (e.g., access to a game-related shopping mall, link to a game-related broadcast program, etc.).

[0088] As described above, the sub-window can provide useful or beneficial information to the game user and enhance the convenience of the game user. Therefore, if the sub-window is displayed in an enlarged manner, larger than what is displayed within the game image, the convenience of the user can be further increased. Accordingly, in the disclosed embodiment, the entire screen output from the display device (100) may include an enlarged image corresponding to the sub-window separately from the game image, which will be described in detail below with reference to FIG. 4.

[0089] Referring to the example illustrated in FIG. 4, if the aspect ratio of the display itself of the display device (100) is 16:9 as in FIG. 3, the aspect ratio of the entire screen (450) becomes 16:9. When displaying a game image (410) having an aspect ratio of 21:9 on the entire screen (450), a black area (460) may exist. The display device (100) may include an enlarged image corresponding to a sub-window within an area of ​​the entire screen (450) excluding the area where the game image (410) is displayed, such as the black area (460). For example, the enlarged image may be an image that enlarges and displays a partial area (e.g., an area displayed as a sub-window) included within the game image (410). Alternatively, the enlarged image may be an image that enlarges and displays at least one image object included within a partial area (e.g., an area displayed as a sub-window) included within the game image (410).

[0090] For example, the full screen (450) may include a game image (410) having an aspect ratio of 21:9, an enlarged image (470) corresponding to a minimap (401) which is a sub-window included within the game image (410), and an enlarged image (480) corresponding to an item window (402) which is a sub-window included within the game image (410). Here, the enlarged images (470, 480) may be displayed on a black area (460).

[0091] After the full screen (450) is displayed, the aspect ratio of the game image (410) can be changed and received. Since the display device (100) supports output of multiple aspect ratios, the display device (100) can receive an image having a changed aspect ratio, decode it, and display the corresponding full screen.

[0092] At this time, errors may occur in the display of the enlarged image. Errors in the display of the enlarged image will be explained in detail below with reference to FIG. 5.

[0093] FIG. 5 is a diagram illustrating the change in the entire screen corresponding to the change in the aspect ratio of a game image from 21:9 to 32:9. In FIG. 5, the same configuration as in FIG. 4 is illustrated using the same drawing symbols. Therefore, redundant descriptions are omitted.

[0094] Referring to FIG. 5, after a game image (410) having an aspect ratio of 21:9 is received, the aspect ratio of the game image (410) is changed to 32:9 so that a game image (501) having the changed aspect ratio can be received. Then, the display device (100) can display a full screen (510) including the game image (501) having the changed aspect ratio of 32:9.

[0095] In conventional or general display devices, when the aspect ratio of an image corresponding to the content being played is changed as described above, the position and size of the sub-window set in the received image prior to the change in aspect ratio are not changed. Accordingly, a partial area corresponding to the position and size of the sub-window set prior to the change in aspect ratio is obtained on the image having the changed aspect ratio, and the obtained partial area is enlarged to generate an enlarged image. Therefore, an incorrect enlarged image is included in the entire screen containing the image having the changed aspect ratio. This will be explained in detail below with reference to the entire screen (510) shown in FIG. 5.

[0096] In a conventional or general display device, even if the aspect ratio of the game image is changed, the position and size of the two sub-windows (401, 402) set in the game image (410) with the 21:9 aspect ratio value received before the change in aspect ratio are maintained. Referring to FIG. 5, when the aspect ratio is changed during the playback of game content, the output screen of the display device (100) can be switched from a full screen (450) to a full screen (510).

[0097] After the aspect ratio is changed, the enlarged image (570) included in the full screen (510) is displayed by enlarging the partial image displayed within a partial area having the same position and size as the previously set sub-window (401). Additionally, the previously set sub-window (402) is not located at the same position and size as the game image (501) having a 32:9 aspect ratio, but exists within the black area (571). Therefore, the partial image corresponding to the previously set sub-window (402) becomes a black image, and the enlarged image corresponding to the sub-window (402) is displayed as a black image (502) on the black area (571).

[0098] As described with reference to FIG. 5, in the case of a general or conventional display device, even if the aspect ratio of an image (e.g., a game image) received during content playback changes, the position and size of the sub-window corresponding to the enlarged image are not changed. Accordingly, the enlarged image provided to the user is displayed as an image of an incorrect form, as in the enlarged image (570, 502) described in FIG. 5. Specifically, an image that enlarges an incorrect image object is displayed instead of the enlarged image the user wants to receive, and consequently, the user may feel discomfort during the game. In other words, the user's convenience and satisfaction may decrease due to the display of an incorrect enlarged image.

[0099] Hereinafter, with reference to FIGS. 6 and 7, full screens that are output when the aspect ratio of a game image displayed during the playback of game content is changed from 32:9 to 21:9 will be described.

[0100] FIG. 6 is a drawing for illustrating a full screen including a game image having a 32:9 aspect ratio output from a display device. In FIG. 6, the same configuration as in FIG. 5 is illustrated using the same drawing symbols, so redundant descriptions are omitted.

[0101] Referring to FIG. 6, when a game image (501) having an aspect ratio of 32:9 is received, the display device (100) can display a full screen (650) corresponding to the received game image (501).

[0102] As described in FIG. 4, the game image (501) may include a minimap (601) and an item window (522) as sub-windows.

[0103] Specifically, the full screen (650) may include a game image (501) having a 32:9 aspect ratio, an enlarged image (670) corresponding to a minimap (601) which is a sub-window included within the game image (501), and an enlarged image (680) corresponding to an item window (602) which is a sub-window included within the game image (501). Here, the enlarged images (670, 680) may be displayed on a black area (660). The black area (660) may be the remaining area of ​​the full screen (650) excluding the area (610) where the game image (501) is displayed.

[0104] FIG. 7 is a diagram illustrating the change in the entire screen corresponding to the change in the aspect ratio of a game image from 32:9 to 21:9. In FIG. 7, the same configuration as in FIG. 4 and FIG. 6 is illustrated using the same drawing symbols, so redundant descriptions are omitted.

[0105] Referring to FIG. 7, after the full screen (650) is displayed, the aspect ratio of the game image (501) can be changed from 32:9 to 21:9. Since the display device (100) supports output of multiple aspect ratios, the display device (100) can receive a game image (410) having an aspect ratio of 21:9, which is the changed aspect ratio, decode it, and display the corresponding full screen (710).

[0106] At this time, regarding the display of the enlarged image, an error of the same or similar manner to the enlarged image display error described in FIG. 5 may occur. The error regarding the display of the enlarged image will be explained in detail below with reference to FIG. 7.

[0107] In a conventional or general display device, even if the aspect ratio of the game image is changed, the position and size of the two sub-windows (601, 602) set in the game image (501) with the 32:9 aspect ratio value received before the change in aspect ratio are maintained. Referring to FIG. 7, when the aspect ratio is changed during the playback of game content, the output screen of the display device (100) can be switched from a full screen (650) to a full screen (710).

[0108] After the aspect ratio is changed, the enlarged image (770) included in the full screen (710) is displayed by enlarging the partial image displayed within a partial area having the same position and size as the previously set sub-window (601). Additionally, the previously set sub-window (602) is not an area where items are displayed within the game image (410) having a 21:9 aspect ratio, and may represent an area where the exterior wall of a building is displayed, which is not meaningful information from the perspective of the game user. Therefore, since the partial image corresponding to the previously set sub-window (602) is an image representing the wall of a building, the enlarged image (780) corresponding to the sub-window (602) can be displayed as shown in FIG. 7.

[0109] As explained with reference to FIG. 7, in the case of a general or conventional display device, even if the aspect ratio of an image (e.g., a game image) received during content playback is changed, the position and size of the sub-window corresponding to the enlarged image are not changed.

[0110] Accordingly, the enlarged image provided to the user is displayed as an incorrect image, as in the enlarged images (770, 780) described in FIG. 7. Specifically, an image is displayed that is an enlarged version of an incorrect image object, rather than the enlarged image the user wants to receive, and as a result, the user may feel discomfort during the game. In other words, the user's convenience and satisfaction may decrease due to the display of an incorrect enlarged image.

[0111] The disclosed embodiment is an apparatus and method capable of eliminating the occurrence of display errors in enlarged images that occur when the aspect ratio of an image corresponding to content being played is changed and displayed, as described with reference to FIGS. 5 and 7, and will be described in detail below with reference to FIGS. 8 to 25.

[0112] FIG. 8 is a block diagram showing a display device according to a disclosed embodiment. The display device (800) and source device (801) shown in FIG. 8 correspond to the display device (100) and source device (101) shown in FIG. 1, respectively. Accordingly, in describing the display device (800), descriptions that overlap with those in FIG. 1 to FIG. 7 are omitted.

[0113] Referring to FIG. 8, the display device (800) includes a display (820), a communication interface (830) that communicates with a source device (801), and a processor (810) that executes at least one instruction.

[0114] A processor (810) included in a display device (800) according to a disclosed embodiment can control at least one component included in the display device (800) to perform the following operations by executing the at least one instruction. Specifically, the processor (810) receives a first image corresponding to a first aspect ratio from the source device (801), and based on identifying a first partial area for enlargement display within the first image, generates and displays a first full screen including the first image and a first enlarged image corresponding to the first partial area. Subsequently, when the processor (810) receives a second image corresponding to a second aspect ratio different from the first aspect ratio from the source device (801), it identifies a second partial area corresponding to the first partial area within the second image based on the first aspect ratio and the second aspect ratio. And, the processor (810) generates and displays a second full screen including the second image and a second enlarged image corresponding to the identified second partial area.

[0115] For example, the ‘first image’ may be an image corresponding to content being played on the display device (800). Here, the content may be game content, lecture content, movie content, music content, home training service content, other broadcast content (e.g., news, drama, music program, etc.). Below, an example will be illustrated and explained where the content being played on the display device (800) is game content, and the first image and the second image are game images corresponding to the playback screen, menu screen, execution screen, etc. of the game content.

[0116] Additionally, 'partial area' refers to a part of an area included within an image and may correspond to the 'sub-window' described with reference to FIGS. 4 to 7. For example, in the disclosed embodiment, 'partial area' (e.g., 'first partial area,' or 'second partial area') may refer to a part of a game image in which an image object that a game user, etc. wishes to enlarge and view is drawn.

[0117] For example, a partial area to be displayed in an image corresponding to content (e.g., a game image) that is included within the content may be an area where at least one image object corresponding to at least one of a mini map, at least one moving object, an item-related window, a character-related window, a chat window, and a current status information window is displayed. For example, the processor (810) may identify a first partial area where at least one of a moving object, a mini map, an item-related window, a character-related window, a chat window, and a current status information window included in the image corresponding to content (e.g., a game image) is displayed, and may obtain a first enlarged image corresponding to the first partial area.

[0118] Additionally, the first aspect ratio and the second aspect ratio may have different values. Additionally, each of the first aspect ratio and the second aspect ratio may be identical to or correspond to any one of the multiple aspect ratio values ​​supported by the display device (800).

[0119] Additionally, the second image may be output and transmitted from the source device (801) based on a user's request. Specifically, the display device (800) may control the source device (801) to transmit a second image having a second aspect ratio based on user input received while receiving a first image having a first aspect ratio from the source device.

[0120] The processor (810) executes at least one instruction to control the execution of an intended operation. Here, the at least one instruction may be stored in an internal memory (not shown) included within the processor (810) or in a memory (not shown) included within the display device (100) separately from the processor (810).

[0121] Specifically, the processor (810) can control at least one component included within the display device (800) so that an intended operation is performed by executing at least one instruction. Therefore, even if the processor (810) is described and explained as performing certain operations, this may mean that the processor (810) controls at least one component included within the display device (800) so that a certain operation is performed.

[0122] Additionally, although the processor (810) has been described and illustrated as an example of being formed as a single processor, it may also be formed in a form that includes multiple processors.

[0123] Specifically, the processor (810) may include RAM (not shown) used as a storage area corresponding to various tasks performed on the display device (100) or for storing signals or data input from outside the display device (800), a control program for controlling the display device (100), an application for providing a predetermined function or service, and / or a plurality of instructions stored in ROM (not shown), and at least one processor (not shown). The processor (not shown) may include a graphic processing unit (not shown) for graphic processing corresponding to video. The processor (not shown) may be implemented as a System On Chip (SoC) integrating a core (not shown) and a GPU (not shown). Additionally, the processor (810) may include a single core or more multi-cores. For example, the processor (810) may include a dual core, triple core, quad core, hexa core, octa core, deca core, dodeca core, hexa-double core, etc.

[0124] The display (820) outputs an image onto the screen. Specifically, the display (820) can output an image corresponding to the video data through an internally included display panel (not shown) so that the user can visually recognize the video data. Specifically, the video data forming the content may include multiple frame images, and the display (820) can play the video content by continuously displaying multiple frame images under the control of the processor (810).

[0125] In the disclosed embodiment, the display (820) can display an image (e.g., a game image) corresponding to content (e.g., game content) received from the source device (101) on the screen under the control of the processor (810).

[0126] The communication interface (830) can communicate with at least one external device (e.g., source device (101)) via a wired or wireless communication network. Here, the external device (not shown) may be a source device (801) capable of providing content, a server device, a storage device, etc.

[0127] Specifically, the communication interface (830) may include at least one port (not shown) for connecting to an external device via a wired cable in order to communicate with an external device (e.g., source device (101)) via a wired connection. For example, the communication interface (830) may include at least one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port. Accordingly, the communication interface (830) can communicate with an external device connected via a wired connection through at least one port (not shown).

[0128] Additionally, the communication interface (830) may include at least one wireless communication module, wireless communication circuit, or wireless communication device that performs wireless communication with an external device, for example, a source device (801).

[0129] For example, the communication interface (830) may include at least one communication module (not shown) that performs communication according to a communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE. Alternatively, the communication interface (830) may further include a communication module (not shown) that performs communication with a server (not shown) to support long-distance communication according to a long-distance communication standard. For example, the communication interface (830) may include a communication module (not shown) that performs communication through a network for internet communication. Additionally, the communication interface (830) may include a communication module (not shown) that performs communication through a communication network according to a communication standard such as 3G, 4G, 5G and / or 6G.

[0130] In the disclosed embodiment, for the display device (800) to provide content transmitted from the source device (801) to a user, the processor (810) may include an application for providing the received content. For example, if the content is game content, the processor (810) may include a game application for controlling and / or managing the execution of the received game content. For example, the game application may be implemented as at least one instruction or program for controlling the execution of the game content.

[0131] In FIGS. 9 to 25 described below, the case in which the image received by the display device (800) from the source device (801) is a game image corresponding to game content is described and illustrated as an example. Additionally, the case in which the display device (800) includes an HDMI port and communicates via a wired connection with the source device (801) through an HDMI cable connected to the HDMI port is described as an example.

[0132] Additionally, the display device (800) may support the output of a screen having various resolutions and / or aspect ratios. For example, the display device (800) may output a screen including an image having aspect ratios such as 4:3, 16:9, 16:10, 21:9, and / or 32:9 onto a display (820) that includes a display panel having a predetermined aspect ratio. The size and aspect ratio of the display (820) (specifically, the size and aspect ratio of the display panel) may correspond to the size and aspect ratio of the screen output through the display (820). Furthermore, the screen output through the display (820) may include images having various aspect ratios. Additionally, the size and aspect ratio of the display (820) itself may be referred to as the 'display aspect ratio' or 'aspect ratio of the entire screen,' and the aspect ratio of the image corresponding to the content may be referred to as the 'aspect ratio of the image.'

[0133] FIG. 9 is a block diagram showing a display device in detail according to a disclosed embodiment. In FIG. 9, configurations identical to those shown in FIG. 3 and FIG. 8 are illustrated using the same drawing symbols. Additionally, the display device (900) and source device (901) shown in FIG. 9 may correspond to the display device (100) and source device (101) shown in FIG. 1, respectively. Furthermore, the display device (900) and source device (901) shown in FIG. 9 may correspond to the display device (800) and source device (801) shown in FIG. 8, respectively. Accordingly, in describing the display device (900), descriptions that overlap with those in FIG. 1 to FIG. 8 are omitted.

[0134] First, the source device (901) will be described. Referring to FIG. 9, the source device (901) may include a transmission unit (910), an image processing unit (920), and a control unit (930).

[0135] The transmission unit (910) can output a video signal of a resolution that the display device (900) can process and an audio signal of a sound format that the display device (900) can process. For example, the video signal may be a digital video signal formed as a digital signal. Additionally, the transmission unit (910) can read EDID (Extended Display Identification Data) information from the display device (900) under the control of the control unit (930). Here, the EDID may include display characteristic information that includes information regarding the resolution or sound format that the display device (900) can support. For example, the information regarding the resolution included in the EDID may be expressed as information regarding the vertical pixel values ​​and horizontal pixel values ​​of the screen to be output on the screen of the display device (900). Accordingly, the EDID may include information regarding the aspect ratio that the display device (900) can support.

[0136] The transmission unit (910) may include one or more ports for communication with the display device (900). For example, one or more ports may include ports of various standards such as HDMI port, DisplayPort (DP), Thunderbolt, MHL (Mobile High-Definition Link), USB (Universal Serial Bus), etc.

[0137] The image processing unit (920) can process the image to be transmitted through the transmission unit (910) under the control of the control unit (930).

[0138] The control unit (930) performs at least one instruction similar to the processor (810) to control the performance of an intended operation. For example, the control unit (930) controls the overall operation of the source device (901), controls the processing of video and audio signals to be transmitted to the display device (900), and controls the transmission of the processed video and audio signals to the display device (800) through the transmission unit (910).

[0139] The control unit (930) can control the image processing unit (920) to process an image based on the EDID read from the display device (900) and the EDID containing display characteristic information. Image processing and transmission operations based on the EDID are described in detail below.

[0140] Next, the display device (900) is described. Referring to FIG. 9, the display device (900) may further include at least one of an image processing unit (825), an audio processing unit (840), an audio output unit (850), a storage unit (861), and a user interface (870) compared to the display device (800) shown in FIG. 8.

[0141] The communication interface (830) can receive video and audio signals received from the source device (901) under the control of the processor (810) according to a connected protocol and output them to the video processing unit (825) and the audio processing unit (840).

[0142] The communication interface (830) may include at least one communication module that transmits and receives data with an external device (not shown) and at least one of at least one port. Specifically, the communication interface (830) may include a communication unit (831) and an input / output unit (832).

[0143] The communication unit (831) communicates with an external device through at least one wired or wireless communication network. In the disclosed embodiment, the communication unit (831) can communicate with a source device (901). Specifically, the communication unit (831) may be formed to include at least one communication module, communication circuit, etc., and may transmit and receive data with an external device through the communication module and / or communication circuit.

[0144] Specifically, the communication unit (831) may include at least one communication module (not shown) that performs communication according to communication standards such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE. Additionally, the communication unit (831) may include a communication module (not shown) that performs communication through a network for internet communication. Additionally, the communication unit (831) may include a communication network according to communication standards such as 3G, 4G, 5G, and / or 6G.

[0145] Additionally, the communication unit (831) may include a communication module capable of receiving control commands from a remote controller (not shown) located at a short distance, such as an IR (infrared) communication module. In this case, the communication unit (831) may receive control commands from the remote controller (not shown). For example, the control commands received from the remote controller (not shown) may include a turn-on or turn-off command, a signal to request the execution of a home training application, etc.

[0146] As another example, control commands received from a remote control device (not shown) may include control commands related to the playback of the game. For example, the control commands may be a command requesting a change in the aspect ratio of a game image, a control command for user input to set a sub-window (or enlarged area) in the game image, etc.

[0147] The input / output unit (832) may include one of an HDMI port (High-Definition Multimedia Interface port, not shown), a component jack (not shown), a PC port (not shown), and a USB port (not shown). Additionally, the input / output unit (832) may include a combination of an HDMI port, a component jack, a PC port, and a USB port. In this case, the input / output unit (832) may directly receive video data to be played on the display device (900) through the HDMI port, component jack, PC port, or USB port.

[0148] The image processing unit (825) can process an image signal received from the communication interface (830) under the control of the processor (810) and output it to the display (820). Here, the image signal may include video and / or audio data.

[0149] The display (820) can display a video signal received from the video processing unit (825) on the screen. For example, the display (820) can display an image (e.g., a game image) generated based on a video signal received from the communication interface (830). As another example, the display (820) can display a full screen including a game image generated based on a video signal received from the communication interface (830), and at least one enlarged image corresponding to at least one partial area included within the game image.

[0150] The audio processing unit (840) can convert an audio signal received from the communication interface (830) into an analog audio signal and output it to the audio output unit (850) under the control of the processor (810).

[0151] The audio output unit (850) can output the received analog audio signal through a speaker.

[0152] The storage unit (861) can store programs related to the operation of the display device (900) and various data generated during the operation of the display device (900). Alternatively, the storage unit (861) can store content received from the source device (901). Alternatively, the storage unit (861) can store data or information necessary for the operation of the display device (900).

[0153] The storage unit (861) may include at least one memory (860, 875, 880). Here, the at least one memory (160, 161) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, a magnetic disk, and an optical disk.

[0154] In FIG. 9, the storage unit (861) is illustrated as an example of a case in which it includes three storage elements (860, 875, 880), but it may include one or more than three storage elements. For example, the storage unit (861) may include a memory (860). Alternatively, the storage unit (861) may include at least one of a memory (860), an EDID storage unit (875), and an EDID memory (880).

[0155] The memory (860) can store programs related to the operation of the display device (900) and various data generated during the operation of the display device (900).

[0156] The EDID storage unit (875) is a memory that stores an EDID and can store an EDID including display characteristic information such as the manufacturer / product identifier of the display device (900), the EDID format version, display parameters (supported resolution, color format, etc.), and audio format. The EDID may be stored in the EDID storage unit (875) by the manufacturer during the production process of the display device (900). For example, a flash memory may be used as the EDID storage unit (875).

[0157] The EDID storage unit (875) can store an EDID corresponding to each port in correspondence with one or more ports included in the communication interface (830) of the display device (900). For example, if the communication interface (830) is equipped with an HDMI port and a display port, the EDID storage unit (875) can store an EDID used for HDMI and an EDID used for the display port, respectively.

[0158] For example, the processor (810) can write the EDID stored in the EDID storage unit (875) to the EEDID memory (880) so that the EDID can be read by the source device (901). For example, the EEDID memory (880) to which the source device (901) can read the EDID can be implemented as an EEPROM (Electrically Erasable Programmable Read-Only Memory).

[0159] For example, the processor (810) may not record the EDID stored in the EDID storage unit (875) as is into the EEDID memory (880), but may change the EDID in response to content received from the source device (901) and record the changed EDID into the EEDID memory (880). Here, changing the EDID may mean deleting, modifying, resetting, updating, and / or adding at least some of the information included in the EDID. To distinguish it from the changed EDID, the EDID stored during the manufacturing process of the display device (900) may be referred to as the EDID or the original EDID, and the EDID generated by changing it by the processor (810) may be referred to as the changed EDID.

[0160] For example, the processor (810) can change the original EDID whenever necessary to improve EDID compatibility and store the changed EDID in the EDID memory (880).

[0161] In the disclosed embodiment, a plurality of EDIDs may be stored in the EDID storage unit (875) during the manufacture of the display device (900). For example, the plurality of EDIDs stored during the manufacture may include an original EDID containing display characteristic information that enables optimal performance of the display device (900), and one or more modified EDIDs containing display characteristic information modified for EDID compatibility. In this way, when a plurality of EDIDs are stored in the EDID storage unit (875), the processor (810) can simply select the appropriate EDID and record it in the EDID memory (880) without needing to change the EDID during the operation of the display device (900), thereby reducing the burden on the processor (810).

[0162] The user interface (870) can receive user input for controlling the display device (900). The user interface (870) may include, but is not limited to, user input devices including, a touch panel that detects a user's touch, a button that receives a user's push operation, a wheel that receives a user's rotation operation, a keyboard, and a dome switch.

[0163] Additionally, the user interface (870) may include a voice recognition device (not shown) for voice recognition. For example, the voice recognition device may be a microphone, and the voice recognition device may receive a voice command or voice request from the user. Accordingly, the processor (240) may control the execution of an action corresponding to the voice command or voice request. Here, the voice command or voice request may be referred to as a 'voice user input'.

[0164] Additionally, the user interface (870) may include a motion detection sensor (not shown). For example, the motion detection sensor (not shown) may detect the movement of the display device (900) and receive the detected movement as user input. Furthermore, the aforementioned voice recognition device (not shown) and motion detection sensor (not shown) may not be included within the user interface (870), but may be included within the display device (900) as a module independent of the user interface (870).

[0165] Hereinafter, the operation of a display device (900) that receives a video signal from a source device (901) will be described in detail. For example, a processor (810) can process the video signal and audio signal transmitted from the source device (901) to display them on a display (820) and control them to be output through an audio output unit (850).

[0166] For example, the transmission unit (910) of the source device (901) and the communication interface (830) of the display device (900) (e.g., input thrust unit (832)) can be connected through one or more cables.

[0167] In FIG. 9, the case in which the transmission unit (910) and the communication interface (830) are connected via an HDMI cable (990) is illustrated and described as an example.

[0168] In the disclosed embodiment, the control unit (930) of the source device (901) can read an EDID from the display device (900) according to the connection between the source device (901) and the display device (900), control the image processing unit (920) to process an image based on the read EDID, and control the image processing signal to be transmitted to the display device (900) through the transmission unit (910).

[0169] Referring to FIG. 9, the HDMI cable (990) may include a TMDS (Transition Minimized Differential Signaling) line (991) for transmitting video and audio signals, a DDC line (992) for transmitting EDID data, a 5V power line (993) for providing a 5-volt voltage from a source device (901) to a display device (900), and an HPD (Hot Plug Detect) line (994) for controlling EDID reading.

[0170] When a source device (901) and a display device (900) are connected by an HDMI cable (990), the transmission unit (910) of the source device (901) can provide a 5-volt voltage to the input / output unit (832) of the display device (900) through a 5 V power line (993). The input / output unit (832) that receives the 5-volt voltage can transmit a signal having a high level voltage to the transmission unit (910) of the source device (901) through a Hot Plug Detect (HPD) line (994). The transmission unit (910) of the source device (901) that receives a signal having a high level voltage through the HPD line (994) sends an EDID request signal through the DDC line (992), and the input / output unit (832) that receives the EDID request signal can provide the EDID of the display device (900) to the transmission unit (910) of the source device (901) under the control of the processor (810).

[0171] The control unit (930) of the source device (901) that receives the EDID of the display device (900) can parse the EDID to obtain display characteristic information and control content processing based on the obtained display characteristic information. For example, the control unit (930) can control the generation of an image (e.g., a game image) corresponding to the obtained display characteristic information. Subsequently, the transmission unit (910) of the source device (901) can transmit the image-processed image signal and audio signal to the input / output unit (832) through the TMDS line (991).

[0172] Additionally, the source device (901) determines whether the voltage level of the HPD signal is a high level above a preset voltage level, and if it is a high level, it can read EDID data from the display device (900) according to the I2C (Inter-IC bus) protocol. Accordingly, the display device (900) can control the source device (901) from reading its EDID by controlling the HPD line. Specifically, when an EDID change operation is required, the display device (900) prevents the source device (901) from reading the EDID signal by keeping the HPD line (994) at a low level while the display device (900) is changing the EDID, and when the EDID change is completed, the display device (900) can control the source device (901) to read the changed EDID by making the HPD line a high level.

[0173] For example, the display device (900) may perform an EDID change operation if at least one of the resolution and aspect ratio of the image received from the source device (901) does not match its EDID. In this case, while performing the EDID change operation, the HPD line (994) is kept at a low level to prevent the source device (901) from reading the EDID signal, and when the EDID change is completed, the display device (900) may control the source device (901) to read the changed EDID by making the HPD line (994) at a high level.

[0174] As described above, the display device (900) provides its EDID to the source device (901) so that a video signal including an image corresponding to the set EDID is received. Additionally, the display device (900) may perform an EDID change operation in response to changes in the aspect ratio and / or resolution of an image corresponding to content provided by the source device (901). As described in FIGS. 5 and 7, when the aspect ratio of a game image corresponding to game content changes, an EDID change operation may be performed as described above.

[0175] For example, if the content played by the display device (900) is a game (e.g., a 3D game), the 3D game may use a 360-degree image or a panoramic image to represent a 360-degree space. Specifically, an image corresponding to a portion of the user's field of view in the 360-degree image (210) is provided to the user, and the user can enjoy the 3D game while viewing the provided image. For example, the control unit (930) of the source device (901) may acquire the EDID of the display device (900) and control the image processing unit (920) to generate an image to be transmitted to the display device (900) based on aspect ratio information (e.g., aspect ratio information having a value of 32:9) included in the acquired EDID. Accordingly, the image processing unit (920) can render an area corresponding to the game user's field of view (e.g., FoV) of the 360-degree image (210) in a 32:9 aspect ratio. Accordingly, the source device (901) can acquire an image (320) having a 32:9 aspect ratio. And, the control unit (930) can control the transmission unit (910) so that an image signal including the acquired image (320) is transmitted to the input / output unit (832) of the display device (900).

[0176] FIG. 10 is a drawing for explaining operations performed in a display device according to a disclosed embodiment. In FIG. 10, configurations identical to those in FIG. 4 through 9 are illustrated using the same drawing symbols. Therefore, in describing the operations illustrated in FIG. 10, descriptions that overlap with those in FIG. 1 through 9 are omitted. Additionally, in describing FIG. 10, the detailed configurations of the display device (900) and the source device (901) are described with reference to the configurations illustrated in FIG. 9.

[0177] In addition, FIG. 10 illustrates and explains the case where the aspect ratio of the entire screen of the display device (900) (specifically, the aspect ratio of the display itself included within the display device (900)) is 16:9.

[0178] The source device (901) can generate an image signal for a first image corresponding to a first aspect ratio (S1001) and transmit it to a display device (900) (S1010). For example, the first aspect ratio can be a value of 21:9. For example, the image signal generated in step S1001 can correspond to the game image (410) described in FIG. 4.

[0179] A display device (900) that receives a video signal transmitted in step S1010 (specifically, a video signal for a first image) can output a first full screen (450) including a first image to a display (820) based on the received video signal (S1020).

[0180] For example, the display device (900) may identify a first partial area (e.g., 401) for enlargement display within a first image (S1015) and generate an enlarged image (e.g., 470) corresponding to the identified first partial area. Then, the display device (900) may generate and display a full screen (450) including the enlarged image (470) and a game image (410) having an aspect ratio of 21:9.

[0181] After the first image is output to the display device (900), the aspect ratio of the game image to be output from the display device (900) may be changed to a second aspect ratio (S1021). For example, the second aspect ratio may correspond to an aspect ratio value of 32:9. For example, the change in aspect ratio may be made according to user settings, automatic changes based on screen optimization of the display device (900), etc. As described with reference to FIG. 9, the display device (900) may reset the EDID according to the change in aspect ratio and transmit the reset EDID to the source device (901) (S1022).

[0182] Accordingly, the source device (901) can generate an image signal for a second image having a second aspect ratio (e.g., 32:9) (S1025) and transmit it to a display device (900) (S1026). For example, the image signal generated in step S1035 may correspond to the game image (501) described in FIG. 5.

[0183] In the disclosed embodiment, when the display device (900) receives a second image (e.g., 501) corresponding to a second aspect ratio different from the first aspect ratio from the source device (901), it can identify a second partial region (e.g., 601) corresponding to a first partial region (e.g., 401) included within the first image (e.g., 410) based on the first aspect ratio and the second aspect ratio (S1040). Then, the display device (900) can generate and display a second full screen (650) including the second image (e.g., 501) and a second enlarged image (e.g., 670) corresponding to the identified second partial region (e.g., 601) (S1050).

[0184] A display device (900) according to the disclosed embodiment can, when the aspect ratio of an image output during the playback of content is changed, identify a partial area for enlargement display within the image with the changed aspect ratio based on a first aspect ratio and a second aspect ratio (for example, a partial area corresponding to a partial area set for enlargement display within the image prior to the change in aspect ratio) and generate an enlarged image based on the identified partial area. Accordingly, display errors for the enlarged image as described in FIGS. 5 and FIGS. 7 can be prevented.

[0185] For example, the display device (900) according to the disclosed embodiment can flexibly change the enlarged display of the partial area in response to the aforementioned change in aspect ratio when the aspect ratio of the game image is changed after the game image, in which a partial area for enlarged display is set, is displayed. Accordingly, it is possible to prevent screen output that causes inconvenience to the user, such as an incorrect area being enlarged or the screen usage efficiency being reduced.

[0186] Accordingly, the display device (900) according to the disclosed embodiment can minimize inconvenience to the user receiving the content and can provide the user with a full screen that transitions smoothly in accordance with the change in aspect ratio.

[0187] FIG. 11a is a flowchart illustrating a method of operation of a display device according to a disclosed embodiment. Specifically, the method of operation of a display device (1100) illustrated in FIG. 1 may be a flowchart illustrating operations performed by a display device (100, 800, or 900) according to a disclosed embodiment described with reference to FIG. 1 to FIG. 10. Additionally, among the step configurations illustrated in FIG. 11a, configurations identical to those in FIG. 10 are illustrated using the same drawing symbols. Therefore, in describing the operations included in the method of operation of a display device (1100), descriptions that overlap with the operations performed by the display device (100, 800, or 900) described with reference to FIG. 1 to FIG. 10 are omitted.

[0188] In addition, the following description explains the case where the operation method (1100) of the display device is performed in the display device (900) described in FIG. 9.

[0189] Additionally, images received in the operation method (1100) of the display device are described with reference to FIG. 12. Among the configurations shown in FIG. 12, configurations identical to those in FIG. 4 to 6 are illustrated using the same drawing symbols.

[0190] Additionally, the entire screens output in the operation method (1100) of the display device are described with reference to FIG. 13. In FIG. 13, configurations identical to those in FIG. 4 to 6 among the illustrated configurations are illustrated using the same drawing symbols.

[0191] Referring to FIG. 11a, the operation method (1100) of the display device receives a first image corresponding to a first aspect ratio from a source device (901) (S1010). For example, the operation of step S1010 can be performed at a communication interface (830) under the control of a processor (810). For example, the first image can be received at an input / output unit (832) via an HDMI cable (990).

[0192] Specifically, the image processing unit (920) of the source device (901) generates a first image corresponding to a first aspect ratio, and the transmission unit (910) can transmit the first image (or an image signal for the first image) to the communication interface (830) of the display device (900) under the control of the control unit (930). Referring to FIG. 12, the first image received in step S1010 may be a game image (410) having a first aspect ratio (e.g., an aspect ratio of 21:9).

[0193] The method of operation (1100) of the display device generates and displays a first full screen including the first image and a first enlarged image corresponding to the first partial area, based on the identification of a first partial area for enlargement display within the first image (S1020). Here, the operation of step S1020 can be performed on the display (820) under the control of the processor (810). For example, the processor (810) can control the image processing unit (825) to generate an image corresponding to the first full screen and control the display (820) so that the generated image is output as a full screen.

[0194] Referring to FIG. 13, the first full screen output in step S1020 may be the full screen (450) described in FIG. 4. In the example illustrated in FIG. 13, the first partial area set for enlarged display within the first image may be a partial area corresponding to the aforementioned sub-window, and may be a minimap (401) and an item window (402) included within the game image (410). For example, the full screen (450) may include a game image (410) having a first aspect ratio (e.g., an aspect ratio of 21:9) and a first enlarged image (e.g., 470, 480). The identification of the first partial area will be described in detail below with reference to FIG. 17 to 19.

[0195] Continuing, the operation method (1100) of the display device receives a second image corresponding to a second aspect ratio different from the first aspect ratio from the source device (901) (S1030). For example, the operation of step S1030 can be performed at a communication interface (830) under the control of a processor (810). For example, the second image can be received at an input / output unit (832) via an HDMI cable (990).

[0196] Additionally, the second image may be output and transmitted from the source device (801) based on a user's request. Specifically, the display device (800) may control the source device (801) to transmit a second image having a second aspect ratio based on a user's request received while receiving a first image having a first aspect ratio from the source device.

[0197] For example, the processor (810) can control the reception of a second image having a second aspect ratio, which is a changed aspect ratio, from the source device (801) based on user input received while receiving a first image from the source device (801). For example, the processor (810) can control the communication interface (830) to receive a second image having a second aspect ratio, which is a changed aspect ratio, from the source device (801) based on user input received while receiving a first image from the source device (801).

[0198] For example, while the processor (810) is receiving a first image having a first aspect ratio from a source device, it may receive a user input requesting a change in aspect ratio (e.g., a user input requesting to change the first aspect ratio to a second aspect ratio) through the user interface (870). Then, the processor (810) may change or reset the EDID in response to the change in aspect ratio based on the user input. Since the EDID change operation has been described in detail with reference to FIG. 9, a detailed description is omitted. Subsequently, the processor (810) may transmit the changed EDID to the source device (801) to control the source device (801) to generate a second image having a second aspect ratio and transmit it to the display device (900).

[0199] Specifically, the image processing unit (920) of the source device (901) generates a second image corresponding to a second aspect ratio, and the transmission unit (910) can transmit the second image (or an image signal for the second image) to the communication interface (830) of the display device (900) under the control of the control unit (930). Referring to FIG. 12, the second image received in step S1030 may be a game image (501) having a second aspect ratio (e.g., an aspect ratio of 32:9).

[0200] When a second image is received in step S1030, the operation method (1100) of the display device identifies a second partial region corresponding to the first partial region within the second image based on the first aspect ratio and the second aspect ratio (S1040). For example, the operation of step S1040 can be performed by a processor (810).

[0201] Referring to the examples in FIGS. 12 and 13, as the aspect ratio of the displayed image is changed (S1021), a second image (e.g., a game image (501) having an aspect ratio of 32:9) may be received. Then, the processor (810) may identify a second partial region (601 or 522) corresponding to a first partial region (401 or 402) within the game image (501), which is the second image, based on the first aspect ratio and the second aspect ratio. Once the second partial region (601 or 522) is identified, an enlarged image (e.g., 670 or 680) corresponding to the second partial region (601 or 522) may be generated. Additionally, the processor (810) can control the image processing unit (825) and the display (820) so that a full screen (650) including the generated second enlarged image (e.g., 670 or 680) is generated and displayed.

[0202] For example, referring to the example of FIG. 13, the processor (810) can identify a second partial region (e.g., 601 or 522) containing an image object identical to the image object displayed in a first partial region (e.g., 401 or 402) included in the first image (e.g., game image (410)) based on a first aspect ratio and a second aspect ratio, and can acquire a second enlarged image (e.g., 670 or 680) corresponding to the identified second partial region (e.g., 601 or 522). Then, the processor (810) can control an image processing unit (825) and a display (820) so that a full screen (650) in which the acquired second enlarged image (e.g., 670 or 680) is placed in a black area is generated and displayed.

[0203] If the first aspect ratio value and the second aspect ratio value are known, it is possible to extract which part of the game image (410) having the first aspect ratio (e.g., a part where a minimap is displayed) corresponds to which part of the game image (501) having the second aspect ratio. For example, between the first image having the first aspect ratio (e.g., a game image (410) having a 21:9 aspect ratio) and the second image having the second aspect ratio (e.g., a game image (501) having a 32:9 aspect ratio), there may be a screen enlargement or reduction ratio determined in the left and right directions. Therefore, if the first aspect ratio and the second aspect ratio are known, it is possible to identify which part of the second image having the second aspect ratio corresponds to which part of the second image having the second aspect ratio. Accordingly, the processor (810) can identify a second partial region (601 or 522) corresponding to a first partial region (401 or 402) included in the first image game image (410) within the second image game image (501) based on the first aspect ratio and the second aspect ratio.

[0204] Alternatively, the processor (810) may identify a second partial region (601 or 522) corresponding to a first partial region (e.g., 401 or 402) in a different way. For example, the processor (810) may identify an image object displayed in the first partial region (e.g., 401 or 402) and identify an image object identical to the image object identified within the second image, which is a game image (501) (specifically, the image object displayed in the first partial region (e.g., 401 or 402)). For example, the processor (810) may identify the area within the second image, which is a game image (501), where an image object is displayed that has a similarity to the image object displayed in the first partial region (e.g., 401 or 402) greater than a threshold value as the second partial region (601 or 522). Here, the search for image objects with a similarity greater than a threshold value may be performed based on machine learning. For example, through machine learning, game images (410) and game images (501) can be compared, and partial regions where the same image object (e.g., minimap) is displayed in each of the two images can be extracted.

[0205] When a second partial area is identified in step S1040, the method of operation (1100) of the display device generates and displays a second full screen including the second image and a second enlarged image corresponding to the identified second partial area (S1050). For example, the processor (810) can control the image processing unit (825) to generate an image corresponding to the second full screen and control the display (820) so that the generated image is output as a full screen. Referring to FIG. 13, the second full screen output in step S1050 may be the full screen (650) described in FIG. 6.

[0206] Additionally, the processor (810) may consider whether the aspect ratio of the display (820) and the second aspect ratio are the same or different when generating and outputting the second full screen.

[0207] Referring to the example illustrated in FIG. 13, if the aspect ratio of the display (820) itself is different from the second aspect ratio, a black area may necessarily exist after displaying a second image (e.g., 501 in FIG. 13) having the second aspect ratio on the second full screen (e.g., 650 in FIG. 13). Therefore, if the aspect ratio of the display (820) itself is different from the second aspect ratio, an enlarged image (670, 680) can be displayed on the black area as illustrated in FIG. 13.

[0208] Alternatively, if the aspect ratio of the display (820) and the second aspect ratio are the same, when the second image is displayed on the second full screen (e.g., 650 in FIG. 13) with the maximum size, the second image is displayed filling the second full screen, and no black area exists. In this case, to display an enlarged image, the processor (810) can divide the second full screen into multiple screens and display the second image and the second enlarged image in each of the multiple divided areas.

[0209] For example, if the aspect ratio of the display (820) is equal to the second aspect ratio value of the second aspect ratio, the processor (810) can divide the entire screen of the display (820) into two partial screens, display the second image in one partial screen, and display the second enlarged image in the other partial screen.

[0210] FIG. 11b is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. In FIG. 11b, the same configuration as in FIG. 11a is illustrated using the same drawing symbols. Additionally, among the step configurations illustrated in FIG. 11b, the same configuration as in FIG. 10 is illustrated using the same drawing symbols.

[0211] Referring to FIG. 11b, the method of operation (1101) of a display device may further include step S1021 compared to the method of operation (1100) of a display device illustrated in FIG. 11a.

[0212] Referring to FIGS. 10 and 11b, the method of operation (1101) of a display device may further include a step (S1021) in which the aspect ratio of an image output from a display device (900) is changed after a first full screen (e.g., 450) is output in step S1020.

[0213] For example, aspect ratio changes can be performed based on user input. A display device (900) may receive user input requesting an aspect ratio change through a user interface (870). For example, when a processor (810) receives user input through the user interface (870) requesting that the aspect ratio of an image (e.g., a game image) corresponding to the content currently being played be changed from a first aspect ratio to a second aspect ratio, the processor (810) may perform an aspect ratio change operation in response to the reception of the user input. Specifically, the processor (810) may control the aspect ratio change by resetting the EDID according to the aspect ratio change as described with reference to FIG. 9, and by transmitting the reset EDID to the source device (901).

[0214] The change in aspect ratio based on user input is explained in more detail below with reference to FIG. 14.

[0215] FIG. 14 is a drawing showing an example of a user interface screen displayed on a display device according to a disclosed embodiment.

[0216] In the disclosed embodiment, the aspect ratio change can be achieved by changing the screen settings or by directly changing the aspect ratio value.

[0217] For example, when the processor (810) receives user input corresponding to a screen setting, it can control the output of a user interface screen (1400) for screen settings in response to the received user input.

[0218] For example, during a game, a user may want the game image to be displayed on a wider screen to enjoy a more vivid and immersive game. For example, if a user who wants to change the aspect ratio of the game image presses a screen setting key on a remote control device (not shown), the processor (810) can control the display of a user interface screen (1400) for settings in response to the received user input.

[0219] Then, the user can select the aspect ratio change section (1430) on the output user interface screen (1400) and change the desired aspect ratio (or aspect ratio) in the aspect ratio change section (1430). For example, if the user selects the '32:9' section in the aspect ratio change menu (1430), the processor (810) can change the aspect ratio of the game image to 32:9 based on the user input.

[0220] Additionally, the user interface screen (1400) may further include at least one of a menu (1420) for determining whether to fix or expand the screen display, a menu (1440) for setting a ratio for zooming in or out of the screen, a menu (1450) for adjusting the output position of an image, a menu (hereinafter referred to as the 'guide recommendation menu') (1460) for guiding or recommending the setting of a partial area for enlarged display, and a menu (hereinafter referred to as the 'auto tracing menu') (1470) for automatically tracking moving objects within the game image. The guide recommendation menu (1460) is described below with reference to FIGS. 17 through 21. Additionally, the auto tracing menu (1470) is described below with reference to FIG. 18.

[0221] FIG. 15 is a drawing showing an example of a full screen displayed in a display device according to a disclosed embodiment.

[0222] FIG. 16 is a drawing showing another example of a full screen displayed in a display device according to a disclosed embodiment.

[0223] FIGS. 15 and 16 illustrate an example in which the aspect ratio of the second image and the aspect ratio of the display (820) itself are different. The aspect ratio of the display (820) itself refers to the ratio of the horizontal length to the vertical length of the display panel forming the display (820), and may be referred to as the 'aspect ratio of the display (820).'

[0224] For example, if the aspect ratio of the display (820) is different from the second aspect ratio, the processor (810) can control the display so that the second enlarged image is displayed in at least a portion of the remaining area excluding the area where the second image is displayed on the entire screen of the display (820).

[0225] In FIG. 15, an example is illustrated in which the aspect ratio of the display (820) is 16:9 and the second aspect ratio is 21:9, and an example is illustrated in which the partial area for enlargement display is the area (1515) where the minimap is displayed.

[0226] Referring to the example illustrated in FIG. 15, the second full screen (1500) may be formed with an area (1510) where the second image, which is a game image (1511), is displayed, and a remaining area (1570) excluding the area where the second image (1511) is displayed. Here, the area (1570) where the game image (1511) is not displayed in the second full screen (1500) may be referred to as the "remaining area" for convenience of explanation. Additionally, FIG. 15 illustrates an example where the partial area set for enlarged display within the second image (1511) is the area (1515) displayed on the minimap.

[0227] If the aspect ratio of the display (820) is different from the second aspect ratio, which is the aspect ratio of the game image (1511) that is the second image, then, as illustrated in FIG. 15, the second full screen (1500) must include a remaining area (1570) where the game image (1511) is not displayed. For example, a second enlarged image (1575) corresponding to a second partial area (1515), which is the area (1515) displayed on the minimap, may be displayed within the remaining area (1570).

[0228] For example, the processor (810) can control the display of the second enlarged image (1575) in at least a portion of the remaining area (1570) excluding the area where the second image is displayed in the second full screen (1500).

[0229] In the disclosed embodiment, the processor (810) may control the display of a second full screen including the second partial area and the second image when the second partial area is identified. Additionally, in outputting the second full screen, the processor (810) may generate the second full screen to maximize screen utilization efficiency. Here, maximizing screen utilization efficiency may mean minimizing the display of meaningless images (e.g., black areas) within the full screen and maximizing the display of meaningful images. For example, 'meaningless images' may refer to areas that are not used to provide information or content to the user, such as black areas. Alternatively, 'meaningless images' may refer to areas that are not used to provide artistic aesthetics to the user.

[0230] In the disclosed embodiment, the processor (810) can adjust at least one of the size and position of the second enlarged image included in the second full screen based on the second aspect ratio and the full screen aspect ratio of the display (820) when displaying the second full screen according to step S1050.

[0231] For example, when displaying a second enlarged image (1575) within the remaining area (1570), the processor (810) may adjust the size of the second enlarged image (1575) so that the size of the second enlarged image (1575) becomes maximum. Accordingly, the second full screen (1500) may be displayed as shown in FIG. 15. Additionally, the position of the second enlarged image (1575) included within the remaining area (1570) may be determined based on at least one of the user's settings and the processor's (810) automatic settings.

[0232] For example, the position where the second enlarged image (1575) is displayed can be adjusted in a way that increases user satisfaction. For example, the processor (810) can control the second enlarged image (1575) to be displayed on the entire screen at a position where it is best seen by the user (e.g., the center of the screen or a position corresponding to the user's field of view).

[0233] In FIG. 16, an example is shown in which the aspect ratio of the display (820) is 16:9 and the second aspect ratio is 32:9, and an example is shown in which the partial area for enlargement display is the area (1615) where the minimap is displayed, just as in FIG. 15.

[0234] Referring to the example illustrated in FIG. 16, the second full screen (1600) may be formed with an area (1610) where a game image (1611), which is a second image, is displayed, and the remaining area (1670) excluding the area where the second image (1611) is displayed.

[0235] For example, when displaying the second enlarged image (1675) within the remaining area (1670), the processor (810) can adjust the size of the second enlarged image (1675) so that the size of the second enlarged image (1675) becomes maximum. Accordingly, the second full screen (1500) can be displayed as shown in FIG. 16.

[0236] FIG. 17 is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. Among the step configurations shown in FIG. 17, configurations identical to those in FIG. 10 are illustrated using the same drawing symbols. Additionally, in FIG. 17, configurations identical to those in FIG. 11a are illustrated using the same drawing symbols.

[0237] In addition, the following description explains the case where the operation method (1700) of the display device is performed in the display device (900) described in FIG. 9.

[0238] Referring to FIG. 17, the control method (1700) of the display device can identify a first partial area (e.g., 401) for enlarged display within the first image received in step S1010 (S1015). Step S1015 can be performed in a processor (810). The operation of S1015 is described in detail below with reference to FIG. 18.

[0239] Furthermore, the control method (1700) of the display device can generate and display a first full screen including the first image and a first enlarged image corresponding to the first partial area identified in step S1015 (S1017).

[0240] FIG. 18 is a drawing showing a game image. The first image (1800), which is a game image shown in FIG. 18, may correspond to the game image (1511) shown in FIG. 15, and the same configuration is illustrated using the same drawing symbols.

[0241] Referring to FIG. 18, a display device (900) may receive a first image (e.g., a game image) (1800). The first image (1800) is illustrated as an example of a game in which a battle is performed using at least one moving character. In the illustrated example, the first image (1800) may be a playback image of the game, and the playback image of the game may include at least one moving object (1524, 1525). Here, the at least one moving object (1524, 1525) may represent a character corresponding to the user performing the battle.

[0242] Additionally, the first image (1800) may include at least one of a mini map (1515), an item-related window (1523), a character-related window (1521), a chat window (1523), and a current status information window (not shown).

[0243] For example, the identification operation of the first partial region can be performed manually based on user input. For example, the processor (810) can identify the first partial region, which is a part of the area included within the first image, based on user input selecting a partial region included in the first image.

[0244] For example, when the processor (810) receives the first image, it can control the image processing unit (825) and the display (820) so that a screen containing the first image is output. Then, the user can view the first image and input user input to the user interface (870) to select a part area of ​​the first image. Then, the processor (810) can identify the area selected by the user as the first part area based on the user input. For example, the user can view the game image and input user input to the user interface (870) to select an area where a minimap is displayed within the game image. Then, the processor (810) can identify the area where the minimap is displayed as the first part area based on the user input.

[0245] For example, when the processor (810) receives the first image (1800), it may output a user interface screen for setting a first partial area within the first image (1800). The user interface screen includes the first image (1800) as the main screen and may include guidance messages such as "Please set the magnified display area." Then, the user may input user input through the user interface (870) to select an area to be magnified and viewed (e.g., an area where the minimap (1515) is displayed) in the first image (1800) displayed on the user interface screen.

[0246] As another example, the identification operation of the first partial area can be performed automatically by the processor (810).

[0247] For example, when the processor (810) receives the first image, it can identify the area in which at least one of a moving object, a mini map, an item-related window, a character-related window, a chat window, and a current status information window included in the first image is displayed as a first partial area. For example, the processor (810) may utilize an optical character recognition (OCR) method, an automatic content recognition (ACR) method, etc., to identify the first partial area. For example, the control unit (220) can identify the area in which at least one of a moving object, a mini map, an item-related window, a character-related window, a chat window, and a current status information window included in the first image is displayed by recognizing a game image corresponding to the content using an optical character reader (OCR) or automatic content recognition (ACR).

[0248] As another example, when the processor (810) receives the first image, the processor (810) can identify the first partial region using AI technology. For example, AI technology can be implemented by utilizing algorithms. Here, an algorithm or a set of algorithms for implementing AI technology is called a neural network. Here, the neural network can receive input data, analyze the input data, and output the desired result data. In this way, for the neural network to accurately output result data corresponding to the input data, it is necessary to train the neural network. Here, 'training' may mean inputting various data into the neural network and training the neural network so that it can discover or learn on its own methods of analyzing the input data, methods of classifying the input data, and / or methods of extracting features necessary for generating result data from the input data. Here, 'training' can be expressed in Korean as 'learning' or 'training'.

[0249] In addition, a set of algorithms that outputs output data corresponding to input data through the aforementioned neural network, software that executes the set of algorithms, and / or hardware that executes the set of algorithms may be referred to as an 'AI model' (or, 'artificial intelligence model').

[0250] AI models can exist in a wide variety of forms. Specifically, there may be various AI models that receive an image as input, analyze the input image, and perform the action of classifying the gestures of objects included in the image into at least one category.

[0251] The AI ​​model may include at least one neural network, and for convenience of explanation, FIG. 19, which will be described below, illustrates the case where the AI ​​model is formed with one neural network (1820).

[0252] Figure 19 is a diagram illustrating the identification operation of a partial region included within a game image.

[0253] For example, methods for performing object recognition, object tracking, and / or object differentiation using artificial intelligence (AI) technology that performs computations through neural networks are being developed and utilized. For the convenience of explanation, the operations of performing object recognition, object tracking, and object differentiation to recognize specific image objects by analyzing images will be collectively referred to as 'object recognition'.

[0254] For example, a neural network can be a Deep Neural Network (DNN) that includes multiple layers and performs multi-stage operations. Additionally, DNN operations may include Convolutional Neural Network (CNN) operations. Specifically, a data recognition model for object recognition can be implemented through the exemplified neural network, and the implemented recognition model can be trained using training data. Then, using the trained data recognition model, input data, such as a received image, can be analyzed to recognize objects within the input image and output the recognized objects as output data. Furthermore, the term Convolutional Neural Network (CNN) refers to any neural network that performs algorithms to analyze images and find patterns, and it can take on various types and forms.

[0255] Referring to the example illustrated in FIG. 19, the neural network (1820) may be a neural network trained to receive a first image (e.g., a game image) (1800) as input and to extract and output an image object displayed in a partial region (e.g., a first partial region) included within the image.

[0256] Referring to FIG. 19, the neural network (1320) may be a neural network trained to receive a first image (1800) through an input layer (1821), extract a first partial region (1850) included within the input image (1800), and output the extracted first partial region (1850) itself or information about the first partial region (1850) to an output terminal (1325).

[0257] For example, a neural network (1820) can be trained to receive multiple game images as input and to extract a first partial region, which is a partial region that requires enlargement display, within the multiple game images.

[0258] For example, the neural network (1820) receives additional information about the game and a game image as input, and can extract a first partial area (1850) that requires enlarged display in a predetermined game (e.g., an area where a mini-map is displayed) or an image object included in the first partial area (1850) (e.g., a mini-map, etc.). Here, the 'additional information' may include at least one of information about the content (e.g., game name, game attributes, etc.), information about an object that requires enlarged display in the content (e.g., game), and information about a sub-window included in an image about the content (e.g., a game image, etc.). Here, the additional information may be provided from the source device (901).

[0259] For example, a neural network can learn additional information for each of multiple games to obtain information regarding partial regions requiring enlarged display for each of the multiple games (e.g., the type of image object included in the partial region, information regarding the location where said image object is displayed, etc.). For example, the neural network can learn game images and additional information for each of the multiple games. Accordingly, when a predetermined game image is input, the trained neural network can identify which game the predetermined game image is (e.g., whether it is Game A, etc.) and identify or extract partial regions or image objects according to the identified type of game.

[0260] For example, the specific area to be magnified for the user may vary depending on the type of game. Based on additional game information, the neural network can extract and output the specific area or image object to be magnified and provided for each game.

[0261] For example, when Game A image is input to a trained neural network, the neural network can extract and output the areas within Game A image that require magnification, specifically the areas where the minimap and item window are displayed. Additionally, when Game B image is input to the trained neural network, the neural network can extract and output the areas within Game B image that require magnification, specifically the areas where the auto-tracing menu and minimap are displayed for magnifying moving objects. Furthermore, when Game B image is input to the trained neural network, the neural network can extract and output the areas within Game B image that require magnification, specifically the areas where the auto-tracing menu and minimap are displayed for magnifying moving objects.

[0262] For example, the aforementioned neural network (1820) may be implemented within a processor (810). In this case, the processor (810) inputs an image (e.g., a game image) into the neural network (1820), and the neural network (1820) analyzes the input image and can separate and extract at least one first partial region (specifically, a partial region corresponding to an enlarged display) (1850) and output it.

[0263] Additionally, the neural network (1820) may be implemented in an external server or external device distinct from the display device (900). In this case, the display device (900) may transmit an image (e.g., a game image) corresponding to the content to be played to the neural network (not shown) implemented in the external server or external device, and receive the result output from the neural network (not shown) (e.g., a first partial region, or information about the first partial region) through a communication interface (830). For example, if the aforementioned neural network is implemented in an external server connected via an internet network, the display device (900) may transmit the image (e.g., a game image) to the external server (not shown) through a communication unit (831). Then, the external server (not shown) may input the received image into the neural network and transmit the result output from the neural network to the communication unit (831) of the display device (900).

[0264] Through the methods described with reference to FIGS. 18 and 19, the display device (900) can identify a first partial area (e.g., 401) for enlargement display within the first image (S1015), and the display device (900) can generate an enlarged image corresponding to the identified first partial area.

[0265] FIG. 20 is a drawing showing an example of a full screen output in a disclosed embodiment. In FIG. 20, the same configuration as in FIG. 15 and FIG. 18 is illustrated using the same drawing symbols. For example, the full screen (2000) illustrated in FIG. 20 may be a full screen output from a display device (e.g., 900) according to the disclosed embodiment. Additionally, the full screen (2000) may be a screen output in step S1017 of the method of operation (1700) of the display device illustrated in FIG. 17.

[0266] Referring again to FIG. 17 and FIG. 20, the method of operation (1700) of the display device may, when a first partial area is identified in step S1015, generate and display a first full screen including a first image (1800) and a first enlarged image corresponding to the first partial area identified in step S1015 (S1017). For example, the first full screen (2000) may include at least one first enlarged image corresponding to each of at least one first partial area. FIG. 20 illustrates an example in which the first full screen (2000) includes three enlarged images (2010, 2020, 2030) corresponding to three first partial areas (e.g., 1521, 1524, 1515).

[0267] For example, in step S1015, the processor (810) can identify at least one partial region included in the first image (1800). For example, the processor (810) can identify a character-related window (1521), a moving object (1524), and a mini-map (1515) as a first partial region corresponding to an enlarged display within the first image (1800).

[0268] Continuing, the processor (810) may generate at least one first enlarged image corresponding to at least one identified first partial area. For example, the processor (810) may control the image processing unit (825) to generate at least one first enlarged image corresponding to at least one identified first partial area. Then, based on the generated at least one first enlarged image, a first full screen (2000) including the first image and at least one first enlarged image may be generated and displayed (S1017). The generation of the enlarged image is described in detail below with reference to FIG. 25.

[0269] FIG. 21 is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. Among the step configurations shown in FIG. 21, configurations identical to those previously described in FIG. 10 to FIG. 17 are illustrated using the same drawing symbols.

[0270] In addition, the following description explains the case where the operation method (2100) of the display device is performed in the display device (900) described in FIG. 9.

[0271] In the disclosed embodiment, the identification operation of the first partial region in step S1015 may be performed based on user input. For example, step S1015 may include a step of displaying a user interface screen displaying a guide region (S2115) and a step of identifying the first partial region based on user input (S2117).

[0272] Referring to FIG. 21, following step S1010, the method of operation (2100) of the display device may display a user interface screen that displays at least one guide area on the first image received in step S1010 (S2115). For example, the processor (810) may control the image processing unit (825) and the display (820) so that the user interface screen is output.

[0273] Additionally, step S2115 may be performed automatically following step S1010. Alternatively, S2115 may be performed based on user input requesting the display of a user interface screen displaying a guide area when the first image is received in step S1010. That is, if a user of the display device (900) wishes to manually set a first area for enlarged display within the first image, the user may input a request or user input to cause step S2115 to be performed by the display device.

[0274] Here, the guide area may be an area formed by guide lines indicating a partial area included in the first image so as to allow the selection of an area requiring enlargement display (e.g., a first partial area). The user interface screen output in step S2115 is described below with reference to FIGS. 22 and 23.

[0275] Specifically, the user can view the user interface screen output in step S2115 and input user input to the display device (900) for selecting at least one of the at least one guide area displayed on the user interface screen. Accordingly, the display device (900) can receive user input for selecting a guide area through the user interface (870). Based on the reception of the user input, the processor (810) can identify a first partial area corresponding to the selected guide area.

[0276] Figure 22 is another diagram illustrating the identification operation of a partial region included within a game image.

[0277] Figure 23 is another diagram illustrating the identification operation of a partial region included within a game image.

[0278] In FIGS. 22 and 23, configurations identical to those shown in FIGS. 15 and 18 are illustrated using the same drawing symbols.

[0279] The method of operation (2100) of the display device can identify a first partial area based on user input selecting a guide area received through the user interface (870) (S2117). For example, step S2117 can be performed under the control of the processor (810).

[0280] Referring to FIGS. 22 and 23, examples of user interface screens displayed in a display device (100, 800, or 900) according to the disclosed embodiment are illustrated. Additionally, FIGS. 22 and FIGS. 23 each represent examples of user interface screens output in step S2115 described in FIG. 21.

[0281] In the following, the case in which the user interface screens illustrated in FIGS. 22 and FIGS. 23 are output from the display device (900) described in FIG. 9 is explained as an example.

[0282] Referring to FIG. 22, the user interface screen (2200) output in step S2115 may be a screen output by displaying at least one guide area for selecting a predetermined area on the first image (1800).

[0283] Referring to the example illustrated in FIG. 22, at least one guide area displayed on the first image (1800) can be distinguished and demarcated by a plurality of guide lines (2210, 2220, 2230, 2240). For example, when a user selects a specific point on the user interface screen (2200) using a tool such as a cursor (2201), the area (2205) corresponding to the point where the cursor (2201) is located can be selected as the guide area. Here, the guide area (2205) can be an area demarcated by the guide line (2220) and the guide line (2240).

[0284] In the above example, the processor (810) can identify the area where a minimap, which is an image object corresponding to a guide area selected based on user input, is displayed as a first partial area. For example, the processor (810) can identify the area where a minimap, which is an image object displayed within a guide area (2205) corresponding to a point selected by the user using a cursor (2201), is displayed as a first partial area. When the area where the minimap is displayed is identified as a first partial area, the processor (810) can control the display of a full screen (not shown) including an enlarged image of the minimap and a first image (1800).

[0285] As another example, when a user selects a point within a guide area (1523), which is an area demarcated by guide lines (2220), guide lines (2230), and guide lines (2240) using a cursor (2201), the processor (810) can identify, based on user input, an area where an item-related window (1523), which is an image object displayed within the selected guide area (1523), is displayed as a first partial area. When the area where the item-related window (1523) is displayed is identified as the first partial area, the processor (810) can control the display of a full screen (not shown) including an enlarged image of the item-related window (1523) and a first image (1800).

[0286] As illustrated in FIG. 22, an example is shown in which multiple guide areas are partitioned and displayed by four guide lines (2210, 2220, 2230, 2240), but the guide areas can be displayed on the first image (1800) in various ways and forms, with various positions and sizes. Additionally, multiple guide areas can be selected based on user input, and multiple first partial areas corresponding to each of the selected guide areas can be identified. Then, the processor (810) can control the display of a full screen (not shown) including multiple enlarged images corresponding to each of the identified multiple partial areas and the first image (1800).

[0287] Figure 23 is another diagram illustrating the identification operation of a partial region included within a game image.

[0288] In the example illustrated in FIG. 23, the user interface screen (2301) may be a screen that displays at least one guide area (2311, 2312, 2313, 2314, 2315, 2316) on the first image (1800).

[0289] For example, the processor (810) can display a user interface screen (2301) that displays at least one guide area on the first image (1800) and identify a first partial area based on user input selecting at least one of the at least one guide area.

[0290] For example, the processor (810) can extract at least one guide region (2311, 2312, 2313, 2314, 2315, 2316) included within the first image (1800) by using the partial region identification or image object recognition method described with reference to FIG. 19. Then, the display device (900) can display a user interface screen (2301) that displays the extracted at least one guide region (2311, 2312, 2313, 2314, 2315, 2316) on the first image (1800). Then, the user can select at least one of the at least one guide region (2311, 2312, 2313, 2314, 2315, 2316) displayed on the first image (1800). The processor (810) can identify a selected guide area as a first partial area based on user input.

[0291] For example, when a user selects a guide area (2315) using a cursor (2305), the processor (8100) can identify the guide area (2315) as a first partial area based on user input and control the image processing unit (825) to generate an enlarged image that enlarges the identified first partial area.

[0292] FIG. 24 is a drawing showing an example of a full screen including a game image and an enlarged image. In FIG. 24, the same configuration as that shown in FIG. 15 and FIG. 18 is illustrated using the same drawing symbols.

[0293] Referring to FIG. 24, an example of a full screen displayed on a display device (100, 800, or 900) according to a disclosed embodiment is shown. An example is given in which the full screen (2400) shown in FIG. 24 is output from the display device (900) described in FIG. 9.

[0294] Referring to FIG. 24, the entire screen (2400) may be the screen output in step S1017 illustrated in FIG. 10 to 21. FIG. 24 illustrates an example where the first partial area identified in step S2117 is the area where the minimap (1515) is displayed.

[0295] In the disclosed embodiment, the processor (810) can adjust at least one of the size and position of a first enlarged image included in the first full screen based on the first aspect ratio and the full screen aspect ratio of the display (820) when displaying the first full screen according to step S1017.

[0296] For example, the full screen (2400) may be a screen including a first enlarged image (2410) and a first image (1800) corresponding to a first partial area (an area where the minimap (1515) is displayed) identified in step S2117. For example, the processor (810) may generate a first full screen to maximize screen utilization efficiency. Here, maximizing screen utilization efficiency may mean minimizing the display of meaningless images (e.g., black areas) within the full screen and maximizing the display of meaningful images.

[0297] FIG. 25 is another flowchart illustrating a method of operation of a display device according to a disclosed embodiment. Among the step configurations shown in FIG. 25, configurations identical to those previously described in FIG. 10 to FIG. 21 are illustrated using the same drawing symbols.

[0298] In addition, the following description explains the case where the operation method (2500) of the display device is performed in the display device (900) described in FIG. 9.

[0299] Referring to FIG. 25, the method of operation (2500) of the display device may further include the step (S1016) of acquiring a first enlarged image corresponding to a first partial area, following step S1015. The acquisition of the first enlarged image may be performed by the following methods.

[0300] For example, step S1016 may request the source device (901) to transmit image data corresponding to the first partial area identified in step S1015, and the source device (901) may transmit the image data corresponding to the first partial area to the display device (900) in response to the request. Here, the image data transmitted from the source device (901) may be the original image data for the first partial area. Then, the image processing unit (825) may generate a first enlarged image based on the received image data.

[0301] As another example, step S1016 can cut out a first partial region identified in step S1015 from a first image received in step S1010, and enlarge the cut-out first partial region to generate an enlarged image. That is, the image processing unit (825) can cut out a first partial region identified in a first image received in step S1010 to generate an enlarged image.

[0302] Additionally, the second enlarged image corresponding to the second partial region identified in step S1040 can be obtained in the same manner as the method for obtaining the first enlarged image described above. For example, the display device (900) may request the source device (901) to transmit image data corresponding to the identified second partial region, and the source device (901) may transmit image data corresponding to the second partial region to the display device (900) in response to the request. Here, the image data transmitted from the source device (901) may be the original image data for the second partial region. Then, the image processing unit (825) may generate the second enlarged image based on the received image data. As another example, the display device (900) may cut out the second partial region identified in step S1040 from the second image received in step S1030 and enlarge the cut-out second partial region to generate an enlarged image. That is, the image processing unit (825) may cut out the second partial region identified in step S1030 to generate an enlarged image.

[0303] A method of operation of a display device according to a disclosed embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. Additionally, the disclosed embodiment may be a computer-readable recording medium on which one or more programs comprising instructions for executing a method of operation of a display device are recorded.

[0304] The above-mentioned computer-readable medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0305] Here, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, a 'non-transitory storage medium' may include a buffer in which data is stored temporarily.

[0306] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

Claims

Claim 1 A display device comprising: a display; a communication interface communicating with a source device; and a processor for executing at least one instruction, wherein the processor executes the at least one instruction to receive a first image corresponding to a first aspect ratio from the source device, wherein the first aspect ratio is different from the physical aspect ratio of the display and, based on identifying a first partial area for enlargement display within the first image, generates and displays a first full screen including the first image and a first enlarged image corresponding to the first partial area, wherein the first enlarged image is displayed in at least a portion of the remaining area other than the area where the first image is displayed, and when a second image corresponding to a second aspect ratio different from the first aspect ratio is received from the source device, identifies a second partial area corresponding to the first partial area within the second image based on the second aspect ratio, and generates and displays a second full screen including the second image and a second enlarged image corresponding to the identified second partial area. Claim 2 A display device according to claim 1, wherein the processor identifies, based on the first aspect ratio and the second aspect ratio, the second partial region within the second image that includes an image object identical to the image object displayed in the first partial region included in the first image, and acquires the second enlarged image corresponding to the identified second partial region. Claim 3 A display device according to claim 1, wherein the processor controls the communication interface to receive the second image having the second aspect ratio from the source device based on user input received while receiving the first image from the source device. Claim 4 A display device according to claim 1, wherein the processor identifies as the first partial area an area in which at least one of a moving object included in the first image, a mini map, an item-related window, a character-related window, a chat window, and a current status information window is displayed, and acquires a first enlarged image corresponding to the first partial area. Claim 5 A display device according to claim 1, wherein the processor identifies the first partial region based on user input selecting a partial region included in the first image. Claim 6 A display device according to claim 1, further comprising a user interface for receiving user input, wherein the processor displays a user interface screen displaying at least one guide area on the first image and identifies the first partial area based on user input selecting at least one of the at least one guide area. Claim 7 A display device according to claim 1, wherein the processor recognizes at least one image object corresponding to at least one of a mini map included in the first image, at least one moving object, an item-related window, a character-related window, a chat window, and a current status information window, displays a user interface screen for selecting the recognized at least one image object, and identifies the first partial area based on user input selecting at least one of the at least one image object. Claim 8 A display device according to claim 1, wherein if the aspect ratio of the display is the same as the second aspect ratio, the processor divides the entire screen of the display into two partial screens, displays the second image in one of the partial screens, and displays the second enlarged image in the other of the partial screens. Claim 9 A display device according to claim 1, wherein the processor displays the second enlarged image in at least a portion of the remaining area excluding the area where the second image is displayed on the entire screen of the display, if the aspect ratio of the display is different from the second aspect ratio. Claim 10 A display device according to claim 9, wherein the processor adjusts the size of the second enlarged image so that the screen utilization efficiency of the remaining area is maximized, and displays the resized second enlarged image on the remaining area. Claim 11 A display device according to claim 1, wherein the processor adjusts at least one of the size and position of the second enlarged image included in the second full screen based on the second aspect ratio and the overall screen aspect ratio of the display. Claim 12 A display device according to claim 1, wherein the first image includes an image corresponding to game content corresponding to the first aspect ratio, and the second image includes an image corresponding to game content corresponding to the second aspect ratio. Claim 13 A display device according to claim 1, wherein the processor identifies an area in which a mini-map included in the first image corresponding to a playback image of game content is displayed as the first partial area, generates a first enlarged image corresponding to the first partial area, and generates and displays the first full screen including the first enlarged image and the first image. Claim 14 A method of operating a display device, comprising: receiving a first image corresponding to a first aspect ratio from a source device, wherein the first aspect ratio is different from the physical aspect ratio of the display of the display device; generating and displaying a first full screen including the first image and a first enlarged image corresponding to the first part area, based on identifying a first part area for enlargement display within the first image, wherein the first enlarged image is displayed in at least a portion of the remaining area other than the area where the first image is displayed; receiving a second image corresponding to a second aspect ratio different from the first aspect ratio from the source device; identifying a second part area corresponding to the first part area within the second image based on the second aspect ratio; and generating and displaying a second full screen including the second image and a second enlarged image corresponding to the identified second part area. Claim 15 A method of operation of a display device according to claim 14, wherein the step of identifying the second partial region comprises: identifying the second partial region containing an image object identical to the image object displayed in the first partial region included in the first image, based on the first aspect ratio and the second aspect ratio; and obtaining the second enlarged image corresponding to the identified second partial region. Claim 16 A method of operation of a display device according to claim 14, wherein the step of generating and displaying the first full screen comprises: identifying as the first partial area an area in which at least one of a moving object, a mini map, an item-related window, a character-related window, a chat window, and a current status information window included in the first image is displayed; and obtaining a first enlarged image corresponding to the first partial area. Claim 17 A method of operation of a display device according to claim 14, further comprising: a step of displaying a user interface screen having at least one guide area displayed on the first image; and a step of identifying the first partial area based on a user input selecting at least one of the at least one guide area. Claim 18 A method of operation of a display device according to claim 14, further comprising: a step of recognizing at least one image object corresponding to at least one of a mini map, at least one moving object, an item-related window, a character-related window, a chat window, and a current status information window included in the first image; a step of displaying a user interface screen for selecting the recognized at least one image object; and a step of identifying the first partial region based on user input selecting at least one of the at least one image object. Claim 19 In claim 14, the step of generating and displaying the second full screen includes, if the aspect ratio of the display included in the display device is different from the second aspect ratio, the step of displaying the second enlarged image in at least a portion of the remaining area excluding the area where the second image is displayed in the full screen of the display. Claim 20 A method of operation of a display device according to claim 14, wherein the step of generating and displaying the second full screen further comprises the step of adjusting at least one of the size and position of the second enlarged image included in the second full screen based on the second aspect ratio and the full screen aspect ratio of the display.

Images