Display, and method for controlling same

Abstract

A display and a method for controlling same are disclosed. A display according to an embodiment of the present invention may comprise: a memory for storing a digital medium; and a processor for changing a setting to an image quality optimized for a document if a ratio of text occupied in the digital medium displayed on a screen for a set time exceeds a set ratio.

Description

Display and its control method

[0001] The disclosed invention relates to a display and a method of controlling the same.

[0002] Users can watch movies, play games, and work on documents through displays such as TVs or computers.

[0003] The display may be set to a resolution optimized for media content, such as games or movies. In this case, if the user stops watching the movie and starts working on an electronic document, the resolution will be optimized for media content, which may reduce the readability of the text within the document.

[0004] For example, in the case of media content, the image quality can be set to enhance the edges of objects (e.g., characters, objects, etc.) to increase the clarity of the image.

[0005] When a user reads a news article or works with an electronic document that is mostly text in this quality setting, a white border-like "shoot" may appear on the text within the document, which may increase eye fatigue and reduce work efficiency.

[0006] The disclosed invention provides a display and a control method thereof that can automatically change the picture quality settings according to the content to provide the user with optimal picture quality.

[0007] A display according to one aspect of the disclosed invention may include a memory for storing digital media; and a processor for changing the settings to an image quality optimized for the document when the ratio of text occupied by the digital media displayed on the screen for a set period of time exceeds a set ratio.

[0008] The digital medium includes an image, and the processor can recognize text in a plurality of consecutive image frames of the image for the set time, and if the ratio of the text in each of the image frames exceeds the set ratio, set the image quality to be optimized for the document.

[0009] The above processor can recognize text in the image frame using OCR (Optical Character Recognition).

[0010] The processor can calculate the proportion of the text in the image frame by comparing the total number of pixels in the image frame with the number of pixels in the area where the text is recognized in the image frame.

[0011] The processor can calculate a ratio of the text in the image frame by comparing the size of the entire area of ​​the image frame with the size of the area in which the text is recognized in the image frame.

[0012] The above processor can set edge emphasis to a minimum value when setting the image quality optimized for the above document.

[0013] The above processor may disable overdrive when setting the image quality optimized for the above document.

[0014] The above processor can reduce the difference between dark and bright parts by lowering the contrast when setting the image quality optimized for the above document.

[0015] The digital medium includes an electronic document, and the processor can recognize text within the electronic document being input through a user interface, and if the ratio of the text within the electronic document exceeds a set ratio for a set period of time, set the image quality to be optimized for the document.

[0016] The digital medium includes an image, and the processor can recognize text in a plurality of consecutive image frames of the image for the set time, determine a category to which the digital medium belongs based on the recognized text, and change the setting to an image quality suitable for the category to which the digital medium belongs.

[0017] A display control method according to another aspect of the disclosed invention may include recognizing text in a plurality of consecutive image frames of an image for a set period of time, calculating a ratio of the text in each of the image frames, and changing the setting to an image quality optimized for the document when the ratio of the text exceeds the set ratio.

[0018] Recognizing the above text may include recognizing the text in the image frame using Optical Character Recognition (OCR).

[0019] Calculating the ratio of the text may include calculating the ratio of the text to the image frame by comparing the total number of pixels of the image frame and the number of pixels of an area in which the text is recognized in the image frame.

[0020] Calculating the ratio of the text may include calculating the ratio of the text to the image frame by comparing the size of the entire area of ​​the image frame and the size of the area in which the text is recognized in the image frame.

[0021] Changing the settings to optimize the image quality for the above document may include setting edge enhancement to a minimum.

[0022] Changing the settings to optimize the image quality for the above document may include disabling overdrive.

[0023] Changing the settings to optimize the image quality in the above document may include lowering the contrast to reduce the difference between dark and light areas.

[0024] The disclosed display and its control method can automatically change the picture quality settings according to the content to provide the user with optimal picture quality.

[0025] Additionally, if the text ratio on the digital media exceeds the set ratio during the set period of time, the image quality can be automatically set to the optimal image quality for the document, thereby improving user convenience.

[0026] The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

[0027] Figure 1 is a block diagram showing the configuration of a display according to one embodiment.

[0028] Figure 2 illustrates a method for calculating the ratio of text occupied in an image frame of a video according to one embodiment.

[0029] FIG. 3 illustrates an electronic document according to another embodiment in which the proportion of text exceeds a set proportion.

[0030] Figure 4 is a flowchart illustrating a method for controlling a display according to one embodiment.

[0031] Fig. 5 is a flowchart showing a method for controlling a display according to another embodiment.

[0032] It should be understood that the various embodiments and terms used in this document are not intended to limit the technical features described in this document to specific embodiments, but rather to include various modifications, equivalents, or substitutes of the embodiments.

[0033] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.

[0034] The singular form of a noun corresponding to an item may include one or more of said items, unless the relevant context clearly indicates otherwise.

[0035] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof.

[0036] The term "and / or" includes any combination of a plurality of related described elements or any one of a plurality of related described elements.

[0037] The terms "part," "module," and "member" may be implemented in hardware or software. Depending on the embodiments, multiple "parts," "modules," or "members" may be implemented as a single component, or a single "part," "module," or "member" may include multiple components.

[0038] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).

[0039] When a component (e.g., a first component) is referred to as being "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0040] The terms "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0041] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0042] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0043] Below, displays according to various embodiments are specifically described with reference to the attached drawings.

[0044] Figure 1 is a block diagram showing the configuration of a display according to one embodiment.

[0045] Digital media may include various electronic documents that receive text input through a user interface including various images and keyboards input from external means.

[0046] Videos may include media content that primarily combines visual and auditory elements, such as games, movies, TV programs, YouTube videos, advertisements, and online lectures, as well as text content that primarily consists of text, such as electronic newspapers.

[0047] For example, a user can use digital media in various ways, such as opening a web page in a web browser, watching a video in a video streaming app, or reading an e-book through the display (100).

[0048] Additionally, users can open electronic documents in document editing applications and perform document operations, such as entering text through a user interface such as a keyboard.

[0049] Users can watch movies or play games, etc., with the picture quality of the display (100) set to be optimized for media content.

[0050] In the past, when a user viewed text content such as a news article or worked on an electronic document with the image quality set to be optimized for media content, a white border-shaped shoot may appear on the text within the document, which may increase eye fatigue and reduce work efficiency.

[0051] The display (100) according to an embodiment of the present invention can automatically change the settings to a picture quality optimized for the document when the screen is mostly occupied by text, such as when viewing text content or working on an electronic document after using media content.

[0052] Additionally, the display (100) can automatically change the settings to a picture quality optimized for media content when using media content after viewing text content or working on an electronic document.

[0053] Referring to FIG. 1, the display (100) includes a processor (110), memory (120), and a panel (130).

[0054] The processor (110) can control the overall operation and function of the display (100), and the functions of the display (100) can be processed by one processor (110) or performed by a combination of multiple processors (110).

[0055] The processor (110) may include logic circuits and arithmetic circuits as hardware. The processor (110) may control electrically connected components of the display (100) using programs, instructions, and data stored in the memory (120) for the operation of the display (100). The processor (110) and the memory (120) may be implemented as separate chips or as a single chip.

[0056] Here, the memory (120) can store digital media, and in addition, can store programs, applications, and data for the operation of the display (100), and can store data generated by the processor (110). The memory (120) can include non-volatile memory such as ROM (Read Only Memory) and flash memory for long-term storage of data. The memory (120) can include volatile memory such as S-RAM (Static Random Access Memory) and D-RAM (Dynamic Random Access Memory) for temporarily storing data.

[0057] The processor (110) displays digital media on the panel (130) screen, and when the ratio of text occupied by the digital media exceeds the set ratio for a set period of time, the processor can change the setting to an image quality optimized for the document.

[0058] Here, the panel (130) may include, for example, TN (Twisted Nematic), IPS (In-Plane Switching), VA (Vertical Alignment), OLED (Organic Light-Emitting Diode), MicroLED, QLED (Quantum Dot LED), etc. The panel (130) may include a driving circuit, a backlight unit, etc., which may be implemented in a form such as a-si TFT, LTPS (low temperature poly silicon) TFT, OTFT (organic TFT), etc.

[0059] When the digital medium is an image, the processor (110) recognizes text in a plurality of consecutive image frames of the image for a set period of time, and when the ratio of text in each image frame exceeds the set ratio, the processor determines the image as text content and changes the settings to an image quality optimized for the document.

[0060] If the ratio of text occupied by at least one of the consecutive image frames of the video during the set period of time does not exceed the set ratio, the current image quality setting suitable for the media content may be maintained as is.

[0061] If the digital medium is an electronic document, the processor (110) can recognize text within the electronic document being input through the user interface, and if the ratio of text within the electronic document remains above the set ratio for a set period of time, the processor can change the settings to an image quality optimized for the document.

[0062] This processor (110) may include a recognition unit (112), a ratio calculation unit (114), and a setting unit (116).

[0063] The recognition unit (112) recognizes text in a digital medium. For example, if the digital medium is an image, the recognition unit (112) can recognize text in a plurality of consecutive image frames of the image over a set period of time.

[0064] If the digital medium is an electronic document, the recognition unit (112) can recognize text within the electronic document when text is entered into the electronic document through a user interface including a keyboard, etc.

[0065] The recognition unit (112) can recognize text in digital media, for example, using OCR (Optical Character Recognition).

[0066] OCR technology can detect and recognize text by combining machine learning-based text feature extraction techniques and models.

[0067] Various methods, including well-known computer vision and artificial intelligence technologies, can be utilized to recognize text in digital media. Computer vision is used to help computer systems interpret and understand visual information, and is primarily used to detect and analyze patterns, objects, and text in digital images or videos.

[0068] Deep learning-based methods can be used for text detection. For example, Faster R-CNN (Region-based Convolutional Neural Network), a deep learning model for object detection, can be used to identify text regions. EAST (Efficient and Accurate Scene Text Detector) is a text detection model that predicts the horizontal and vertical bounding boxes of text regions. CTPN (Connectionist Text Proposal Network) is a model that identifies text regions by predicting text as connected lines.

[0069] In text recognition, a Convolutional Neural Network (CNN) can be used to extract features from text regions. A Recurrent Neural Network (RNN), a Long Short-Term Memory (LSTM), and a Gated Recurrent Unit (GRU) can convert the features extracted by a CNN into sequences and recognize characters. Connectionist Temporal Classification (CTC) can be used in conjunction with an RNN to process and recognize text of variable length.

[0070] The text detection and recognition process may include, for example, preprocessing a video image, identifying text regions using a text detection model, extracting features from the text regions using a CNN, and converting the extracted features into character sequences using an RNN or transformer. At this time, the importance of each character may be considered through an attention mechanism. In addition to the above, various known text detection and recognition technologies can be applied to the present invention.

[0071] The ratio calculation unit (114) calculates the ratio of text in a digital medium. If the digital medium is an image, the ratio calculation unit (114) can calculate the ratio of text in each image frame by comparing the total number of pixels in each image frame of the image with the number of pixels in the area where text is recognized in each image frame.

[0072] In addition, the ratio calculation unit (114) can calculate the ratio of text occupied in each image frame by comparing the total area size of each image frame of the video with the size of the area where text is recognized in each image frame.

[0073] If the digital medium is an electronic document, the ratio calculation unit (114) can calculate the ratio of text occupied by the electronic document.

[0074] The ratio calculation unit (114) can calculate the ratio of text in the electronic document by comparing the total number of pixels in the electronic document with the number of pixels in the area where text is recognized in the electronic document.

[0075] In addition, the ratio calculation unit (114) can calculate the ratio of text occupied in the electronic document by comparing the size of the entire area of ​​the electronic document with the size of the area where text is recognized in the electronic document.

[0076] If the ratio of text occupied by the digital medium exceeds the set ratio, the setting unit (116) changes the setting to an image quality optimized for the document.

[0077] The settings section (116) can minimize the sharpness of the edges by setting the edge enhancement to the minimum value when setting the image quality to optimize the image quality for the document. This prevents the occurrence of a white border-like shoot in the text and improves the readability of the text.

[0078] Additionally, the setting unit (116) can disable overdrive when setting the image quality to set the image quality optimized for the document.

[0079] Overdrive is used in environments requiring rapid screen transitions, such as games or video playback. It improves response time, reduces screen flicker, and sharpens the edges of moving objects. Therefore, disabling overdrive can improve image quality for documents.

[0080] Additionally, the setting unit (116) can reduce the difference between dark and bright areas by lowering the contrast when setting the image quality to optimize the image quality for the document. High contrast increases the difference between dark and bright areas, which increases eye fatigue. Therefore, by lowering the contrast to optimize the image quality for the document, the user can read the text more comfortably.

[0081] In another example, the processor (110) can recognize text in a plurality of consecutive image frames of an image (digital medium) for a period of time set by the recognition unit (112) and determine the category to which the digital medium belongs based on the recognized text. In addition, the processor (110) can change the image quality setting to an appropriate category to which the digital medium belongs by the setting unit (116).

[0082] Related text information for each pre-classified category can be stored in the memory (120), and the processor (110) can compare the text recognized by the recognition unit (112) with the information stored in the memory (120) to determine the category to which the corresponding digital medium belongs. For example, if the processor (110) determines that the text of the digital medium recognized by the recognition unit (112) is related to a racing game in a pre-classified category, the processor (110) can change the image quality to one suitable for a racing game through the setting unit (116).

[0083] Figure 2 illustrates a method for calculating the ratio of text occupied in an image frame of a video according to one embodiment.

[0084] Referring to FIG. 2, it is assumed that a user watches a movie on a screen (101) and then views a news article (ELECTRONIC NEWS) as text content, with the picture quality set to be optimized for media content such as movies or games.

[0085] The processor (110) can recognize text in multiple image frames of an image for a set period of time (e.g., 5 seconds) and calculate the proportion of text occupied by each image frame.

[0086] For example, the processor (110) can compare the total number of pixels in each image frame of the image with the number of pixels in the area where text is recognized in each image frame to calculate the proportion of text occupied in each image frame.

[0087] Additionally, the processor (110) can compare the size of the area occupied by the text in each image frame with the total area size of each image frame to calculate the ratio of the text occupied in each image frame.

[0088] At this time, when the total area size of the image frame of the news article is 100, the ratio of text occupied by multiple image frames during a set period of time may all exceed the set ratio (e.g., 50%).

[0089] The processor (110) changes the setting to an image quality optimized for the document when the ratio of text occupied by each image frame for a set period of time exceeds a set ratio (e.g., 50%).

[0090] The processor (110) can set the edge emphasis to the minimum value when setting the image quality to set the image quality optimized for the document, thereby minimizing the sharpness of the edge portion.

[0091] Additionally, the processor (110) can disable overdrive as described above and lower the contrast to reduce the difference between dark and bright areas.

[0092] When a user watches media content such as a movie while viewing text content, the processor (110) can reset the image quality to an optimized image quality for the media content when the ratio of text occupied by a plurality of consecutive image frames of the video for a set period of time does not exceed the set ratio.

[0093] FIG. 3 illustrates an electronic document according to another embodiment in which the proportion of text exceeds a set proportion.

[0094] Referring to FIG. 3, it is assumed that a user watches a movie on a screen (101) and then creates an electronic document (105) using document editing software, with the picture quality set to be optimized for media content such as a movie or game.

[0095] A user can input text into an electronic document (105) through a user interface including a keyboard, etc.

[0096] The processor (110) can recognize text in an electronic document (105) being input through a user interface and calculate the proportion of text in the electronic document (105).

[0097] If the proportion of text in an electronic document (105) does not exceed the center line (106) of the electronic document (105), i.e., the 50% point, and the user continues to input text through the keyboard and crosses the center line (106), the proportion of text in the electronic document (105) exceeds the set proportion (e.g., 50%).

[0098] The processor (110) may change the image quality setting to be optimized for the document if the text ratio in the electronic document (105) remains above the set ratio for a set period of time. Since the image quality setting optimized for the document has been described above, a detailed description thereof will be omitted.

[0099] The processor (110) can reset the image quality to be optimized for the original media content when, for example, the text entered by the user in the electronic document (105) is deleted, and the text ratio in the electronic document (105) falls back below a set ratio (e.g., 50%).

[0100] Figure 4 is a flowchart illustrating a method for controlling a display according to one embodiment.

[0101] For example, assume that the user watches a movie on the screen (101) with the picture quality set to be optimized for media content such as movies or games, and then views a news article as text content.

[0102] Referring to FIG. 4, when a processor (110) receives an image as a digital medium, it recognizes text in a plurality of consecutive image frames of the image for a set period of time (401).

[0103] The processor (110) can recognize text in the image frame, for example, using OCR.

[0104] The processor (110) calculates the proportion of text occupied in each image frame (411).

[0105] The ratio calculation unit (114) can calculate the ratio of text occupied by each image frame by comparing the total number of pixels in each image frame of the video with the number of pixels in the area where text is recognized in each image frame.

[0106] In addition, the ratio calculation unit (114) can calculate the ratio of text occupied in each image frame by comparing the size of the entire area of ​​each image frame of the video with the size of the area where text is recognized in each image frame.

[0107] If the text ratio exceeds the set ratio, the processor (110) changes the setting to an image quality optimized for the document (421).

[0108] The processor (110) can set edge emphasis to a minimum value when setting image quality to optimize image quality for a document, thereby minimizing the sharpness of edge portions. In addition, the processor (110) can disable overdrive and lower contrast to reduce the difference between dark and bright portions.

[0109] Fig. 5 is a flowchart showing a method for controlling a display according to another embodiment.

[0110] For example, assume that a user watches a movie on a screen (101) with the picture quality set to be optimized for media content such as movies or games, and then creates an electronic document (105) using document editing software.

[0111] Referring to FIG. 5, the processor (110) recognizes text within an electronic document being input through a user interface (501).

[0112] The processor (110) can recognize text in the image frame, for example, using OCR.

[0113] The processor (110) calculates the proportion of text in the electronic document (511).

[0114] The processor (110) can calculate the proportion of text in the electronic document by comparing, for example, the total number of pixels in the electronic document with the number of pixels in the area where text is recognized in the electronic document.

[0115] Additionally, the processor (110) can calculate the proportion of text in the electronic document by comparing the size of the entire area of ​​the electronic document with the size of the area where text is recognized in the electronic document.

[0116] If the text ratio remains above the set ratio for a set period of time, the processor (110) changes the setting to an image quality optimized for the document (521).

[0117] For example, if the proportion of text in an electronic document exceeds a set proportion (e.g., 50%) and is maintained for a set period of time (e.g., 5 seconds), the processor (110) may change the setting to an image quality optimized for the document.

[0118] The processor (110) can set edge emphasis to a minimum value when setting image quality to optimize image quality for a document, thereby minimizing the sharpness of edge portions. In addition, the processor (110) can disable overdrive and lower contrast to reduce the difference between dark and bright portions.

[0119] The methods according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between multiple user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0120] The above illustrates and describes specific embodiments. However, the present invention is not limited to the aforementioned embodiments, and those skilled in the art will appreciate that various modifications and implementations can be made without departing from the spirit and scope of the invention as set forth in the claims below.

Claims

1. Memory for storing digital media; and A display including a processor that changes the settings to an image quality optimized for the document when the ratio of text occupied by the digital medium displayed on the screen for a set period of time exceeds the set ratio.

2. In paragraph 1, The above digital media includes images, The above processor, A display that recognizes text in a plurality of consecutive image frames of the video during the set time, and changes the settings to an image quality optimized for the document when the ratio of the text in each of the image frames exceeds the set ratio.

3. In paragraph 2, The above processor, A display that recognizes text in the image frame using OCR (Optical Character Recognition).

4. In paragraph 2, The above processor, A display that calculates the ratio of the text in the image frame by comparing the total number of pixels in the image frame with the number of pixels in the area where the text is recognized in the image frame.

5. In paragraph 2, The above processor, A display that calculates the proportion of the text in the image frame by comparing the size of the entire area of the image frame with the size of the area in which the text is recognized in the image frame.

6. In paragraph 1, The above processor, A display with edge emphasis set to minimum when optimizing image quality for the above document.

7. In paragraph 1, The above processor, Display with overdrive disabled when the image quality is optimized for the above document.

8. In paragraph 1, The above processor, A display that reduces the difference between dark and bright areas by lowering the contrast when setting the picture quality to the optimum setting for the above document.

9. In paragraph 1, The above digital media includes electronic documents, The above processor, A display that recognizes text within the electronic document being input through a user interface and, when the ratio of the text within the electronic document remains above the set ratio for a set period of time, changes the settings to an image quality optimized for the document.

10. In paragraph 1, The above digital media includes images, The above processor, Recognize text in a plurality of consecutive image frames of the video during the above-described set time, Based on the recognized text, determine the category to which the digital medium belongs, A display that changes the picture quality settings to suit the category to which the above digital media belongs.

11. Recognize text in multiple consecutive image frames of a video over a set period of time, Calculate the proportion of the text occupied in each of the above image frames, A display control method including changing the settings to an image quality optimized for the document when the ratio of the above text exceeds the set ratio.

12. In paragraph 11, Recognizing the above text, A display control method including recognizing text in the image frame using OCR (Optical Character Recognition).

13. In paragraph 11, To calculate the ratio of the above text, A display control method comprising calculating a ratio of the text occupied in the image frame by comparing the total number of pixels of the image frame with the number of pixels of an area in which the text is recognized in the image frame.

14. In paragraph 11, To calculate the ratio of the above text, A display control method comprising calculating a ratio of the text occupied in the image frame by comparing the size of the entire area of the image frame with the size of the area in which the text is recognized in the image frame.

15. In paragraph 11, To change the settings to the optimized image quality for the above document, A display control method comprising setting edge emphasis to a minimum value.

Images