Electronic apparatus that can improve the readability of video subtitles and the operating method thereof

Abstract

An electronic device capable of improving the readability of video subtitles and a method of operation thereof are disclosed. By presenting an electronic device capable of displaying video subtitles at an optimal location and a method of operation thereof, the present invention can support video viewers in more easily identifying video subtitles.

Description

Technology Field

[0001] The present invention relates to an electronic device capable of improving the readability of video subtitles and a method of operating the same. Background Technology

[0002] With the recent proliferation of various electronic devices such as desktop computers, laptops, and smartphones, the number of people watching videos using these devices is increasing.

[0003] Given that some of these videos are produced in foreign languages, subtitles are sometimes included to help viewers understand the content more easily.

[0004] While video subtitles may sometimes be embedded as a single object existing within the video from the beginning, typically, subtitle data for the video is configured separately. Therefore, an electronic device playing a video containing subtitle data operates by loading the subtitle data separately while playing the video to display the subtitles on the screen.

[0005] When conventional electronic devices display subtitles for videos, they typically display them in the subtitle display area located at the bottom of the screen.

[0006] In this regard, a video may contain text within the video itself. If specific text is present in the subtitle display area during a particular playback segment and the video's subtitles are displayed in that area, the viewer may perceive the subtitles and text as overlapping, which can lead to a problem where the content of the subtitles and text cannot be accurately distinguished. For example, suppose there is a video containing specific subtitle data, and since the video depicts a visit to a certain location, the name of that location is displayed as text within the video itself. If the video's subtitles are displayed together in the area where the text is displayed, the viewer may be unable to clearly distinguish between the text and the subtitles because the text regarding the location inserted into the video and the video's subtitles are overlapping.

[0007] Therefore, when there is a playback section containing specific characters within the subtitle display area, it is necessary to introduce technology that moves the subtitle display area to another part of the screen, thereby enabling viewers to more easily identify the characters present in the video and the corresponding subtitles. The problem to be solved

[0008] The present invention aims to support video viewers in more easily identifying video subtitles by presenting an electronic device capable of displaying video subtitles at an optimal location and a method of operation thereof. means of solving the problem

[0009] An electronic device according to one embodiment of the present invention includes: an event generating unit that, when a video starts playing on the electronic device, displays a subtitle for the video in a preset first color in a preset subtitle display area, and generates an adjustment event for adjusting the subtitle position whenever the playback time of the video elapses by a preset first time; a judgment unit that, when an adjustment event occurs at any point, checks the frame of the video at the point in time when the adjustment event occurred and determines whether a character exists in the subtitle display area in the frame based on a preset character recognition module; and a subtitle adjustment unit that, if it is determined that no character exists in the subtitle display area in the frame, processes the subtitle to be displayed in the subtitle display area until the next adjustment event occurs, and if it is determined that a character exists in the subtitle display area in the frame, selects a first candidate subtitle display area which is one of a preset n (n is a natural number greater than or equal to 2) candidate subtitle display areas and processes the subtitle to be displayed in the first candidate subtitle display area until the next adjustment event occurs.

[0010] In addition, a method of operation of an electronic device according to an embodiment of the present invention comprises the steps of: when a video starts to be played on the electronic device, displaying a subtitle for the video in a pre-set first color in a pre-set subtitle display area, and generating an adjustment event for adjusting the subtitle position whenever the playback time of the video elapses by a pre-set first time; when an adjustment event occurs at any point, checking the frame of the video at the point in time when the adjustment event occurred, and then determining whether a character exists in the subtitle display area in the frame based on a pre-set character recognition module; and if it is determined that no character exists in the subtitle display area in the frame, processing to display the subtitle in the subtitle display area until the next adjustment event occurs, and if it is determined that a character exists in the subtitle display area in the frame, selecting a first candidate subtitle display area which is one of a pre-set n (n is a natural number greater than or equal to 2) candidate subtitle display areas, and processing to display the subtitle in the first candidate subtitle display area until the next adjustment event occurs. Effects of the invention

[0011] The present invention provides an electronic device capable of displaying video subtitles at an optimal location and a method of operation thereof, thereby supporting video viewers to identify video subtitles more easily. Brief explanation of the drawing

[0012] FIG. 1 is a drawing illustrating the structure of an electronic device according to an embodiment of the present invention. FIGS. 2 to 4 are drawings for explaining an electronic device according to an embodiment of the present invention. FIG. 5 is a flowchart illustrating the operation method of an electronic device according to an embodiment of the present invention. Specific details for implementing the invention

[0013] Embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. This description is not intended to limit the present invention to specific embodiments and should be understood to include all modifications, equivalents, and substitutions that fall within the spirit and scope of the present invention. Similar reference numerals have been used for similar components in describing each drawing, and unless otherwise defined, all terms used in this specification, including technical or scientific terms, have the same meaning as generally understood by a person skilled in the art to which the present invention pertains.

[0014] In this document, when a part is described as "including" a component, it means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, in various embodiments of the present invention, each component, functional block, or means may be composed of one or more sub-components, and the electrical, electronic, or mechanical functions performed by each component may be implemented by various known devices or mechanical elements, such as electronic circuits, integrated circuits, and ASICs (Application Specific Integrated Circuits), and may be implemented separately or two or more may be integrated into one.

[0015] Meanwhile, the blocks in the attached block diagram or the steps in the flowchart may be interpreted as computer program instructions that perform designated functions by being loaded into the processor or memory of data-processing equipment, such as general-purpose computers, specialized computers, portable notebook computers, and network computers. Since these computer program instructions may be stored in memory provided in a computer device or in memory readable by a computer, the functions described in the blocks in the block diagram or the steps in the flowchart may be produced as manufactured products containing means of instruction to perform them. Furthermore, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing a specific logical function(s). Also, it should be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may be executed in a different order than the prescribed order. For example, two blocks or steps shown in succession may be performed substantially simultaneously or in reverse order, and in some cases, some blocks or steps may be omitted.

[0016] FIG. 1 is a drawing illustrating the structure of an electronic device according to an embodiment of the present invention.

[0017] Referring to FIG. 1, the electronic device (110) according to the present invention includes an event generating unit (111), a judgment unit (112), and a subtitle adjustment unit (113).

[0018] The event generating unit (111) displays subtitles for the video in a preset first color in a preset subtitle display area when the video starts playing on the electronic device (110), and generates an adjustment event for adjusting the subtitle position whenever the playback time of the video elapses by a preset first time.

[0019] For example, the above subtitle display area may exist in the bottom area of ​​the screen, as shown in the figure indicated by reference numeral 211 in FIG. 2. At this time, when the first color is 'white' and the first time is '3 seconds', the event generating unit (111) displays subtitles for the video in 'white' in the pre-designated subtitle display area (211) when the video starts playing on the electronic device (110), and may generate an adjustment event for adjusting the subtitle position whenever the playback time of the video elapses by '3 seconds'.

[0020] When an adjustment event occurs at any point, the judgment unit (112) checks the frame of the video at the time the adjustment event occurred and then determines whether there is a character in the subtitle display area (211) in the frame based on a preset character recognition module.

[0021] Here, the character recognition module refers to a module capable of recognizing characters from a predetermined image or video, and may use an OCR (Optical Character Recognition) based character recognition module or a deep learning based character recognition module that has been pre-trained to recognize characters from an image or video.

[0022] For example, let’s assume that ‘3 seconds’ have elapsed since the above video started playing. Then, the event generating unit (111) can generate an adjustment event, and at this time, the judgment unit (112) can check the frame of the above video at the time when the adjustment event occurred.

[0023] At this time, if the above frame is said to be like the figure shown in FIG. 3, the judgment unit (112) can determine whether there is a character in the subtitle display area (211) in the above frame based on the character recognition module.

[0024] In the embodiment of FIG. 3, since there is a character in the subtitle display area (211), the judgment unit (112) can determine that there is a character in the subtitle display area (211) in the frame.

[0025] The subtitle adjustment unit (113) processes the subtitles to be displayed in the subtitle display area (211) until the next adjustment event occurs when it is determined that there are no characters in the subtitle display area (211) in the frame, and when it is determined that there are characters in the subtitle display area (211) in the frame, it selects a first candidate subtitle display area, which is one of the pre-specified n (n is a natural number greater than or equal to 2) candidate subtitle display areas, and processes the subtitles to be displayed in the first candidate subtitle display area until the next adjustment event occurs.

[0026] In this regard, unlike the embodiment of FIG. 3, if the judgment result of the judgment unit (112) determines that there are no characters in the subtitle display area (211) in the frame, the subtitle adjustment unit (113) can process the subtitles to be displayed in the subtitle display area (211) until the next adjustment event occurs, since there is no major problem for the video viewer to see the subtitles displayed in the subtitle display area (211). After that, the event generation unit (111) can generate an adjustment event when the playback time of the video has elapsed again by the first time, and process the process for adjusting the subtitle position according to the adjustment event to be performed.

[0027] On the other hand, as in the embodiment illustrated in FIG. 3, if the judgment result of the judgment unit (112) determines that there is a character in the subtitle display area (211) in the frame, the viewer of the video may have great difficulty seeing the subtitle displayed in the subtitle display area (211). Therefore, the subtitle adjustment unit (113) can select a first candidate subtitle display area, which is one of the pre-specified n (n is a natural number greater than or equal to 2) candidate subtitle display areas, and process the subtitle to be displayed in the first candidate subtitle display area until the next adjustment event occurs.

[0028] In this case, according to one embodiment of the present invention, the candidate subtitle display areas may be composed of an upper area (311), a left area (312), and a right area (313) of the screen where the video is displayed, as shown in the figure in FIG. 4.

[0029] At this time, the upper area (311) may be a rectangular area formed by a combination of straight lines passing through the top point (301) of the screen, a first point (302) spaced down by a first distance set in the downward direction from the top point (301) of the screen, a second point (303) spaced down by a second distance set in the right direction from the leftmost point (305) of the screen, and a third point (304) spaced down to the left by the second distance set in the left direction from the rightmost point (308) of the screen.

[0030] Additionally, the left area (312) may be a rectangular area formed by a combination of straight lines passing through the leftmost point (305) of the screen, the second point (303), the fourth point (306) spaced downward by a preset third distance from the top point (301) of the screen, and the fifth point (307) spaced upward by the third distance from the bottom point (309) of the screen.

[0031] Additionally, the right area (313) may be a rectangular area that can be formed by a combination of straight lines passing through the far right point (308) of the screen, the third point (304), the fourth point (306), and the fifth point (307).

[0032] In this case, according to one embodiment of the present invention, the subtitle adjustment unit (113) may include a vector generation unit (114) and a processing unit (115).

[0033] When it is determined that a character exists in the subtitle display area (211) in the frame, the vector generation unit (114) checks whether a character exists in each of the n candidate subtitle display areas (311, 312, 313) based on the character recognition module, selects candidate subtitle display areas where it is confirmed that no character exists, and then for each of the selected candidate subtitle display areas, calculates the average RGB value of the pixels constituting each candidate subtitle display area (wherein the average RGB value means the average of the R value, the average of the B value, and the average of the G value of the pixels), and then constructs a 3-dimensional feature vector having the average RGB value of each candidate subtitle display area as a component, thereby generating a feature vector corresponding to each of the selected candidate subtitle display areas and generating a 3-dimensional color vector having the RGB value constituting the first color as a component.

[0034] In this regard, if the n candidate subtitle display areas (311, 312, 313) are the top area (311), the left area (312), and the right area (313) as shown in the figure in FIG. 4, the vector generation unit (114) can check whether characters exist in each of the top area (311), the left area (312), and the right area (313) based on the character recognition module, and select candidate subtitle display areas where it is confirmed that no characters exist. If, as a result of selection, it is confirmed that characters exist in all of the top area (311), the left area (312), and the right area (313), the vector generation unit (114) does not proceed with vector generation and can process the subtitle to be displayed in the subtitle display area (211) until the next adjustment event occurs.

[0035] However, as a result of the selection, it is confirmed that no characters exist in the upper area (311), the left area (312), and the right area (313). In the case where the upper area (311), the left area (312), and the right area (313) are all selected, the vector generation unit (114) can calculate the average RGB value of the upper area (311) by calculating the average of the R values, the average of the B values, and the average of the G values ​​of the pixels constituting the upper area (311), the average RGB value of the left area (312) by calculating the average of the R values, the average of the B values, and the average of the G values ​​of the pixels constituting the left area (312), and the average RGB value of the right area (313) by calculating the average of the R values, the average of the B values, and the average of the G values ​​of the pixels constituting the right area (313).

[0036] Then, for the upper region (311), the vector generation unit (114) generates a 3-dimensional feature vector having the average RGB values ​​of the upper region (311) as components, that is, a feature vector having the average R values, average G values, and average B values ​​of the upper region (311) as components, '[R average , G average , Baverage It can be generated as ]', and for the left region (312), a 3-dimensional feature vector having the average RGB values ​​of the left region (312) as components, that is, a feature vector having the average R values, average G values, and average B values ​​of the left region (312) as components, is '[R average , G average , B average It can be generated as ]', and for the right region (313), a 3-dimensional feature vector having the average RGB values ​​of the right region (313) as components, that is, a feature vector having the average R values, average G values, and average B values ​​of the right region (313) as components, is '[R average , G average , B average It can be created like ]'.

[0037] Additionally, the vector generation unit (114) can generate a three-dimensional color vector having RGB values ​​as components that constitute the first color, which is the color of the subtitle. In this regard, if the R value of the first color is 'R1', the B value is 'B1', and the G value is 'G1', the vector generation unit (114) can generate a color vector called '[R1 B1 G1]'.

[0038] The processing unit (115) selects a candidate subtitle display area having a feature vector with the minimum vector similarity with the color vector among the selected candidate subtitle display areas as the first candidate subtitle display area, and processes the subtitle to be displayed in the first candidate subtitle display area until the next adjustment event occurs. Here, vector similarity may be Euclidean distance, cosine similarity, etc.

[0039] In this regard, as in the example described above, if a feature vector corresponding to each of the upper area (311), left area (312), and right area (313) is generated and a color vector for the first color is generated, the processing unit (115) calculates the vector similarity between the feature vector of the upper area (311) and the color vector, calculates the vector similarity between the feature vector of the left area (312) and the color vector, and calculates the vector similarity between the feature vector of the right area (313) and the color vector, and then selects the candidate subtitle display area having the feature vector with the minimum vector similarity among the upper area (311), left area (312), and right area (313) as the first candidate subtitle display area.

[0040] In this regard, if the right area (313) is the candidate subtitle display area having the feature vector with the minimum vector similarity among the top area (311), left area (312), and right area (313), the processing unit (115) can select the right area (313) as the first candidate subtitle display area.

[0041] Then, the processing unit (115) can process the subtitles to be displayed in the right area (313) until the next adjustment event occurs. In this way, when the subtitles are displayed in the right area (313), the subtitles will continue to be displayed in the right area (313) until the next adjustment event occurs. After that, the event generating unit (111) can generate an adjustment event when the playback time of the video has elapsed again by the first time, thereby processing the process for adjusting the subtitle position according to the occurrence of the next adjustment event.

[0042] As described above, the electronic device (110) according to the present invention can improve the readability of video subtitles by checking whether there are characters in the subtitle display area (211) whenever the playback time of the video has elapsed by a preset first time, and if it is confirmed that there are no characters, processing to continue displaying subtitles in the subtitle display area (211), and if it is confirmed that there are characters, processing to display subtitles in one of the candidate subtitle display areas having the average color most dissimilar to the color of the subtitles.

[0043] According to one embodiment of the present invention, when an adjustment event occurs at a certain point in time, the judgment unit (112) determines whether there is a character in the subtitle display area (211) in the frame at that point in time, and if it is determined that there is no character, the subtitle is displayed in the subtitle display area (211) until the next adjustment event occurs. However, if the color of the subtitle display area (211) and the color of the subtitle, the first color, are compared and it is confirmed that the color similarity exceeds a preset threshold, the color of the subtitle can be changed to a different color and displayed.

[0044] At this time, according to one embodiment of the present invention, if it is determined that there are no characters in the subtitle display area (211) in the frame, the subtitle adjustment unit (113) processes the subtitle to be displayed in the subtitle display area (211) until the next adjustment event occurs, by calculating the average RGB value of the pixels constituting the subtitle display area (211) (wherein the average RGB value means the average of the R value, the average of the B value, and the average of the G value of the pixels) to generate a three-dimensional feature vector having the average RGB value of the subtitle display area (211) as a component, and then generates a three-dimensional color vector having the RGB value constituting the first color as a component, and then calculates the vector similarity between the two vectors as the color similarity, and if it is confirmed that the color similarity exceeds the reference value, generates a sum value by summing the maximum value and the minimum value from the average RGB value of the pixels constituting the subtitle display area (211), subtracts each of the RGB values ​​constituting the first color from the sum value to form a new RGB value, and then to the new RGB value The color of the above subtitle can be changed and displayed according to the corresponding color.

[0045] For example, let us assume that when an adjustment event occurs at a certain point in time, the judgment unit (112) determines whether there is a character in the subtitle display area (211) of the video frame at that point in time, and as a result, it is determined that there is no character.

[0046] Then, the subtitle adjustment unit (113) can process the subtitles of the video to be displayed in the subtitle display area (211) until the next adjustment event occurs.

[0047] At this time, when the subtitle adjustment unit (113) processes the subtitle to be displayed in the subtitle display area (211), it can calculate the color similarity between the first color, which is the color of the subtitle, and the color of the subtitle display area (211).

[0048] Specifically, the subtitle adjustment unit (113) can calculate the average RGB values ​​of the pixels constituting the subtitle display area (211) and generate a three-dimensional feature vector having the average RGB values ​​of the subtitle display area (211) as components. That is, the subtitle adjustment unit (112) can calculate the average R values, average B values, and average G values ​​of the pixels constituting the subtitle display area (211), and then calculate a three-dimensional feature vector having the average R values, average B values, and average G values ​​as components.

[0049] Then, the subtitle adjustment unit (113) can also generate a three-dimensional color vector having RGB values ​​constituting the first color as components.

[0050] After that, the subtitle adjustment unit (113) can calculate the vector similarity between the feature vector of the subtitle display area (211) and the color vector of the first color as the color similarity, and then check whether the color similarity exceeds the reference value.

[0051] If the color similarity exceeds the above standard value, it can be seen that the current color of the subtitle is similar to the color of the subtitle display area (211) and the readability is significantly reduced, so the subtitle adjustment unit (113) can change the color of the subtitle to a color that improves readability.

[0052] In this regard, the subtitle adjustment unit (113) can generate a sum value by adding the maximum and minimum values ​​from the average RGB values ​​of the pixels constituting the subtitle display area (211). For example, if the average R value, average G value, and average B value of the pixels constituting the subtitle display area (211) are '130, 54, and 23', respectively, the subtitle adjustment unit (113) can generate a sum value of '153' by adding the maximum value '130' and the minimum value '23'.

[0053] Then, the subtitle adjustment unit (113) can subtract each of the RGB values ​​constituting the first color from the sum value to form a new RGB value. For example, if the RGB values ​​constituting the first color are 'R value: 125, G value: 48, B value: 27', the subtitle adjustment unit (113) can subtract the R value '125' from the sum value '153' to create a new R value '28', subtract the G value '48' from the sum value '153' to create a new G value '105', and subtract the B value '27' from the sum value '153' to create a new B value '126'. At this time, the subtitle adjustment unit (113) can set the value to '255' if the result of subtracting each RGB value constituting the first color from the sum value yields a value exceeding '255', and can set the value to '0' if the result yields a value less than '0'. For example, if the sum value is '275' and the R value is '15', the new R value obtained by subtracting the R value '15' from the sum value is '260', so the subtitle adjustment unit (113) can set the new R value to '255' instead of '260'.

[0054] In this way, when a new RGB value is calculated as '28, 105, 126', the subtitle adjustment unit (113) can change the color of the subtitle to the color according to the new RGB value and display it in the subtitle display area (211).

[0055] That is, the electronic device (110) according to the present invention can support a video viewer in more easily identifying subtitles by changing the color of the subtitle to a new color that is distinct from the color of the subtitle display area (211) when the color of the subtitle display area (211) and the color of the video subtitle are similar.

[0056] FIG. 5 is a flowchart illustrating the operation method of an electronic device according to an embodiment of the present invention.

[0057] In step (S510), when a video starts playing on the electronic device, subtitles for the video are displayed in a preset first color in a preset subtitle display area, and an adjustment event for adjusting the subtitle position is generated whenever the playback time of the video elapses by a preset first time.

[0058] In step (S520), when an adjustment event occurs at any point, the frame of the video at the time the adjustment event occurred is checked, and then, based on a preset character recognition module, it is determined whether there is a character in the subtitle display area of ​​the frame.

[0059] In step (S530), if it is determined that there are no characters in the subtitle display area in the frame, the subtitle is displayed in the subtitle display area until the next adjustment event occurs, and if it is determined that there are characters in the subtitle display area in the frame, a first candidate subtitle display area is selected from among the pre-specified n (n is a natural number greater than or equal to 2) candidate subtitle display areas, and the subtitle is displayed in the first candidate subtitle display area until the next adjustment event occurs.

[0060] At this time, according to one embodiment of the present invention, step (S530) may include: when it is determined that a character exists in the subtitle display area in the frame, checking whether a character exists in each of the n candidate subtitle display areas based on the character recognition module, selecting candidate subtitle display areas where it is confirmed that no character exists, then for each of the selected candidate subtitle display areas, calculating the average RGB value of the pixels constituting each candidate subtitle display area (wherein the average RGB value means the average of the R value, the average of the B value, and the average of the G value of the pixels), and then constructing a 3-dimensional feature vector having the average RGB value of each candidate subtitle display area as a component to generate a feature vector corresponding to each of the selected candidate subtitle display areas, and generating a 3-dimensional color vector having the RGB value constituting the first color as a component; and among the selected candidate subtitle display areas, selecting the candidate subtitle display area having a feature vector with the minimum vector similarity with the color vector as the first candidate subtitle display area, and processing so that the subtitle is displayed in the first candidate subtitle display area until the next adjustment event occurs.

[0061] In addition, according to one embodiment of the present invention, the candidate subtitle display areas are composed of an upper area, a left area, and a right area of ​​the screen on which the video is displayed, wherein the upper area is a rectangular area that can be composed of a combination of straight lines passing through the top point of the screen, a first point spaced by a first distance pre-set in the downward direction from the top point of the screen, a second point spaced by a second distance pre-set in the right direction from the leftmost point of the screen, and a third point spaced by the second distance in the left direction from the rightmost point of the screen; the left area is a rectangular area that can be composed of a combination of straight lines passing through the leftmost point of the screen, the second point, a fourth point spaced by a third distance pre-set in the downward direction from the top point of the screen, and a fifth point spaced by the third distance in the upward direction from the bottom point of the screen; and the right area is a rectangular area that can be composed of a combination of straight lines passing through the rightmost point of the screen, the third point, the fourth point, and the fifth point.

[0062] In addition, according to one embodiment of the present invention, in step (S530), if it is determined that there are no characters in the subtitle display area of ​​the frame, the subtitle is displayed in the subtitle display area until the next adjustment event occurs, and if it is confirmed that the color similarity between the color of the subtitle display area and the first color exceeds a preset threshold, the color of the subtitle can be changed to another color and displayed.

[0063] At this time, according to one embodiment of the present invention, in step (S530), if it is determined that there is no character in the subtitle display area in the frame, the subtitle is displayed in the subtitle display area until the next adjustment event occurs, wherein the average RGB value of the pixels constituting the subtitle display area (wherein the average RGB value means the average of the R value, the average of the B value, and the average of the G value of the pixels) is calculated to generate a three-dimensional feature vector having the average RGB value of the subtitle display area as a component, and then a three-dimensional color vector having the RGB value constituting the first color as a component is generated, and then the vector similarity between the two vectors is calculated as the color similarity, and if it is confirmed that the color similarity exceeds the reference value, the maximum value and the minimum value are added to the average RGB value of the pixels constituting the subtitle display area to generate a sum value, and each of the RGB values ​​constituting the first color is subtracted from the sum value to form a new RGB value, and then the color of the subtitle is changed and displayed according to the new RGB value.

[0064] Hereinafter, a method of operation of an electronic device according to an embodiment of the present invention has been described with reference to FIG. 5. Since the method of operation of an electronic device according to an embodiment of the present invention may correspond to the configuration of the operation of the electronic device (110) described using FIG. 1 to 4, a more detailed description thereof will be omitted.

[0065] A method of operation of an electronic device according to one embodiment of the present invention can be implemented as a computer program stored in a storage medium for execution through combination with a computer.

[0066] In addition, a method of operation of an electronic device according to an embodiment of the present invention may be implemented in the form of computer program instructions for execution through combination with a computer and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0067] As described above, the present invention has been explained by specific details such as specific components, limited embodiments, and drawings; however, this is provided merely to aid in a more comprehensive understanding of the invention, and the invention is not limited to the above embodiments. A person skilled in the art can make various modifications and variations from this description.

[0068] Therefore, the scope of the present invention is not limited to the described embodiments, and all things equivalent to or having equivalent variations to the claims set forth below, as well as the claims themselves, shall be considered to fall within the scope of the concept of the present invention. Explanation of the symbols

[0069] 110: Electronic device 111: Event originator 112: Judgment Department 113: Subtitle Adjustment Department 114: Vector generation section 115: Processing unit

Claims

Claim 1 In an electronic device, when a video begins to play in the electronic device, an event generating unit displays a subtitle for the video in a preset first color in a preset subtitle display area, and generates an adjustment event for adjusting the subtitle position whenever the playback time of the video elapses by a preset first time; and when an adjustment event occurs at a certain point in time, a judgment unit checks the frame of the video at the point in time when the adjustment event occurred, and then determines whether a character exists in the subtitle display area of ​​the frame based on a preset character recognition module. The subtitle adjustment unit includes, when it is determined that no character exists in the subtitle display area in the above frame, processing to display the subtitle in the above subtitle display area until the next adjustment event occurs, and when it is determined that a character exists in the subtitle display area in the above frame, selecting a first candidate subtitle display area which is one of a pre-specified n (n is a natural number greater than or equal to 2) candidate subtitle display areas, and processing to display the subtitle in the first candidate subtitle display area until the next adjustment event occurs; wherein, when it is determined that a character exists in the subtitle display area in the above frame, the subtitle adjustment unit checks whether a character exists in each of the n candidate subtitle display areas based on the character recognition module and selects candidate subtitle display areas where it is confirmed that no character exists, and for each of the selected candidate subtitle display areas, calculates the average RGB value of the pixels constituting each candidate subtitle display area—wherein the average RGB value refers to the average of the R value, the average B value, and the average G value of the pixels—and constructs a 3D feature vector having the average RGB value of each candidate subtitle display area as a component, thereby the selected candidate subtitle display areas A vector generation unit that generates a feature vector corresponding to each and generates a three-dimensional color vector having RGB values ​​constituting the first color as components;An electronic device comprising a processing unit that selects a candidate subtitle display area having a feature vector having the minimum vector similarity with the color vector among the selected candidate subtitle display areas as the first candidate subtitle display area, and processes the subtitle to be displayed in the first candidate subtitle display area until the next adjustment event occurs. Claim 2 delete Claim 3 An electronic device characterized in that, in claim 1, the candidate subtitle display areas are composed of an upper area, a left area, and a right area of ​​the screen on which the video is displayed, wherein the upper area is a rectangular area that can be composed of a combination of straight lines passing through the top point of the screen, a first point spaced by a first distance set in the downward direction from the top point of the screen, a second point spaced by a second distance set in the right direction from the leftmost point of the screen, and a third point spaced by the second distance set in the left direction from the rightmost point of the screen; the left area is a rectangular area that can be composed of a combination of straight lines passing through the leftmost point of the screen, the second point, a fourth point spaced by a third distance set in the downward direction from the top point of the screen, and a fifth point spaced by the third distance set in the upward direction from the bottom point of the screen; and the right area is a rectangular area that can be composed of a combination of straight lines passing through the rightmost point of the screen, the third point, the fourth point, and the fifth point. Claim 4 An electronic device according to claim 1, wherein the subtitle adjustment unit processes the subtitle to be displayed in the subtitle display area until the next adjustment event occurs when it is determined that there is no character in the subtitle display area in the frame, and if it is confirmed that the color similarity between the color of the subtitle display area and the first color exceeds a preset threshold, the color of the subtitle is changed to a different color and displayed. Claim 5 An electronic device characterized in that, in claim 4, the subtitle adjustment unit processes the subtitle to be displayed in the subtitle display area until the next adjustment event occurs when it is determined that there is no character in the subtitle display area in the frame, and calculates the average RGB value of the pixels constituting the subtitle display area—wherein the average RGB value refers to the average of the R value, the average B value, and the average G value of the pixels—to generate a three-dimensional feature vector having the average RGB value of the subtitle display area as a component, and then generates a three-dimensional color vector having the RGB value constituting the first color as a component, then calculates the vector similarity between the two vectors as the color similarity, and if it is confirmed that the color similarity exceeds the reference value, it generates a sum value by summing the maximum value and the minimum value of the average RGB value of the pixels constituting the subtitle display area, subtracts each of the RGB values ​​constituting the first color from the sum value to form a new RGB value, and then changes and displays the color of the subtitle to the color according to the new RGB value. Claim 6 A method of operating an electronic device, wherein when a video begins to be played on the electronic device, a subtitle for the video is displayed in a preset first color in a preset subtitle display area, and an adjustment event for adjusting the subtitle position is generated whenever a preset first time elapses during the playback time of the video; and when an adjustment event is generated at a certain point in time, a frame of the video at the point in time when the adjustment event is generated is checked, and then a determination is made whether a character exists in the subtitle display area of ​​the frame based on a preset character recognition module. The method includes the step of, when it is determined that no character exists in the subtitle display area in the above frame, processing to display the subtitle in the above subtitle display area until the next adjustment event occurs, and when it is determined that a character exists in the above subtitle display area in the above frame, selecting a first candidate subtitle display area which is one of a pre-specified n (n is a natural number greater than or equal to 2) candidate subtitle display areas, and processing to display the subtitle in the first candidate subtitle display area until the next adjustment event occurs; wherein the processing step includes, when it is determined that a character exists in the above subtitle display area in the above frame, checking whether a character exists in each of the n candidate subtitle display areas based on the character recognition module, selecting candidate subtitle display areas where it is confirmed that no character exists, and for each of the selected candidate subtitle display areas, calculating the average RGB value of the pixels constituting each candidate subtitle display area—wherein the average RGB value refers to the average of the R value, the average B value, and the average G value of the pixels—and constructing a 3-dimensional feature vector having the average RGB value of each candidate subtitle display area as a component, thereby corresponding to each of the selected candidate subtitle display areas A step of generating a feature vector and generating a three-dimensional color vector having RGB values ​​constituting the first color as components;A method of operation of an electronic device comprising the step of selecting a candidate subtitle display area having a feature vector having the minimum vector similarity with the color vector among the selected candidate subtitle display areas as the first candidate subtitle display area, and then displaying the subtitle in the first candidate subtitle display area until the next adjustment event occurs. Claim 7 delete Claim 8 In claim 6, the above candidate subtitle display areas are composed of an upper area, a left area, and a right area of ​​the screen on which the video is displayed, wherein the upper area is a rectangular area that can be composed of a combination of straight lines passing through the top point of the screen, a first point separated by a first distance predetermined downward from the top point of the screen, a second point separated by a second distance predetermined rightward from the leftmost point of the screen, and a third point separated by the second distance leftward from the rightmost point of the screen; the left area is a rectangular area that can be composed of a combination of straight lines passing through the leftmost point of the screen, the second point, a fourth point separated by a third distance predetermined downward from the top point of the screen, and a fifth point separated by the third distance upward from the bottom point of the screen; and the right area is a rectangular area that can be composed of a combination of straight lines passing through the rightmost point of the screen, the third point, the fourth point, and the fifth point. Claim 9 A method of operation of an electronic device according to claim 6, wherein the processing step is such that when it is determined that there is no character in the subtitle display area in the frame, the subtitle is displayed in the subtitle display area until the next adjustment event occurs, and when it is confirmed that the color similarity between the color of the subtitle display area and the first color exceeds a preset threshold, the color of the subtitle is changed to another color and displayed. Claim 10 In claim 9, the processing step is characterized by processing so that the subtitle is displayed in the subtitle display area until the next adjustment event occurs when it is determined that there is no character in the subtitle display area in the frame, and by calculating the average RGB value of the pixels constituting the subtitle display area—wherein the average RGB value refers to the average of the R value, the average B value, and the average G value of the pixels—to generate a three-dimensional feature vector having the average RGB value of the subtitle display area as a component, and then generating a three-dimensional color vector having the RGB value constituting the first color as a component, then calculating the vector similarity between the two vectors as the color similarity, and if it is confirmed that the color similarity exceeds the reference value, generating a sum value by summing the maximum value and the minimum value of the average RGB value of the pixels constituting the subtitle display area, subtracting each of the RGB values ​​constituting the first color from the sum value to form a new RGB value, and then changing and displaying the color of the subtitle according to the new RGB value. Claim 11 A computer-readable recording medium having a computer program for executing the method of any one of paragraphs 6, 8, 9, or 10 through combination with a computer. Claim 12 A computer program stored on a storage medium for executing the method of any one of paragraphs 6, 8, 9, or 10 through combination with a computer.

Images