Method for providing video for myopia prevention and video processing device

Abstract

This method for providing a video for myopia prevention comprises the steps in which: a video processing device receives a source video; the video processing device determines a non-focal region, other than a focal region, in a specific frame of the source video; and the video processing device adjusts focus for the non-focal region. The video processing device adjusts the focus so that the focal region corresponds to emmetropia and the non-focal region corresponds to at a certain level of myopic defocus.

Description

Method for providing images for preventing myopia and image processing device

[0001] The technology described below relates to a video presentation technique for preventing myopia.

[0002] Myopia (myopia) is a condition in which the eyeball grows longer, causing the focus of light, which should be on the retina, to focus in front of the retina, resulting in poor vision for distant objects but clearer vision for near objects. High myopia, in particular, can lead to complications such as retinal detachment, glaucoma, and macular degeneration, potentially leading to blindness. The prevalence of myopia is increasing worldwide. Recent studies show that the prevalence of myopia in Korea is increasing at a particularly high rate compared to other countries. Because myopia is essentially an incurable disease, prevention is crucial.

[0003] Near-distance work using smartphones or laptops is a major cause of myopia. With the popularization of smart devices and technological advancements, their use is bound to continue. Therefore, myopia prevention measures, such as limiting smart device use, have limitations.

[0004] The technology described below is intended to provide images for preventing myopia or delaying the onset of myopia by considering the causes of myopia.

[0005] A method for providing an image for preventing myopia includes the steps of an image processing device receiving a source image, a step of the image processing device determining a non-focus area excluding a focus area in a specific frame of the source image, and a step of the image processing device adjusting a focus on the non-focus area. The image processing device adjusts the focus such that the focus area is emmetropia and the non-focus area has a certain level of myopic defocus.

[0006] An image processing device for generating an image for preventing myopia includes an interface device for receiving a source image and an arithmetic device for determining a non-focus area excluding a focus area in a specific frame of the source image, and adjusting the focus of the non-focus area so that the focus area is emmetropia and the non-focus area has a certain level of myopic defocus.

[0007] The technology described below provides video content that actively prevents myopia without the use of additional devices such as glasses or contact lenses. The technology described below can simultaneously prevent myopia while providing near-range content using smart devices or computers.

[0008] Figure 1 is an example showing the shape of the eye according to the progression of myopia.

[0009] Figure 2 is an example of a myopia state and a myopia correction state.

[0010] Figure 3 is an example of an image for myopia prevention.

[0011] Figure 4 is an example of a process in which an image processing device encodes an image for preventing myopia.

[0012] Figure 5 is an example of a system that provides images for myopia prevention.

[0013] Figure 6 is an example of a process in which an image processing device provides an image for preventing myopia in real time.

[0014] Figure 7 is another example of a system that provides images for myopia prevention.

[0015] Figure 8 is an example of an image processing device that provides images for preventing myopia.

[0016] The technology described below is susceptible to various modifications and embodiments. Specific embodiments are illustrated and described in detail in the drawings. However, this does not limit the technology described below to specific embodiments, and it should be understood that all modifications, equivalents, and alternatives fall within the spirit and scope of the technology described below.

[0017] Terms such as first, second, A, and B may be used to describe various components, but these components are not limited by these terms and are used solely to distinguish one component from another. For example, without departing from the scope of the technology described below, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. The term "and / or" includes a combination of a plurality of related described items or any of a plurality of related described items.

[0018] As used herein, the singular expressions should be understood to include the plural expressions unless the context clearly dictates otherwise, and the term "comprises" and the like should be understood to mean the presence of a described feature, number, step, operation, component, part, or combination thereof, but not to exclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0019] Before going into a detailed description of the drawings, it should be made clear that the division of components in this specification is merely a division based on the main function of each component. In other words, two or more components described below may be combined into a single component, or a single component may be further subdivided into two or more components with more detailed functions. In addition to its own main function, each component described below may additionally perform some or all of the functions of other components, and of course, some of the main functions of each component may be exclusively performed by other components.

[0020] Additionally, in performing a method or method of operation, each process constituting the method may occur in a different order than the stated order, unless the context clearly indicates a specific order. That is, each process may occur in the same order as the stated order, may be performed substantially simultaneously, or may be performed in the opposite order.

[0021] Myopia is a disease in which distant objects are not visible and nearby objects are visible because the length of the eyeball becomes longer and the focus that should be on the retina is focused in front of the retina.

[0022] Figure 1 is an example showing the shape of the eye according to the progression of myopia.

[0023] Figure 1(A) illustrates an example of a normal eye. In a normal eye, light entering through the cornea focuses on a single point on the retina. A normal eye has a round, spherical shape.

[0024] The reason myopia is induced is because the eyeball should grow round like a ball, but it grows longer and longer like a rugby ball. Figures 1(B) and 1(C) illustrate examples of myopic eyeball shapes. In Figures 1(B) and 1(C), the vertical dotted arrows indicate the axial or longitudinal direction of the eyeball. Myopia induced by the eyeball being elongated in the axial direction is called axial myopia. Axial myopia occurs when, for some reason, hyperopic defocus occurs, where light focuses behind the retina, and the eyeball grows in the longitudinal direction to focus on the focal point behind the retina.

[0025] The eyeball in Fig. 1(B) is axially elongated by a length a from the eyeball in Fig. 1(A). The eyeball in Fig. 1(C) is axially elongated by a length b from the eyeball in Fig. 1(B). As the eyeball becomes longer axially, the degree of myopia increases.

[0026] Figure 2 is an example of a myopia state and a myopia correction state.

[0027] Figure 2(A) is an example of myopia. In myopia, the central part of the retina experiences myopic defocus, and the peripheral part of the retina experiences hyperopic defocus.

[0028] Figure 2(B) shows an example of myopia corrected with glasses. Glasses focus the image at a constant distance toward the retina. With glasses, the central retina maintains normal focus, but the periphery of the retina experiences hyperopic defocusing. This is why increasing the prescription of glasses can further progress myopia.

[0029] Figure 2(C) represents the optimal condition for mitigating or preventing myopia progression. The central retina maintains normal focus, while the peripheral retina exhibits myopic defocus. Correcting the condition shown in Figure 2(C) prevents the eye from growing axially, thereby suppressing myopia progression.

[0030] The myopia prevention technique described below provides video content for myopia prevention. "Video content" here refers to images or videos.

[0031] The following images for preventing myopia are images in which the area projected to the center of the retina is in focus on the retina, and the area projected to the periphery of the retina is an image of myopic defocus. In the following images for preventing myopia, the area projected to the center of the retina is called the focus area, and the area projected to the periphery of the retina is called the defocus area. In other words, the images for preventing myopia correspond to a state as shown in Fig. 2(C). In the images for preventing myopia, the focus area is in focus and appears clear, and the defocus area is out of focus and appears blurry.

[0032] The following explains how the image processing device processes the source image into an image for myopia prevention. The source image refers to image content in which the entire frame is sharp (in focus).

[0033] An image processing device is a computing device capable of performing specific image processing. Image processing devices can be implemented as PCs, VR headsets, smart devices, network servers, or chipsets embedded with dedicated programs.

[0034] Figure 3 is an example of an image for myopia prevention. The image for myopia prevention has a focus area (indicated by A) where the image is accurately focused on the retina (emmetropia), and a defocus area (excluding A) where there is a certain level of myopic defocus. The degree of myopia in the peripheral areas may vary depending on the settings.

[0035] The image processing device processes the out-of-focus area of ​​the source image, excluding the in-focus area, into an image in a myopic defocus state. The image processing device can convert the source image into an image for myopia prevention, and store and manage the image for myopia prevention. Alternatively, the image processing device can convert the source image into an image for myopia prevention in real time and play it back.

[0036] Fig. 4 is an example of a process (100) in which an image processing device encodes an image for preventing myopia. That is, in Fig. 4, the image processing device corresponds to an encoder.

[0037] The image processing device receives a source image (110). At this time, the source image is an original image that has not been subjected to myopic defocusing.

[0038] The image processing device can determine a focus area from a source image (120).

[0039] The focus area can be determined by various criteria.

[0040] (i) The image processing device can simply determine the central area of ​​the current image frame as the focus area.

[0041] (ii) The image processing device can select a region of interest from the current image frame and determine it as the focus region. The region of interest may be the area where a specific object is located. The region of interest may vary depending on the type of content. For example, in a movie, the region of interest may be the area where the main character or main object is located. In an educational video, the region of interest may be the area where the speaker or educational content is displayed. Meanwhile, the image processing device can also extract the region of interest using image processing techniques or deep learning models.

[0042] (iii) The image processing device can track the direction of the viewer's (user's) gaze and determine the area where the gaze is focused as the focus area. In other words, the image processing device can change the focus area based on the user's gaze. In this case, the image processing device can track the user's gaze using a separate camera device.

[0043] The shape of the focus area can vary, such as square or circular.

[0044] Additionally, the size of the focus area can vary. It can be a preset size or a size determined by the content type. The size of the focus area can vary depending on the type of video content, the distance from which the user views the video, the device on which the video is output, and other factors. Alternatively, the focus area can be of a shape and size that encompasses a specific object.

[0045] The out-of-focus area can be an area in the source image that is outside the in-focus area. Therefore, determining the in-focus area is synonymous with determining the out-of-focus area. The out-of-focus area is given a certain level of myopic defocus. The degree of myopia in the out-of-focus area can vary depending on the viewer's eye condition (the degree of myopia).

[0046] An image processing device can impart a certain degree of myopia to a non-focus area through a specific image processing process. For example, the non-focus area can have a myopic defocus of 0.5 diopters.

[0047] The image processing device may provide a first degree of myopia to the non-focus area for a certain period of time (e.g., 30 minutes) and a second degree of myopia thereafter.

[0048] Furthermore, the image processing device can adjust myopia information for the non-focus area according to a certain schedule according to a certain myopia prevention program.

[0049] The image processing device performs a process to provide myopic defocusing to the non-focus area (130). The image processing device can adjust the focus (provide myopic defocusing) of the non-focus area in various ways.

[0050] For example, an image processing device can adjust the focus on a non-focus area through an image coding process. For example, an image processing device can perform a Fourier transform during an encoding process to decompose an input signal into a sum of periodic functions with various frequencies. At this time, the periodic functions used in the Fourier transform are sine and / or cosine trigonometric functions. The Fourier transform will be briefly explained. The Fourier transform converts a non-periodic signal into a complex sine wave (periodic function) e with continuous frequencies. j2πux It is converted into components. Mathematical expression 1 below expresses the source image signal f(x) as a first-order combination of periodic functions.

[0051]

[0052] j is imaginary, e j2πux is a periodic function component with frequency u, and F(u) is the coefficient of the periodic function component. The primary coupling coefficient F(u) can be expressed as a combination of complex exponential functions as in Equation 2 below. Equation 2 below corresponds to the Fourier transform process.

[0053]

[0054]

[0055] As shown in mathematical equation 3, it is Euler's formula. Using Euler's formula, a multi-exponential function can be converted into a trigonometric function. If Euler's formula is substituted into the Fourier transform, e is obtained as shown in mathematical equation 4 below. j2πux can be expressed as a periodic function with all periods being 1 / u.

[0056]

[0057] The image processing device can adjust the focus of the image by adjusting the phase angle θ. The image processing device can only provide myopic defocus to the non-focus area.

[0058] If the angle of the normal vision screen is θ, the image processing device can generate an image that is out of focus by providing a certain phase difference. For example, the image processing device can provide a phase difference of "θ + π / 6" to the non-focus area. The image processing device can adjust the degree of myopia by adjusting the phase difference in the range of π / 24 to π / 2. In cases of severe myopia, the image processing device can provide a large phase difference to the non-focus area to provide a high degree of myopia. If the myopia is not severe, the image processing device can provide a relatively small phase difference to the non-focus area. In other words, the image processing device can dynamically adjust the degree of myopic defocusing for the non-focus area depending on the degree of myopia of the subject.

[0059] The image processing device completes encoding of the image for myopia prevention (140). The Fourier transform may be performed during the encoding process. Details of the encoding process are not described here. The specific encoding process or strategy may vary depending on the video codec (e.g., H.624, H.265).

[0060] The image for preventing myopia encoded by the image processing device can be stored or transmitted to another object (150).

[0061] Figure 4 illustrates an example of applying myopic defocus by adjusting the angle of the periodic function of the Fourier transform during the encoding process. Alternatively, the image processing device can apply myopic defocus to the out-of-focus region in other ways. The image processing device can apply myopic defocus to the out-of-focus region using a conventionally known focus adjustment processing algorithm. Alternatively, the image processing device can apply myopic defocus to the out-of-focus region using a deep learning model that processes the image.

[0062] FIG. 5 is an example of a system (200) that provides images for preventing myopia.

[0063] The image processing device (210) generates image content for preventing myopia. For example, as described in FIG. 4, the image processing device (210) may adjust the angle of the trigonometric function of the Fourier transform during the image encoding process to impart myopic defocus to the surrounding area. Alternatively, the image processing device (210) may impart myopic defocus to the image content itself using other techniques.

[0064] The image processing device (210) can generate a plurality of image contents for preventing myopia.

[0065] The image processing device (210) can store the encoded myopia prevention image in a database (DB, 220).

[0066] The service server (230) receives an image requested by a user from the database (220) and provides it to a user terminal (240). The user terminal (240) may be a PC, a laptop, a smart device, a VR device, or other various devices. The image for preventing myopia received by the user terminal (240) is an image in which myopic defocusing is applied to the non-focus area. The user terminal (240) can decode the received image and play it on the screen.

[0067] Fig. 6 is an example of a process (300) in which an image processing device provides an image for preventing myopia in real time. In Fig. 6, the image processing device may be a decoder.

[0068] An image processing device receives a bitstream containing a specific image (310). The image may be an image for preventing myopia.

[0069] The image processing device can decode the image from the received bitstream (320). Decoding can also utilize various techniques depending on the image codec.

[0070] If the bitstream received by the image processing device is an image encoded by the process of FIG. 4, the process of determining the focus area and adjusting the focus for the non-focus area may not be performed.

[0071] If the image received by the image processing device is a source image, the image processing device can perform a process of determining a focus area and adjusting focus for a non-focus area. The image processing device can determine a focus area from a decoded image (330). Determining the focus area can be performed using various criteria as described above. The image processing device can perform a process of providing myopic defocusing for a non-focus area (340). The image processing device can provide myopic defocusing for a non-focus area by adjusting the angle of a periodic function while performing a Fourier transform. In this case, the image processing device must convert the signal in the frequency domain back into an image signal (inverse Fourier transform). Furthermore, the image processing device can provide myopic defocusing for a non-focus area by using a separate image processing technique or a deep learning model.

[0072] The image processing device can play an image for preventing myopia (350).

[0073] Fig. 7 is another example of a system (400) that provides images for myopia prevention. In Fig. 5, the image processing device corresponds to a server (420) and a user terminal (430).

[0074] DB (410) stores the source image. The source image refers to the original image without myopic defocusing.

[0075] The server (420) receives a source image from the database (DB) (410). The server (420) can determine a focus area from the received source image. In addition, the server (420) provides myopic defocusing to a non-focus area of ​​the source image. The server (420) can provide myopic defocusing to a peripheral area by adjusting the angle of a trigonometric function of a Fourier transform for the source image. In this case, the server (420) can convert frequency domain data back into an image using an inverse Fourier transform. Alternatively, the server (420) can provide myopic defocusing to a peripheral area of ​​the image content using an image processing technique. The server (420) provides myopic image content to a user terminal (440).

[0076] The user terminal (440) can play the received image as is. Alternatively, the user terminal (440) can play the image after performing an inverse Fourier transform (decoding) on ​​the received data.

[0077] The user terminal (430) receives a source image from the DB (410). The user terminal (430) can determine a focus area from the received source image. The user terminal (430) applies myopic defocus to the non-focus area of ​​the source image.

[0078] The user terminal (430) can adjust the angle of the trigonometric function of the Fourier transform for the source image to provide myopic defocusing to the surrounding area. In this case, the server (420) can convert the frequency domain data back into an image using the inverse Fourier transform.

[0079] Alternatively, in some cases, the user terminal (430) may adjust the angle of the periodic function during the inverse Fourier transform during the decoding process of the source image to provide myopic defocusing to the non-focus area.

[0080] The user terminal (230) can apply myopic defocus to the non-focus area of ​​the image using image processing technology or a deep learning model.

[0081] The user terminal (230) can play an image for preventing myopia.

[0082] Figure 8 illustrates an example of an image processing device (500) that provides images for myopia prevention. The image processing device (500) may be physically implemented in various forms. For example, the image processing device (500) may take the form of a computer device such as a PC, a network server, a data processing chipset, or the like.

[0083] The image processing device (500) can receive a source image and generate an image for preventing myopia. Alternatively, the image processing device (500) can generate an image for preventing myopia by encoding the source image. Furthermore, the image processing device (500) can receive a bitstream, decode the image, and generate an image for preventing myopia.

[0084] The image processing device (500) may include a storage device (510), a memory (520), a computing device (530), an interface device (540), a communication device (550), and an output device (560).

[0085] The storage device (510) can store source images.

[0086] The storage device (510) can store images for preventing myopia.

[0087] The storage device (510) can store a program for coding an image.

[0088] The storage device (510) can store an algorithm or model for determining a focus image from a source image.

[0089] The storage device (510) can store an algorithm or model for generating an image for preventing myopia from a source image.

[0090] The memory (520) can store data and information generated during the process of generating an image for myopia prevention or the process of applying myopic defocus to a non-focus area.

[0091] The interface device (540) is a device that receives certain commands and data from the outside.

[0092] The interface device (540) can receive a source image.

[0093] The interface device (540) can receive information about the focus area. Information about the focus area can include the type of content, the user's gaze direction, etc.

[0094] The interface device (540) can receive user commands related to video playback.

[0095] The interface device (540) can receive input of the user's gaze direction.

[0096] The interface device (540) can transmit an image for preventing myopia to an external object.

[0097] The interface device (540) may be configured to internally transmit information received through the communication device (550).

[0098] A communication device (550) refers to a configuration that receives and transmits certain information through a wired or wireless network.

[0099] The communication device (550) can receive a source image.

[0100] The communication device (550) can receive information about the focus area.

[0101] The communication device (550) can also transmit an image for preventing myopia to an external device.

[0102] The operating device (530) can adjust the focus for a non-focus area for a plurality of frames constituting the source image.

[0103] The computational device (530) can determine a focus area from a frame of a source image. Basically, the out-of-focus area may be an area excluding the focus area from the frame of the source image. Therefore, the computational device (530) can simultaneously determine the focus area and the out-of-focus area.

[0104] The computational device (530) can determine a central area of ​​a certain size in a frame of a source image as a focus area.

[0105] The computational device (530) can determine a focus area in a source image based on information related to the focus area.

[0106] The computing device (530) may determine a specific area as a focus area depending on the type of content. For example, the computing device (530) may determine an area where a speaker or content is located in a video lecture as a focus area.

[0107] The computational device (530) can determine the area where the region of interest is located as the focus area. The computational device (530) can extract the region of interest using a pre-learned segmentation model (such as a deep learning model).

[0108] The computing device (530) can perform myopic defocus processing for non-focus areas other than the focus area. The computing device (530) can perform myopic defocus processing by adjusting the angle of the trigonometric function of the Fourier transform during the encoding process for the non-focus area. This process is the process of generating an image for preventing myopia. The computing device (530) can encode the generated myopia prevention image according to an image codec.

[0109] The computing device (530) can decode the received bitstream according to the video codec. In this process, the computing device (530) can perform myopic defocus processing by adjusting the angle of the trigonometric function while performing an inverse Fourier transform for the non-focus area.

[0110] Alternatively, the processing unit (530) may use a separate image processing technique to adjust the focus on the out-of-focus area of ​​the source image or the decoded image.

[0111] Furthermore, the computing device (530) may adjust focus on a non-focus area using a pre-trained deep learning model to generate a focused image.

[0112] The computing device (530) may be a device such as a processor, AP, or chip embedded with a program that processes data and performs certain operations.

[0113] The output device (560) is a device that outputs certain information.

[0114] The output device (560) can output interfaces, source images, and images for preventing myopia required for the myopic defocusing process.

[0115] Additionally, the image generation method or image provision method for preventing myopia as described above may be implemented as a program (or application) including an executable algorithm that can be executed on a computer. The program may be stored and provided on a temporary or non-transitory computer-readable medium.

[0116] A non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specifically, the various applications or programs described above may be stored and provided on a non-transitory readable medium, such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM (read-only memory), PROM (programmable read only memory), EPROM (Erasable PROM, EPROM), EEPROM (Electrically EPROM), or flash memory.

[0117] Temporarily readable media refers to various types of RAM, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous DRAM (Synclink DRAM, SLDRAM), and Direct Rambus RAM (DRRAM).

[0118] The present embodiment and the drawings attached to the present specification only clearly illustrate a part of the technical idea included in the above-described technology, and it is obvious that all modified examples and specific embodiments that can be easily inferred by a person skilled in the art within the scope of the technical idea included in the specification and drawings of the above-described technology are included in the scope of the rights of the above-described technology.

Claims

1. A step in which an image processing device receives a source image; A step in which the image processing device determines a non-focus area excluding a focus area in a specific frame of the source image; and The above image processing device includes a step of adjusting focus for the non-focus area, A method for providing an image for preventing myopia, wherein the image processing device adjusts the focus so that the focus area is emmetropia and the non-focus area is a certain level of myopic defocus.

2. In paragraph 1, A method for providing an image for preventing myopia by adjusting the angle of a trigonometric function of a Fourier transform for the non-focus area during the encoding process of the source image.

3. In paragraph 2, The above image processing device is a method for providing an image for preventing myopia by controlling the degree of myopic defocusing based on the angle value of the trigonometric function.

4. In paragraph 1, A method for providing an image for preventing myopia, wherein the image processing device further comprises a step of encoding the specific frame including the focus area and the focus-adjusted non-focus area.

5. In paragraph 1, A method for providing an image for preventing myopia by adjusting the angle of a trigonometric function in an inverse Fourier transform for the non-focus area during decoding of the source image, wherein the image processing device adjusts the focus.

6. Interface device for receiving source video; and An image processing device for generating an image for preventing myopia, comprising a calculation device for determining a non-focus area excluding a focus area in a specific frame of the source image, and adjusting the focus of the non-focus area so that the focus area is emmetropia and the non-focus area has a certain level of myopic defocus.

7. In paragraph 6, The above-mentioned operation device is an image processing device that generates an image for preventing myopia by adjusting the angle of a trigonometric function of a Fourier transform for the non-focus area during the encoding process of the source image.

8. In paragraph 7, The above-mentioned calculation device is an image processing device that generates an image for preventing myopia by adjusting the degree of myopic defocusing based on the angle value of the above-mentioned trigonometric function.

9. In paragraph 6, The above-mentioned operating device is an image processing device that generates an image for preventing myopia by encoding the specific frame including the focus area and the focus-adjusted non-focus area.

10. In paragraph 6, The above-mentioned calculation device is an image processing device that generates an image for preventing myopia by adjusting the angle of a trigonometric function in the inverse Fourier transform for the non-focus area during decoding of the source image.

Images